In this section, we'll take a look at how to extract other interesting information such as emails, forms, and comments that will be useful for our security analysis.
We've added recursive capabilities to our crawler, so now we are ready to add more features. In this case, we'll be adding some extraction capabilities for emails because it is always useful to have a valid account, which could be handy during our tests. Forms will be useful where there's information being submitted from the browser to the application. Comments could provide interesting information, which developers may have left in production without realizing.
There is more stuff that you can obtain from web applications but these are usually the most useful:
- First, let's add these fields into our item. Open the items.py file in Atom and add the following code...
