CeWL

CeWL is a custom wordlist generator made by Robin Hood. It basically spiders the target site to a certain depth and then returns a list of words. This wordlist can later be used as a dictionary to bruteforce web application logins, for example an administrative portal.

CeWL is present in Kali Linux but can be downloaded from https://digi.ninja/projects/cewl.php#download.

./cewl target.com

Let me run this tool on my homepage with a link depth count of 1.

Look at that! It returned us a nice looking wordlist based on the scraped data from my website. CeWL also supports HTTP Basic Authentication and provide options to proxy the traffic. More options can be fiddled with by viewing its help switch --help. Instead of displaying the wordlist output on the console, we can save it to a file by using the -w switch.

You can clearly see the generated wordlist was written to the cewl.txt file. There's also the -v switch to increase the verbosity of the CeWL output, it comes in very handy when the site...