Writing a basic web crawler – take one

We're now ready to write our first fully-fledged Julia program—a simple web crawler. This first iteration will make a request for Julia's Wikipedia page, will parse it and extract all the internal URLs, storing them in an Array.

Setting up our project

The first thing we need to do is to set up a dedicated project. This is done by using Pkg. It is a very important step as it allows us to efficiently manage and version the packages on which our program depends.

For starters, we need a folder for our software. Create one—let's call it WebCrawler. I'll use Julia to make it, but you do it however you like:

julia> mkdir("WebCrawler&quot...