Throughout the next chapters, we will be assembling, piece by piece, our very own search-engine. As with all projects, we need to come up with a cool-sounding name for it. Let me introduce you to Links 'R' Us!
So, what are the core functionalities of the Links 'R' Us project? The primary, and kind of obvious, functionality is being able to search for content. However, before we can make our search engine available to the public, we first need to seed it with content. To this end, we need to provide the means for users to submit URLs to our search engine. The search engine would then crawl those links, index their content, and add any newly encountered links to its database for further crawling.
Is this all we need for launching Links 'R' Us? The short answer is no! While user searches would...
