Google – the gold standard
When working with clients during a data lake engagement, a common request from them is, "Just make it work like Google." It's not an unreasonable request. Google is one of the most successful, pervasive, and intuitive projects in the history of computing. Additionally, the Google index doesn't contain only one company's data. It contains most of the data on the internet. Properly indexing a small fraction of that data for one client should be a walk in the park, right?
According to Live Internet Stats (see the following link), on average, Google undertakes more than 40,000 search queries every second. This equates to over 3.5 billion daily searches and 1.2 trillion searches annually. The word google has now become a verb. As a scientist, I am not a big believer in the paranormal, but even I get scared sometimes when I type a few letters in the Google search bar, and it seems to read my mind regarding what I want to search.
If...