Google – the gold standard

When working with clients during a data lake engagement, a common request from them is, "Just make it work like Google." It's not an unreasonable request. Google is one of the most successful, most pervasive, and most intuitive projects in the history of computing. Additionally, the Google index doesn't contain only one company's data. It contains most of the data on the internet. Being able to properly index a small fraction of that data for one client should be a walk in the park, right?

According to Internet Live Stats (see the following link), on average, every second, Google undertakes more than 40,000 search queries. This equates to over 3.5 billion searches per day and 1.2 trillion searches per year. The word google has now become a verb. As a scientist, I am not a big believer in the paranormal, but even I get scared sometimes when I type a few letters in the Google search bar and it seems to read my mind regarding...