Chapter 3: Building a Data Warehouse in BigQuery
The power of a data warehouse is delivered when organizations combine multiple sources of information into a single place that becomes the single source of truth. The utopia of data analytics will be when every single business aspect in an organization relies on data. That condition will be met when all business decision makers know how to access data, trust the data, and can make decisions based on it.
Unfortunately, most of the time, utopia is far removed from reality. There are many challenges along the way. Based on my experience, there are three main challenges – technology bottlenecks, data consistency, and the ability to serve multiple business purposes.
The preceding challenges are natural when we build a data warehouse. It's not limited to certain technologies and organizations. In this chapter, we will learn those challenges through two hands-on scenarios. We will mainly use BigQuery as the Google...