Elaborating on Google Cloud solutions for data management
In this section of the chapter, we will review each of the first-party and Google-managed open source offerings available on Google Cloud. We will provide a brief description of each service while highlighting the use case and comparative solutions or potential competitors. We’ll start with the data pipeline services, covering ingestion and transformation, before covering data lakes, datastores, and beyond.
The following diagram highlights a high-level overview of Google Cloud-native data analytics pipeline leveraging exclusively first-party or Google-managed open source technologies:
Figure 5.1 – Mature data pipeline in Google Cloud (source: https://storage.googleapis.com/gweb-cloudblog-publish/images/Data_Analytics_Pipeline_on_Google_CLoud.max-1500x1500.png)
We’ll start on the left side, covering ingestion through to transformation, before finishing with data warehousing...
