GCP BQ
As we mentioned in the Google Cloud BigQuery section in Chapter 1, Comprehending Google Cloud Services, BigQuery is a petabyte cloud enterprise data warehouse. BigQuery has the following features:
- Fully managed GCP service – you do not concern yourself with the underlying backend data processing infrastructure, including compute, network storage, and other resources.
- Serverless – you do not manage any servers in BigQuery. All of the data processing engines are taken care of by Google, including the invisible BigQuery BI Engine and ML Engine.
- Highly scalable – it is incredibly elastic and can scale to any size, quickly and seamlessly.
- Cost-effective – you are only charged for the BigQuery resources you consume.
In the Google Cloud big data processing pipeline, BigQuery is a key service for data ingestion, storing, analyzing, and visualization, as follows:
- BigQuery ingests data from data sources in three ways: archive...