Technical requirements
In this chapter's exercises, we will use the following GCP services:
- IAM
- BigQuery
- Google Cloud Storage (GCS)
- Data Catalog
If you've never opened any of these services in your GCP console before, open them and enable the Application Programming Interface (API). We will also use an open source software called Terraform. It's downloadable from their public website at https://www.terraform.io/downloads.html. The step-by-step installation will be discussed in the Exercise – creating and running basic Terraform scripts section.
Make sure you have your GCP console, Cloud Shell, and Cloud Shell Editor ready.
Download the example code and the dataset here: https://github.com/PacktPublishing/Data-Engineering-with-Google-Cloud-Platform/tree/main/chapter-9/code.