The installers are available for Windows, Linux, and macOS. Since Linux has various distributions, some manual command execution is needed for installing and configuring the Google Cloud SDK on Linux.

Google Cloud SDK for Windows comes with a friendly installer and it also comes with an option to install Python which is a prerequisite to run the commands in Google Cloud SDK:

1. Download the installer from the link provided: https://cloud.google.com/sdk/docs/quickstart-windows. The installer is a GUI-based utility which will install the requisites for the SDK, and the SDK with default configuration.

2. In the installation wizard, choose the Bundled Python...

gsutil provides options to manage files, folders, and buckets in Google Cloud Storage. The first step in moving your data to Google Cloud and Google BigQuery is to export the data and upload to Google Cloud Storage:

• Manually via the browser if it is small
• Automate it for basic scenarios using gsutil, which comes with Google Cloud SDK
• The third option will be to use the Google Cloud Storage API to perform advanced automation

Before using the gsutil command, make sure that the project and credentials configured in the Google Cloud SDK are pointing to the project and account which you intend to use by typing the following command:

gcloud info

We will now look at the features available with gsutil:

• To see the list of options provided by gsutil, type the following command:

gsutil help

• The available commands section shows the command...

The bq command-line utility is used to interact with the Google BigQuery service on Google Cloud Platform:

• Use the following command to check the version of the bq utility once the SDK is installed:

bq version

• Type the following command to confirm which project the bq utility will use. The bq utility shares settings with the gcloud utility. If you wish to change the project, then run the command in the second line and choose the project you want to work on:

gcloud info
gcloud init

• The first step in using BigQuery is to create a dataset in a project and then create tables...

The gcloud utility is used to interact with the rest of the services on the Google Cloud Platform, other than BigQuery and Google Cloud Storage. The commands in the gcloud utility are grouped for each service. The following are the service groups for some of the services on the Google Cloud Platform:

There is more than one way to connect to a Cloud SQL instance from your machine, but the two most frequently used options are in the following list. The listed prerequisites for both the options require the MySQL client libraries to be installed on the local machine:

• Adding the client machine IP address to authorized networks in Google Cloud Console
• Installing a proxy script on the client machine and using that to connect to Google Cloud SQL

Get the IP address of the client machine by opening the browser and navigating to this URL: http://ipv4.whatismyv6.com/. Note down the IP address shown on this page for your machine. Open Google...

To deploy to Google App Engine, use the app command group. The App Engine allows us to host websites developed in PHP, Java, Go, or Python in the standard environment. To deploy a sample app to the App Engine instance that was created in Chapter 1, Google Cloud and Google BigQuery, follow the steps listed here:

1. Download the sample PHP file and app.yaml file from the GitHub URL (https://github.com/hthirukkumaran/Learning-Google-BigQuery/tree/master/chapter2/phpapp) to a folder on the local computer. This PHP code connects to the Cloud SQL instance of the same project, executes a sample query, and displays the result.
2. Open the index.php file and modify the $dsn variable value to point to your Cloud SQL instance. To get the full qualified Cloud SQL instance name, open the Cloud SQL instance in your project. Copy the value of the instance connection...

This chapter covered the Google Cloud SDK and the utilities that come with it. The samples in this chapter provided an overview of how to interact with Google Cloud Services and how to manage your resources on Google Cloud Platform using the Google Cloud SDK. Use the utilities to write your batch programs that you run from your on-premises infrastructure.

The next chapter covers data types in Google BigQuery, how to use them when creating custom tables, and how to import and export the data using the bq utility that was covered in this chapter.