Moving data to Google Cloud
When we start a machine learning project on Google Cloud Platform (GCP), the very first step is to move all our project-related data to the Google Cloud environment. While transferring data to the cloud, the key things to focus on are reliability, security, scalability, and the ease of managing the transfer process. With these points in mind, Google Cloud provides four major data transfer utilities to meet customer requirements across a variety of use cases. In general, these utilities are useful for any kind of data transfer purposes, including data center migration, data backup, content storage, and machine learning. As our current focus is on making data available for machine learning use cases, we can utilize any of the following transfer solutions:
- Google Cloud Storage Transfer tools
- BigQuery Data Transfer Service
- Storage Transfer Service
- Transfer Appliance
Let’s understand each of these transfer solutions.