Launching model training on Vertex AI
In this section, we will launch our training experiment as a Vertex AI training job. There are multiple advantages of launching training jobs on Vertex AI instead of doing it in a Juypter Notebook:
- The flexibility to launch any number of parallel experiments
- We can choose the best hardware for model training, which is very important when accelerators are needed to train deep learning models.
- We don’t need active monitoring regarding training progress
- There’s no fear of the Jupyter Notebook crashing
- Vertex AI training jobs can be configured to log metadata and experiments in the Google Cloud Console UI
- In this section, we will create and launch a Vertex AI training job for our experiment. There are two main things we need to do to launch a Vertex AI training job. First, we need to put the dataset in a location that will be accessible to the Vertex AI job (such as GCS or BigQuery). Second, we need to put...
