Chapter 12: Distributed Machine Learning on Azure
In the previous chapter, we learned about hyperparameter tuning through search and optimization, using HyperDrive as well as Automated Machine Learning as a special case of hyperparameter optimization, involving feature engineering, model selection, and model stacking. Automated Machine Learning is machine learning as a service (MLaaS), whereby the only input is your data, an ML task, and an error metric. It's hard to imagine running all experiments and parameter combinations for Automated Machine Learning on a single machine or a single CPU/GPUwe are looking into ways to speed up the training process through parallelization and distributed computing.
In this chapter, we will look into distributed and parallel computing algorithms and frameworks for efficiently training ML models in parallel. The goal of this chapter is to build an environment in Azure where you can speed up the training process of classical ML and deep learning...