Using distributed ML in Azure
The Exploring methods for distributed ML section contained an overwhelming amount of different parallelization scenarios, various communication backends for collective algorithms, and code examples using different ML frameworks and even execution engines. The amount of choice when it comes to ML frameworks is quite large and making an educated decision is not easy. This choice gets even more complicated when some frameworks are supported out of the box in Azure Machine Learning while others have to be installed, configured, and managed by the user.
In this section, we will go through the most common scenarios, learn how to choose the correct combination of frameworks, and implement a distributed ML pipeline in Azure.
In general, you have three choices for running distributed ML in Azure:
- The first obvious choice is using Azure Machine Learning, the Notebook environment, the Azure Machine Learning SDK, and Azure Machine Learning compute clusters...