Summary

In this chapter, we discussed how to deploy machine learning models, especially neural networks, to mobile and cloud platforms. We examined that, on these platforms, we usually need a customized build of the machine learning framework that we used in our project. Mobile platforms use different CPUs, and sometimes, they have specialized neural network accelerator devices, so you need to compile your application and machine learning framework in regards to these architectures. The architectures that are used for cloud machines differ from development environments, and you often use them for two different purposes. The first case is to use powerful machine configuration with GPUs to accelerate the machine learning training process, so you need to build your application while taking the use of one or multiple GPUs into account. The other case is using a cloud machine for inference...