Developing a Powerful Deep Learning Model
In this chapter, we will describe how to design and train a deep learning (DL) model. Within the notebook context described in the previous chapter, data scientists investigate various network designs and model training settings to generate a working model for the given task. The main topics of this chapter include the theory behind DL and how to train a model using the most popular DL frameworks: PyTorch and TensorFlow (TF). At the end of the chapter, we will decompose the StyleGAN implementation, a popular DL model for image generation, to explain how to construct a complex model using the components that we have introduced in this chapter.
In this chapter, we’re going to cover the following main topics:
- Going through the basic theory of DL
- Understanding the components of DL frameworks
- Implementing and training a model in PyTorch
- Implementing and training a model in TF
- Decomposing a complex, state-of-the-art model implementation