Summary

We have reached the end of the first step of our training acceleration journey. You started this chapter by remembering how the training process works. In addition to refreshing concepts such as datasets and samples, you remembered the four phases of the training algorithm.

Next, you learned that hyperparameters, operations, and parameters are the three-fold factors influencing the training process’s computational burden.

Now that you have remembered the training process and understood what contributes to its computational complexity, it’s time to move on to the next topic.

Let’s take our first steps to learn how to accelerate this heavy computational process!