Deep model layers

In this section, we're going to briefly discuss the most important layer types employed in deep learning architectures. Clearly, as this is an introductory book, we are not presenting all the mathematical details, but we are focusing the attention on the specific applications. Further details and theoretical foundations can be found in Mastering Machine Learning Algorithms, Bonaccorso G, Packt Publishing, 2018.

Fully connected layers

A fully connected layer (sometimes called a dense layer) is made up of n neurons, and each of them receives all the output values coming from the previous layer (such as the hidden layer in a Multi-layer Perceptron (MLP)). It can be characterized by a weight matrix, a bias...