Until now, we have been studying feed-forward networks, where the data moves in one direction and there is no interconnection of nodes in each layer. In the presence of basic hypotheses that interact with some problems, the intrinsic unidirectional structure of feed-forward networks is strongly limiting. However, it is possible to start from it and create networks in which the results of computing one unit affect the computational process of the other. It is evident that algorithms that manage the dynamics of these networks must meet new convergence criteria.
In this chapter, we will introduce Recurrent Neural Networks (RNN), which are networks with cyclic data flows. We will also see Convolutional Neural Networks (CNN), which are standardized neural networks mainly used for image recognition. For both of these types of networks, we...
