Convolution networks
Convolution networks, also called convolutional neural networks (CNNs), are like neural networks for processing data in the form of a grid. This grid can be 2D (such as an image), 1D (such as a time series), 3D (such as data from LIDAR sensors), and so on. Although this book is about time series and, typically, 1D convolutions are used in time series forecasting, it’s easier to understand convolutions in the 2D context (an image and so on) and then move back to a single-dimensional grid for time series.
The basic idea behind CNNs is inspired by how human vision works. In 1979, Fukushima proposed Neocognitron (Reference 12). It was a one-of-a-kind architecture that was directly inspired by how human vision works. But CNNs came into existence as we know them today in 1989 when Yann Le Cun used backpropagation to learn such a network, proving it by getting state-of-the-art results in handwritten digit recognition (Reference 13). In 2012, when AlexNet ...