Deep learning started to gain popularity a couple of years ago when AlexNet, a convolutional neural network (CNN) designed by Alex Krizhevsky and published with Ilya Sutskever and doctoral adviser Geoffrey Hinton, also referred to as the godfather of deep learning, was created. AlexNet blew away the ImageNet Large Scale Visual Recognition Challenge on 30 September 2012. Their deep neural network was significantly better than all the other submissions. Architectures such as AlexNet have revolutionized the field of computer vision. In the following diagram, you can see the top five predictions for the visual challenge where AlexNet emerged victorious:
Because deep learning requires lots of GPU computation and data, people began to take notice and implemented their own deep neural networks for different tasks, resulting in a deep learning library.
Theano was one of the first widely adopted deep learning...