Let's try to familiarize ourselves with some of the basic concepts behind neural networks that make all deep learning models tick!
Neural network basics
A simple linear neuron
A linear neuron is the most basic building block of a deep neural network. It can be schematically represented as shown in the following figure. Here, represents the input vector and wis are the weights of the neuron. Given a training set consisting a of set of input, target value pairs, a linear neuron tries to learn a linear transformation that can map the input vectors to the corresponding target value. Basically, a linear neuron approximates the input output relationship by a linear function :
Schematic representation of a simple linear neuron...