Algorithms used by neural networks

Here, we will look at the structure of individual neurons. We will also look into the details about the two algorithms, thus, we will understand how word2vec generates vectors from words.

Structure of the neurons

We have seen the overall neural network structure, but we haven't yet seen what each neuron is made of and what the structure of the neurons is. So, in this section, we will look at the structure of each single input neuron.

We will look at the following structures:

• Basic neuron structure
• Training a single neuron
• Single neuron application
• Multi-layer neural network
• Backpropagation
• Mathematics behind the word2vec model

In this, we will heavily include the mathematical formulas...