In this section, we will cover two mathematical models of biological neurons—the McCulloch-Pitts (MP) neuron and Rosenblatt's perceptron—which create the foundation for neural networks.
Comparing the perceptron and the McCulloch-Pitts neuron
The MP neuron
The MP neuron was created in 1943 by Warren McCulloch and Walter Pitts. It was modeled after the biological neuron and is the first mathematical model of a biological neuron. It was created primarily for classification tasks. The MP neuron takes as input binary values and outputs a binary value based on a threshold value. If the sum of the inputs is greater than the threshold, then the neuron outputs 1 (if it is under the threshold, it outputs 0). In the...
