Building a Perceptron-based classifier
Neurons, dendrites, and axons comprise the building blocks of the brain. Similarly, perceptrons are the most basic structure in a neural network.
The evolution of the neural networks has gone through many changes. Their development is grounded on the neurological work performed by Santiago Ramon y Cajal and Sir Charles Scott Sherrington. Ramon y Cajal was a pioneer in the exploration of the structure of nervous tissue and demonstrated that:
- Neurons can communicate with each other
- Neurons are physically separate from other neurons
Leveraging the research of Ramon y Cajal and Sherrington, Warren McCulloch and Walter Pitts in their 1943 paper, A Logical Calculus of Ideas Immanent in Nervous Activity, described an architecture borrowing from the structure of neurons having a binary threshold activation function analogous to first order logic sentences.
The following is a basic representation of McCulloch and...
