We can describe a neural network as a mathematical model for information processing. As discussed in Chapter 1, Machine Learning – an Introduction, this is a good way to describe any ML algorithm, but, in this chapter, well give it a specific meaning in the context of neural networks. A neural net is not a fixed program, but rather a model, a system that processes information, or inputs. The characteristics of a neural network are as follows:
- Information processing occurs in its simplest form, over simple elements called neurons.
- Neurons are connected and they exchange signals between them through connection links.
- Connection links between neurons can be stronger or weaker, and this determines how information is processed.
- Each neuron has an internal state that is determined by all the incoming connections from other neurons.
- Each neuron...
