There are a huge variety of neural network flavors, and each of these flavors has its own set of jargon. However, there is some common jargon that we should know regardless of the type of neural network that we are utilizing. This jargon is presented in the following points:
- Nodes, perceptrons, or neurons: These interchangeable terms refer to the basic building blocks of a neural network. Each node or neuron takes in input data and performs an operation on this data. After performing the operation, the node/neuron may or may not pass the results of the operation on to other nodes/neurons.
- Activation: The output or values associated with the operation of a node.
- Activation function: The definition of the function that transforms the inputs to a node into the output, or activation.
- Weights or biases: These values define the relationships between...
