Chapter 4

1. We went through a lot in this chapter. You can use the framework provided to investigate the properties of neural networks. Make adjustments to the learning rate, batch size, number of epochs, and loss functions.

   This is an exercise for the student. You should see different curves develop as these parameters are changed. Some will not produce an answer at all (which looks like random results – the curve stays at the same level as no learning is taking place). Some will learn faster or slower.

2. Draw a diagram of an artificial neuron and label the parts. Look up a natural, human biological neuron and compare.

   See Figure 4.3 in the chapter. The artificial neuron has a number of inputs, a set of weights, one for each input, a bias, an activation, and a set of outputs.

3. Which features are the same in a real neuron and an artificial neuron?

   Both have multiple inputs and multiple outputs and accept inputs, perform some processing, and then make an output. Both use...