Exercises

1. Why is it possible to assess that the model suffers from overfitting only by looking at the graph?
2. Extend the baseline example to place the matrix multiplication operation on a remote device at IP 192.168.1.12; visualize the result on TensorBoard.
3. Is it necessary to have a remote device to place an operation on?
4. Extend the CNN architecture defined in the define_cnn method: add a batch normalization layer (from tf.layers) between the output of the convolutional layer and its activation function.
5. Try to train the model with the extended CNN architecture: the batch normalization layer adds two update operations that must be executed before running the training operation. Become familiar with the tf.control_dependencies method to force the execution of the operations contained inside the collection tf.GraphKeys.UPDATE_OPS, to be executed before the train operation (look...