As we progressed through this book, the exercises have morphed from learning exercises to almost research efforts, and that is the case in this chapter. Therefore, the exercises in this chapter are meant for the hardcore RL enthusiast and may not be for everyone:
- Tune the hyperparameters for one of the sample visual environments in the ML-Agents toolkit.
- Modify the visual observation standard encoder found in the ML-Agents toolkit to include additional layers or different kernel filter settings.
- Train an agent with nature_cnn or resnet visual encoder networks and compare their performance with earlier examples using the base visual encoder.
- Modify the resnet visual encoder to accommodate many more layers or other variations of filter/kernel size.
- Download, install, and play the Unity Obstacle Tower Challenge and see how far you can get in the game. As you play, think...
