Learning to tune PPO

In this section, we are going to learn to tune a modified/new control learning environment. This will allow us to learn more about some inner workings of the Unity example, but will also show you how to modify a new or modified sample on your own later. Let's begin by opening up the Unity editor so we can complete the following exercise:

1. Open the Reacher scene, set it for learning, and run it in training. You should be able to do this part in your sleep now. Let the agent train for a substantial amount of time so you can establish a baseline, as always.
2. From the menu, select Assets/Import Package/Custom Package. Locate Chapter_8_Assets.unitypackage from the Chapter08 folder of the books downloaded to the source code.
3. Open up the Reacher_3_joint scene from the Assets/HoDLG/Scenes folder. This is the modified scene, but we will go through its construction...