In late 2018, Unity, with the help of DeepMind, began development of a challenge designed to task researchers in the most challenging areas of DRL. The challenge was developed with Unity as a Gym interface environment and featured a game using a 3D first-person perspective. The 3D perspective is a type of game interface made famous with the likes of games such as Tomb Raider and Resident Evil, to name just a couple of examples. An example of the game interface is shown in the following screenshot:
The Obstacle Tower Challenge is not only in 3D, but the patterns and materials in the rooms and on the walls change over the levels. This makes vision generalization even more difficult. Furthermore, the challenge poses multiple concurrent steps to complete tasks. That is, each level requires the character...
