At the time of writing, a new AI called AlphaStar, a deep reinforcement learning (DRL) agent, used imitation learning (IL) to beat a human opponent five-nil playing the real-time strategy game StarCraft II. AlphaStar was the continuation of David Silver and Google DeepMind's work to build a smarter and more intelligent AI. The specific techniques AlphaStar used to win could fill a book, and IL and the use of learning to copy human play is now of keen interest. Fortunately, Unity has already implemented IL in the form of offline and online training scenarios. While we won't make it to the level of AlphaStar in this chapter, we still will learn about the underlying technologies of IL and other forms of transfer learning.
In this chapter, we will look at the implementation of IL in ML-Agents and then look to other applications of transfer...
