Challenges and limitations
In this section, we explore the main challenges of this synthetic data generation approach.
Similar to other synthetic data generation approaches, utilizing video games for this purpose has some challenges. The main challenges and drawbacks can be summarized as follows.
Controllability
One of the main advantages of using synthetic data is the ability to customize and fully control each aspect of this process. However, with video games not deployed for research purposes, the 3D virtual world and the scene elements are already created, fixed, and hard to change. Thus, it is not easy to add or remove certain objects and actions.
Game genres and limitations on synthetic data generation
Depending on the game market, some game genres are more popular than others. For example, action, sports, role-playing, and first-person shooter games are more popular compared to text-based adventure and music and rhythm. Thus, generating synthetic data for certain...
