Placing interactable objects in the world

In MR game design, interactive objects are essential to bridging the virtual and real worlds. Interactable objects are designed to respond to user input, even as basic as hand (or controller) movements that allow natural and intuitive interactions like pushing, grabbing, throwing, or even complex multi-hand manipulation (for example, rotating and scaling the object). They really help to sell the reality of the environment, and as a result, they significantly enhance the player’s engagement and overall gameplay experience.

For our game’s purposes, we’ll have examples of a simple grab and placement interaction and, with the gun, a secondary interactable event action for shooting. Note that while many MR games and experiences are built for use with hands (hand tracking), our boss room example game will use controllers.

Let’s start by configuring the modules for grabbing – these will then be configured to...