Hand tracking enables users to intuitively interact with digital content by using natural hand gestures, and automatically detecting the movements of a user’s hands in real-time.
In addition to gestures, Magic Leap 2 supports other input methods, including:
- Controller (6DoF included)
- Eye Tracking
- Voice Commands
- Bluetooth devices such as wireless keyboards, game pads and mice. This input flexibility allows developers and users to customize their experience.
How to Enable Hand Navigation in the OS
The OS has two options for content/user interface (UI) location, and corresponding interaction modes:
- Far field interaction: Interaction with screens at a relatively “far” field, when the Operating system User Interface is at approximately 1 m distance.
- Near field interaction: Interaction with screens at a relatively “near” field, when the Operating system is at approximately 50 cm distance.
To enable hand navigation on the OS go to: "Settings > Magic Leap Inputs > Gestures".
Toggle "Hand Navigation (Beta)" on (this setting is off by default). Two options will appear, with the second, Far Field Interaction Only, on as the default option. When set to "Near & Far Field Interaction", only Home and Settings are located in the Near Field. Everything else in the system is located in the Far Field.
Note: After turning on Hand Navigation from Settings, the Controller must be placed idle (i.e. on a table) or can be turned off for 3 seconds, this will then enable Hand Navigation.
Navigate with Far Field interaction in the OS
To interact with objects in the far field, make sure the ray intersects with the chosen object.
Gestures that can be used within the OS
|Target UI buttons by aiming, and then select by pinching and releasing. Make sure your index and thumb are visible to the camera.
|Scroll by first aiming, pinching and holding, then dragging your hand in the desired direction. Release when complete.
|Grab content by aiming, pinching and holding, then move your hand in the desired direction. Release when complete.
Navigate with Near Field Interaction in the OS
|The main gesture for Near Field interaction is the poking gesture. Make sure your entire index finger is visible to the camera.
|Select UI buttons by pointing at the content and poking to select.
|Scroll by first pointing, poking and holding, then dragging your hand in the desired direction. Release when complete.
|Grab content by approaching, pinching, and holding, then move your hand in the desired direction. Release when complete.
How to Enable Home Gesture in the OS
Home gestures can be turned on by going to: "Settings > Magic Leap Inputs > Gestures"
This provides two gesture options:
- Hand Close (enabled by default).
- Wrist Tap (Beta).
Hold up one hand with the palm facing you, and create a tight fist. Hold until Home launches.
Wrist Tap (Preview)
Hold up one hand with the palm facing you, then tap your wrist with your other hand.