Hand tracking enables users to intuitively interact with digital content by using natural hand gestures, and automatically detecting the movements of a user’s hands in real-time.
In addition to gestures, Magic Leap 2 supports other input methods, including:
- Controller (6DoF included)
- Eye Tracking
- Headpose
- Voice Commands
- Bluetooth devices such as wireless keyboards, game pads and mice. This input flexibility allows developers and users to customize their experience.
How to Enable Hand Navigation in the OS
The OS has two options for content/user interface (UI) location, and corresponding interaction modes:
- Far field interaction: Interaction with screens at a relatively “far” field, when the Operating system User Interface is at approximately 1 m distance.
- Near field interaction: Interaction with screens at a relatively “near” field, when the Operating system is at approximately 50 cm distance.
To enable (or disable) hand navigation on the OS go to: "Settings > Magic Leap Inputs > Gestures".
Note: Starting with Magic Leap OS 1.8.0, near field interactions are enabled by default.
Two options will appear, with the first, "Near Field Interaction as Primary", on as the default option. When set to "Far Field Interaction Only", only far field gestures are supported.
Note: After turning on Hand Navigation from Settings, the Controller must be placed idle (i.e. on a table) or can be turned off for 3 seconds, this will then enable Hand Navigation.
Navigate with Near Field Interaction in the OS
Gestures | Description |
|
The main gesture for Near Field interaction is the poking gesture. Make sure your entire index finger is visible to the camera. |
|
Select UI buttons by pointing at the content and poking to select. |
|
Scroll by first pointing, poking and holding, then dragging your hand in the desired direction. Release when complete. |
|
Grab content by approaching, pinching, and holding, then move your hand in the desired direction. Release when complete. |
How to Enable Home Gesture in the OS
Home gestures can be turned on by going to: "Settings > Magic Leap Inputs > Gestures"
This provides two gesture options:
- Hand Close (enabled by default).
- Wrist Tap (Beta).
Gesture | Name |
Hand Close Hold up one hand with an open palm facing you, and create a tight fist. Hold until Home launches. |
|
Wrist Tap (Preview) Hold up one hand. With an open palm facing you, tap your wrist with your other hand. |
Navigate with Far Field interaction in the OS
To interact with objects in the far field, make sure the ray intersects with the chosen object.
Gestures that can be used within the OS
Gesture | Description |
|
Target UI buttons by aiming, and then select by pinching and releasing. Make sure your index and thumb are visible to the camera. |
|
Scroll by first aiming, pinching and holding, then dragging your hand in the desired direction. Release when complete. |
|
Grab content by aiming, pinching and holding, then move your hand in the desired direction. Release when complete. |
Using a Controller and Hand Tracking Interchangeably
You can still switch to the controller at any point, the same way you have in the past. We’ve added in the ability to switch between the two input methods, so you can use hand tracking and controller interchangeably.
When you use the controller, the interface will push into "Far" mode for more comfortable controller use. To go back to using hand tracking, the controller must be idle (for example, you must set it aside on a table, leaving it completely still) or turned off and you need to bring your hands back into the device's field of view.