Hand Tracking

Hand Tracking refers to the capability of detecting and tracking a user’s hand movements in a 3D space within an augmented/mixed reality or virtual reality environment. This feature allows to create more immersive and interactive experiences by enabling users to control or interact with virtual objects using their hands. Hand tracking can be implemented using different sensors and hardware, such as cameras, depth sensors, and specialized devices like Leap Motion or other hand-tracking hardware.

In Babylon.js, hand support is enabled per default, if supported, when using the default experience helper. This will enable basic hand support - 25 hidden spheres will be created for each hand, and each hand will have the default hand mesh loaded and enabled.

Learn More

For advanced hand tracking features, please refer to Babylon.js documentation: https://doc.babylonjs.com/features/featuresDeepDive/webXR/WebXRSelectedFeatures/WebXRHandTracking/.