XR Hand

With the metaverse coming at us, I wanted to play around with how to do hand interactions in VR. Using WebXR API and Oculus Quest 2 for its hand tracking capibility, this gives me the opertunity to give it a go using web technologies while rendering the results with THREE.js.

As an added bonus, I wrote most of the XR funtionality from scratch with only the actual VR rendering being done by 3js. This means getting and setting up the xr session, plus polling the api for controller and hand data to be stored in an easy to get data structures.

Source Code : https://github.com/sketchpunklabs/xrhand


Prototypes
  1. XR Data Debugging : Joints rendered with a THREE.AxesHelper
  2. Oculus's First Hand Model
  3. Rachet & Clank : Rivot's Hand
Resources
  1. Oculus unity sample : FirstHand