Ultraleap launches its fifth-generation hand tracking platform, Gemini
Ultraleap’s fifth-generation hand tracking platform, known as Gemini, is fully available on Windows, the bristol company has announced.
Described by Ultraleap as "the most robust, flexible hand tracking ever" the technology has been used by Finnish VR firm Varjo, been integrated into Qualcomm’s Snapdragon XR2 platform, and has been utilised for self-service solutions worldwide.
Following the Gemini Windows release, Ultraleap hope to make the technology more accessible across multiple platforms, camera systems and third-party hardware.
Ultraleap have rebuilt their tracking engine from the ground up to be able to improve hand tracking across various aspects including:
- Improved two-handed interaction
- Faster initialization and hand detection
- Improved robustness to challenging environmental conditions
- Better adaptation to hand anatomy
Ultraleap have also made significant changes to the tracking platform to able to extend hand-tracking to different platforms and hardware. Varjo’s XR-3 and VR-3 headsets and Qualcomm’s XR2 chipset are two variations already announced, with more in the pipeline.
Tom Carter, CEO of Ultraleap, said: “From powering immersive XR experiences, to providing quick and easy engagement with digital screens, Gemini is making natural interaction between people and technology possible. Robust, accurate hand tracking is one of the biggest challenges in 21st century computing. With ten years of ongoing developer support, experimentation, and feedback, we’ve refined our hand tracking to deliver the best and most flexible hand tracking available. We are incredibly proud of the progress we have made, and we are looking forward to working with software and hardware partners to bring hand tracking to the masses.”
Hand tracking will be to XR what touchscreens were to mobile
The Windows release is the first time full Gemini has been made available to all and the first full hand tracking release from the company in three years. Since a preview of the release went out earlier in the year, Ultraleap have been further refining the software ahead of full launch.
The improved features are applicable to a range of use cases where Ultraleap hand tracking is already making an impact:
- Using hand tracking instead of VR controllers is making a big difference to Pre-Flight Cabin Check training for Lufthansa
- Being able to interact naturally with two hands matters for ergonomic and design reviews in Autodesk’s VRED
- Accommodating different sizes and shapes of hands matters for VR arcade experiences like Raw Thrills
- Fast, reliable initialization matters for projects such as Embodied Labs’ VR empathy training
- Social collaboration is being taken to the next level as users can freely motion and accentuate their language with their hands, as they do in real life
As part of the release, Ultraleap are also showcasing a new XR Launcher experience which will show how VR can be made accessible to more people by enabling and empowering them to use their hands naturally, with no controllers needed.
Accurate and robust hand tracking for touchless kiosk and OOH use cases
In Out of Home (OOH), Ultraleap’s hand tracking alongside the TouchFree application, is fuelling the demand for touchless interaction.
Fast initialization, robustness and accuracy are all elements needed in hand tracking to make the touchless kiosk experience seamless for the user. Ultraleap’s solutions are already being used in the market with the likes of PepsiCo, LEGO and Image Holders.
With this latest hand tracking update, Ultraleap’s recommended camera position is enabled – Above Facing User. This camera position will support more aesthetically pleasing set ups, easier integration and a longer life of the installation.
To download Gemini, please visit: https://developer.leapmotion.com/tracking-software-download
To download TouchFree, please visit: https://developer.leapmotion.com/touchfree Note that Gemini is not compatible with previous versions of TouchFree. If you want to take advantage of Gemini hand tracking in touchless kiosks, you’ll need to upgrade to TouchFree 2.1.
For developer documentation, guidelines and support, please visit: https://docs.ultraleap.com/
