The XR Week Peek (2020.09.21): Quest 2 released, NVIDIA acquires ARM, Leap Motion 2 on sale, and much more!

The Ghost Howls

an ARM chips can be installed on IoT sensors that communicate to a server where an NVIDIA card is used to perform machine learning on the data). You can finally buy the Leap Motion v2 accessory. The time for us XR developers to buy a Leap Motion 2 has finally come.

Design Sprints at Leap Motion: A Playground of 3D User Interfaces


Click To Tweet When someone first puts on a Leap Motion-enabled VR headset, it often seems like they’re rediscovering how to use their own hands. Designing virtual interactions for human arms, hands, and fingers means digging into the range of motion of shoulders, elbows, and wrists. Using Gravity Sketch to mark out ranges of comfortable motion, pivoting at my shoulders, elbows, and wrists.


Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Oculus Quest Controller-Free Hand Tracking SDK Now Available


It uses the four cameras on the Oculus Quest and advanced computer vision algorithms, powered by machine learning, to track your hands and fingers. Oculus Quest facebook finger tracking hand tracking leap motion oculus SDK Standalone VR top stories VR Development

Oculus Rift S Onboard Cameras Could Support Finger Tracking In Future


Machine Learning Breakthrough. Last year at Facebook’s annual F8 conference the company finaly showed off high quality gloveless, markerless finger tracking: An Oculus representative explained on stage that this “breakthrough” was made possible by Facebook’s heavy investment in machine learning (“AI”) research. Or perhaps Leap Motion was simply being used to help train a first party algorithm using the front facing cameras.

Voxon’s 3D Volumetric Arcade Machine Leads The Charge For Holographic Gaming


Thanks to the efforts of Australian-based star-up Voxon, a futuristic technology from a galaxy far far away is now a reality with the development of Voxon VX1 3D volumetric arcade machine. People can gather around the VX1 to visualize, communicate, learn, and play via a shared 3D holographic experience. Voxon currently has two products available; the Voxon VX1, an advanced 3D volumetric display; and the Voxon Z3D, labeled as the world’s first holographic arcade machine.

Building a Playground of 3D User Interfaces


At Leap Motion, our team is constantly pushing the boundaries of our interactive VR toolkit. We built the Leap Motion Interaction Engine to give developers the power to define the physical laws of the virtual universe. Since the iPhone introduced multi-touch input in 2007, we’ve seen 2D touchscreen interaction design evolve into a responsive, motion-filled language. ” Tagged with: leap motion Facebook Twitter Reddit More.

Why VR Will Transform How We Learn About the World and Ourselves


Tomáš Mariančík wants to change how people learn about the world and bring their ideas to life. In the age of “learning” by rote memorization of Latin passages from books for the rich and privileged, he suggested that education should be accessible to anyone, regardless of wealth, social position, or gender. He also came up with a concept of “school by play,” learning languages by re-enacting various scenarios in a theatrical play where the language was used.

The Evolution of Arm HUD


At Leap Motion, we’re making VR/AR development easier with Widgets: fundamental UI building blocks for Unity. As an interaction engineer here at Leap Motion, I built the Arm HUD for the Planetarium. While we introduced an early version of Arm HUD in December, I wanted to share what we learned from its evolution and development. Additionally, the Arm HUD uses Unity’s Mecanim animation state machines in conjunction with the Arm HUD’s own C# state machine.

Twist the Gears of a Massive VR Music Engine with Carillon


There’s a lot to learn – you have to learn how to compose, orchestrate music for an ensemble, interaction design, etc. Students in the class make up the ensemble and in the span of 9-10 weeks learn how to program, compose music and build innovative interactive performance works. Using technology like the Leap Motion Controller allows us to use our hands to directly engage virtual instruments, from the plucking of a virtual string to the casting of a sonic fireball.

11 New #3DJam Demos: Droids and Discovery


Learn all about the effects of super-cooling. Designed by a team of students at Game-U ( @gameu_nj ), Nerves is an intense visit to the operating room for a motion-control surgeon. Control a Darby robot on the Raspberry Pi and a Rodeo machine with this project from Hirokazu Egashira and @routeflags. They form part of the unofficial Leap Motion Jp developers group. LEAPing into Accessibility. Are these the droids you’re looking for?

Scaffolding in VR: Interaction Design for Stacking and Assembly


Check out our results below or download the example demo from the Leap Motion Gallery. The advanced hand-based physics layer of the Leap Motion Interaction Engine makes the foundational elements of grabbing and releasing virtual objects feel natural. Then, in our ScaffoldGridVisual class, we can use the Leap Motion API to get a fingertip position, using it to set the value for our custom “_HoverPosition” variable in the material for our grid point cubes.

12 Explosive Sci-Fi Games


According to creator Bertz ( @cbrpnkrd ), its “monochrome art style bears reference to industrial design, machine vision, and the works of Tsutomu Nihei. C0NFL1CT features a natural movement locomotion system that did not induce motion sickness and lets the player move in any direction, while requiring only 4 square meters of free space and the Oculus Rift DK2 headset.”. I’ll be honest, this was the first time I’d ever had exposure to the Leap Motion Controller.

Facebook Files Patent For VR Finger Tracking AI Armband


Machine learning is used to convert these signals into finger positions. Leap Motion shipped a finger tracking kit for the Oculus DK2 all the way back in 2014, but the tracking quality left a lot to be desired. Facebook filed a patent application for an armband which performs finger tracking by reading electrical signals inside the user’s wrist. Two variations of the device are described. In one, an active signal is sent through the wrist.

Facebook Acquires Startup Developing AI Finger Tracking Armband


Machine learning is used to convert these position changes into finger poses. Leap Motion shipped a finger tracking kit for the Oculus DK2 all the way back in 2014, but the tracking quality left a lot to be desired. Facebook is in the final stages of acquiring a New York based startup called CTRL Labs which was developing an armband which tracks the user’s fingers by reading electrical signals inside their arm.

Sony Researchers Unveil Knuckles-style Prototype VR Controller with Full Hand Tracking

Road to VR

Sony Interactive Entertainment (SIE) researchers unveiled a prototype motion controller recently which showcases experimental techniques into full hand tracking using machine learning and capacitive sensors.

Hands-On: Oculus Quest Hand Tracking Feels Great, But It’s Not Perfect


Their computer vision team came up with a new method of using deep learning to understand the position of your fingers using just the monochrome cameras featured on the Quest, with no active depth-sensing cameras, additional sensors, or extra processors required. The game places you inside an otherworldly laboratory littered with oozing green liquids, ghoulish sound effects, and strange wooden machines; an aesthetic similar to something you might see in a Harry Potter film.

The XR Week Peek (2021.03.22): Sony reveals PSVR2 controllers, FRL shows the wristband of the future, and more!

The Ghost Howls

It showed what is its vision for the long-term future: AR glasses that are intelligent enough to learn about your behavior and to examine the context you are in so that to be able to already provide you suggestions about what they can do to help you. Learn more. Happy Spring everyone!

Sony 310

SenseGlove review: a nice DK1 for force-feedback in VR

The Ghost Howls

Thanks to the force feedback, the user can really feel the drilling machine in his hands (Image by SenseGlove). you can feel when a drilling machine is on). But to learn something more advanced I would need a bit of time to study the whole SDK.

Haptic 392

Sign Language In VR ‘Worth Exploring’ As Hand Tracking Improves

Upload VR

Prototype software using a new generation of hand tracking technology is showing promise for facilitating some forms of sign language learning and communication, regardless of physical distance. They also learned slowing down their signing could help with expression.

OSVR Co-founder on the Future of Open Source Virtual Reality

Road to VR

Acer, NVIDIA, Valve, Ubisoft, Leap Motion and many others joined the ecosystem. We see headsets, motion trackers, haptics, eye trackers, motion chairs, and body suits. If developers use an API from one peripheral vendor, they need to learn a new API for each new device. Some accept a high-end gaming PC, while others prefer inexpensive Android machines. OSVR is an open source software platform and VR headset.

‘New Retro Arcade: Neon’ Review

Road to VR

It was disappointing to learn that the tech demo I’d been salivating over for the last two years didn’t let me do the one thing I wanted it for: play video games with my friends in VR. Then again, I vastly prefer the Vive controllers when it comes to interacting with in-game items like a drum machine and the cassette tapes that litter the whole arcade.

Shaping the Digital World with Our Hands, with Clay AIR’s Varag Gharibjanian

XR for Business Podcast

And it's pretty cool that we get to experiment with the latest and greatest machine learning models, and try to get the most out of those chips. But after seeing what came out of CES this year, and learning about this Qualcomm XR2 chip, you've now got AR glasses coming out en masse. Alan: With Facebook now working on AR, and you've got Magic Leap, and Microsoft's Hololens. But things like midair haptics, with the Ultra Haptics or the Ultra Leap now.

OSVR - a Look Ahead


Acer, NVIDIA, Valve, Ubisoft, Leap Motion and many others joined the ecosystem. We see goggles, motion trackers, haptics, eye trackers, motion chairs and body suits. If developers use an API from one peripheral vendor, they need to learn a new API for each new device. Some accept a high-end gaming PC, while others prefer inexpensive Android machines. Magic Leap is not commercial yet.

All you need to know on Oculus Connect 6: the most important news in one single article!

The Ghost Howls

It uses a new method of deep learning to reconstruct the pose of the hands of the user. Then there are the problems that are inherent to all hands-tracking solutions like Leap Motion : no haptic feedback, virtual hands that trespass objects they are interacting with, and such. This is the official description: You’ll play as an Allied agent of the Office of Strategic Services (OSS), tasked with infiltrating, outgunning, and outsmarting the Nazi war machine.

Oculus 243

The XR Week Peek (2021.05.24): Snap releases new Spectacles AR glasses, Quest releases runtime v29, and more!

The Ghost Howls

But this is not coming anytime soon , exactly like the HoloLens 3, which will only come when there is a technological leap big enough to justify the build of a new version. Learn more. Learn more. Learn more. Welcome to my weekly appointment with the best AR VR news!

AR 214