Skip to main content

Apple’s new AR headset may use Face ID technology to track hand gestures

Apple has an augmented reality (AR) headset in the works, and a well-known analyst now predicts that it will use Face ID to track hand movements.

The upcoming headset is said to be equipped with more 3D sensing modules than iPhones and, according to the report, may one day replace iPhones altogether.

Apple VR Headset Concept by Antonio De Rosa.
Antonio De Rosa

The information comes from a note for investors prepared by Ming-Chi Kuo, a respected analyst, which was then shared by MacRumors. In his report, he elaborates on the kind of performance and features we can expect from the upcoming Apple AR/MR (augmented reality/mixed reality) headset.

According to Kuo, the new headsets will feature four sets of 3D sensors as opposed to the one to two sets currently offered by the latest iPhones. The use of extra sensors opens up the headset to a whole lot of new capabilities, extending the realism of the user experience.

The sensors used in the new Apple headset rely on structured light to detect motion and actions. Kuo predicts that this will make it possible for the headset to track not just the position of the user, but also the hands of the user and other people, objects in front of the user, and lastly, detailed changes in hand movements.

Kuo compared the headset’s ability to track small hand movements to the way Apple’s Face ID is capable of tracking changes in facial expressions. Being able to detect small hand and finger movements allows for a more intuitive user interface that doesn’t take away from the realism of using an AR/MR headset.

Apple VR Headset Concept by Antonio De Rosa.
Apple VR Headset Concept Antonio De Rosa

Both the iPhone and the yet unnamed Apple headset rely on structured light, but the headset needs to be more powerful than the iPhone in order to offer proper hand movement detection. Kuo notes that this means that the structured light power consumption of the AR/MR headset is higher.

“We predict that the detection distance of Apple’s AR/MR headset with structured light is 100% to 200% farther than the detection distance of the iPhone Face ID. To increase the field of view for gesture detection, we predict that the Apple AR/MR headset will be equipped with three sets of ToFs (time of flight) to detect hand movement trajectories with low latency requirements,” said Ming-Chi Kuo in his investor note.

Kuo believes that Apple may one day wish to replace the iPhone with the AR headset, although that won’t happen anytime soon. He predicts that in the next 10 years, headsets may very well replace existing electronics with displays.

With the added hand gesture tracking, the new Apple headset may offer an immersive user experience. As rumors suggest that Apple may be looking to join Meta and other companies in expanding toward the metaverse, it’s possible that this headset might be the first step toward just that.

Editors' Recommendations

Monica J. White
Monica is a UK-based freelance writer and self-proclaimed geek. A firm believer in the "PC building is just like expensive…
This is what Apple’s in-store Vision Pro demo will likely be like
A person wears an Apple Vision Pro headset. Their eyes are visible through the front of the device.

Anyone interested in buying Apple’s Vision Pro mixed-reality headset will be encouraged to sign up for an in-store demonstration of the device so that Apple can ensure they have the best possible experience with it from the very beginning.

The tech giant is about to launch its most important product since the Apple Watch in 2015, and with many people never having gone near such a device, Apple wants to ensure that the initial experience with the Vision Pro is as good as it can be.

Read more
Watch Apple’s new ‘Get Ready’ ad for its Vision Pro headset
A screenshot from Apple's Vision Pro ad released in January 2024.

Apple’s Vision Pro headset -- the company’s most significant product launch since the Apple Watch in 2015 -- is almost here.

The eagerly awaited mixed-reality goggles will be available to preorder in the U.S. starting January 19 ahead of an official launch on February 2, the tech giant revealed on Monday. Other countries are expected to follow soon after.

Read more
Spatial computing went public this year, but the true test is ahead
Apple Vision Pro's spatial computing could make it easier to work from home.

2023 was the year the world at large was introduced to the term spatial computing. Even though Apple didn't invent the term, its use of it while announcing the Vision Pro instead of "mixed-reality" or "augmented reality" was notable.

In short, a spatial computer is a new type of device with a wearable display, the ability to sense the surrounding area, and a user interface based on the wearer's hands, eyes, and voice instead of a traditional screen. But Apple is hardly alone in its pursuit. 2023 saw some huge releases from major players in the game, pushing this technology to places it's never been before, but it will only get bigger in 2024.
Spatial computing in 2023
As we approach the end of 2023, let's review several devices that almost qualify as spatial computers but fall short of replacing your laptop or revolutionizing computing. AR and VR headsets that include hand-tracking and some form of computer vision are intriguing but ultimately aren't practical enough for most people. AR glasses and smart glasses are much more inviting due to their relatively small and light form but lack complete spatial computing features.
AR headsets
A rendering of virtual graphics seen in a Microsoft HoloLens. Microsoft / Microsoft

Read more