Researchers from Facebook’s R&D department, Facebook Reality Labs, and the University of California, Berkeley have published new research which demonstrates a method for expanding the field-of-view of holographic displays.

In the paper, titled High Resolution Étendue Expansion for Holographic Displays, researchers Grace Kuo, Laura Waller, Ren Ng, and Andrew Maimone explain that when it comes to holographic displays there’s an intrinsic inverse link between a display’s field-of-view and its eye-box (the eye-box is the area in which the image from a display can be seen). If you want a larger eye-box, you get a smaller field-of-view. And if you want a larger field of view, you get a smaller eye-box.

If the eye-box is too small, even the movement from the rotation of your eye would make the image invisible because your pupil would leave the eye-box when looking any direction but forward. A large eye-box is necessary not only to keep the image visible during eye movement, but also to compensate for subtle differences in headset fit from one session to the next.

The researchers explain that a traditional holographic display with a 120° horizontal field-of-view would have an eye-box of just 1.05mm—far too small for practical use in a headset. On the other hand, a holographic display with a 10mm eye-box would have a horizontal field-of-view of just 12.7°.

If you want to satisfy both a 120° field-of-view and a 10mm eye-box, the researchers say, you’d need a holographic display with a resolution of 32,500 × 32,500. That’s not only impractical because such a display doesn’t exist, but even if it did, rendering that many pixels for real-time applications would be impossible with today’s hardware.

SEE ALSO
'Asgard's Wrath 2' Hands-on: The New Benchmark for Quest Games

So, the researchers propose a different solution, which is decouple the link between field-of-view and eye-box in a holographic display. The method proposes the use of a scattering element placed in front of the display which scatters the light to expand its cone of propagation (also known as étendue). Doing so allows the field-of-view and eye-box characteristics to be adjusted independently.

But there’s a problem of course. If you put a scattering element in front of a display, how do you form a coherent image from the scattered light? The researchers have developed an algorithm which pre-compensates for the scattering element, such that the ‘scattered’ light actually forms a proper image after being scattered.

At a high level, it’s very similar to the approach that existing headsets use to handle color separation (chromatic aberration) as light passes through the lenses—rendered frames pre-separate colors so that the lens ends up bending the colors back into the correct place.

Here the orange box represents the field of view of a normal holographic display while the full frame shows the expanded field of view | Image courtesy Facebook Reality Labs

The researchers used optical simulations to hone their algorithm and then built a benchtop prototype of their proposed pipeline to experimentally demonstrate the method for expanding the field of view of a holographic display.

Although the researchers believe their work “demonstrates progress toward more practical holographic displays,” they also say that there is “additional work to be done to achieve a full-color display with high resolution, complete focal depth cues, and a sunglasses-like form factor.”

Toward the end of the paper they identify miniaturization, compute time, and perceptual effects among the challenges needed to be addressed by further research.

The paper also hints at potential future projects for the team, which may be to attempt to combine this method with prior work from one of the paper’s researchers, Andrew Maimone.

SEE ALSO
Vision Pro Isn't Here Yet, But You Can Already Start Capturing Spatial Video on Your iPhone

“The prototype presented in this work is intended as a proof-of-concept; the final design is ideally a wearable display with a sunglasses-like form factor. Starting with the design presented by Maimone et al. [2017], which had promising form factor and FoV but very limited eyebox, we propose integrating our scattering mask into the holographic optical element that acts as an image combiner.”

Image courtesy Facebook Reality Labs

If you read our article last month on Facebook’s holographic folded optics, you may be wondering how these projects differ.

The holographic folded optics project makes use of a holographic lens to focus light, but not a holographic display to generate the image in the first place. That project also employs folded optics to significantly reduce the size of such a display.

On the other hand, the research outlined in this article deals with making actual holographic displays more practical by showing that a large field-of-view and large eye-box are not mutually exclusive in a holographic display.

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • Shem

    Neat!

  • Duane Aakre

    Will these various holographic concepts be able to automatically correct for those of us without 20/20 vision?

    • That would be amazing on VR/AR/Holo sets. You enter your prescription…BOOM. No need for glasses or added prescription lenses.

      • Bob

        Apple are apparently working on a solution for this on their upcoming VR/AR headset.

        • dk

          no they r not ….they have various simple ar/vr patents …and all they will have for the next few years is the equivalent of focals and nothing more

    • benz145

      AFAIK, any true hologram is in theory capable of digital prescription adjustment. I’m not sure if this changes depending upon the method for producing the hologram.

  • Guygasm

    Link at the beginning of the article points to the older paper incorrectly.

    https://research.fb.com/publications/high-resolution-etendue-expansion-for-holographic-displays/

    • benz145

      Thanks for pointing this out, fixed!

      • Rosemary

        I lost my job after working for the same business enterprise for several years, I expected legitimate profit, I was not seeking for the “get rich quick” home packages you see all throughout the internet. Those usually are pyramid system or things where you really have to sell to your buddies and relatives. Only two or three months ago I stumbled upon a great online work prospect. Via the online I receive almost 6,000 to 8,000 bucks each 30 days This is great to surely replace my past work net income, mainly considering I just do the work nearly 20 hours weekly in a home office. I really required a reliable process to earn an income for me personally as well as my family members. The best part of doing the job via the internet is that I am usually home with the kids, I save a bunch of money. Truly, it is much simpler than you could think. I obtained the guides package and then within 30 days I commenced making money online over 4,000 $ every month. The instructions are incredibly simple, you do not have to be a computer whiz, but you must understand how to use the net. If you can fill up forms and also surf web sites, you can actually do it successfully, You need not even have to sell off anything and nobody needs to buy anything. It is really as simple as being on Fb or twitter.Here’s the simplest way to start ->->-> https://krowdy.co/9fof

  • Jim P

    Hope I’m still alive to see that day When VR/AR merge.

  • Very interesting research!

  • duck

    Great. Thumbs up
    This is future
    Magic

  • ImperialDynamics

    I’ve said it many times before, Facebook’s R&D labs are years ahead of everyone else in XR