Magic leap horizontal vertical field of view

Magic Leap One’s field of view: making assumptions from the emulator

At GDC 2018 Magic Leap has announced the release of the Lumin SDK, that is the tools that we should use to develop for this AR glass. I started toying around with it, because I want to review it on this blog next week (stay tuned for updates… maybe subscribing to my newsletter using the hello bar above!) and I discovered that the SDK contains a fancy emulator so that you can start exploring Magic Leap development even if you don’t have a device.

Inside the emulator, you see your device as if it were inside a room and then you can move it (rotate the glass, move the glass, etc…) and simulate a lot of inputs. You can then develop in Unity and connect your Unity editor to the emulator so that to see a live view of how the app would work on the device: the interesting thing is that you can hit Play in Unity and see the program running live in the emulator… so that if you, for instance, change the color inside Unity, it changes immediately inside the emulator. I followed the tutorial to create a simple cube application and then I started moving the cube to see if this mechanism worked… and actually, it worked very well

…even too much well: as you can see, moving and rotating the glass inside the emulator, the fixed cube gets clipped when it gets out of Magic Leap field of view, exactly as in real life. This is very powerful because lets you see if your application really fits well into the small field of view of an AR headset or if at the moment it results not usable.

But this triggered also a big idea in me: if the device inside the emulator is the most similar possible to the real device, as it should be… THE FOV OF THE EMULATOR IS THE SAME FOV OF THE DEVICE… so we can detect the field of view of Magic Leap One using its emulator.

I first tried looking the FOV of the Unity Camera: when you run the program into the emulator, it immediately becomes 80, so I thought that the FOV of ML would be 80 degrees. It seemed too much, so I looked the docs and discovered that actually that value of the Unity camera is referred to the vertical fov…while the horizontal fov depends on the size of the viewport. Unity has to be discarded.

I so started looking into the emulator “Mini Map” window, that shows the viewing frustum of the device… but unluckily it has only a projective top-down view and not an orthographic one: so it is not possible to measure reliably and easily the fov there.

Then I got another idea: why couldn’t I move a very small object along the X-axis and see when it disappears from the view? So I created a little sphere, and I put it at 2 meters from the camera on the Z axis. Inside the emulator, I reset device position and orientation, then I hit play and I started moving the sphere along the x-axis. As soon as it disappeared, I stopped it and took the measurement of that point. I took the last point where it was last visible, took a screenshot and super-imposed a goniometer to the picture to see the angle… can you see what I’ve seen it there?

Magic leap horizontal vertical field of view
Look at that tiny sphere…

Exactly, a little less than 30 degrees on one side!

So, I decided to make another experiment that was a bit better than the previous one: I attached a script to the camera that generates the writing of the angle number at the exact position of that angle and that stays attached to the main camera. The script was exactly this one

public class NumberAngle : MonoBehaviour {

    public int step = 10;

	// Use this for initialization
	void Start ()
    {
		for(int i = 180; i >= 0; i-= step)
        {
            GameObject go = new GameObject();
            go.transform.SetParent(transform, false);
            go.transform.localPosition = new Vector3(Mathf.Cos(i * Mathf.Deg2Rad), 0, Mathf.Sin(i * Mathf.Deg2Rad));
            go.transform.localScale = 0.01f * Vector3.one;
            TextMesh tm = go.AddComponent<TextMesh>();
            tm.text = (-(i - 90)).ToString();
            tm.alignment = TextAlignment.Center;
            tm.anchor = TextAnchor.MiddleCenter;
            tm.fontSize = 17;
            tm.color = Color.blue;
        }
	}
	
	// Update is called once per frame
	void Update () {
		
	}
}

I launched it and these were the results…

Magic leap horizontal vertical field of view
The strange thing is that the results appear asymmetrical… but as you can see, we have -30 and +27 as maximum values

As you can see we have approximately 57° of horizontal angle interval. Moving the headset in the emulator strangely these results slightly change and usually stay in the range 57-60°. Let’s take 60° as the actual FOV because it is a round number 🙂

As a final experiment, I extended the above script to also get the vertical FOV…

public class NumberAngle : MonoBehaviour {

    public int step = 10;

	// Use this for initialization
	void Start ()
    {
		for(int i = 180; i >= 0; i-= step)
        {
            GameObject go = new GameObject();
            go.transform.SetParent(transform, false);
            go.transform.localPosition = new Vector3(Mathf.Cos(i * Mathf.Deg2Rad), 0, Mathf.Sin(i * Mathf.Deg2Rad));
            go.transform.localScale = 0.01f * Vector3.one;
            TextMesh tm = go.AddComponent<TextMesh>();
            tm.text = (-(i - 90)).ToString();
            tm.alignment = TextAlignment.Center;
            tm.anchor = TextAnchor.MiddleCenter;
            tm.fontSize = 17;
            tm.color = Color.blue;
        }

        for (int i = 180; i >= 0; i -= step)
        {
            GameObject go = new GameObject();
            go.transform.SetParent(transform, false);
            go.transform.localPosition = new Vector3(0, Mathf.Cos(i * Mathf.Deg2Rad), Mathf.Sin(i * Mathf.Deg2Rad));
            go.transform.localScale = 0.01f * Vector3.one;
            TextMesh tm = go.AddComponent<TextMesh>();
            tm.text = (-(i - 90)).ToString();
            tm.alignment = TextAlignment.Center;
            tm.anchor = TextAnchor.MiddleCenter;
            tm.fontSize = 17;
            tm.color = Color.blue;
        }
    }
	
	// Update is called once per frame
	void Update () {
		
	}
}

…and from the tests, it seems that it always sits at 45°.

Magic leap horizontal vertical field of view
The viewport of the emulator is set so that its height is equal to the one of the viewing frustum, indipendently from the “Eye View” window size

So the Magic Leap One may have a horizontal FOV of around 60° and a vertical FOV of around 45°.

But… there is a big problem: I noticed that the two representations of the device FOV inside the emulator (the one in the “Mini Map” and in the “Eye View”) are actually uncoherent and show two different frustums.

Magic leap horizontal vertical field of view
Look the left side of the field of view: in the upper window it seems that the device can see only the grey wall, while actually looking at the output seen through Unity, it even overwrites the white door hole. So… what is the real viewing frustum of the device??

I decided to calculate the frustum of the emulation window, too. So, I’ve used the grid with the angle just created by me in Unity… and with a bit of creativity I started moving an object inside the room inside the emulator to get when it touched the red lines of the frustum. At that point I got which was the angle thanks the blue grid. With this process, I got two different values from before: 45° horizontal FOV and 34° of vertical FOV circa. The only thing that the couples 45-60 and 34-45 have in common is a 3:4 aspect ratio… for the rest they represent a huge difference.

Magic leap horizontal vertical field of view
I put the mirror at the same Z of the red frustum and then I moved it until it touched the red borders. In this picture, it touches the lower limit and from the blue grid you see that we are close to 22.5°

Of course, this is all speculation: if the emulator’s FOV is actually different from the real one, these calculations are completely useless. But I really hope that a company doesn’t ship an emulator with wrong rendering features inside, so I trust more the 60° option. In my opinion, 60° seems a value that has sense and it is coherent with the reviews saying that its FOV is noticeably bigger than the one of HoloLens (that is around 30-35°) and coherent with the one of the next evolution of Hololens that should be around 70°. An AR device released this year may absolutely have 60° FOV. So, this speculation, in my opinion, won’t be that distant from reality. But, at the same time, I have to say that using the info from Rolling Stone article, Oliver Kreylos supposed a FOV of around 40°, so 45° can also be a good guess. As always with Magic Leap, there is a lot of confusion.

What do you think about my assumptions? Do you think that the FOV can actually be 60°? Or 45°? Let me know in the comments!

UPDATE: I asked an opinion about this article to the awesome Oliver Kreylos on reddit and he answered me that what I did was good and that the fact that I obtained an asymmetric FOV with the first method is actually a good news to confirm the 60° result. Here you are his exact quote:

In general, your approach is a good one in lieu of having actual hardware in hand. The fact that you got a skewed field of view is a positive indicator, in that sense. If the emulator is based on measured FoV, then it’s likely either the left- or right-eye FoV, and those are expected to be skewed. If the FoV values in the emulator were made up, they’d probably have made them symmetric.

UPDATE 2: The same Oliver Kreylos published later this other comment:

I’m not an expert on waveguides; the one thing I know is that there is a specific type of waveguide that has a hard ~40° limit, that from the Microsoft patent prior to HoloLens. I don’t actually know if that limit applies to all possible types of waveguide.

I also don’t know what Magic Leap are doing. Maybe they have tiled displays with multiple waveguides at angles to each other (imagine like a shallow pyramid), or picked up some other way of projecting the image.

In general, I’m thinking of /u/SkarredGhost‘s estimate as an upper limit, and expect the actual (horizontal) FoV to be somewhere between 40° and 60°.

(Header image by Magic Leap)


Disclaimer: this blog contains advertisement and affiliate links to sustain itself. If you click on an affiliate link, I'll be very happy because I'll earn a small commission on your purchase. You can find my boring full disclosure here.

16 thoughts on “Magic Leap One’s field of view: making assumptions from the emulator

  1. Nice write-up. I think you are right, my bet is on 60 FOV, but who knows, I’m still not convinced this isn’t just a big scam to grab investor money. The price-point they’ve tossed out is ludicrous. I don’t know who is going to drop 2k+ on a consumer gaming device; at least Hololens has some an enterprise applications angle going for them and I could see a real benefit to a system like Hololens in doctors, nurses, assembly line, warehouses, etc. Consumer adoption is harder to imagine given the current price-point.

    Of course, they could surprised us all and take a huge loss and sell it for under a grand to become a standard but so far I haven’t heard them suggest anything like that (aka the old video game console approach of giving the razor away to sell blades etc). Hell even at let’s say 999.99 US I would be hard-pressed to buy one.

    1. Agree completely with you. I hope that at some point Rony Abovitz realizes that it is impossible to survive trying to sell a $2K device to consumers and will start an enterprise program as the one of HoloLens. I think that everything will also depend on the actual features and apps of the device: maybe we’ll discover that while it is sold to consumers, actually it is better than HoloLens for enterprise and so we’ll use it for consultancies.
      A bit like the Kinects: a gaming device mostly used in R&D departments of the world.

      1. Its going to be very interesting to see what Magic Leap actually does? I tried Hololens just once (cannot say where/who) wow that was something else even with its current limitation. Roll on the future….Happy AR 😎

        1. I’m curious as well. HoloLens is awesome, but the low computational power and the super-reduced FOV really hurt its usability… if Magic Leap manages in be better on both sectors, Microsoft will have to react fast

    2. Huge investments from companies like Google and raving impressions from very respectable people, like Tim Sweeney, suggest that they have a really good tech, so definitely not a scam.

      I dislike their marketing approach and the overall attitude, but it doesn’t tell anything about device.

    3. Keep in mind the Creator Edition is essentially a publicly available development kit, it’s meant for enthusiasts and developers to bring content to the Magic Leap platform; the actual consumer-oriented product is likely for 2020-2021 timeframe.

  2. From 100+ degrees hype of 4 years back, the ML fans must be hyping the 60* as super duper compared to 2015 gadgets.
    There will be another article hyping the 50 degrees when it is released.
    These fans stopped talking about the hyped photons display tech, light coming from display and nano-structures diffraction.
    Now it is the same technology as HoloLens – waveguide.

    1. I don’t know if you have read that awesome article on Magic Leap by Karl Guttag. They claimed they could be using Fiber Scanning Displays when actually it was just impossible.
      In the end ML seems just an improved version of Hololens for now. If it will come out, the good side will be that Microsoft will finally have a competitor and things will iterate faster.

      1. You can see NO USA investors in the last 2 rounds for ML, which speaks of lots of its nature.

        HL3 in 2019 with AI embedded chip, will be many times better than this ML1. ML is good at wicked marketing.

  3. No one in USA has invested further.
    There are many other links which does not say any thing about others. Typical ML false wicked information leaks.

    1. Your logic doesn’t make any sense. Are you saying that business insider is lying when they reported that several American investors chipped in to the last round of funding? Just because other articles only mentioned the newest investor doesn’t mean it’s not true. Those articles are just incomplete. A normal person would say thank you for the correction, not double down on what is obviously wrong information.

      1. ML is known false hypes.
        After a whale in the gym and the fake videos with photonic projector, what ever it is, now doubling back on reverse engineered HoloLens.

Comments are closed.

Releated

playstation vr 2

The XR Week Peek (2024.03.26): Sony halts production of PSVR 2, Meta slashes the price of Quest 2, and more!

This has been the week of GDC and of the NVIDIA GTC, so we have a bit more pieces of news than the usual because there have been some interesting things announced there. Oh yes, also IEEE VR had its show. Actually, a lot of things happened for tech people in the US, which is […]

We need camera access to unleash the full potential of Mixed Reality

These days I’m carrying on some experiments with XR and other technologies. I had some wonderful ideas of Mixed Reality applications I would like to prototype, but most of them are impossible to do in this moment because of a decision that almost all VR/MR headset manufacturers have taken: preventing developers from accessing camera data. […]