Microsoft Debuts Mixed Reality Toolkit 3

Breaking down Microsoft's most recent MR engine update

2
Microsoft Debuts Mixed Reality Toolkit 3
Mixed RealityLatest News

Published: June 13, 2022

Rgreenerheadshot

Rory Greener

Last Thursday, Microsoft debuted version three of its Mixed Reality (MR) toolkit (MRTK3) for use in Unity Technologies’ real-time 3D (RT3D) animation engine.

The technology partnership accelerates the development of MR content on the open-source development hub to deliver cross-platform immersive experiences.

MRTK3 runs on OpenXR, meaning that the toolkit supports a range of extended reality (XR) devices like the firm’s Microsoft HoloLens 2. The MR toolkit also supports other devices under ‘experimental’ guidelines. Devices supported by Microsoft include the Meta Quest, Windows Mixed Reality, SteamVR, and Oculus Rift.

Microsoft designed the update to fully support mobile XR devices, reducing the computing power needed for streaming immersive MR experiences.

Microsoft also supports XR experiences delivered on traditional 2D monitors for personal computers. According to Microsoft documentation, the firm will soon add more device delivery options.

The news comes after Microsoft’s now-former MR Chief and Creator of the Hololens, Alex Kipman, resigned last week following a significant controversy.

New Features

MRTK3 supports additional Unity engine tools, including its Canvas and 3D user interface (UI) development suites that enable developers to create spatial navigational spaces.

The tools enable MR developers to create and place interactive menus anywhere in an immersive MR environment, either overlaid on or replacing the real world. To support integrated Unity features, Microsoft leverages XR interaction tools and an input system provided by the RT3D engine architects.

The update also includes enhanced interactions and input for RT3D models. Animators can create RT3D MR assets that users can pinch and manipulate within an immersive environment.

Microsoft includes fresh 2D and 3D input support, enabling developers to integrate classic input methods like a mouse, keyboard, and controller.

Microsoft is also adding data binding tools for brands and businesses to create dynamic custom user interfaces, RT3D assets, and MR spaces.

Furthermore, Microsoft is adding various accessibility features to MRTK3, such as hand-tracking, eye-tracking, and low-vision assistance. Recently, Microsoft and partners Nreal partnered with University of Bristol researchers to develop an MR device that uses spatial audio to read aloud the names of individuals to children with low vision.

Unity offers a rich XR development suite that democratises immersive content development with easy-to-use tools, developer support, and integrated third-party tools.

DesignHoloLens 2Immersive CollaborationMicrosoft MeshMixed Reality Headsets

Brands mentioned in this article.

Featured

Share This Post