Brilliant Labs announced on Tuesday the release of its arGPT smart glasses platform. Compatible with Apple’s iOS operating system, it will enable ChatGPT artificial intelligence (AI) on smart glasses and wearables.
The next-level solution for human-computer interfacing (HCI) aims to provide hands-free access to global knowledge bases using voice prompts. The company’s Monocle AR device provides a heads-up display (HUD) for wearers, indicating a major boost for those seeking to streamline their day-to-day tasks.
arGPT: The Next Step for GenAI Wearables
For people with previous ChatGPT experience, Brilliant Labs’ solution will offer workplaces and enterprises novel workflow tools. Company employees can create real-time translations, build research, summaries, and other key features via their augmented reality (AR) HUDs on their Monocle devices.
Monocle will also enhance location-based ChatGPT responses, including the introduction of real-time translations on the fly without the need for user input. Wearers can also use the platform for fact-checking, locating key information for travel, and communicating with audiences with augmented teleprompters.
Additional features will offer embedded microphones, high-visibility AR displays, and a 5-megapixel camera, among others. The device also provides Bluetooth connectivity, generative AI capabilities with Language Learning Models (LLMs), and Diffusion Models for creating content.
Interview with Brilliant Labs’ Tavangar
Bobak Tavangar, Chief Executive and Co-Founder, Brilliant Labs, said in a statement that such technologies could back “growing demand for ChatGPT.” Currently, the platform has over 300 million users, leading to increasing use cases across immersive devices.
He added that arGPT would become the “ideal solution for AR wearables as we inch closer to a future where persistent AI assistants are a reality.”
In a brief interview with XR Today, Tavangar indicated Brilliant Labs’ potential future as a key AI solution for the XR industry.
The former Apple executive previously worked with the Cupertino-based tech giant as its Product Design Programme Lead. While there, he developed the company’s supply chain technology platform.
A Killer Application for Spatial Computing?
He told XR Today that recent funding from “deeply credible investors” had validated “our company’s focus on aligning generative AI with human sight.”
Tavangar added arGPT would become the “breakthrough application of spatial computing in our lives.”
He continued,
“There is a growing sense in our industry that XR has been lacking a reason for existence, and generative AI tools like arGPT are finally clarifying that”
When asked how Brilliant Labs aims to scale up its arGPT solution over future generations of the GenAI platform, he said they would soon become “multimodal.”
Doing so would “enable our devices to see what your eyes see and hear what your eyes hear.”
Tavangar explained further:
“This opens the door for your AR device to proactively prompt you with helpful insights as you navigate daily life. This will usher a new, tectonic shift in humanity’s relationship with the personal computer”
Speaking further on the potential use cases for arGPT and the enterprise and its end users, Tavangar stated: “The implications for enterprise use cases are immense.”
Outlining specific use cases, the executive said: “Whether distilling meeting audio into salient text-based notes, structuring a whiteboard brainstorm into a spreadsheet and charts, or guiding a colleague through domain knowledge relevant to the execution of a task, the possibilities are endless.”
Brilliant Labs Updates
The news comes after the company earned $3 million USD in series funding from major investors across the tech industry. These have included:
- Brendan Iribe, Co-Founder, Oculus
- Nirav Patel, Former Core Team Member, Oculus
- Adam Cheyer, Co-Founder, Siri
- Eric Migicovsky, Founder, Pebble
- Steve Saroitz, Founder, Paylocity
- Francisco Tolmasky, iPhone Team Member and Software Engineer, Apple
Tavangar and co-founders Raj Nakarja and Ben Heald created the company to boost HCI solutions with GenAI AR wearables. The open-source ecosystem it aims to develop will back users across verticals to support their workflows. The human augmentation tools aim to empower the future of productivity, creativity, and information.
The developments come amid the ongoing SIGGRAPH 2023 event in Los Angeles, California, USA. The event, one of the premier conferences for visual effects (VFX), computer vision, and compute technologies, will feature dozens of sessions focusing on key updates across the industry.
These will feature top metaverse firms and virtual, augmented, and mixed reality (VR/AR/MR) technologies like NVIDIA, Autodesk, and VICON.
Recently, Stanford University Students leveraged Brilliant Labs’ technologies to build a pair of AR smart glasses.
The most recent iteration tapped Brilliant Labs’ Monocle hardware and RizzGPT’s HCI software. It integrated Brilliant Labs’ technologies with the speech detection tool Whisper for real-time responses during conversations.
