Logo
FrontierNews.ai

AR Glasses Are Bringing Real-Time Captions to Everyday Conversations

Augmented reality (AR) captioning glasses are making it possible for people with hearing loss to follow conversations in real time by displaying live transcripts directly in their field of vision, much like watching television with captions. These lightweight devices use speech-to-text technology powered by AI to convert spoken words into readable text, eliminating the need to rely on lip reading or body language to fill in missing parts of conversations.

How Are AR Captioning Glasses Transforming Accessibility?

For years, closed captioning has been standard on digital platforms like YouTube, social media, and video calls through services such as Zoom and Google Meet. Now that same technology is moving into the physical world through AR glasses designed specifically for real-time communication. Unlike earlier prototypes that were bulky and uncomfortable, today's captioning glasses are becoming increasingly lightweight and practical for all-day wear.

The technology works by projecting captions onto the glasses' display as conversations happen around you. Users can wear them in various settings, including restaurants, bars, work meetings, theaters, lectures, and at home while watching television. The glasses typically pair wirelessly with a smartphone via Bluetooth, with the speech-to-text processing handled on the phone to keep the glasses themselves lighter and more power-efficient.

What Features Do Current AR Captioning Glasses Offer?

The market for AR captioning glasses has expanded significantly, with multiple companies offering different approaches. Some companies build dedicated captioning glasses from scratch, while others adapt AR glasses from established manufacturers like Vuzix, XREAL, and LLVISION, layering their own speech-to-text software on top.

Key capabilities now available in AR captioning glasses include:

  • Real-time speech-to-text: Converts spoken words into captions displayed in the wearer's field of view as conversations happen
  • Translation features: Many systems can translate conversations into multiple languages, expanding communication across language barriers
  • Extended battery life: Modern glasses offer 6 to 8 hours of continuous captioning, with some models providing 8 or more hours of use per charge
  • Offline functionality: Basic captioning works without an internet connection, though cloud-enhanced features require connectivity for improved accuracy
  • 360-degree audio capture: Multiple built-in microphones pick up conversations from all directions, not just directly in front of the wearer
  • Flexible compatibility: Some systems work as standalone apps on phones and tablets, while others integrate with compatible AR glasses for a more seamless experience

One example is XRAI AR2, a dedicated captioning system priced at $699 that includes three built-in microphones, a dual-lens display so captions appear in both eyes, and up to 8 hours of battery life per charge. The charging case can provide up to 12 additional recharges, offering up to 96 hours of total use.

How Do Pricing and Subscription Models Work?

Most AR captioning glasses offer tiered pricing structures. Many companies provide free or basic offline captioning without requiring a subscription, making the technology accessible to people who need fundamental captioning features. For users who want enhanced accuracy, translation, speaker identification, and support for longer conversations, paid plans add these advanced capabilities.

For instance, XRAI offers a free Essentials tier that includes unlimited basic transcription minutes, support for 20 languages, and up to 30-minute conversations without requiring an internet connection. Premium plans start at $15 per month and add cloud-enhanced transcription engines for faster and more accurate captioning, particularly in noisy environments. The Ultimate plan at $30 per month includes multilingual translation, automatic language detection, and speaker identification.

What's Driving the Growth of This Technology?

The expansion of AR captioning glasses reflects a broader shift toward making technology more inclusive for people with hearing loss. The founder of XRAI Glass, Dan Scarfe, explained that the idea grew out of watching his 96-year-old grandfather struggle to follow conversation around a family dinner table because of hearing loss. This personal motivation has translated into a product designed to restore independence and ease in everyday social situations.

"The idea grew out of watching his 96-year-old grandfather struggle to follow conversation around a family dinner table because of hearing loss," noted the company's founder regarding the inspiration behind XRAI Glass.

Dan Scarfe, Founder of XRAI Glass

Beyond individual use, companies are expanding into venues and public spaces. XRAI has launched XRAI Stream, a platform designed to bring captioning to larger settings, suggesting that this technology may soon extend beyond personal devices into shared spaces like theaters, conferences, and public events.

As larger tech companies like Meta, Google, and Apple develop their own smart glasses platforms, captioning features are likely to become more common in mainstream consumer products. Meta Ray-Ban Display, for example, represents a vertically integrated approach where captioning is built into a consumer-focused smart glasses product rather than being a dedicated accessibility tool. This trend suggests that real-time captioning may eventually become a standard feature across multiple AR glasses platforms.