Smart Glasses Get a Multimodal AI Upgrade: Why Seamless Audio-Visual Conversations Matter
Smart eyewear maker Innovative Eyewear has rolled out a suite of multimodal AI features for its Lucyd glasses, enabling users to switch fluidly between audio and visual AI conversations while accessing custom AI-generated news reports. The updates, which include Google Gemini integration and improved Android controls, represent a significant step toward making wearable AI more practical for everyday use.
What Is Multimodal AI, and Why Does It Matter for Wearables?
Multimodal AI refers to artificial intelligence systems that can process and respond to multiple types of input simultaneously, such as voice, text, and images. In the context of Lucyd glasses, this means users can start an AI conversation on their phone's visual interface and pick up that same thread using voice commands on the eyewear without losing context. The AI remembers what was discussed, any images or documents that were shared, and the full conversational history.
For wearable technology, this capability solves a real usability problem. Users often switch between devices throughout the day, and forcing them to restart conversations or re-upload information creates friction. By maintaining full conversational context across audio and visual modes, Lucyd's multimodal approach makes the glasses feel like a natural extension of the user's digital workflow rather than an isolated tool.
How to Maximize Multimodal AI Features on Your Smart Eyewear?
- Start conversations visually: Begin complex queries or uploads on your phone's app interface where you have a larger screen, then continue the conversation hands-free using voice commands on the glasses while moving around.
- Save and export conversations: Lucyd's multimodal chats can be saved and exported, allowing you to archive important discussions, research threads, or problem-solving sessions for later reference or sharing with colleagues.
- Switch between AI models mid-conversation: With access to ChatGPT, Claude, and Google Gemini, you can leverage different AI strengths within the same session, such as using one model for creative writing and another for technical analysis.
- Use voice commands for hands-free activation: Android users can now set Lucyd as their device-level voice assistant, enabling instant access to AI models from the phone's action button or directly from the glasses without additional voice commands.
What New Features Are Included in the Latest Lucyd Update?
The update introduces three major capabilities. First, a Newscast widget allows users to create custom, AI-generated news reports delivered as audio podcasts directly to their glasses. Users select their interests, desired length, and activate the report via voice command or the app widget. The system uses a large language model (LLM), which is a type of AI trained on vast amounts of text to generate human-like responses, to create on-demand news reports that refresh each time the command is given.
Second, Innovative Eyewear has integrated Google's Gemini service alongside existing ChatGPT and Claude options. This gives users access to Gemini's image generation capabilities and standard LLM queries. The company plans to allow custom API key entry in the future, enabling users to sync their Gemini experience with their personal Google accounts.
Third, the multimodal AI feature enables seamless conversation flow between the app's visual interface and the glasses' audio interface. Users can pick up a thread started in one mode and continue it in another, with full context preserved. These conversations can be saved and exported for future reference.
Why Is Custom AI News Generation a Practical Alternative to News Apps?
Traditional news consumption requires users to scroll through multiple websites or apps, often encountering information overload or irrelevant stories. Lucyd's AI-generated newscast solves this by creating personalized news reports in podcast format, delivered directly to the user's glasses. The feature launches next week and allows users to stay informed hands-free while commuting, exercising, or working.
"As a constant news reader myself, I have long wanted a better way to learn about what's happening in the world. A custom, AI-generated podcast perfectly tailored to the individual is an elegant solution for cutting down screen time and impulsive scrolling, while still getting the information you want," said Harrison Gross, CEO of Innovative Eyewear.
Harrison Gross, CEO of Innovative Eyewear
This approach addresses a growing concern about screen fatigue and digital wellness. By vocalizing news in a podcast style rather than requiring users to read text on a screen, the feature makes information consumption more natural and less addictive than traditional scrolling-based news apps.
What Android-Specific Improvements Are Included?
Android users receive two targeted upgrades. They can now set Lucyd as their device-level voice assistant, providing instant access to the app's AI models from the phone's action button or directly from the glasses without needing an additional voice command. Additionally, a new floating Lucyd widget appears when the assistant is activated, allowing users to quickly switch between AI models without navigating through menus.
These improvements reflect the growing importance of voice-first interfaces in mobile AI. By reducing the number of steps required to access AI tools, Lucyd makes the technology more accessible to users who may be driving, exercising, or otherwise unable to interact with a traditional touchscreen.
The combination of multimodal AI, custom news generation, and expanded model access positions smart eyewear as a viable platform for AI interaction beyond simple voice commands. As wearable technology matures, the ability to seamlessly blend audio and visual interfaces will likely become a standard expectation for users accustomed to switching between phones, computers, and other devices throughout their day.