Logo
FrontierNews.ai

Apple's Siri AI Is Getting a Spatial Makeover on Vision Pro This Fall

Apple's next-generation Siri AI will arrive on Vision Pro later this year as a persistent spatial orb that responds to your gaze and voice, powered by large language models co-developed with Google. The upgrade marks a significant shift in how Apple's digital assistant will work across its ecosystem, moving beyond simple voice commands to offer personal context understanding and broad world knowledge.

What Makes Siri AI Different From Traditional Siri?

The new Siri AI represents a fundamental rethinking of Apple's assistant. Unlike the current Siri, which handles most tasks through voice commands, the AI-powered version will be "profoundly more capable and conversational," according to Apple's documentation. The system uses next-generation Apple Foundation Models, which were co-developed with Google and based on its Gemini models through a reported $1 billion per year deal.

The architecture follows Apple's established approach to on-device artificial intelligence. Some tasks run on a small model stored directly on your device, while more complex requests are sent to Apple's Private Cloud Compute system, a server infrastructure designed to handle heavier computational loads while maintaining privacy.

How Will Siri AI Work on Vision Pro?

On Apple's spatial computing headset, Siri AI takes on a distinctly different form than on iPhones or Macs. Instead of appearing as a text box or voice interface, the assistant manifests as a persistent orb that you can pin to any physical location in your room. You can activate it simply by looking at the orb and speaking, eliminating the need to say "Siri" first, though that option remains available.

The spatial interface also introduces Visual Intelligence, a feature that lets you "search, ask questions, and take action" relating to both your physical surroundings and virtual content within the headset. This capability positions Apple's approach somewhere between Meta AI on Quest 3 and Gemini on Samsung Galaxy XR, offering a middle ground in spatial AI capabilities.

Beyond the floating orb interface, visionOS 27 will include a dedicated Siri app that lets you review previous conversations. This preinstalled alternative to third-party AI chatbot apps like ChatGPT, Gemini, Claude, Grok, and Meta AI gives users a native option without leaving the Vision Pro ecosystem.

What New Capabilities Come With Apple Intelligence on Vision Pro?

The next-generation Apple Foundation Models powering Siri AI will unlock several new features across visionOS 27. These improvements extend beyond just the assistant itself, touching multiple parts of the operating system:

  • Image Generation: Image Playground will produce significantly more realistic synthetic images compared to previous versions
  • Browser Intelligence: Safari will automatically organize your open tabs, reducing manual management
  • Password Management: You can upgrade the strength of saved passwords with a single tap, improving security without manual intervention
  • Smart Replies: Messages will offer personalized smart reply suggestions tailored to your communication style

These capabilities demonstrate how Apple is distributing AI improvements across its software stack rather than concentrating them in a single assistant.

When Will Siri AI Actually Arrive?

Apple has announced that Siri AI will come to its major operating systems "later this year," which includes visionOS alongside iOS, iPadOS, and macOS. The broader visionOS 27 update is scheduled to arrive "this fall" for both M2 and M5 models of Apple Vision Pro. The first beta release is already available to developers, though it lacks many features coming in the stable launch.

This staggered rollout means Vision Pro users will get the full spatial Siri AI experience sometime after the initial visionOS 27 release, giving Apple time to refine the experience based on developer feedback and testing.

How Does This Fit Into Apple's Broader AI Strategy?

The Siri AI rollout on Vision Pro reflects Apple's larger approach to artificial intelligence, which emphasizes on-device processing for privacy and speed, combined with cloud compute for complex tasks. By co-developing foundation models with Google rather than building entirely from scratch, Apple has accelerated its timeline to competitive AI capabilities while maintaining control over the user experience.

The spatial interface on Vision Pro also positions Apple to differentiate its AI assistant from competitors. While other companies offer conversational AI through screens or speakers, Apple's approach of embedding the assistant as a spatial object in your environment creates a fundamentally different interaction model that leverages the unique affordances of spatial computing.