TL;DR
Play games on Amazon Luna for your next adventure, included with Prime
- A rotating selection of games, no download needed
- Play on TV, laptop or phone
- Fast, free delivery for your gear, too
Apple has released visionOS 27 for Vision Pro, introducing significant VR enhancements such as Siri AI, spatial panoramas, high-frame-rate object tracking, and support for custom IR LED accessories. These updates aim to improve user interaction and expand hardware capabilities.
Apple has rolled out visionOS 27 for its Vision Pro headset, introducing a suite of new virtual reality features, notably Siri AI, spatial panoramas, and enhanced object tracking. Learn more about Apple AI and mixed reality updates. The update, available for both M2 and M5 models, marks one of the most substantial upgrades since the operating system’s launch, aimed at transforming user interaction and expanding device capabilities.
visionOS 27 is now accessible via a beta program, with users needing to join a waitlist through the device settings. The update brings Siri AI, a next-generation, large language model-powered digital assistant that offers more conversational and context-aware interactions. See how Apple is adjusting product prices including Vision Pro. Siri AI is currently limited to English and requires users to join a waitlist for activation, with automatic download once access is granted.
Siri AI appears as a persistent, pin-able orb in the environment, allowing users to initiate conversations simply by looking at it and speaking, bypassing the traditional voice command trigger. It supports Visual Intelligence, enabling searches and questions related to the physical surroundings, akin to AI assistants on other XR platforms but with Apple’s unique integration.
Additional features include more realistic image generation in Image Playground, smarter Safari bookmarks, and future password management upgrades. On the M5 model, Siri’s voice becomes more expressive and customizable, enhancing the realism of interactions.
visionOS 27 also extends spatial scene capabilities to iPhone-captured panoramas, allowing users to set these as environment backgrounds. The system now supports high-frequency object tracking, capable of following moving objects at around 30Hz, a significant step up from previous static tracking systems. Furthermore, Apple has opened support for third-party IR LED accessories, enabling companies to develop their own tracked peripherals for the Vision Pro, similar to PC VR systems. Discover the UHF X11 accessories built for VisionOS.
Impacts of Enhanced VR Interaction and Hardware Support
The introduction of Siri AI and advanced spatial features significantly enhances user interaction, making the Vision Pro more intuitive and immersive. The ability to interact via gaze and voice, combined with realistic AI responses, could redefine how users engage with virtual environments. Supporting third-party IR accessories opens new avenues for hardware innovation, potentially expanding the ecosystem and use cases for Vision Pro.
These updates position Apple’s Vision Pro as a more competitive and versatile mixed reality device, with capabilities that could influence the broader XR market. The focus on AI-driven interaction and hardware extensibility indicates Apple’s strategy to embed the headset deeply into daily workflows and entertainment.
Apple Vision Pro VR headset accessories
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Background and Evolution of visionOS Features
Since its initial release, visionOS has steadily integrated new features, starting with basic spatial environments and object tracking in visionOS 2 and 26. Apple’s collaboration with hardware partners like Sony and Logitech introduced IR-tracked controllers last year, and the recent support for third-party accessories marks a shift toward a more open ecosystem. The development of Siri AI, based on Apple’s Foundation Models and Google’s Gemini technology, signals a major leap in AI integration for Apple’s XR devices.
Prior to visionOS 27, Apple’s virtual assistant was limited in scope and responsiveness. The new AI aims to offer a more natural, conversational experience, aligning with broader industry trends toward more intelligent, context-aware digital assistants in XR environments.
“High frame rate object tracking at around 30Hz is a big step forward, although it still has higher latency than hand tracking or accessories.”
— Brad Lynch, XR enthusiast
As an affiliate, we earn on qualifying purchases.
Unconfirmed Details About Siri AI and Hardware Compatibility
While Apple states that Siri AI is rolling out in beta, the exact timing for all users remains uncertain, as access is limited to a waitlist. The full extent of Siri AI’s capabilities outside English or in multi-user environments is still unclear. Additionally, details about the final performance of high-frequency object tracking and third-party accessory support are still emerging, with initial reports suggesting around 30Hz update rates but no official confirmation of the exact figures.
spatial panorama creation tools for VR
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Upcoming Updates and Developer Opportunities
Apple plans to expand Siri AI to support additional languages and integrate it more deeply into apps like Messages and Safari. The company is also expected to release the final version of visionOS 27 to all users later this year. Developers will have opportunities to create new IR LED accessories and leverage the high-speed object tracking for enterprise and gaming applications. Further enhancements to spatial scene creation and AI features are likely in future updates.
As an affiliate, we earn on qualifying purchases.
Key Questions
When will Siri AI be available to all Vision Pro users?
Apple has begun rolling out Siri AI in beta, with a waitlist system. The full public release is expected later this year, but exact timing has not been announced.
Can I use Siri AI in languages other than English?
Currently, Siri AI is limited to English, and Apple has not announced plans for additional language support in the initial rollout.
What types of third-party accessories will be supported?
Third-party companies can develop IR LED tracked accessories for Vision Pro, supported via APIs introduced in visionOS 27. These include controllers and styluses similar to PlayStation VR2 Sense devices.
How does high-frequency object tracking improve over previous versions?
It allows for tracking moving objects at approximately 30Hz, offering more responsive and accurate virtual anchoring compared to earlier static or slow tracking systems.
Will Apple release a dedicated Siri app on Vision Pro?
Yes, visionOS 27 includes a dedicated Siri app that stores previous conversations and offers an alternative to third-party AI chatbots.
Source: UploadVR
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
