The Arcturus Vision Camera, a $149 accessory for Steam Frame, now provides full-color passthrough and tracked stereoscopic video capture, significantly enhancing mixed reality experiences. The device attaches via the headset’s PCI-E expansion port and is immediately available for users seeking higher fidelity AR and VR integration, making it a notable upgrade for Steam Frame owners.

The Arcturus Vision Camera features two 32-megapixel Sony RGB sensors spaced approximately 64mm apart, matching typical IPD measurements. It offers two passthrough modes: full resolution at 2464×2464 pixels per eye at 72Hz (default 60Hz), and a half resolution mode at 1232×1232 pixels per eye at 144Hz (experimental). This results in a substantial increase in color and clarity over the monochrome passthrough originally available on Steam Frame, which was grayscale and lacked color detail.

In addition to visual enhancements, the camera enables tracked stereoscopic video recording. It captures 6MP HDR video at 60fps or 1.5MP at 120fps, while also recording the headset’s tracked position throughout each capture. This allows for a novel playback mode called Stabilized Immersive Playback, where the recorded footage moves dynamically around the viewer, matching the tracked movement for a more immersive viewing experience. This feature is unique to the Arcturus system and is not available on other headsets.

The device also includes an app that converts captured footage for playback on other VR headsets, such as Apple Vision Pro and Meta Quest, although these versions lack the Stabilized Immersive Playback feature. Additionally, Arcturus offers a Gaussian splat viewer, Arcturus Vision Gaussian XR, which allows exploration of 3D point cloud data generated from captured footage, primarily for professional or creative uses.

Enhanced Mixed Reality with Color and 3D Capture

This development marks a significant step forward in mixed reality hardware for Steam Frame, a headset primarily known for its lightweight design and affordability. By adding full-color passthrough and tracked stereoscopic video, the Arcturus Vision Camera transforms Steam Frame into a more versatile device capable of detailed environmental awareness and immersive media playback. This upgrade appeals to users interested in AR applications, content creation, and immersive viewing, broadening the headset’s potential beyond traditional gaming.

Moreover, the ability to capture and relive first-person 3D footage with tracked positioning opens new avenues for content creators, researchers, and developers. It enhances the realism and interactivity of VR experiences, providing tools for more accurate spatial recordings and immersive playback. While the camera introduces some trade-offs, such as limited battery life during extended use, its overall impact is a notable enhancement for the Steam Frame ecosystem.

Previous Limitations and the Evolution of Passthrough Technology

Originally, Steam Frame’s passthrough was limited to monochrome, grayscale images with a configurable tint, offering a sharper but less immersive view than newer headsets like Quest 3. Valve’s partnership with Arcturus Vision, which previously contributed to depth-correct 3D passthrough for the Index headset in 2020, has now resulted in a more advanced upgrade for Steam Frame. The new camera accessory builds on prior efforts to improve environmental awareness and mixed reality capabilities, aligning with industry trends seen in devices like Apple Vision Pro and Meta Quest, which emphasize high-resolution, color passthrough and spatial video recording.

This development follows Valve’s recent announcement of the Steam Frame’s pricing and features, including its bundled version of Half-Life: Alyx, now standalone-capable. The addition of Arcturus’s camera complements the headset’s existing features and addresses longstanding user requests for better environmental visibility and mixed reality content creation.

“The Arcturus Vision Camera significantly elevates Steam Frame’s mixed reality capabilities by adding true color passthrough and tracked 3D video recording.”

— an anonymous researcher

Technical Limitations and Compatibility Concerns

While the Arcturus Vision Camera introduces notable features, some aspects remain unclear. The device’s performance at higher refresh rates can exhibit flickering or banding under artificial lighting, as warned by Arcturus. Battery life during extended use may also be limited, potentially affecting usability for prolonged sessions. Compatibility with future software updates or other headsets is not yet confirmed, and user experiences may vary based on lighting conditions and environmental factors.

Upcoming Firmware Updates and User Feedback

Valve and Arcturus plan to release firmware updates that optimize the camera’s performance and address current limitations. User feedback from early adopters will likely influence further refinements, including improvements to stability, battery life, and visual quality. Additionally, developers may explore new applications leveraging the tracked 3D video capture, expanding the utility of the device for professional and creative use cases. The community can expect ongoing updates over the coming months.

Key Questions

How does the color passthrough compare to other headsets?

The Arcturus Vision Camera offers 6MP per eye in full resolution, providing richer color and detail compared to Quest 2’s grayscale passthrough and matching or exceeding Quest Pro’s grayscale resolution. It approaches the clarity of Quest 3’s true color but at a lower resolution and frame rate.

Will the camera affect the battery life of Steam Frame?

Yes, activating the Arcturus Vision Camera impacts battery life, especially during extended use. Users may experience reduced runtime, which is a tradeoff for the enhanced visual capabilities.

Can the tracked stereoscopic videos be shared or edited easily?

Captured videos can be converted for playback on other VR headsets using Arcturus’s Sync tool, but advanced editing and processing require external open-source tools and a Linux workstation with an Nvidia GPU.

Is the device compatible with future software updates?

Compatibility with future updates is not yet confirmed, but Valve and Arcturus have indicated ongoing support and potential improvements based on user feedback.

Does the camera add significant weight or bulk to the headset?

The Arcturus Vision Camera weighs just 10 grams, making it a lightweight addition that minimally affects the headset’s comfort or form factor.

Source: UploadVR