AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Empire At Sea is a new 22-minute immersive drama using shared mixed reality technology, premiering at Venice Immersive. It allows multiple viewers to interact with volumetrically captured actors around a physical table. The project blends science fiction with participatory storytelling, with future platform plans announced.

Empire At Sea, a shared mixed reality drama utilizing Apple Vision Pro technology, has debuted at Venice Immersive, part of the 83rd Venice International Film Festival. The 22-minute production features volumetrically captured actors and allows multiple viewers to participate around a physical table, marking a significant step in immersive storytelling. The project’s premiere highlights advancements in participatory AR experiences and the integration of live actors into interactive narratives, making it a notable development for the future of immersive media.

The production, directed by Peter Flaherty, is set in a solarpunk sci-fi universe where a group of climate scientists attempts to build a sustainable community at sea after a catastrophic disaster isolates them from the mainland. The story unfolds five years later, when a young woman named Lani spots a boat on the horizon, prompting a critical decision for the community: whether to welcome outsiders or remain isolated. The narrative is designed to branch based on participant choices, with ten viewers able to move around a physical LED table and influence the story through their perspectives.

Actors, including Orlando Jones, Ayelet Zurer, Geoffrey Arend, Beth Grant, Imani Jade Powers, and Mary Chieffo, were volumetrically captured for the experience, which uses technology from 4DV.ai. The production’s setup involves passthrough mixed reality, blending virtual actors into the physical scene in real-time, allowing viewers to interact with and move around volumetric performances. The experience was commissioned by Lincoln Center and ASU Gammage, with plans to extend beyond Venice to other venues and platforms, including VR headsets and mobile devices, though specific release details remain undisclosed.

At a glance
reportWhen: premiered September 2023 at Venice Imme…
The developmentEmpire At Sea, a shared mixed reality drama, premieres at Venice Immersive, featuring volumetric actors and interactive storytelling on Apple Vision Pro.
Empire At Sea Brings A Shared Mixed Reality Drama To Venice Immersive
Venice Immersive · 83rd Venice International Film Festival

Empire At Sea Brings A Shared Mixed Reality Drama To Venice

A 22-minute participatory drama built on Apple Vision Pro technology debuts at Venice Immersive, letting ten viewers move around a physical table and shape a branching story alongside volumetrically captured actors — a landmark step for immersive storytelling.

22 min
Runtime of the immersive drama
10 viewers
Participants per shared session
6 actors
Volumetrically captured performances
2023
Venice Immersive premiere
2027
Lincoln Center screening
4DV.ai
Volumetric capture tech
Live + MR
Passthrough hybrid format
01

A Solarpunk Drama With Branching Choices

Directed by Peter Flaherty, Empire At Sea unfolds in a solarpunk sci-fi universe: after a catastrophic disaster cuts them off from the mainland, a group of climate scientists builds a sustainable community at sea. Five years later, a young woman named Lani spots a boat on the horizon — and the community faces a defining decision.

Setting · Solarpunk

A Community Adrift

Climate scientists attempt to build a sustainable ocean society after catastrophe isolates them from the mainland — a hopeful, eco-driven sci-fi vision.

Inciting Incident

A Boat On The Horizon

Five years on, Lani spots an approaching vessel. The community must choose: welcome the outsiders, or preserve their isolation.

Format · Participatory

The Audience Decides

The narrative branches based on participant choices, with ten viewers moving around a physical LED table and influencing the story through their perspectives.

02

How The Shared Experience Works

Passthrough mixed reality blends virtual actors into the physical scene in real time — a notable evolution from single-user VR toward multi-user, social, collaborative environments.

1

Performances Captured

Actors are volumetrically captured using technology from 4DV.ai.

2

Viewers Suited Up

Ten participants wear Apple Vision Pro headsets around a physical LED table.

3

Worlds Merge

Passthrough MR blends volumetric actors into the physical scene in real time.

4

Story Branches

Viewers’ movements, perspectives, and choices steer the branching narrative.

03

Cast, Creators & The Road Ahead

Orlando JonesVolumetric cast
Ayelet ZurerVolumetric cast
Geoffrey ArendVolumetric cast
Beth GrantVolumetric cast
Imani Jade PowersVolumetric cast
Mary ChieffoVolumetric cast
Venice Immersive
Sept 2023 · Premiere
Commissioned By
Lincoln Center · ASU Gammage
Next Venue
Lincoln Center · Jan 2027
Home Platforms
VR & mobile · TBA
04

Key Questions, Answered

QuestionAnswer
What is Empire At Sea?A 22-minute immersive drama combining mixed reality, volumetric actors, and participatory storytelling, premiering at Venice Immersive.
How does the shared experience work?Multiple viewers wear Apple Vision Pro headsets, gather around a physical LED table, and interact with volumetrically captured actors integrated into the scene — influencing the story through movement and choices.
Will it be available outside Venice?Yes. Screenings at Lincoln Center in early 2027 and versions for VR headsets and mobile phones are planned, though specific release details remain unconfirmed.
What makes it different?It is one of the first shared mixed reality dramas letting multiple participants influence and experience a branching narrative in real time, blending physical and virtual elements.
Who are the key creators?Directed by Peter Flaherty, with a cast including Orlando Jones and Ayelet Zurer, and volumetric capture technology from 4DV.ai.
Director’s Track Record

Peter Flaherty previously created the AR project The Dial (Sundance 2019) and contributed to Marvel Studios and Disney’s Eternals AR initiatives. Immersive works are now prominent at Sundance, Venice, and Cannes.

05

Unconfirmed Details

The exact VR headsets and mobile devices that will support Empire At Sea beyond Venice have not been announced. It remains unclear whether at-home availability will be immediate or venue-limited at first, and the long-term distribution strategy is still unconfirmed.

Why It Matters

By enabling multiple viewers to influence and experience a story simultaneously, Empire At Sea pushes the boundaries of traditional media — offering a glimpse of future entertainment formats that blend live actors, augmented reality, and interactive choice. Industry observers will be watching whether it paves the way for mainstream shared mixed reality storytelling.

Implications of Shared Mixed Reality in Storytelling

This project exemplifies a significant shift toward participatory, immersive narratives that combine physical and virtual elements, expanding the potential for audience engagement in storytelling. By enabling multiple viewers to influence and experience a story simultaneously, Empire At Sea pushes the boundaries of traditional media, offering a glimpse into future entertainment formats that blend live actors, augmented reality, and interactive choice. Its premiere at Venice Immersive underscores the growing importance of immersive technology in the arts and entertainment sectors, potentially influencing how stories are created and consumed in the coming years.

Amazon

Apple Vision Pro mixed reality headset

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Advancements in Immersive and Mixed Reality Media

Recent years have seen rapid development in immersive storytelling, with projects utilizing VR, AR, and volumetric capture gaining prominence at major festivals like Sundance, Venice, and Cannes. Director Peter Flaherty has previously worked on AR projects such as The Dial, shown at Sundance in 2019, and contributed to Marvel Studios and Disney’s Eternals AR initiatives. The current project, Empire At Sea, builds on these technological advancements by integrating shared mixed reality, allowing multiple participants to engage with virtual characters within a physical setting. This marks a notable evolution from single-user VR experiences to multi-user, interactive environments that foster social engagement and collaborative storytelling.

Amazon

volumetric actor capture device

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unconfirmed Details About Platform and Distribution

Specific details about the platforms beyond Venice, such as the exact VR headsets or mobile devices that will support Empire At Sea, have not yet been announced. It is also unclear whether the experience will be available for at-home use immediately or if it will be limited to select venues initially. Additionally, the long-term distribution strategy and whether similar shared mixed reality projects will become more common remain unconfirmed.

Amazon

shared mixed reality experience

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Future Screenings and Platform Releases Planned

Following its Venice premiere, Empire At Sea is scheduled to be shown at Lincoln Center in January 2027. The creators have indicated plans to develop versions for VR headsets and mobile phones to reach at-home audiences, but specific platform details and release timelines are still pending. Industry observers will be watching whether this project paves the way for broader adoption of shared mixed reality storytelling in mainstream entertainment.

Amazon

interactive immersive storytelling VR

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

What is Empire At Sea?

Empire At Sea is a 22-minute immersive drama that combines mixed reality, volumetric actors, and participatory storytelling, premiering at Venice Immersive.

How does the shared mixed reality experience work?

Multiple viewers wear Apple Vision Pro headsets, gather around a physical LED table, and interact with volumetrically captured actors integrated into the scene, influencing the story through their movements and choices.

Will Empire At Sea be available to the public outside Venice?

Yes, plans include screenings at Lincoln Center in early 2027 and versions for VR headsets and mobile phones, though specific release details are not yet confirmed.

What makes this project different from other immersive media?

It is one of the first shared mixed reality dramas allowing multiple participants to influence and experience a branching narrative in real time, blending physical and virtual elements.

Who are the key creators behind Empire At Sea?

Directed by Peter Flaherty, the project features a cast including Orlando Jones and Ayelet Zurer, with volumetric capture technology from 4DV.ai.

Source: UploadVR

You May Also Like

Amplium Makes Room For A Wider Range Of Apple Immersive Video On Vision Pro

Amplium now supports a broader variety of immersive videos on Apple Vision Pro, improving discoverability for diverse content types and creators.

Gun Club VR & Dragon Fist: VR Kung Fu Are Quest's Horizon+ Monthly Games For July

Meta’s Horizon+ subscription now includes Gun Club VR, Dragon Fist: VR Kung Fu, and Phantom: Covert Ops for July, expanding its VR game catalog.

Pablo Hernández Backs Legislation To Boost Gaming And VR Jobs

Pablo Hernández Rivera supports new legislation aimed at promoting growth in gaming and virtual reality employment sectors, signaling policy focus on tech jobs.

Disney Song Pack Comes to ‘Trombone Champ’ VR in July, Including Toy Story & Little Mermaid Environments

Flat2VR Studios announces a Disney-themed DLC for Trombone Champ Unflattened, featuring six classic songs and new environments, arriving in July on all supported VR headsets.