NASA Mars Mission 2030: 4D Volumetric Medical Training | Radiant Images Case Study
RADIANT IMAGES
www.radiantimages.com
Case Study / NASA × Harvard Medical School

4D medical training for NASA Mission to Mars 2030

Radiant Images partnered with Harvard Medical School's STRATUS Center for Medical Simulation on a NASA-funded program to reinvent astronaut medical training for the 2030 Mars mission. With a one-way communication delay of up to 20 minutes, a crew in deep space must manage a medical emergency without live help from Earth. Volumetric video and photogrammetry turn real procedures into interactive 4D training a crew can carry with them.

Volumetric Capture Branching Narrative 4D Gaussian Splatting NASA × Harvard
140M+miles
140+ million miles from Earth on a Mars mission, beyond any real-time medical support
~20min
One-way communication delay, ruling out live guidance
1,000+days
Mission length a crew must stay medically ready for
40hrs
Total pre-flight medical training time
01

The challenge

What is at stake

On a Mars-class mission, a medical emergency has no safety net. The crew is up to 140 million miles from Earth, a round-trip message to Mission Control can take 40 minutes, and the mission lasts more than 1,000 days. Whatever happens, the crew must recognize it, decide, and act alone.

Today's gold standard is high-fidelity physical simulation. Harvard's STRATUS Center built a full-scale replica of the spacecraft medical bay, with a robotic patient, to rehearse the five highest-stakes emergencies a 28-expert NASA panel identified, from sudden cardiac arrest to penetrating eye injury. It works. But it cannot travel, and it cannot scale.

Why current training falls short

Simulation centers are costly and fixed. Physical centers are expensive to build and operate, learners must travel to them, and each new scenario can demand a new physical build.

E-learning lacks gravity. Screen-based modules and CGI avatars lack human realism, so learners never feel the importance and weight of the event they are training for.

No instructor in deep space. A crew in transit to Mars cannot bring the simulator or the staff who run it. The training has to travel with the crew and stand on its own.

02

Beyond NASA

Medical errors and serious adverse events are the third leading cause of death in the United States.

A substantial share of those deaths are preventable through effective training. That makes training quality a life-safety issue in every hospital, clinic, and field team on Earth, not just on a spacecraft. Yet the best training available today remains hard to reproduce and hard to scale.

The lesson reaches past medicine. Any team that must perform under pressure, from first responders and flight crews to energy and industrial safety teams, faces the same gap between reading about a crisis and living through one. Training that closes that gap saves lives everywhere.

03

The Radiant approach

Real capture, not AI generation

Radiant Images digitized the training itself. Photogrammetry rebuilt the full-scale spacecraft medical bay as a navigable digital double, and volumetric video captured real subject-matter performances of each emergency procedure. Nothing is generated by AI: every scenario is a true 4D recording of real people, preserving every nuance of human behavior, urgency, and realism.

The captured assets become branching-narrative scenarios. The trainee's clinical decisions determine what happens next, and the scenario worsens in real time if they fail to act. Learners move through the digital double with full freedom of movement, interact with the 4D assets, and view any moment from any position or perspective, including the point of view of the subject-matter experts themselves. With 4D Gaussian Splatting, they can review the event from any angle and any moment in time.

This is why it prevents errors where e-learning and text cannot. A manual tells a learner what to do; a volumetric scenario makes them do it. Standing inside a real captured emergency, with real people and real urgency, learners rehearse the exact decisions that fail under stress, and feel the weight of getting them wrong. What is practiced as lived experience returns as instinct in a real event, something no screen-based module or checklist can build.

01
Digitize the environment
Photogrammetry converts the full-scale spacecraft medical bay into a navigable digital double.
STRATUS CENTER, BOSTON
02
Capture the procedures
A four-person crew performs scripted medical emergencies on a multi-camera 4K volumetric stage, each performer captured as its own 4D asset.
VOLUMETRIC STAGE
03
Build the branches
Decision-based and time-based story paths, with a voice-activated SMART checklist as a real-time cognitive aid.
UNITY ENGINE
04
Deploy anywhere
One build runs on desktop, immersive VR headset, and mixed-reality holographic headset.
3 MODALITIES
 

The training experience

Watch: Holographic medical training built for NASA's 2030 Mars mission, captured and assembled by Radiant Images.
 

The capture

Fixed volumetric camera array capturing a medical procedure
The volumetric camera array capturing the medical procedures, every camera seeing the same instant.
Crew member attending to a patient during a medical emergency scenario
A crew member responds to a medical emergency scenario on the training stage.
Close-up of a crew member's NASA patch and American flag patch
Every detail survives the capture: the crew member's NASA patch and American flag in full volumetric detail.
Inside the spacecraft medical bay capsule replica
Inside the full-scale replica of the spacecraft's medical bay, rebuilt as a digital double through photogrammetry.
Reviewing a captured medical training scenario on a tablet
Reviewing a captured training scenario on a tablet inside a spaceflight training environment.
04

The system

100%real
Captured from real subject-matter performances. No AI-generated video, so every human nuance survives into the training
6DoF
Full freedom of movement: learners navigate the digital double and interact with the 4D assets instead of watching a fixed recording
AnyPOV
Unlimited views from any position or perspective, including the point of view of the subject-matter experts themselves
SMARTchecklist
A voice-activated cognitive aid: saying "SMART, I need help" guides the learner through the emergency with audio and visual prompts built on validated clinical protocols, so guidance is there the moment it is needed
Branchingnarrative
Guides the learner through the story: clinical decisions drive what happens next, and time-based paths let the scenario worsen if they hesitate, building judgment under real pressure
Volumetricvideo
Real crew performances of each emergency captured in 4D, with every performer isolated as its own asset that can be recomposited into new scenario branches
05

The impact

Greater learner confidence

Astronauts rehearse the highest-stakes emergencies until the decisions feel familiar, with confidence and readiness measured through the program's evaluation framework covering engagement, cognitive workload, sense of presence, and decision performance.

Fewer procedural errors

Decision correctness and time to task completion are captured directly from platform metadata during simulated emergencies, so every training run shows exactly where judgment held and where it slipped.

A permanent 4D training library

Captured once, replayed without limit from any perspective and any moment in time. New learners train without traveling to a center, and new scenarios do not require new construction.

A blueprint for all high-stakes learning

The NASA work has already expanded into a healthcare training platform with Harvard Medical School and Brigham and Women's Hospital, with biometric-adaptive scenarios and AI-driven clinical guidance. The blueprint reaches further still: first responders, flight crews, defense, energy and industrial safety, and any field where a skill is best learned by doing can be captured in 4D and rehearsed anywhere.

Build training your team can trust in a crisis

From deep space to the operating room: if your team must perform under pressure without backup, Radiant Images can capture the training that keeps them ready.

RADIANT IMAGES
Radiant Images · Cinema. Immersive. Live. In every dimension. · www.radiantimages.com