Mixed Reality Crew Assistance (MRCA)

Images paired to demonstrate concept of one person authoring work on the ground while another uses the playback capabilities of MRCA onboard the ISS

The goal of this project is to create mixed reality tools that enhance operational procedures by augmenting what the crew sees and hears while performing a task.

Over the next decades, NASA wants to open the boundaries to human exploration of space, expanding our presence well beyond low-Earth orbit to advance exploration, science, innovation, benefits to humanity, and international collaboration. To achieve its deep space exploration goals, NASA needs to maximize crew efficiency and safety. New mixed reality technologies have the potential to help the agency meet this objective by reducing time needed for crew training and task execution.

The goal of the Mixed Reality Crew Assistance project is to create mixed reality tools that enhance operational procedures by augmenting what the crew sees and hears while performing a task. Specific project objectives toward creating and fielding these tools include:

  • Model alignment: Aligning and rendering instructional holographic animations on top of the equipment relevant to a task
  • Authoring & playback: Enabling task experts to efficiently author and revise holographic instructions
  • Object recognition: Automatic recognition of objects relevant to a procedure

The key deliverable of this project is a software system ready for testing and use in support of Earth-based personnel training and onboard ISS.

Project Manager Principal Technologist
Victor Luo (victor.luo@jpl.nasa.gov Kimberly Hambuchen (kimberly.a.hambuchen@nasa.gov)