Beyond LunAR: An augmented reality UI for deep-space exploration missions

TL;DR

This paper presents an augmented reality user interface designed for deep-space exploration missions, enabling astronauts to perform complex tasks independently with AR-based instructions and telemetry displays, reducing reliance on Earth-based support.

Contribution

The paper introduces a novel AR UI prototype for the xEMU spacesuit that facilitates autonomous task execution and communication for astronauts on planetary surfaces.

Findings

AR UI improves task completion efficiency

Enhanced astronaut independence demonstrated

Supports real-time telemetry monitoring

Abstract

As space exploration efforts shift to deep space missions, new challenges emerge regarding astronaut communication and task completion. While the round trip propagation delay for lunar communications is 2.6 seconds, the time delay increases to nearly 22 minutes for Mars missions. This creates a need for astronaut independence from earth-based assistance, and places greater significance upon the limited communications that are able to be delivered. To address this issue, we prototyped an augmented reality user interface for the new xEMU spacesuit, intended for use on planetary surface missions. This user interface assists with functions that would usually be completed by flight controllers in Mission Control, or are currently completed in manners that are unnecessarily difficult. We accomplish this through features such as AR model-based task instruction, sampling task assistance, note taking, and telemetry monitoring and display.