Strategies to Manage Human Factors in Mixed Reality Pilot Training: A Survey

TL;DR

This survey reviews human factors challenges in mixed reality pilot training, focusing on mitigation strategies for cybersickness, fatigue, and ergonomic issues, and evaluates their regulatory feasibility to enhance training safety and effectiveness.

Contribution

It systematically analyzes existing mitigation strategies for human factors in MR pilot training within regulatory frameworks, guiding practical implementation and policy development.

Findings

Identification of key human factors challenges in MR pilot training

Evaluation of hardware, software, and ergonomic interventions

Insights into regulatory considerations for implementing mitigation strategies

Abstract

Mixed Reality (MR) head mounted displays (HMDs) offer a promising alternative to traditional Flight Simulator Training Device (FSTD) displays, providing immersion, realism and cost efficiency. However, these technologies require management of human factors; cybersickness, visual fatigue and ergonomic strain. If left unmitigated, these effects can hinder pilot performance and training outcomes. For safety critical fields like aviation, addressing human factors challenges is crucial for MR's training potential. This survey systematically reviews the current literature identifying key human factors challenges in MR HMD use in pilot training and examines strategies to mitigate these barriers. Drawing on existing industry standards set by a leading aviation authority, the review adopts a regulatory perspective to explore hardware, software, ergonomic, physiological and psychological interventions improving pilot comfort, safety and training effectiveness in an MR FSTD. Additionally, it evaluates which of these interventions are most appropriate and viable for MR pilot training under existing aviation training regulations, ensuring that technical requirements and pilot wellbeing remain balanced. The findings yield significant insights for the human dimensions of aviation simulation training, highlighting how regulatory considerations shape the practicality of mitigation measures. These insights inform emerging MR aviation training guidelines and best practices, supporting MR's readiness to enhance aviation training.