AI Meets Maritime Training: Precision Analytics for Enhanced Safety and Performance

TL;DR

This paper presents an AI-driven framework that objectively assesses maritime trainees' performance using visual focus, speech, and stress analysis, enhancing safety and training effectiveness in high-risk scenarios.

Contribution

It introduces a novel AI system integrating eye tracking, speech recognition, and stress detection to improve maritime training assessments.

Findings

Achieved ~92% accuracy in visual focus detection

Achieved ~91% accuracy in maritime speech recognition

Achieved ~90% accuracy in stress detection

Abstract

Traditional simulator-based training for maritime professionals is critical for ensuring safety at sea but often depends on subjective trainer assessments of technical skills, behavioral focus, communication, and body language, posing challenges such as subjectivity, difficulty in measuring key features, and cognitive limitations. Addressing these issues, this study develops an AI-driven framework to enhance maritime training by objectively assessing trainee performance through visual focus tracking, speech recognition, and stress detection, improving readiness for high-risk scenarios. The system integrates AI techniques, including visual focus determination using eye tracking, pupil dilation analysis, and computer vision; communication analysis through a maritime-specific speech-to-text model and natural language processing; communication correctness using large language models; and mental stress detection via vocal pitch. Models were evaluated on data from simulated maritime scenarios with seafarers exposed to controlled high-stress events. The AI algorithms achieved high accuracy, with ~92% for visual detection, ~91% for maritime speech recognition, and ~90% for stress detection, surpassing existing benchmarks. The system provides insights into visual attention, adherence to communication checklists, and stress levels under demanding conditions. This study demonstrates how AI can transform maritime training by delivering objective performance analytics, enabling personalized feedback, and improving preparedness for real-world operational challenges.