Robust Speech-Workload Estimation for Intelligent Human-Robot Systems

TL;DR

This paper introduces a real-time algorithm for estimating speech workload in human-robot systems, aiming to improve task performance by adapting system demands based on workload states.

Contribution

The paper presents a novel real-time speech workload estimation algorithm that is generalizable across individuals and human-machine teaming scenarios.

Findings

The algorithm accurately estimates speech workload in real-time.

It demonstrates robustness across different individuals.

It enables adaptive modulation of system demands.

Abstract

Demanding task environments (e.g., supervising a remotely piloted aircraft) require performing tasks quickly and accurately; however, periods of low and high operator workload can decrease task performance. Intelligent modulation of the system's demands and interaction modality in response to changes in operator workload state may increase performance by avoiding undesirable workload states. This system requires real-time estimation of each workload component (i.e., cognitive, physical, visual, speech, and auditory) to adapt the correct modality. Existing workload systems estimate multiple workload components post-hoc, but few estimate speech workload, or function in real-time. An algorithm to estimate speech workload and mitigate undesirable workload states in real-time is presented. An analysis of the algorithm's accuracy is presented, along with the results demonstrating the algorithm's generalizability across individuals and human-machine teaming paradigms. Real-time speech workload estimation is a crucial element towards developing adaptive human-machine systems.