MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems
Helen Hastie, Francisco J. Chiyah Garcia, David A. Robb, Pedro Patron, and Atanas Laskov
TL;DR
MIRIAM is a multimodal chat interface designed to enhance autonomous vehicle situation awareness by enabling interactive communication about plans, objectives, and events, including proactive alerts.
Contribution
It introduces a novel multimodal chat-based interface that supports proactive and reactive interactions for autonomous systems, improving user understanding and control.
Findings
Demonstrated integration with SeeByte's SeeTrack interface
Enabled proactive communication of key events
Improved situation awareness through multimodal interaction
Abstract
We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.