The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond
Abigail Sellen, Eric Horvitz

TL;DR
This paper advocates for designing AI systems as collaborative co-pilots that enhance human oversight and engagement, drawing lessons from aviation to prevent over-reliance and skill erosion in AI-human partnerships.
Contribution
It introduces a design framework emphasizing active human control and oversight in AI systems, inspired by aviation safety principles, to foster effective human-AI collaboration.
Findings
Highlighting risks of automation over-reliance
Proposing design principles for human-centered AI interaction
Emphasizing the importance of human oversight in AI systems
Abstract
The fast pace of advances in AI promises to revolutionize various aspects of knowledge work, extending its influence to daily life and professional fields alike. We advocate for a paradigm where AI is seen as a collaborative co-pilot, working under human guidance rather than as a mere tool. Drawing from relevant research and literature in the disciplines of Human-Computer Interaction and Human Factors Engineering, we highlight the criticality of maintaining human oversight in AI interactions. Reflecting on lessons from aviation, we address the dangers of over-relying on automation, such as diminished human vigilance and skill erosion. Our paper proposes a design approach that emphasizes active human engagement, control, and skill enhancement in the AI partnership, aiming to foster a harmonious, effective, and empowering human-AI relationship. We particularly call out the critical need…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman-Automation Interaction and Safety · Ethics and Social Impacts of AI
