Human-AI Interaction Design in Machine Teaching

TL;DR

This paper explores the design of human-AI interaction in machine teaching systems, emphasizing how interface design impacts teaching efficiency and machine learning performance through a Socratic dialogue approach.

Contribution

It provides a framework for designing the teaching interface in machine teaching systems, building on previous work and highlighting key design decisions.

Findings

Interaction design influences teaching efficiency

Design choices affect machine learning performance

Framework guides development of teaching interfaces

Abstract

Machine Teaching (MT) is an interactive process where a human and a machine interact with the goal of training a machine learning model (ML) for a specified task. The human teacher communicates their task expertise and the machine student gathers the required data and knowledge to produce an ML model. MT systems are developed to jointly minimize the time spent on teaching and the learner's error rate. The design of human-AI interaction in an MT system not only impacts the teaching efficiency, but also indirectly influences the ML performance by affecting the teaching quality. In this paper, we build upon our previous work where we proposed an MT framework with three components, viz., the teaching interface, the machine learner, and the knowledge base, and focus on the human-AI interaction design involved in realizing the teaching interface. We outline design decisions that need to be addressed in developing an MT system beginning from an ML task. The paper follows the Socratic method entailing a dialogue between a curious student and a wise teacher.