Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors

TL;DR

Generative Lecture introduces an interactive AI-enhanced lecture video system that allows students to ask questions and receive personalized explanations through AI clone instructors and avatars, improving engagement and learning.

Contribution

The paper presents a novel system integrating AI clone instructors and avatars into lecture videos, enabling interactive, personalized learning experiences based on user feedback and design goals.

Findings

System enables effective two-way communication.

Supports personalized explanations and interactive features.

User study shows improved engagement and usability.

Abstract

We introduce Generative Lecture, a concept that makes existing lecture videos interactive through generative AI and AI clone instructors. By leveraging interactive avatars powered by HeyGen, ElevenLabs, and GPT-5, we embed an AI instructor into the video and augment the video content in response to students' questions. This allows students to personalize the lecture material, directly ask questions in the video, and receive tailored explanations generated and delivered by the AI-cloned instructor. From a design elicitation study (N=8), we identified four goals that guided the development of eight system features: 1) on-demand clarification, 2) enhanced visuals, 3) interactive example, 4) personalized explanation, 5) adaptive quiz, 6) study summary, 7) automatic highlight, and 8) adaptive break. We then conducted a user study (N=12) to evaluate the usability and effectiveness of the system and collected expert feedback (N=5). The results suggest that our system enables effective two-way communication and supports personalized learning.