Generative Lecture: Making Lecture Videos Interactive with LLMs and AI Clone Instructors
Hye-Young Jo, Ada Yi Zhao, Xiaoan Liu, Ryo Suzuki

TL;DR
Generative Lecture introduces an interactive AI-enhanced lecture video system that allows students to ask questions and receive personalized explanations through AI clone instructors and avatars, improving engagement and learning.
Contribution
The paper presents a novel system integrating AI clone instructors and avatars into lecture videos, enabling interactive, personalized learning experiences based on user feedback and design goals.
Findings
System enables effective two-way communication.
Supports personalized explanations and interactive features.
User study shows improved engagement and usability.
Abstract
We introduce Generative Lecture, a concept that makes existing lecture videos interactive through generative AI and AI clone instructors. By leveraging interactive avatars powered by HeyGen, ElevenLabs, and GPT-5, we embed an AI instructor into the video and augment the video content in response to students' questions. This allows students to personalize the lecture material, directly ask questions in the video, and receive tailored explanations generated and delivered by the AI-cloned instructor. From a design elicitation study (N=8), we identified four goals that guided the development of eight system features: 1) on-demand clarification, 2) enhanced visuals, 3) interactive example, 4) personalized explanation, 5) adaptive quiz, 6) study summary, 7) automatic highlight, and 8) adaptive break. We then conducted a user study (N=12) to evaluate the usability and effectiveness of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIntelligent Tutoring Systems and Adaptive Learning · Visual and Cognitive Learning Processes · Teaching and Learning Programming
