LearnMate^2: Design and Evaluation of an LLM-powered Personalized and Adaptive Support System for Online Learning

TL;DR

LearnMate^2 is an LLM-powered system designed to provide personalized, adaptive support for online learners, improving outcomes and user experience through tailored guidance and activities.

Contribution

This paper introduces LearnMate^2, a novel LLM-based platform that offers personalized study plans and adaptive learning support, demonstrating improved learning outcomes.

Findings

LearnMate^2 enhances learning outcomes compared to existing tools.

User experience with LearnMate^2 is significantly improved.

The system effectively supports personalized and adaptive online learning.

Abstract

Personalization is crucial for effective learning, yet online learning, designed for widespread availability and open access, lacks personalized guidance. Recent advancements in large language models (LLMs) offer opportunities to bridge this gap. We explore how LLM-driven tools may be designed to support personalized and adaptive learning and examine how they shape user experience and learning outcomes. We iteratively designed \tool{} to support online learning by providing personalized study plans, real-time contextual assistance, and adaptive learning activities. A preliminary study ($n=24$) assessed the effectiveness and usability of \tool{} and informed refinements in our system, which we then evaluated ($n = 16$) against a combination of a state-of-the-art online learning platform and an LLM for learning support. Results indicate that \tool{} advances AI pedagogy by improving both learning outcomes and user experience compared to existing online learning and support tools. This work advances our understanding of the design space of personalized, AI-driven educational tools and their potential impact on user experience.