When learning analytics dashboard is explainable: An exploratory study on the effect of GenAI-supported learning analytics dashboard
Angxuan Chen

TL;DR
This study explores how an explainable learning analytics dashboard, grounded in SRL and XAI principles, influences students' understanding and collaboration in academic writing with AI, showing deeper learning benefits.
Contribution
It introduces a theory-driven, explainable LAD design and empirically evaluates its impact on students' conceptual understanding in AI-supported academic writing.
Findings
Students using the explainable LAD showed better grasp of writing principles.
No significant difference in abstract quality between groups.
Explainable feedback enhances deeper learning and skill transfer.
Abstract
This study investigated the impact of a theory-driven, explainable Learning Analytics Dashboard (LAD) on university students' human-AI collaborative academic abstract writing task. Grounded in Self-Regulated Learning (SRL) theory and incorporating Explainable AI (XAI) principles, our LAD featured a three-layered design (Visual, Explainable, Interactive). In an experimental study, participants were randomly assigned to either an experimental group (using the full explainable LAD) or a control group (using a visual-only LAD) to collaboratively write an academic abstract with a Generative AI. While quantitative analysis revealed no significant difference in the quality of co-authored abstracts between the two groups, a significant and noteworthy difference emerged in conceptual understanding: students in the explainable LAD group demonstrated a superior grasp of abstract writing…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsInnovative Teaching and Learning Methods · Intelligent Tutoring Systems and Adaptive Learning · Online Learning and Analytics
