A Hierarchical Probabilistic Framework for Incremental Knowledge Tracing in Classroom Settings
Xinyi Gao, Qiucheng Wu, Yang Zhang, Xuechen Liu, Kaizhi Qian, Ying Xu, Shiyu Chang

TL;DR
This paper introduces KT$^2$, a hierarchical probabilistic framework for knowledge tracing that effectively models student learning in low-resource classroom settings with online updates.
Contribution
We propose KT$^2$, a novel hierarchical probabilistic model using a tree structure and EM algorithm for incremental knowledge tracing in low-resource environments.
Findings
KT$^2$ outperforms baseline models in low-resource online settings.
The hierarchical structure improves knowledge estimation accuracy.
Incremental updates enable real-time student performance prediction.
Abstract
Knowledge tracing (KT) aims to estimate a student's evolving knowledge state and predict their performance on new exercises based on performance history. Many realistic classroom settings for KT are typically low-resource in data and require online updates as students' exercise history grows, which creates significant challenges for existing KT approaches. To restore strong performance under low-resource conditions, we revisit the hierarchical knowledge concept (KC) information, which is typically available in many classroom settings and can provide strong prior when data are sparse. We therefore propose Knowledge-Tree-based Knowledge Tracing (KT), a probabilistic KT framework that models student understanding over a tree-structured hierarchy of knowledge concepts using a Hidden Markov Tree Model. KT estimates student mastery via an EM algorithm and supports personalized…
Peer Reviews
Decision·ICLR 2026 Conference Withdrawn Submission
1. The paper addresses a practical problem: performing KT under low-resource and online settings. 2. The model formulation is mathematically consistent and clearly presented, with interpretable structure. 3. The use of a hierarchical KC tree adds intuitive interpretability compared to flat KT baselines.
1. While the model is conceptually clear, some assumptions—such as deterministic parent-to-child mastery—might be too strong; relaxing them could further improve realism. The model assumes full entailment between parent and child KCs (“if parent mastered → all children mastered”), which is unrealistic and oversimplifies real learning dynamics. 2. The current experiments rely on simulated subsets of existing datasets; validation on live classroom or streaming data would better demonstrate real-wo
The paper is well written. The proposed approach is elegant and does not require heavy computation nor a GPU. It seems to outperform existing approaches. I enjoyed reading the paper, didn't believe the results at first read, then I understood that the proposed approach results in extra runtime as there is refitting at test time.
However, there is a large body of literature that seems missing from the paper. The authors mostly compare themselves to deep learning approaches and not simpler approaches. For example, this paper uses a hierarchical Bayesian network that is refitted on new observations, and matches the performance of DKT: Wilson, Kevin H., et al. "Back to the Basics: Bayesian Extensions of IRT Outperform Neural Networks for Proficiency Estimation." International Educational Data Mining Society (2016). https:
Nice figures. The method writing is clear, though the formality of the notations could be improved. The motivation is valid, in proposing a personalized graph for each student and considering online learning in KT, which hasn’t been extensively explored yet.
- I like the presentation overall; it is clear. However, I strongly recommend that the authors improve the writing. For example, 1) avoid overusing LLMs for paraphrasing; 2) I assume lines 98–102 belong to the same paragraph; 3) The subheadings in the related works section should either be formatted as subsection titles or end with a full stop. - What is gained beyond correlation graphs? Ths use of Hidden Markov Tree over KCs where each node’s mastery is a latent variable and has a hard entailm
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIntelligent Tutoring Systems and Adaptive Learning · Online Learning and Analytics · Innovative Teaching and Learning Methods
