Eigen Memory Trees
Mark Rucker, Jordan T. Ash, John Langford, Paul Mineiro, Ida, Momennejad

TL;DR
The paper introduces Eigen Memory Trees, an efficient online memory model for sequential learning that outperforms existing methods by routing data through a binary tree using principal components, validated on numerous datasets.
Contribution
It presents the Eigen Memory Tree, a novel data structure for online learning that improves memory access efficiency and performance over prior approaches.
Findings
Outperforms existing online memory models.
Validated on 206 datasets from OpenML.
Hybrid EMT-parametric algorithm shows significant improvements.
Abstract
This work introduces the Eigen Memory Tree (EMT), a novel online memory model for sequential learning scenarios. EMTs store data at the leaves of a binary tree and route new samples through the structure using the principal components of previous experiences, facilitating efficient (logarithmic) access to relevant memories. We demonstrate that EMT outperforms existing online memory approaches, and provide a hybridized EMT-parametric algorithm that enjoys drastically improved performance over purely parametric methods with nearly no downsides. Our findings are validated using 206 datasets from the OpenML repository in both bounded and infinite memory budget situations.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsData Stream Mining Techniques · Machine Learning and Data Classification · Domain Adaptation and Few-Shot Learning
