Dynamic Trees for Learning and Design
Matthew A. Taddy, Robert B. Gramacy, and Nicholas G. Polson

TL;DR
This paper introduces dynamic regression trees with particle learning algorithms for efficient online inference, enabling adaptive modeling in regression, classification, and sequential experiment design with improved performance and lower computational cost.
Contribution
It presents a novel sequential tree model with particle filtering for online learning, allowing dynamic adaptation and uncertainty quantification in regression and classification tasks.
Findings
Outperforms standard methods in nonparametric regression examples.
Effective in sequential experiment design, including active learning and optimization.
Provides a computationally efficient approach for online inference with dynamic trees.
Abstract
Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the accumulation of new data, and provide particle learning algorithms that allow for the efficient on-line posterior filtering of tree-states. A major advantage of tree regression is that it allows for the use of very simple models within each partition. The model also facilitates a natural division of labor in our sequential particle-based inference: tree dynamics are defined through a few potential changes that are local to each newly arrived observation, while global uncertainty is captured by the ensemble of particles. We consider both constant and linear mean functions at the tree leaves, along with multinomial leaves for classification problems, and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGaussian Processes and Bayesian Inference · Statistics Education and Methodologies · Machine Learning and Algorithms
