Born-Again Tree Ensembles
Thibaut Vidal, Toni Pacheco, Maximilian Schiffer

TL;DR
This paper introduces a dynamic programming algorithm to create simplified, interpretable decision trees that replicate the behavior of complex tree ensembles, enhancing transparency without sacrificing accuracy.
Contribution
The paper presents a novel dynamic programming approach to construct minimal, exact reproductions of ensemble models as single decision trees, improving interpretability.
Findings
Optimal born-again trees are often simpler and more interpretable.
The algorithm effectively handles practical datasets.
Reproduces ensemble behavior exactly.
Abstract
The use of machine learning algorithms in finance, medicine, and criminal justice can deeply impact human lives. As a consequence, research into interpretable machine learning has rapidly grown in an attempt to better control and fix possible sources of mistakes and biases. Tree ensembles offer a good prediction quality in various domains, but the concurrent use of multiple trees reduces the interpretability of the ensemble. Against this background, we study born-again tree ensembles, i.e., the process of constructing a single decision tree of minimum size that reproduces the exact same behavior as a given tree ensemble in its entire feature space. To find such a tree, we develop a dynamic-programming based algorithm that exploits sophisticated pruning and bounding rules to reduce the number of recursive calls. This algorithm generates optimal born-again trees for many datasets of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsExplainable Artificial Intelligence (XAI) · Machine Learning and Data Classification · Adversarial Robustness in Machine Learning
MethodsPruning · Interpretability
