Convex Polytope Trees
Mohammadreza Armandpour, Mingyuan Zhou

TL;DR
Convex Polytope Trees (CPT) extend decision trees by using convex polytopes for decision boundaries, improving interpretability and efficiency in classification and regression tasks.
Contribution
This paper introduces CPT, a novel decision tree model using convex polytopes for splits, with a Bayesian approach for simpler boundaries and scalable training algorithms.
Findings
CPT outperforms existing decision trees in accuracy and interpretability.
Efficient greedy and end-to-end training algorithms for CPT.
Demonstrated effectiveness on diverse real-world datasets.
Abstract
A decision tree is commonly restricted to use a single hyperplane to split the covariate space at each of its internal nodes. It often requires a large number of nodes to achieve high accuracy, hurting its interpretability. In this paper, we propose convex polytope trees (CPT) to expand the family of decision trees by an interpretable generalization of their decision boundary. The splitting function at each node of CPT is based on the logical disjunction of a community of differently weighted probabilistic linear decision-makers, which also geometrically corresponds to a convex polytope in the covariate space. We use a nonparametric Bayesian prior at each node to infer the community's size, encouraging simpler decision boundaries by shrinking the number of polytope facets. We develop a greedy method to efficiently construct CPT and scalable end-to-end training algorithms for the tree…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsMachine Learning and Data Classification · Bayesian Modeling and Causal Inference · Explainable Artificial Intelligence (XAI)
