
TL;DR
This paper introduces a geometric decision tree algorithm that uses clustering hyperplanes and their angle bisectors to better capture data structure, resulting in smaller trees and improved performance.
Contribution
The paper proposes a novel method for learning oblique decision trees using geometric clustering hyperplanes and their angle bisectors, addressing limitations of impurity-based approaches.
Findings
Leads to smaller decision trees
Achieves better classification performance
Provides a principled geometric optimization framework
Abstract
In this paper we present a new algorithm for learning oblique decision trees. Most of the current decision tree algorithms rely on impurity measures to assess the goodness of hyperplanes at each node while learning a decision tree in a top-down fashion. These impurity measures do not properly capture the geometric structures in the data. Motivated by this, our algorithm uses a strategy to assess the hyperplanes in such a way that the geometric structure in the data is taken into account. At each node of the decision tree, we find the clustering hyperplanes for both the classes and use their angle bisectors as the split rule at that node. We show through empirical studies that this idea leads to small decision trees and better performance. We also present some analysis to show that the angle bisectors of clustering hyperplanes that we use as the split rules at each node, are solutions of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
