A Comparison of Decision Forest Inference Platforms from A Database Perspective
Hong Guan, Mahidhar Reddy Dwarampudi, Venkatesh Gunda, Hong Min, Lei, Yu, Jia Zou

TL;DR
This paper compares various decision forest inference platforms, including in-database solutions, to evaluate their performance and identify optimal use cases, revealing that in-database inference can significantly outperform external frameworks in specific scenarios.
Contribution
The study provides a comprehensive performance comparison of multiple decision forest inference frameworks and introduces an in-database inference framework, netsDB, with novel optimizations.
Findings
netsDB excels with small models on large datasets and all models on small datasets.
Relation-centric representation boosts large-scale model performance.
Model reuse optimization enhances small-scale dataset performance.
Abstract
Decision forest, including RandomForest, XGBoost, and LightGBM, is one of the most popular machine learning techniques used in many industrial scenarios, such as credit card fraud detection, ranking, and business intelligence. Because the inference process is usually performance-critical, a number of frameworks were developed and dedicated for decision forest inference, such as ONNX, TreeLite from Amazon, TensorFlow Decision Forest from Google, HummingBird from Microsoft, Nvidia FIL, and lleaves. However, these frameworks are all decoupled with data management frameworks. It is unclear whether in-database inference will improve the overall performance. In addition, these frameworks used different algorithms, optimization techniques, and parallelism models. It is unclear how these implementations will affect the overall performance and how to make design decisions for an in-database…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImbalanced Data Classification Techniques · Data Quality and Management · Machine Learning and Data Classification
