Super learning in the SAS system

TL;DR

This paper introduces a super learning macro for SAS that performs comparably to the R package, enabling ensemble machine learning within SAS and integrating R packages for enhanced algorithm diversity.

Contribution

Development of a super learning macro in SAS that matches R package performance and extends ensemble learning capabilities within SAS environment.

Findings

SAS macro performs similarly to R package in simulations and datasets.

Macro leverages both SAS procedures and R packages for broader algorithm inclusion.

Super learning macro facilitates machine learning in SAS with comparable accuracy.

Abstract

Background and objective: Stacking is an ensemble machine learning method that averages predictions from multiple other algorithms, such as generalized linear models and regression trees. An implementation of stacking, called super learning, has been developed as a general approach to supervised learning and has seen frequent usage, in part due to the availability of an R package. We develop super learning in the SAS software system using a new macro, and demonstrate its performance relative to the R package. Methods: Following previous work using the R SuperLearner package we assess the performance of super learning in a number of domains. We compare the R package with the new SAS macro in a small set of simulations assessing curve fitting in a predictive model as well in a set of 14 publicly available datasets to assess cross-validated accuracy. Results: Across the simulated data and the publicly available data, the SAS macro performed similarly to the R package, despite a different set of potential algorithms available natively in R and SAS. Conclusions: Our super learner macro performs as well as the R package at a number of tasks. Further, by extending the macro to include the use of R packages, the macro can leverage both the robust, enterprise oriented procedures in SAS and the nimble, cutting edge packages in R. In the spirit of ensemble learning, this macro extends the potential library of algorithms beyond a single software system and provides a simple avenue into machine learning in SAS.