Acceleration of Subspace Learning Machine via Particle Swarm Optimization and Parallel Processing

TL;DR

This paper enhances the computational efficiency of the subspace learning machine by integrating particle swarm optimization for faster discriminant dimension search and employing parallel processing, achieving significant speedups without sacrificing accuracy.

Contribution

It introduces a novel acceleration method for SLM using PSO and parallel processing, reducing training time substantially while maintaining performance.

Findings

Achieved a 577-fold speedup in training time.

Reduced the number of iterations by 10-20 times with PSO.

Maintained comparable classification and regression accuracy.

Abstract

Built upon the decision tree (DT) classification and regression idea, the subspace learning machine (SLM) has been recently proposed to offer higher performance in general classification and regression tasks. Its performance improvement is reached at the expense of higher computational complexity. In this work, we investigate two ways to accelerate SLM. First, we adopt the particle swarm optimization (PSO) algorithm to speed up the search of a discriminant dimension that is expressed as a linear combination of current dimensions. The search of optimal weights in the linear combination is computationally heavy. It is accomplished by probabilistic search in original SLM. The acceleration of SLM by PSO requires 10-20 times fewer iterations. Second, we leverage parallel processing in the SLM implementation. Experimental results show that the accelerated SLM method achieves a speed up factor of 577 in training time while maintaining comparable classification/regression performance of original SLM.