An Autotuning-based Optimization Framework for Mixed-kernel SVM Classifications in Smart Pixel Datasets and Heterojunction Transistors

TL;DR

This paper introduces an autotuning framework to optimize hyperparameters in mixed-kernel SVMs, significantly improving classification accuracy in high energy physics and heterojunction transistor datasets.

Contribution

It presents a novel autotuning-based optimization framework specifically designed for mixed-kernel SVMs, enhancing hyperparameter selection and classification performance.

Findings

Optimal hyperparameters vary across datasets and applications.

Proper hyperparameter tuning greatly improves classification accuracy.

The framework achieves up to 94.6% accuracy in HEP and 97.2% in MKH applications.

Abstract

Support Vector Machine (SVM) is a state-of-the-art classification method widely used in science and engineering due to its high accuracy, its ability to deal with high dimensional data, and its flexibility in modeling diverse sources of data. In this paper, we propose an autotuning-based optimization framework to quantify the ranges of hyperparameters in SVMs to identify their optimal choices, and apply the framework to two SVMs with the mixed-kernel between Sigmoid and Gaussian kernels for smart pixel datasets in high energy physics (HEP) and mixed-kernel heterojunction transistors (MKH). Our experimental results show that the optimal selection of hyperparameters in the SVMs and the kernels greatly varies for different applications and datasets, and choosing their optimal choices is critical for a high classification accuracy of the mixed kernel SVMs. Uninformed choices of hyperparameters C and coef0 in the mixed-kernel SVMs result in severely low accuracy, and the proposed framework effectively quantifies the proper ranges for the hyperparameters in the SVMs to identify their optimal choices to achieve the highest accuracy 94.6\% for the HEP application and the highest average accuracy 97.2\% with far less tuning time for the MKH application.