Parallel and Streaming Wavelet Neural Networks for Classification and Regression under Apache Spark

TL;DR

This paper introduces a scalable, parallel wavelet neural network framework implemented on Apache Spark, capable of handling big data in static and streaming environments for classification and regression tasks.

Contribution

The paper presents a novel parallelized wavelet neural network architecture (SPWNN) that efficiently processes large-scale data using stochastic gradient descent in both static and streaming settings.

Findings

SPWNN with Morlet activation outperforms Gaussian in static classification.

Gaussian activation performs better in streaming classification.

Speedup of 1.32-1.40 achieved in processing large datasets.

Abstract

Wavelet neural networks (WNN) have been applied in many fields to solve regression as well as classification problems. After the advent of big data, as data gets generated at a brisk pace, it is imperative to analyze it as soon as it is generated owing to the fact that the nature of the data may change dramatically in short time intervals. This is necessitated by the fact that big data is all pervasive and throws computational challenges for data scientists. Therefore, in this paper, we built an efficient Scalable, Parallelized Wavelet Neural Network (SPWNN) which employs the parallel stochastic gradient algorithm (SGD) algorithm. SPWNN is designed and developed under both static and streaming environments in the horizontal parallelization framework. SPWNN is implemented by using Morlet and Gaussian functions as activation functions. This study is conducted on big datasets like gas sensor data which has more than 4 million samples and medical research data which has more than 10,000 features, which are high dimensional in nature. The experimental analysis indicates that in the static environment, SPWNN with Morlet activation function outperformed SPWNN with Gaussian on the classification datasets. However, in the case of regression, the opposite was observed. In contrast, in the streaming environment i.e., Gaussian outperformed Morlet on the classification and Morlet outperformed Gaussian on the regression datasets. Overall, the proposed SPWNN architecture achieved a speedup of 1.32-1.40.