Automatic Online Multi-Source Domain Adaptation

TL;DR

This paper introduces AOMSDA, an innovative online multi-source domain adaptation method that effectively manages concept drifts and leverages multiple data streams for improved knowledge transfer in streaming environments.

Contribution

The paper proposes AOMSDA, a novel online multi-source domain adaptation technique that combines generative and discriminative autoencoders with CMD regularization and self-organizing structures.

Findings

AOMSDA outperforms existing methods in 5 of 8 case studies.

The approach effectively handles asynchronous concept drifts.

AOMSDA is adaptable to any number of source streams.

Abstract

Knowledge transfer across several streaming processes remain challenging problem not only because of different distributions of each stream but also because of rapidly changing and never-ending environments of data streams. Albeit growing research achievements in this area, most of existing works are developed for a single source domain which limits its resilience to exploit multi-source domains being beneficial to recover from concept drifts quickly and to avoid the negative transfer problem. An online domain adaptation technique under multisource streaming processes, namely automatic online multi-source domain adaptation (AOMSDA), is proposed in this paper. The online domain adaptation strategy of AOMSDA is formulated under a coupled generative and discriminative approach of denoising autoencoder (DAE) where the central moment discrepancy (CMD)-based regularizer is integrated to handle the existence of multi-source domains thereby taking advantage of complementary information sources. The asynchronous concept drifts taking place at different time periods are addressed by a self-organizing structure and a node re-weighting strategy. Our numerical study demonstrates that AOMSDA is capable of outperforming its counterparts in 5 of 8 study cases while the ablation study depicts the advantage of each learning component. In addition, AOMSDA is general for any number of source streams. The source code of AOMSDA is shared publicly in https://github.com/Renchunzi-Xie/AOMSDA.git.