MADCluster: Model-agnostic Anomaly Detection with Self-supervised Clustering Network
Sangyong Lee, Subo Hwang, Dohoon Kim

TL;DR
MADCluster is a versatile, self-supervised clustering framework for anomaly detection that improves performance across different deep learning architectures by addressing the hypersphere collapse problem.
Contribution
It introduces a novel model-agnostic anomaly detection method with a new adaptive loss and continuous clustering, applicable to various architectures.
Findings
Improves anomaly detection performance on four benchmark datasets.
Addresses hypersphere collapse issue in deep anomaly detection.
Demonstrates compatibility and effectiveness across multiple architectures.
Abstract
In this paper, we propose MADCluster, a novel model-agnostic anomaly detection framework utilizing self-supervised clustering. MADCluster is applicable to various deep learning architectures and addresses the 'hypersphere collapse' problem inherent in existing deep learning-based anomaly detection methods. The core idea is to cluster normal pattern data into a 'single cluster' while simultaneously learning the cluster center and mapping data close to this center. Also, to improve expressiveness and enable effective single clustering, we propose a new 'One-directed Adaptive loss'. The optimization of this loss is mathematically proven. MADCluster consists of three main components: Base Embedder capturing high-dimensional temporal dynamics, Cluster Distance Mapping, and Sequence-wise Clustering for continuous center updates. Its model-agnostic characteristics are achieved by applying…
Peer Reviews
Decision·Submitted to ICLR 2025
1. The paper is well-written and easy to follow. 2. The motivation of learnable cluster center and one-directed adaptive loss is clear and well proved through the experiments.
1. The paper does not present sufficient discussion of the reconstruction-based methods, which should be a very important type of methods in time series anomaly detection. More speficially, it seems that the authors can conbine their method with the reconstruction-based methods such as Anomaly Transformer and DCdetector. I wonder how to implement such conbination. Do you only use the network backbones from the Anomaly Transformer or DCdetector, or delivers a reconstruction loss (or even contrast
1. The authors propose MADCluster, a model-agnostic anomaly detection framework. 2. The authors propose a one-directed adaptive loss for single clustering. 3. The authors address the hypersphere collapse problem in the clustering-based anomaly detection methods.
1. The claimed novelty in this paper is Model-Agnostic. But the authors did not compare with any Model-Agnostic anomaly detection models, such as [1] and [2]. The authors should include these related works in one section, compare these prior works by experiments, and provide a detailed comparison highlighting the key technical differences and innovations compared to these previous works. [1] Towards Lightweight, Model-Agnostic and Diversity-Aware Active Anomaly Detection. ICLR 2023. [
1.MADCluster is easy to adapt to a wide range of neural network architectures and effectively enhances the performance of base models. 2.The framework's dynamic update of cluster centers prevents hypersphere collapse, ensuring a more expressive feature space. 3.The writing of this paper is clear and well-structured.
1.The paper lacks a detailed analysis of time and computational costs, particularly a comparison between the original base model and the model combined with MADCluster. 2.The performance improvement observed in advanced methods like DCdetector appears to be less than in simpler methods such as D-RNN. Does this suggest a limitation in the effectiveness of MADCluster when feature quality is already high? 3.It appears that MADCluster is not specifically designed for time-series anomaly detection.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAnomaly Detection Techniques and Applications · Time Series Analysis and Forecasting · Software System Performance and Reliability
MethodsBalanced Selection
