MemStream: Memory-Based Streaming Anomaly Detection
Siddharth Bhatia, Arjit Jain, Shivin Srivastava, Kenji Kawaguchi,, Bryan Hooi

TL;DR
MemStream is an online, memory-based anomaly detection framework that effectively detects anomalies in streaming multi-dimensional data while adapting to concept drift without requiring labeled data.
Contribution
It introduces a novel streaming anomaly detection method combining autoencoders and memory modules to handle concept drift efficiently in real-time.
Findings
Outperforms state-of-the-art streaming baselines on multiple datasets
Proves the optimal memory size for effective drift handling
Demonstrates robustness against memory poisoning attacks
Abstract
Given a stream of entries over time in a multi-dimensional data setting where concept drift is present, how can we detect anomalous activities? Most of the existing unsupervised anomaly detection approaches seek to detect anomalous events in an offline fashion and require a large amount of data for training. This is not practical in real-life scenarios where we receive the data in a streaming manner and do not know the size of the stream beforehand. Thus, we need a data-efficient method that can detect and adapt to changing data trends, or concept drift, in an online manner. In this work, we propose MemStream, a streaming anomaly detection framework, allowing us to detect unusual events as they occur while being resilient to concept drift. We leverage the power of a denoising autoencoder to learn representations and a memory module to learn the dynamically changing trend in data without…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsData Stream Mining Techniques · Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection
MethodsDenoising Autoencoder
