Uncertainty-aware Human Mobility Modeling and Anomaly Detection
Haomin Wen, Shurui Cao, Zeeshan Rasheed, Khurram Hassan Shafique,, Leman Akoglu

TL;DR
This paper introduces USTAD, an unsupervised, uncertainty-aware model for human mobility anomaly detection using GPS data, which effectively accounts for behavioral stochasticity and data sparsity.
Contribution
The work presents a novel sequence modeling approach with uncertainty estimation for anomaly detection in human mobility without labeled data.
Findings
USTAD improves anomaly detection AUCROC by 3-15% over baselines.
Incorporates aleatoric and epistemic uncertainties for robustness.
Effective on industry-scale GPS data.
Abstract
Given the temporal GPS coordinates from a large set of human agents, how can we model their mobility behavior toward effective anomaly (e.g. bad-actor or malicious behavior) detection without any labeled data? Human mobility and trajectory modeling have been extensively studied, showcasing varying abilities to manage complex inputs and balance performance-efficiency trade-offs. In this work, we formulate anomaly detection in complex human behavior by modeling raw GPS data as a sequence of stay-point events, each characterized by spatio-temporal features, along with trips (i.e. commute) between the stay-points. Our problem formulation allows us to leverage modern sequence models for unsupervised training and anomaly detection. Notably, we equip our proposed model USTAD (for Uncertainty-aware Spatio-Temporal Anomaly Detection) with aleatoric (i.e. data) uncertainty estimation to account…
Peer Reviews
Decision·Submitted to ICLR 2025
1. Originality: The model’s design, utilizing a dual-Transformer architecture for feature- and event-level attention, effectively captures dependencies at different levels of human behavior. 2. Quality: The paper includes comparisons with various baselines, showing that UIFORMER achieves superior performance for anomaly detection. 3. Clarity: The paper is well-organized and clearly explains the model’s architecture, training dynamics, and uncertainty estimation. Figures and tables enhance the u
1. Lack of Novelty in Uncertainty Quantification: The techniques for quantifying aleatoric and epistemic uncertainty, including Monte Carlo (MC) Dropout, have been widely used in other domains. The absence of a discussion on related works, specifically evidential deep learning methods, limits the novelty of the approach. Incorporating such references and discussions could strengthen the contribution of this paper. 2. There is insufficient detail about the SimLA dataset, particularly whether it i
1) The problem of modeling human mobility data is an important one, with **important real-world implications**. 2) The overall approach proposed for this particular problem is **a unique and new combination of existing ideas from literature**. It is of significance for the urban mobility domain. Especially the focus on modeling uncertainty when modeling human mobility data is something that can be very relevant for practical applications but is typically ignored in the urban mobility literature
1) Although the specific combination of existing ideas in the proposed approach is new from the application point of view, from a methodological point of view, the **low novelty** is a concern, especially **for the broader ICLR audience**. Since the contribution is of significance mostly for a transportation audience, I would encourage the authors to consider targeting a transportation journal instead since I believe this work would have more visibility and more impact there. Otherwise, for ICLR
1. The motivation of the paper is clearly presented, and the writing is easy to follow. 2. The proposed method estimates both epistemic uncertainty and aleatoric uncertainty. 3. Both feature-level and event-level information are taken into account. 4. An uncertainty-based score is proposed for anomaly detection.
1. My main concern with the paper is the lack of novelty. The proposed method is merely the combination of existing techniques. The authors should explore more advanced techniques in the field. For example, the epistemic uncertainty is estimated by MC dropout which is a weight-space method. It can also be studied from a function-space perspective, using methods such as Gaussian processes, Hamiltonian Monte Carlo, Stein variational gradient descent, etc. As for aleatoric uncertainty, methods such
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Mobility and Location-Based Analysis · Context-Aware Activity Recognition Systems · Anomaly Detection Techniques and Applications
MethodsSparse Evolutionary Training · Greedy Policy Search
