Hawkes Process Multi-armed Bandits for Disaster Search and Rescue
Wen-Hao Chiang, George Mohler

TL;DR
This paper introduces a novel framework combining Hawkes processes with multi-armed bandit algorithms to improve spatio-temporal event forecasting and disaster search and rescue, demonstrating superior performance on real hurricane data.
Contribution
It presents a new Bayesian spatial Hawkes process-based UCB algorithm for balancing exploration and exploitation in spatial event detection tasks.
Findings
Model outperforms baseline algorithms in cumulative reward
Effective in disaster search and rescue scenarios
Validated on hurricane Harvey call data
Abstract
We propose a novel framework for integrating Hawkes processes with multi-armed bandit algorithms to solve spatio-temporal event forecasting and detection problems when data may be undersampled or spatially biased. In particular, we introduce an upper confidence bound algorithm using Bayesian spatial Hawkes process estimation for balancing the tradeoff between exploiting geographic regions where data has been collected and exploring geographic regions where data is unobserved. We first validate our model using simulated data and then apply it to the problem of disaster search and rescue using calls for service data from hurricane Harvey in 2017. Our model outperforms the state of the art baseline spatial MAB algorithms in terms of cumulative reward and several other ranking evaluation metrics.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Bandit Algorithms Research · Gaussian Processes and Bayesian Inference · Healthcare Operations and Scheduling Optimization
