A Markov Decision Process Approach for Managing Medical Drone Deliveries
Amin Asadi, Sarah Nurre Pinkley, Martijn Mes

TL;DR
This paper models and optimizes medical drone delivery operations considering stochastic demands and flight ranges using a Markov decision process, with reinforcement learning demonstrating high performance over exact solutions.
Contribution
It introduces a novel MDP-based framework for managing drone deliveries with stochastic demands and applies reinforcement learning for efficient decision-making.
Findings
Reinforcement learning outperforms dynamic programming in solution quality and speed.
The model effectively handles demand variability based on geographic distance.
Insights for operational management of drone hubs are provided.
Abstract
We consider the problem of optimizing the distribution operations at a drone hub that dispatches drones to different geographic locations generating stochastic demands for medical supplies. Drone delivery is an innovative method that introduces many benefits, such as low-contact delivery, thereby reducing the spread of pandemic and vaccine-preventable diseases. While we focus on medical supply delivery for this work, drone delivery is suitable for many other items, including food, postal parcels, and e-commerce. In this paper, our goal is to address drone delivery challenges related to the stochastic demands of different geographic locations. We consider different classes of demand related to geographic locations that require different flight ranges, which is directly related to the amount of charge held in a drone battery. We classify the stochastic demands based on their distance from…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTransportation and Mobility Innovations · Vehicle Routing Optimization Methods · Facility Location and Emergency Management
