Deep Reinforcement Learning for Dynamic Order Picking in Warehouse Operations

TL;DR

This paper introduces a deep reinforcement learning framework for dynamic order picking in warehouses, significantly improving routing efficiency and order fulfillment rates under fluctuating demand compared to traditional static methods.

Contribution

The study presents a novel DRL-based approach tailored for real-time dynamic order picking, outperforming existing algorithms in high-demand warehouse scenarios.

Findings

Achieves approximately 98% order fulfillment at high arrival rates

Outperforms benchmark algorithms in efficiency and throughput

Demonstrates robustness on out-of-sample instances

Abstract

Order picking is a pivotal operation in warehouses that directly impacts overall efficiency and profitability. This study addresses the dynamic order picking problem, a significant concern in modern warehouse management, where real-time adaptation to fluctuating order arrivals and efficient picker routing are crucial. Traditional methods, which often depend on static optimization algorithms designed around fixed order sets for the picker routing, fall short in addressing the challenges of this dynamic environment. To overcome these challenges, we propose a Deep Reinforcement Learning (DRL) framework tailored for single-block warehouses equipped with an autonomous picking device. By dynamically optimizing picker routes, our approach significantly reduces order throughput times and unfulfilled orders, particularly under high order arrival rates. We benchmark our DRL model against established algorithms, utilizing instances generated based on standard practices in the order picking literature. Experimental results demonstrate the superiority of our DRL model over benchmark algorithms. For example, at a high order arrival rate of 0.09 (i.e., 9 orders per 100 units of time on average), our approach achieves an order fulfillment rate of approximately 98%, compared to the 82% fulfillment rate observed with benchmarking algorithms. We further investigate the integration of a hyperparameter in the reward function that allows for flexible balancing between distance traveled and order completion time. Finally, we demonstrate the robustness of our DRL model on out-of-sample test instances.