Benchmarking Pedestrian Dynamics Models for Common Scenarios: An Evaluation of Force-Based Models

TL;DR

This study evaluates the performance of five force-based pedestrian models in common, moderate-to-low density scenarios, revealing significant shortcomings and providing a comprehensive benchmark across four typical situations.

Contribution

It is the first systematic benchmarking of force-based pedestrian models in moderate-to-low density scenarios across multiple common situations.

Findings

Best model scored 57.14% success rate

All models showed significant shortcomings in prediction accuracy

Evaluation covered six parameters including trajectory success and path smoothness

Abstract

Extensive research in pedestrian dynamics has primarily focused on crowded conditions and associated phenomena, such as lane formation, evacuation, etc. Several force-based models have been developed to predict the behavior in these situations. In contrast, there is a notable gap in terms of investigations of the moderate-to-low density situations. These scenarios are extremely commonplace across the world, including the highly populated nations like India. Additionally, the details of force-based models are expected to show significant effects at these densities, whereas the crowded, nearly packed, conditions may be expected to be governed largely by contact forces. In this study, we address this gap and comprehensively evaluate the performance of different force-based models in some common scenarios. Towards this, we perform controlled experiments in four situations: avoiding a stationary obstacle, position-swapping by walking toward each other, overtaking to reach a common goal, and navigating through a maze of obstacles. The performance evaluation consists of two stages and six evaluating parameters - successful trajectories, overlapping proportion, oscillation strength, path smoothness, speed deviation, and travel time. Firstly, models must meet an eligibility criterion of at least 80\% successful trajectories and secondly, the models are scored based on the cutoff values established from the experimental data. We evaluated five force-based models where the best one scored 57.14\%. Thus, our findings reveal significant shortcomings in the ability of these models to yield accurate predictions of pedestrian dynamics in these common situations.