SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction

TL;DR

This paper introduces SR-LSTM, a novel LSTM-based model that refines pedestrian trajectory predictions by incorporating current neighbor intentions and social-aware information selection, achieving state-of-the-art results.

Contribution

The paper proposes a data-driven state refinement module for LSTM that utilizes current neighbor intentions and a social-aware information selection mechanism.

Findings

Achieves state-of-the-art results on ETH and UCY datasets.

Effectively models social behaviors in pedestrian trajectory prediction.

Outperforms previous LSTM-based methods in accuracy.

Abstract

In crowd scenarios, reliable trajectory prediction of pedestrians requires insightful understanding of their social behaviors. These behaviors have been well investigated by plenty of studies, while it is hard to be fully expressed by hand-craft rules. Recent studies based on LSTM networks have shown great ability to learn social behaviors. However, many of these methods rely on previous neighboring hidden states but ignore the important current intention of the neighbors. In order to address this issue, we propose a data-driven state refinement module for LSTM network (SR-LSTM), which activates the utilization of the current intention of neighbors, and jointly and iteratively refines the current states of all participants in the crowd through a message passing mechanism. To effectively extract the social effect of neighbors, we further introduce a social-aware information selection mechanism consisting of an element-wise motion gate and a pedestrian-wise attention to select useful message from neighboring pedestrians. Experimental results on two public datasets, i.e. ETH and UCY, demonstrate the effectiveness of our proposed SR-LSTM and we achieves state-of-the-art results.