PMM-Net: Single-stage Multi-agent Trajectory Prediction with Patching-based Embedding and Explicit Modal Modulation

TL;DR

PMM-Net is a novel single-stage multi-agent trajectory prediction model that combines patching-based temporal features with explicit social modality modulation, achieving superior results on benchmark datasets.

Contribution

The paper introduces a new framework with patching-based feature extraction and explicit modality modulation for improved multi-agent trajectory prediction.

Findings

Outperforms state-of-the-art methods on benchmark datasets

Effective cross-scenario generalization demonstrated

Single-stage inference pipeline enhances efficiency

Abstract

Analyzing and forecasting trajectories of agents like pedestrians plays a pivotal role for embodied intelligent applications. The inherent indeterminacy of human behavior and complex social interaction among a rich variety of agents make this task more challenging than common time-series forecasting. In this letter, we aim to explore a distinct formulation for multi-agent trajectory prediction framework. Specifically, we proposed a patching-based temporal feature extraction module and a graph-based social feature extraction module, enabling effective feature extraction and cross-scenario generalization. Moreover, we reassess the role of social interaction and present a novel method based on explicit modality modulation to integrate temporal and social features, thereby constructing an efficient single-stage inference pipeline. Results on public benchmark datasets demonstrate the superior performance of our model compared with the state-of-the-art methods. The code is available at: github.com/TIB-K330/pmm-net.