Human Action Anticipation: A Survey

TL;DR

This survey reviews recent advances in human action anticipation, covering technical innovations, datasets, metrics, and performance comparisons to guide future research in this evolving field.

Contribution

It consolidates fragmented literature on human action anticipation, providing a comprehensive overview of recent methods, datasets, and evaluation metrics.

Findings

Summarizes recent technical innovations in action anticipation.

Provides performance comparison of approaches on eleven datasets.

Highlights future research directions in the field.

Abstract

Predicting future human behavior is an increasingly popular topic in computer vision, driven by the interest in applications such as autonomous vehicles, digital assistants and human-robot interactions. The literature on behavior prediction spans various tasks, including action anticipation, activity forecasting, intent prediction, goal prediction, and so on. Our survey aims to tie together this fragmented literature, covering recent technical innovations as well as the development of new large-scale datasets for model training and evaluation. We also summarize the widely-used metrics for different tasks and provide a comprehensive performance comparison of existing approaches on eleven action anticipation datasets. This survey serves as not only a reference for contemporary methodologies in action anticipation, but also a guideline for future research direction of this evolving landscape.