A Comprehensive Review of Few-shot Action Recognition

TL;DR

This paper provides a comprehensive review of recent methods in few-shot action recognition, categorizing approaches, analyzing benchmarks, and discussing future research directions in this challenging video classification task.

Contribution

It introduces a systematic taxonomy of existing approaches, focusing on generative and meta-learning frameworks, and offers detailed analysis and insights for future research.

Findings

Categorizes methods into generative-based and meta-learning frameworks.

Analyzes common benchmarks and evaluation protocols.

Discusses future directions and challenges in the field.

Abstract

Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data in action recognition. It requires accurately classifying human actions in videos using only a few labeled examples per class. Compared to few-shot learning in image scenarios, few-shot action recognition is more challenging due to the intrinsic complexity of video data. Numerous approaches have driven significant advancements in few-shot action recognition, which underscores the need for a comprehensive survey. Unlike early surveys that focus on few-shot image or text classification, we deeply consider the unique challenges of few-shot action recognition. In this survey, we provide a comprehensive review of recent methods and introduce a novel and systematic taxonomy of existing approaches, accompanied by a detailed analysis. We categorize the methods into generative-based and meta-learning frameworks, and further elaborate on the methods within the meta-learning framework, covering aspects: video instance representation, category prototype learning, and generalized video alignment. Additionally, the survey presents the commonly used benchmarks and discusses relevant advanced topics and promising future directions. We hope this survey can serve as a valuable resource for researchers, offering essential guidance to newcomers and stimulating seasoned researchers with fresh insights.