An overview on the evaluated video retrieval tasks at TRECVID 2022

TL;DR

This paper reviews the TRECVID 2022 evaluation campaign, detailing the tasks, datasets, evaluation methods, and summarizing the participation and high-level results of the event.

Contribution

It provides a comprehensive overview of the latest TRECVID tasks, datasets, evaluation frameworks, and summarizes the results of the 2022 video retrieval evaluation.

Findings

Six new video retrieval tasks introduced in 2022

35 research teams participated in TRECVID 2022

Summary of performance outcomes across tasks

Abstract

The TREC Video Retrieval Evaluation (TRECVID) is a TREC-style video analysis and retrieval evaluation with the goal of promoting progress in research and development of content-based exploitation and retrieval of information from digital video via open, tasks-based evaluation supported by metrology. Over the last twenty-one years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID has been funded by NIST (National Institute of Standards and Technology) and other US government agencies. In addition, many organizations and individuals worldwide contribute significant time and effort. TRECVID 2022 planned for the following six tasks: Ad-hoc video search, Video to text captioning, Disaster scene description and indexing, Activity in extended videos, deep video understanding, and movie summarization. In total, 35 teams from various research organizations worldwide signed up to join the evaluation campaign this year. This paper introduces the tasks, datasets used, evaluation frameworks and metrics, as well as a high-level results overview.