SOTVerse: A User-defined Task Space of Single Object Tracking
Shiyu Hu, Xin Zhao, Kaiqi Huang

TL;DR
SOTVerse introduces a comprehensive, user-defined task space for single object tracking that enhances data utilization and evaluation methods, facilitating more standardized and effective research in challenging scenarios.
Contribution
It proposes a novel 3E Paradigm and constructs SOTVerse, a large-scale, automatically labeled dataset with tools for customizable tracking tasks and improved evaluation strategies.
Findings
Constructed SOTVerse with 12.56 million frames
Automatically labels challenging factors per frame
Provides new evaluation indicators and mechanisms
Abstract
Single object tracking (SOT) research falls into a cycle -- trackers perform well on most benchmarks but quickly fail in challenging scenarios, causing researchers to doubt the insufficient data content and take more effort to construct larger datasets with more challenging situations. However, inefficient data utilization and limited evaluation methods more seriously hinder SOT research. The former causes existing datasets can not be exploited comprehensively, while the latter neglects challenging factors in the evaluation process. In this article, we systematize the representative benchmarks and form a Single Object Tracking metaverse (SOTVerse) -- a user-defined SOT task space to break through the bottleneck. We first propose a 3E Paradigm to describe tasks by three components (i.e., environment, evaluation, and executor). Then, we summarize task characteristics, clarify the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVirtual Reality Applications and Impacts · Infrared Thermography in Medicine
