Towards AI-Powered Video Assistant Referee System (VARS) for Association Football
Jan Held, Anthony Cioppa, Silvio Giancola, Abdullah Hamdi, Christel, Devue, Bernard Ghanem, Marc Van Droogenbroeck

TL;DR
This paper introduces a semi-automated AI-powered VAR system for football that improves foul recognition and sanctioning accuracy, aiming to support referees at all levels and achieve human-level performance.
Contribution
The paper presents a novel semi-automated VAR system leveraging multi-view video analysis, setting new state-of-the-art results on the SoccerNet-MVFoul dataset.
Findings
Achieves 50% foul recognition accuracy
Achieves 46% sanctioning accuracy
Comparable to human performance in foul classification
Abstract
Over the past decade, the technology used by referees in football has improved substantially, enhancing the fairness and accuracy of decisions. This progress has culminated in the implementation of the Video Assistant Referee (VAR), an innovation that enables backstage referees to review incidents on the pitch from multiple points of view. However, the VAR is currently limited to professional leagues due to its expensive infrastructure and the lack of referees worldwide. In this paper, we present the semi-automated Video Assistant Referee System (VARS) that leverages the latest findings in multi-view video analysis. VARS sets a new state-of-the-art on the SoccerNet-MVFoul dataset, a multi-view video dataset of football fouls. Our VARS achieves a new state-of-the-art on the SoccerNet-MVFoul dataset by recognizing the type of foul in 50% of instances and the appropriate sanction in 46% of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Analysis and Summarization
