NTIRE 2023 Quality Assessment of Video Enhancement Challenge

TL;DR

The NTIRE 2023 challenge focused on evaluating video quality assessment methods for enhanced videos, involving a large dataset and multiple participants, leading to improved prediction models for video enhancement quality.

Contribution

This paper introduces a new challenge and dataset for video quality assessment of enhanced videos, fostering development of better predictive models in this domain.

Findings

Winning methods outperformed baseline models.

High participant engagement with 37 teams submitting models.

The challenge advanced the state-of-the-art in video quality assessment.

Abstract

This paper reports on the NTIRE 2023 Quality Assessment of Video Enhancement Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2023. This challenge is to address a major challenge in the field of video processing, namely, video quality assessment (VQA) for enhanced videos. The challenge uses the VQA Dataset for Perceptual Video Enhancement (VDPVE), which has a total of 1211 enhanced videos, including 600 videos with color, brightness, and contrast enhancements, 310 videos with deblurring, and 301 deshaked videos. The challenge has a total of 167 registered participants. 61 participating teams submitted their prediction results during the development phase, with a total of 3168 submissions. A total of 176 submissions were submitted by 37 participating teams during the final testing phase. Finally, 19 participating teams submitted their models and fact sheets, and detailed the methods they used. Some methods have achieved better results than baseline methods, and the winning methods have demonstrated superior prediction performance.