RGC-VQA: An Exploration Database for Robotic-Generated Video Quality Assessment

TL;DR

This paper introduces the first dedicated database for robotic-generated video quality assessment, highlighting the unique distortions of RGC videos and evaluating existing VQA models' performance on this new content type.

Contribution

The paper establishes the first RGC database, conducts subjective quality assessments, and benchmarks current VQA models, revealing their limitations for robotic-generated videos.

Findings

Existing VQA models perform poorly on RGC videos.

RGC videos exhibit unique distortions not well captured by traditional models.

The new database supports future research in RGC-specific VQA models.

Abstract

As camera-equipped robotic platforms become increasingly integrated into daily life, robotic-generated videos have begun to appear on streaming media platforms, enabling us to envision a future where humans and robots coexist. We innovatively propose the concept of Robotic-Generated Content (RGC) to term these videos generated from egocentric perspective of robots. The perceptual quality of RGC videos is critical in human-robot interaction scenarios, and RGC videos exhibit unique distortions and visual requirements that differ markedly from those of professionally-generated content (PGC) videos and user-generated content (UGC) videos. However, dedicated research on quality assessment of RGC videos is still lacking. To address this gap and to support broader robotic applications, we establish the first Robotic-Generated Content Database (RGCD), which contains a total of 2,100 videos drawn from three robot categories and sourced from diverse platforms. A subjective VQA experiment is conducted subsequently to assess human visual perception of robotic-generated videos. Finally, we conduct a benchmark experiment to evaluate the performance of 11 state-of-the-art VQA models on our database. Experimental results reveal significant limitations in existing VQA models when applied to complex, robotic-generated content, highlighting a critical need for RGC-specific VQA models. Our RGCD is publicly available at: https://github.com/IntMeGroup/RGC-VQA.