Adaptive Paired-Comparison Method for Subjective Video Quality Assessment on Mobile Devices

TL;DR

This paper introduces an adaptive paired comparison method utilizing particle filtering for efficient, reliable subjective video quality assessment on mobile devices, requiring only one rating per sample and suitable for non-expert users.

Contribution

It presents a novel adaptive paired comparison approach that reduces test time and improves reliability over traditional methods for subjective video quality evaluation.

Findings

Reduces test time compared to regular paired comparison

Works effectively with non-expert raters

Improves reliability over MOS and DS-MOS methods

Abstract

To effectively evaluate subjective visual quality in weakly-controlled environments, we propose an Adaptive Paired Comparison method based on particle filtering. As our approach requires each sample to be rated only once, the test time compared to regular paired comparison can be reduced. The method works with non-experts and improves reliability compared to MOS and DS-MOS methods.