JNDMix: JND-Based Data Augmentation for No-reference Image Quality Assessment

TL;DR

JNDMix introduces a novel data augmentation method for no-reference image quality assessment by adding imperceptible JND noise, which enhances model robustness, reduces overfitting, and achieves state-of-the-art results on benchmark datasets.

Contribution

The paper proposes JNDMix, a new data augmentation technique that injects imperceptible JND noise into images without label adjustment, improving NR-IQA model performance and generalization.

Findings

JNDMix significantly boosts model accuracy on LIVEC and KonIQ-10k datasets.

JNDMix enhances data efficiency and robustness of NR-IQA models.

JNDMix achieves state-of-the-art performance with various models.

Abstract

Despite substantial progress in no-reference image quality assessment (NR-IQA), previous training models often suffer from over-fitting due to the limited scale of used datasets, resulting in model performance bottlenecks. To tackle this challenge, we explore the potential of leveraging data augmentation to improve data efficiency and enhance model robustness. However, most existing data augmentation methods incur a serious issue, namely that it alters the image quality and leads to training images mismatching with their original labels. Additionally, although only a few data augmentation methods are available for NR-IQA task, their ability to enrich dataset diversity is still insufficient. To address these issues, we propose a effective and general data augmentation based on just noticeable difference (JND) noise mixing for NR-IQA task, named JNDMix. In detail, we randomly inject the JND noise, imperceptible to the human visual system (HVS), into the training image without any adjustment to its label. Extensive experiments demonstrate that JNDMix significantly improves the performance and data efficiency of various state-of-the-art NR-IQA models and the commonly used baseline models, as well as the generalization ability. More importantly, JNDMix facilitates MANIQA to achieve the state-of-the-art performance on LIVEC and KonIQ-10k.