Which tone-mapping operator is the best? A comparative study of perceptual quality

TL;DR

This study compares fifteen tone-mapping operators through psychophysical experiments to evaluate their effectiveness in reproducing physical scene qualities, highlighting the influence of evaluation criteria on ranking and the need for standardized assessments.

Contribution

It provides a comprehensive psychophysical comparison of fifteen TMOs, revealing the impact of evaluation criteria on their perceived performance and emphasizing the need for standardized testing methods.

Findings

Ranking depends on evaluation criteria used.

Most TMOs focus on either local or global image attributes.

Room for improvement in TMO evaluation standards.

Abstract

Tone-mapping operators (TMO) are designed to generate perceptually similar low-dynamic range images from high-dynamic range ones. We studied the performance of fifteen TMOs in two psychophysical experiments where observers compared the digitally generated tone-mapped images to their corresponding physical scenes. All experiments were performed in a controlled environment and the setups were designed to emphasise different image properties: in the first experiment we evaluated the local relationships among intensity-levels, and in the second one we evaluated global visual appearance among physical scenes and tone-mapped images, which were presented side by side. We ranked the TMOs according to how well they reproduce the results obtained in the physical scene. Our results show that ranking position clearly depends on the adopted evaluation criteria, which implies that, in general, these tone-mapping algorithms consider either local or global image attributes but rarely both. We conclude that a more thorough and standardized evaluation criteria are needed to study all the characteristics of TMOs, as there is ample room for improvement in future developments.