Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation

TL;DR

This paper introduces HDRTVNet++, a novel three-step method for converting SDR content to HDRTV, addressing gamut errors with adaptive color mapping, local enhancement, and highlight refinement, achieving state-of-the-art results.

Contribution

The paper proposes a new three-step framework for SDRTV-to-HDRTV conversion, including a dataset HDRTV1K, and demonstrates superior performance over existing methods.

Findings

HDRTVNet++ outperforms previous methods quantitatively.

The method effectively preserves highlight details.

The dataset HDRTV1K supports training and evaluation.

Abstract

Modern displays can render video content with high dynamic range (HDR) and wide color gamut (WCG). However, most resources are still in standard dynamic range (SDR). Therefore, transforming existing SDR content into the HDRTV standard holds significant value. This paper defines and analyzes the SDRTV-to-HDRTV task by modeling the formation of SDRTV/HDRTV content. Our findings reveal that a naive endto-end supervised training approach suffers from severe gamut transition errors. To address this, we propose a new three-step solution called HDRTVNet++, which includes adaptive global color mapping, local enhancement, and highlight refinement. The adaptive global color mapping step utilizes global statistics for image-adaptive color adjustments. A local enhancement network further enhances details, and the two sub-networks are combined as a generator to achieve highlight consistency through GANbased joint training. Designed for ultra-high-definition TV content, our method is both effective and lightweight for processing 4K resolution images. We also constructed a dataset using HDR videos in the HDR10 standard, named HDRTV1K, containing 1235 training and 117 testing images, all in 4K resolution. Additionally, we employ five metrics to evaluate SDRTV-to-HDRTV performance. Our results demonstrate state-of-the-art performance both quantitatively and visually. The codes and models are available at https://github.com/xiaom233/HDRTVNet-plus.