Histogram-guided Video Colorization Structure with Spatial-Temporal Connection

TL;DR

This paper introduces ST-HVC, a novel video colorization method that leverages histogram guidance and spatial-temporal connections to enhance color quality and temporal consistency in gray video frames.

Contribution

The paper proposes a joint flow and histogram module and a U-shape network to improve colorization quality and temporal stability, outperforming existing methods.

Findings

Achieves superior quantitative performance on two video datasets.

Maintains high temporal consistency in colorized videos.

Effectively reduces artifacts and blurring in colorization results.

Abstract

Video colorization, aiming at obtaining colorful and plausible results from grayish frames, has aroused a lot of interest recently. Nevertheless, how to maintain temporal consistency while keeping the quality of colorized results remains challenging. To tackle the above problems, we present a Histogram-guided Video Colorization with Spatial-Temporal connection structure (named ST-HVC). To fully exploit the chroma and motion information, the joint flow and histogram module is tailored to integrate the histogram and flow features. To manage the blurred and artifact, we design a combination scheme attending to temporal detail and flow feature combination. We further recombine the histogram, flow and sharpness features via a U-shape network. Extensive comparisons are conducted with several state-of-the-art image and video-based methods, demonstrating that the developed method achieves excellent performance both quantitatively and qualitatively in two video datasets.