Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimization

TL;DR

This paper introduces a hierarchical two-stage optimization framework for image watermarking that enhances invisibility, robustness, and broad applicability, achieving high accuracy and low latency in watermark extraction.

Contribution

The proposed HiWL framework is the first to simultaneously optimize for invisibility, robustness, and broad applicability in deep image watermarking through a hierarchical learning approach.

Findings

Achieves 7.6% higher watermark extraction accuracy than existing methods.

Maintains extremely low latency, processing 1000 images in 1 second.

Effectively learns generalizable watermark representations.

Abstract

Deep image watermarking, which refers to enabling imperceptible watermark embedding and reliable extraction in cover images, has been shown to be effective for copyright protection of image assets. However, existing methods face limitations in simultaneously satisfying three essential criteria for generalizable watermarking: (1) invisibility (imperceptible hiding of watermarks), (2) robustness (reliable watermark recovery under diverse conditions), and (3) broad applicability (low latency in the watermarking process). To address these limitations, we propose a Hierarchical Watermark Learning (HiWL) framework, a two-stage optimization that enables a watermarking model to simultaneously achieve all three criteria. In the first stage, distribution alignment learning is designed to establish a common latent space with two constraints: (1) visual consistency between watermarked and non-watermarked images, and (2) information invariance across watermark latent representations. In this way, multimodal inputs -- including watermark messages (binary codes) and cover images (RGB pixels) -- can be effectively represented, ensuring both the invisibility of watermarks and robustness in the watermarking process. In the second stage, we employ generalized watermark representation learning to separate a unique representation of the watermark from the marked image in RGB space. Once trained, the HiWL model effectively learns generalizable watermark representations while maintaining broad applicability. Extensive experiments demonstrate the effectiveness of the proposed method. Specifically, it achieves 7.6% higher accuracy in watermark extraction compared to existing methods, while maintaining extremely low latency (processing 1000 images in 1 second).