Revelio: A Real-World Screen-Camera Communication System with Visually Imperceptible Data Embedding

TL;DR

Revelio is a novel screen-camera communication system that uses imperceptible flickering and neural decoding to reliably transmit data in real-world scenarios without disrupting visual content.

Contribution

It introduces a visually imperceptible data embedding method leveraging flicker fusion and neural decoding, robust against noise and distortions in practical environments.

Findings

Effective data transmission in interactive TV scenarios

Visually imperceptible embedding with high robustness

Reliable decoding using neural network-based methods

Abstract

We present `Revelio', a real-world screen-camera communication system leveraging temporal flicker fusion in the OKLAB color space. Using spatially-adaptive flickering and encoding information in pixel region shapes, Revelio achieves visually imperceptible data embedding while remaining robust against noise, asynchronicity, and distortions in screen-camera channels, ensuring reliable decoding by standard smartphone cameras. The decoder, driven by a two-stage neural network, uses a weighted differential accumulator for precise frame detection and symbol recognition. Initial experiments demonstrate Revelio's effectiveness in interactive television, offering an unobtrusive method for meta-information transmission.