SilhouetteTell: Practical Video Identification Leveraging Blurred Recordings of Video Subtitles

TL;DR

SilhouetteTell is a novel attack method that identifies videos by analyzing blurred subtitle silhouettes, leveraging their spatial and temporal features to infer video content from recordings at significant distances.

Contribution

The paper introduces SilhouetteTell, a new video identification technique that uses subtitle silhouette analysis to accurately infer video content without relying on network traffic analysis.

Findings

High accuracy in inferring video titles and clips

Effective from distances up to 40 meters

Works on both online and offline videos

Abstract

Video identification attacks pose a significant privacy threat that can reveal videos that victims watch, which may disclose their hobbies, religious beliefs, political leanings, sexual orientation, and health status. Also, video watching history can be used for user profiling or advertising and may result in cyberbullying, discrimination, or blackmail. Existing extensive video inference techniques usually depend on analyzing network traffic generated by streaming online videos. In this work, we observe that the content of a subtitle determines its silhouette displayed on the screen, and identifying each subtitle silhouette also derives the temporal difference between two consecutive subtitles. We then propose SilhouetteTell, a novel video identification attack that combines the spatial and time domain information into a spatiotemporal feature of subtitle silhouettes. SilhouetteTell explores the spatiotemporal correlation between recorded subtitle silhouettes of a video and its subtitle file. It can infer both online and offline videos. Comprehensive experiments on off-the-shelf smartphones confirm the high efficacy of SilhouetteTell for inferring video titles and clips under various settings, including from a distance of up to 40 meters.