Single-Pixel Vision-Language Model for Intrinsic Privacy-Preserving Behavioral Intelligence

TL;DR

This paper introduces SP-VLM, a privacy-preserving vision-language model that uses single-pixel sensing to monitor human behavior in sensitive environments, effectively balancing safety and privacy.

Contribution

The paper presents a novel single-pixel sensing framework that intrinsically protects identity while enabling behavioral analysis in privacy-sensitive settings.

Findings

Single-pixel sensing suppresses face recognition effectiveness.

SP-VLM accurately detects anomalies and counts people from degraded signals.

A practical sampling regime balances behavioral insight with privacy protection.

Abstract

Adverse social interactions, such as bullying, harassment, and other illicit activities, pose significant threats to individual well-being and public safety, leaving profound impacts on physical and mental health. However, these critical events frequently occur in privacy-sensitive environments like restrooms, and changing rooms, where conventional surveillance is prohibited or severely restricted by stringent privacy regulations and ethical concerns. Here, we propose the Single-Pixel Vision-Language Model (SP-VLM), a novel framework that reimagines secure environmental monitoring. It achieves intrinsic privacy-by-design by capturing human dynamics through inherently low-dimensional single-pixel modalities and inferring complex behavioral patterns via seamless vision-language integration. Building on this framework, we demonstrate that single-pixel sensing intrinsically suppresses identity recoverability, rendering state-of-the-art face recognition systems ineffective below a critical sampling rate. We further show that SP-VLM can nonetheless extract meaningful behavioral semantics, enabling robust anomaly detection, people counting, and activity understanding from severely degraded single-pixel observations. Combining these findings, we identify a practical sampling-rate regime in which behavioral intelligence emerges while personal identity remains strongly protected. Together, these results point to a human-rights-aligned pathway for safety monitoring that can support timely intervention without normalizing intrusive surveillance in privacy-sensitive spaces.