LLMCount: Enhancing Stationary mmWave Detection with Multimodal-LLM

TL;DR

LLMCount leverages large-language models to improve stationary millimeter wave crowd detection by compensating for signal irregularities, achieving higher accuracy and lower latency across diverse environments.

Contribution

This work introduces LLMCount, the first system using LLMs to enhance mmWave stationary crowd detection through signal compensation and domain adaptation.

Findings

High detection accuracy across multiple scenarios

Lower latency compared to previous methods

Effective compensation of signal power irregularities

Abstract

Millimeter wave sensing provides people with the capability of sensing the surrounding crowds in a non-invasive and privacy-preserving manner, which holds huge application potential. However, detecting stationary crowds remains challenging due to several factors such as minimal movements (like breathing or casual fidgets), which can be easily treated as noise clusters during data collection and consequently filtered in the following processing procedures. Additionally, the uneven distribution of signal power due to signal power attenuation and interferences resulting from external reflectors or absorbers further complicates accurate detection. To address these challenges and enable stationary crowd detection across various application scenarios requiring specialized domain adaption, we introduce LLMCount, the first system to harness the capabilities of large-language models (LLMs) to enhance crowd detection performance. By exploiting the decision-making capability of LLM, we can successfully compensate the signal power to acquire a uniform distribution and thereby achieve a detection with higher accuracy. To assess the system's performance, comprehensive evaluations are conducted under diversified scenarios like hall, meeting room, and cinema. The evaluation results show that our proposed approach reaches high detection accuracy with lower overall latency compared with previous methods.