Real-Time Object Detection and Localization in Compressive Sensed Video on Embedded Hardware
Yeshwanth Ravi Theja Bethi, Sathyaprakash Narayanan, Venkat Rangan,, Chetan Singh Thakur

TL;DR
This paper demonstrates real-time object detection directly on compressively sensed video frames, bypassing the need for full reconstruction, and achieves efficient processing on embedded hardware.
Contribution
It introduces the first approach for object detection on CS frames, creates a new dataset, and achieves high accuracy with real-time inference on embedded devices.
Findings
Achieved 46.27% mAP on CS frames
Inference time of 23ms on NVIDIA TX2
Enabled real-time detection without full video reconstruction
Abstract
Every day around the world, interminable terabytes of data are being captured for surveillance purposes. A typical 1-2MP CCTV camera generates around 7-12GB of data per day. Frame-by-frame processing of such enormous amount of data requires hefty computational resources. In recent years, compressive sensing approaches have shown impressive results in signal processing by reducing the sampling bandwidth. Different sampling mechanisms were developed to incorporate compressive sensing in image and video acquisition. Pixel-wise coded exposure is one among the promising sensing paradigms for capturing videos in the compressed domain, which was also realized into an all-CMOS sensor \cite{Xiong2017}. Though cameras that perform compressive sensing save a lot of bandwidth at the time of sampling and minimize the memory required to store videos, we cannot do much in terms of processing until the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSparse and Compressive Sensing Techniques · Advanced Image and Video Retrieval Techniques · Visual Attention and Saliency Detection
