Online Monitoring of Object Detection Performance During Deployment
Quazi Marufur Rahman, Niko S\"underhauf, Feras Dayoub

TL;DR
This paper presents a cascaded neural network that monitors object detection quality in real-time during deployment, helping mobile robots maintain safety by detecting performance drops under varying environmental conditions.
Contribution
It introduces a novel cascaded neural network that predicts object detector performance using internal features, enabling real-time monitoring during deployment.
Findings
Effective in predicting mAP fluctuations across different datasets
Improves safety by alerting performance degradation
Applicable to various object detectors and environments
Abstract
During deployment, an object detector is expected to operate at a similar performance level reported on its testing dataset. However, when deployed onboard mobile robots that operate under varying and complex environmental conditions, the detector's performance can fluctuate and occasionally degrade severely without warning. Undetected, this can lead the robot to take unsafe and risky actions based on low-quality and unreliable object detections. We address this problem and introduce a cascaded neural network that monitors the performance of the object detector by predicting the quality of its mean average precision (mAP) on a sliding window of the input frames. The proposed cascaded network exploits the internal features from the deep neural network of the object detector. We evaluate our proposed approach using different combinations of autonomous driving datasets and object detectors.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Neural Network Applications · Video Surveillance and Tracking Methods · CCD and CMOS Imaging Sensors
