Search-based Robustness Testing of Laptop Refurbishing Robotic Software
Erblin Isaku, Hassan Sartaj, Shaukat Ali, Malaika Din Hashmi, and Francois Picard

TL;DR
This paper introduces PROBE, a search-based method using multi-objective optimization to find minimal input perturbations that reveal failures in object detection models used in laptop refurbishing robots, improving robustness testing.
Contribution
The paper presents PROBE, a novel search-based robustness testing approach employing NSGA-II to efficiently identify failure-inducing perturbations in robotic object detection models.
Findings
PROBE is 3 to 7 times more effective than random search in finding failures.
Generated perturbations transfer across different models.
Metamorphic relations help assess model stability even without failures.
Abstract
The Danish Technological Institute (DTI) focuses on transferring advanced technologies (including robots) to the industry and the public sector. One key application is laptop refurbishment using specialized robots, aimed at promoting reuse, reducing electronic waste, and supporting the European Circular Economy Action Plan. The software of such robots often includes features that use object detection models to detect objects for various purposes, such as identifying screws for laptop disassembly or detecting stickers to remove them. Ensuring the robustness of such models to small input variations remains a critical challenge, and addressing it is important to avoid potential damage to laptops during refurbishment. In this paper, we propose PROBE, a search-based robustness testing approach that leverages multi-objective optimization to identify minimal, localized perturbations that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
