Advances in Compliance Detection: Novel Models Using Vision-Based Tactile Sensors
Ziteng Li, Malte Kuhlmann, Ilana Nisky, Nicol\'as Navarro-Guerrero

TL;DR
This paper introduces two advanced neural network models using vision-based tactile sensors to improve compliance detection accuracy across various applications.
Contribution
The paper presents novel LRCN and Transformer models that enhance compliance prediction accuracy using RGB tactile images from GelSight sensors.
Findings
Models outperform baseline methods in compliance prediction.
Transformer-based model achieves higher accuracy than LRCN.
Object hardness affects compliance estimation difficulty.
Abstract
Compliance is a critical parameter for describing objects in engineering, agriculture, and biomedical applications. Traditional compliance detection methods are limited by their lack of portability and scalability, rely on specialized, often expensive equipment, and are unsuitable for robotic applications. Moreover, existing neural network-based approaches using vision-based tactile sensors still suffer from insufficient prediction accuracy. In this paper, we propose two models based on Long-term Recurrent Convolutional Networks (LRCNs) and Transformer architectures that leverage RGB tactile images and other information captured by the vision-based sensor GelSight to predict compliance metrics accurately. We validate the performance of these models using multiple metrics and demonstrate their effectiveness in accurately estimating compliance. The proposed models exhibit significant…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
