Autoencoding a Soft Touch to Learn Grasping from On-land to Underwater
Ning Guo, Xudong Han, Xiaobo Liu, Shuqiao Zhong, Zhiyuan Zhou, Jian, Lin, Jiansheng Dai, Fang Wan, Chaoyang Song

TL;DR
This paper presents a vision-based soft robotic finger that learns to transfer grasping force knowledge from land to underwater environments, improving underwater manipulation reliability using a variational autoencoder.
Contribution
It introduces a novel SVAE-based approach for transferring tactile grasping knowledge from land to underwater settings with soft robotic fingers.
Findings
SVAE effectively learns transferable latent representations.
The approach outperforms commercial force sensors in underwater grasping.
Soft tactile sensing enhances underwater interaction robustness.
Abstract
Robots play a critical role as the physical agent of human operators in exploring the ocean. However, it remains challenging to grasp objects reliably while fully submerging under a highly pressurized aquatic environment with little visible light, mainly due to the fluidic interference on the tactile mechanics between the finger and object surfaces. This study investigates the transferability of grasping knowledge from on-land to underwater via a vision-based soft robotic finger that learns 6D forces and torques (FT) using a Supervised Variational Autoencoder (SVAE). A high-framerate camera captures the whole-body deformations while a soft robotic finger interacts with physical objects on-land and underwater. Results show that the trained SVAE model learned a series of latent representations of the soft mechanics transferrable from land to water, presenting a superior adaptation to the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSoft Robotics and Applications · Tactile and Sensory Interactions · Advanced Sensor and Energy Harvesting Materials
