Transformer in Touch: A Survey
Jing Gao, Ning Cheng, Bin Fang, and Wenjuan Han

TL;DR
This survey reviews the emerging use of Transformer models in tactile perception, highlighting their core mechanisms, applications, and future research directions in tactile technology.
Contribution
It provides a comprehensive overview of Transformer applications in tactile tasks, summarizing methodologies, benchmarks, and design insights for the tactile community.
Findings
Transformers are effective in tactile object recognition.
They enable cross-modal generation in tactile systems.
Performance benchmarks show competitive results.
Abstract
The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the application and development of Transformers in tactile technology. We first introduce the two fundamental concepts behind the success of the Transformer: the self-attention mechanism and large-scale pre-training. Then, we delve into the application of Transformers in various tactile tasks, including but not limited to object recognition, cross-modal generation, and object manipulation, offering a concise summary of the core methodologies, performance benchmarks, and design highlights. Finally, we suggest potential areas for further research and future work, aiming to generate more interest within the community, tackle existing challenges, and encourage the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVibration and Dynamic Analysis · Elevator Systems and Control
MethodsAttention Is All You Need · Dense Connections · Linear Layer · Position-Wise Feed-Forward Layer · Label Smoothing · Residual Connection · Absolute Position Encodings · Byte Pair Encoding · Adam · Dropout
