OnomaCompass: A Texture Exploration Interface that Shuttles between Words and Images
Miki Okamura, Shuhey Koyama, Li Jingjing, Yoichi Ochiai

TL;DR
OnomaCompass is a web-based system that links sound-symbolic onomatopoeia and visual textures to facilitate early-stage material discovery, reducing workload and enhancing user experience in texture exploration.
Contribution
The paper introduces OnomaCompass, a novel interface that connects words and images through latent-space maps for texture exploration, bypassing the need for complex AI prompts.
Findings
Significantly reduced user workload and frustration.
Enhanced hedonic user experience during exploration.
Facilitated externalization of sensory expectations and serendipitous discovery.
Abstract
Humans can finely perceive material textures, yet articulating such somatic impressions in words is a cognitive bottleneck in design ideation. We present OnomaCompass, a web-based exploration system that links sound-symbolic onomatopoeia and visual texture representations to support early-stage material discovery. Instead of requiring users to craft precise prompts for generative AI, OnomaCompass provides two coordinated latent-space maps--one for texture images and one for onomatopoeic term--built from an authored dataset of invented onomatopoeia and corresponding textures generated via Stable Diffusion. Users can navigate both spaces, trigger cross-modal highlighting, curate findings in a gallery, and preview textures applied to objects via an image-editing model. The system also supports video interpolation between selected textures and re-embedding of extracted frames to form an…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAesthetic Perception and Analysis · Color perception and design · Spatial Cognition and Navigation
