Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions
Seo-Hyun Lee, Young-Eun Lee, Seong-Whan Lee

TL;DR
This paper explores the integration of imagined speech brain-computer interfaces with the metaverse to enable intuitive, brain-based communication and control, demonstrated through a virtual assistant for smart home management.
Contribution
It introduces a brain-to-speech system for real-world communication in the metaverse, including a demonstration of imagined speech for smart home control.
Findings
Achieved 46.54% accuracy in thirteen-class imagined speech classification.
Achieved 75.56% accuracy in binary imagined speech classification.
Supports the feasibility of imagined speech BCI for metaverse applications.
Abstract
Metaverse provides an alternative platform for human interaction in the virtual world. Since virtual platform holds few restrictions in changing the surrounding environments or the appearance of the avatars, it can serve as a platform that reflects human thoughts or even dreams at least in the metaverse world. When it is merged together with the current brain-computer interface (BCI) technology, which enables system control via brain signals, a new paradigm of human interaction through mind may be established in the metaverse conditions. Recent BCI systems are aiming to provide user-friendly and intuitive means of communication using brain signals. Imagined speech has become an alternative neuro-paradigm for communicative BCI since it relies directly on a person's speech production process, rather than using speech-unrelated neural activity as the means of communication. In this paper,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEEG and Brain-Computer Interfaces · Advanced Memory and Neural Computing · Robotics and Automated Systems
