Dialogue system with humanoid robot

TL;DR

This paper presents a humanoid robot dialogue system that integrates speech content, facial expressions, and gaze control to enable more natural human-robot interactions, advancing beyond traditional speech-only dialogue systems.

Contribution

It introduces a novel dialogue system that incorporates facial expressions and gaze control, enhancing human-like interaction capabilities of humanoid robots.

Findings

Developed a robot capable of controlling speech, facial expressions, and gaze.

Participated in the Japanese Dialogue Robot Competition.

Achieved more natural and engaging human-robot interactions.

Abstract

Today, as seen in smart speakers, spoken dialogue technology is rapidly advancing to enable human-like interaction. However, current dialogue systems cannot pay attention not only to the content of speech, but also to the way of speaking and eye contact and facial expressions, while watching the facial expressions of the person with whom one is speaking. Therefore, this study participated in a Japanese competition called the "Dialogue Robot Competition" and attempted to develop a dialogue system that includes control of not only the content of speech but also the robot's facial expressions and gaze in order to realize a humanoid robot that can naturally interact with humans.