Gaze estimation learning architecture as support to affective, social and cognitive studies in natural human-robot interaction

TL;DR

This paper introduces a novel robotic architecture for estimating human gaze direction using only robot sensors, facilitating social and cognitive studies in natural human-robot interactions without external hardware.

Contribution

It presents a new learning architecture and a dataset for gaze estimation in tabletop scenarios, enhancing ecological validity in social cognition research.

Findings

Successful gaze estimation in tabletop scenarios

Dataset with 24 participants and annotated images

Supports studies without external hardware

Abstract

Gaze is a crucial social cue in any interacting scenario and drives many mechanisms of social cognition (joint and shared attention, predicting human intention, coordination tasks). Gaze direction is an indication of social and emotional functions affecting the way the emotions are perceived. Evidence shows that embodied humanoid robots endowing social abilities can be seen as sophisticated stimuli to unravel many mechanisms of human social cognition while increasing engagement and ecological validity. In this context, building a robotic perception system to automatically estimate the human gaze only relying on robot's sensors is still demanding. Main goal of the paper is to propose a learning robotic architecture estimating the human gaze direction in table-top scenarios without any external hardware. Table-top tasks are largely used in many studies in experimental psychology because they are suitable to implement numerous scenarios allowing agents to collaborate while maintaining a face-to-face interaction. Such an architecture can provide a valuable support in studies where external hardware might represent an obstacle to spontaneous human behaviour, especially in environments less controlled than the laboratory (e.g., in clinical settings). A novel dataset was also collected with the humanoid robot iCub, including images annotated from 24 participants in different gaze conditions.