A Gaze Estimation Method Based on Spatial and Channel Reconstructed ResNet Combined with Multi-Clue Fusion

TL;DR

This paper introduces a new gaze estimation model that improves accuracy by combining spatial and channel feature extraction with multi-clue fusion for online learning applications.

Contribution

The novel RSP-MCGaze model integrates ResNet and SCConv to better extract features and model spatio-temporal relationships in gaze estimation.

Findings

The model achieves a detection error of 9.86 on the Gaze360 dataset.

It achieves a detection error of 7.11 on the detectable face subset of Gaze360.

The model outperforms existing baseline models on public datasets.

Abstract

The complexity of various factors influencing online learning makes it difficult to characterize learning concentration, while Accurately estimating students’ gaze points during learning video sessions represents a critical scientific challenge in assessing and enhancing the attentiveness of online learners. However, current appearance-based gaze estimation models lack a focus on extracting essential features and fail to effectively model the spatio-temporal relationships among the head, face, and eye regions, which limits their ability to achieve lower angular errors. This paper proposes an appearance-based gaze estimation model (RSP-MCGaze). The model constructs a feature extraction backbone network for gaze estimation (ResNetSC) by integrating ResNet and SCConv; this integration enhances the model’s ability to extract important features while reducing spatial and channel redundancy. Based on the ResNetSC backbone, the method for video gaze estimation was further optimized by jointly locating the head, eyes, and face. The experimental results demonstrate that our model achieves significantly higher performance compared to existing baseline models on public datasets, thereby fully confirming the superiority of our method in the gaze estimation task. The model achieves a detection error of 9.86 on the Gaze360 dataset and a detection error of 7.11 on the detectable face subset of Gaze360.

Figures