Cross-Dataset Gaze Estimation by Evidential Inter-intra Fusion

TL;DR

This paper introduces a novel framework for cross-dataset gaze estimation that leverages evidential fusion and uncertainty estimation to improve generalization across diverse and unseen environments.

Contribution

The paper proposes the EIF framework with independent dataset branches, evidential regressors, and fusion strategies to enhance cross-dataset gaze prediction performance.

Findings

Improves accuracy in unseen domains

Provides uncertainty estimates for gaze predictions

Outperforms existing methods in cross-dataset scenarios

Abstract

Achieving accurate and reliable gaze predictions in complex and diverse environments remains challenging. Fortunately, it is straightforward to access diverse gaze datasets in real-world applications. We discover that training these datasets jointly can significantly improve the generalization of gaze estimation, which is overlooked in previous works. However, due to the inherent distribution shift across different datasets, simply mixing multiple dataset decreases the performance in the original domain despite gaining better generalization abilities. To address the problem of ``cross-dataset gaze estimation'', we propose a novel Evidential Inter-intra Fusion EIF framework, for training a cross-dataset model that performs well across all source and unseen domains. Specifically, we build independent single-dataset branches for various datasets where the data space is partitioned into overlapping subspaces within each dataset for local regression, and further create a cross-dataset branch to integrate the generalizable features from single-dataset branches. Furthermore, evidential regressors based on the Normal and Inverse-Gamma (NIG) distribution are designed to additionally provide uncertainty estimation apart from predicting gaze. Building upon this foundation, our proposed framework achieves both intra-evidential fusion among multiple local regressors within each dataset and inter-evidential fusion among multiple branches by Mixture \textbfof Normal Inverse-Gamma (MoNIG distribution. Experiments demonstrate that our method consistently achieves notable improvements in both source domains and unseen domains.