# Uncertainty Modeling of Contextual-Connections between Tracklets for Unconstrained Video-based Face Recognition

## TL;DR

This paper introduces the Uncertainty-Gated Graph (UGG), a novel method for video-based face recognition that models uncertainty in contextual connections to improve identity propagation across tracklets.

## Contribution

The paper presents UGG, a new graph-based model that explicitly incorporates uncertainty in contextual connections, enhancing face recognition accuracy in unconstrained videos.

## Key findings

- Achieved state-of-the-art results on Cast Search in Movies dataset.
- Demonstrated robustness in IARPA Janus Surveillance Video Benchmark.
- Effectively propagates identity information despite noisy connections.

## Abstract

Unconstrained video-based face recognition is a challenging problem due to significant within-video variations caused by pose, occlusion and blur. To tackle this problem, an effective idea is to propagate the identity from high-quality faces to low-quality ones through contextual connections, which are constructed based on context such as body appearance. However, previous methods have often propagated erroneous information due to lack of uncertainty modeling of the noisy contextual connections. In this paper, we propose the Uncertainty-Gated Graph (UGG), which conducts graph-based identity propagation between tracklets, which are represented by nodes in a graph. UGG explicitly models the uncertainty of the contextual connections by adaptively updating the weights of the edge gates according to the identity distributions of the nodes during inference. UGG is a generic graphical model that can be applied at only inference time or with end-to-end training. We demonstrate the effectiveness of UGG with state-of-the-art results in the recently released challenging Cast Search in Movies and IARPA Janus Surveillance Video Benchmark dataset.