Who's that Actor? Automatic Labelling of Actors in TV series starting from IMDB Images
Rahaf Aljundi, Punarjay Chakravarty, Tinne Tuytelaars

TL;DR
This paper presents a novel method for automatically labeling actors in TV series using only IMDB images for reference, employing a graph-matching algorithm to handle appearance variations, achieving high accuracy.
Contribution
The paper introduces the Hungarian Self Labeling (HSL) algorithm for domain adaptation in actor labeling, including a new edge cost and outlier-robust clustering extension.
Findings
Achieved 90% accuracy in actor labeling across multiple TV series episodes.
Demonstrated robustness to appearance changes like makeup and lighting.
Validated effectiveness of the proposed graph-matching approach.
Abstract
In this work, we aim at automatically labeling actors in a TV series. Rather than relying on transcripts and subtitles, as has been demonstrated in the past, we show how to achieve this goal starting from a set of example images of each of the main actors involved, collected from the Internet Movie Database (IMDB). The problem then becomes one of domain adaptation: actors' IMDB photos are typically taken at awards ceremonies and are quite different from their appearances in TV series. In each series as well, there is considerable change in actor appearance due to makeup, lighting, ageing, etc. To bridge this gap, we propose a graph-matching based self-labelling algorithm, which we coin HSL (Hungarian Self Labeling). Further, we propose a new edge cost to be used in this context, as well as an extension that is more robust to outliers, where prototypical faces for each of the actors are…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Analysis and Summarization · Generative Adversarial Networks and Image Synthesis · Image Retrieval and Classification Techniques
