Fun Selfie Filters in Face Recognition: Impact Assessment and Removal
Cristian Botezatu, Mathias Ibsen, Christian Rathgeb, Christoph Busch

TL;DR
This paper examines how fun selfie filters impact face recognition accuracy and introduces a GAN-based removal method that significantly improves biometric performance after filter application.
Contribution
It provides a comprehensive analysis of selfie filter effects on face recognition and proposes a novel GAN-based technique for filter removal to enhance recognition performance.
Findings
Selfie filters can significantly reduce face recognition accuracy.
Filters covering key facial features cause the most disruption.
GAN-based removal improves biometric system performance after filter application.
Abstract
This work investigates the impact of fun selfie filters, which are frequently used to modify selfies, on face recognition systems. Based on a qualitative assessment and classification of freely available mobile applications, ten relevant fun selfie filters are selected to create a database. To this end, the selected filters are automatically applied to face images of public face image databases. Different state-of-the-art methods are used to evaluate the influence of fun selfie filters on the performance of face detection using dlib, RetinaFace, and a COTS method, sample quality estimated by FaceQNet and MagFace, and recognition accuracy employing ArcFace and a COTS algorithm. The obtained results indicate that selfie filters negatively affect face recognition modules, especially if fun selfie filters cover a large region of the face, where the mouth, nose, and eyes are covered. To…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis · Face and Expression Recognition · Emotion and Mood Recognition
MethodsMagFace · Additive Angular Margin Loss
