Event-based Solutions for Human-centered Applications: A Comprehensive Review

TL;DR

This comprehensive review explores the use of event cameras in human-centered applications, highlighting recent advancements, challenges, and future opportunities across facial and body motion analysis.

Contribution

It is the first survey to unify human-centered applications of event cameras, covering both face and body tasks, and discusses emerging areas like event compression and simulation frameworks.

Findings

Extensive overview of event camera applications in human-centered tasks.

Identification of challenges and future research directions.

Discussion of less-explored areas like event compression techniques.

Abstract

Event cameras, often referred to as dynamic vision sensors, are groundbreaking sensors capable of capturing changes in light intensity asynchronously, offering exceptional temporal resolution and energy efficiency. These attributes make them particularly suited for human-centered applications, as they capture both the most intricate details of facial expressions and the complex motion dynamics of the human body. Despite growing interest, research in human-centered applications of event cameras remains scattered, with no comprehensive overview encompassing both body and face tasks. This survey bridges that gap by being the first to unify these domains, presenting an extensive review of advancements, challenges, and opportunities. We also examine less-explored areas, including event compression techniques and simulation frameworks, which are essential for the broader adoption of event cameras. This survey is designed to serve as a foundational reference that helps both new and experienced researchers understand the current state of the field and identify promising directions for future work in human-centered event camera applications. A summary of this survey can be found at https://github.com/nmirabeth/event_human