Unified Simulation, Perception, and Generation of Human Behavior

TL;DR

This thesis presents a comprehensive approach to human behavior modeling by integrating simulation, perception, and generation, demonstrating their interconnectedness and mutual benefits for advancing computer vision and robotics.

Contribution

It introduces a unified framework that combines the three key aspects of human behavior modeling, highlighting their interdependence and potential for improved applications.

Findings

Enhanced understanding of the connections between simulation, perception, and generation.

Demonstrated mutual improvements when integrating the three aspects.

Provided insights and future directions for human behavior modeling.

Abstract

Understanding and modeling human behavior is fundamental to almost any computer vision and robotics applications that involve humans. In this thesis, we take a holistic approach to human behavior modeling and tackle its three essential aspects -- simulation, perception, and generation. Throughout the thesis, we show how the three aspects are deeply connected and how utilizing and improving one aspect can greatly benefit the other aspects. We also discuss the lessons learned and our vision for what is next for human behavior modeling.