Live Stream Temporally Embedded 3D Human Body Pose and Shape Estimation
Zhouping Wang, Sarah Ostadabbas

TL;DR
This paper introduces TePose, a real-time method for 3D human pose and shape estimation from live stream videos, utilizing temporal information and adversarial training to enhance accuracy and consistency.
Contribution
The paper proposes a novel temporally embedded approach with a multi-scale spatio-temporal graph convolutional network and a sequential data loading strategy for live streams.
Findings
TePose achieves state-of-the-art performance on human pose benchmarks.
The method improves temporal consistency in live stream videos.
Extensive experiments validate the effectiveness of each module.
Abstract
3D Human body pose and shape estimation within a temporal sequence can be quite critical for understanding human behavior. Despite the significant progress in human pose estimation in the recent years, which are often based on single images or videos, human motion estimation on live stream videos is still a rarely-touched area considering its special requirements for real-time output and temporal consistency. To address this problem, we present a temporally embedded 3D human body pose and shape estimation (TePose) method to improve the accuracy and temporal consistency of pose estimation in live stream videos. TePose uses previous predictions as a bridge to feedback the error for better estimation in the current frame and to learn the correspondence between data frames and predictions in the history. A multi-scale spatio-temporal graph convolutional network is presented as the motion…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHuman Pose and Action Recognition · Video Surveillance and Tracking Methods · Anomaly Detection Techniques and Applications
