L3D-Pose: Lifting Pose for 3D Avatars from a Single Camera in the Wild
Soumyaratna Debnath, Harish Katti, Shashikant Verma, Shanmuganathan, Raman

TL;DR
This paper introduces L3D-Pose, a framework that synthesizes datasets and employs a simple attention-based neural network to lift 2D poses to 3D for avatars, enabling pose retargeting in natural environments.
Contribution
It presents a novel hybrid approach combining synthetic dataset generation, an attention-based MLP for 2D to 3D pose lifting, and a lookup table for accurate pose retargeting onto arbitrary avatars.
Findings
Effective 3D pose estimation from 2D in wild settings
Efficient pose retargeting using a deep pose lookup table
Scalable framework for natural environment applications
Abstract
While 2D pose estimation has advanced our ability to interpret body movements in animals and primates, it is limited by the lack of depth information, constraining its application range. 3D pose estimation provides a more comprehensive solution by incorporating spatial depth, yet creating extensive 3D pose datasets for animals is challenging due to their dynamic and unpredictable behaviours in natural settings. To address this, we propose a hybrid approach that utilizes rigged avatars and the pipeline to generate synthetic datasets to acquire the necessary 3D annotations for training. Our method introduces a simple attention-based MLP network for converting 2D poses to 3D, designed to be independent of the input image to ensure scalability for poses in natural environments. Additionally, we identify that existing anatomical keypoint detectors are insufficient for accurate pose…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAugmented Reality Applications · Human Motion and Animation · Virtual Reality Applications and Impacts
