Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Cameras
Charles Javerliat, Pierre Raimbaud, Guillaume Lavou\'e

TL;DR
Kineo is a novel calibration-free motion capture system that automatically reconstructs 3D human motion from uncalibrated, unsynchronized RGB videos, achieving high accuracy and efficiency without expert intervention.
Contribution
Kineo introduces a fully automatic pipeline that calibrates cameras and reconstructs 3D motion from uncalibrated videos, significantly improving accuracy and computational efficiency over prior methods.
Findings
Reduces camera translation error by 83-85%.
Decreases camera angular error by 86-92%.
Faster processing than real-time in some scenarios.
Abstract
Markerless multiview motion capture is often constrained by the need for precise camera calibration, limiting accessibility for non-experts and in-the-wild captures. Existing calibration-free approaches mitigate this requirement but suffer from high computational cost and reduced reconstruction accuracy. We present Kineo, a fully automatic, calibration-free pipeline for markerless motion capture from videos captured by unsynchronized, uncalibrated, consumer-grade RGB cameras. Kineo leverages 2D keypoints from off-the-shelf detectors to simultaneously calibrate cameras, including Brown-Conrady distortion coefficients, and reconstruct 3D keypoints and dense scene point maps at metric scale. A confidence-driven spatio-temporal keypoint sampling strategy, combined with graph-based global optimization, ensures robust calibration at a fixed computational cost independent of sequence length.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
