CoreUI: Interactive Core Training System with 3D Human Shape

TL;DR

CoreUI is an interactive system that uses 3D human shape estimation from monocular images to guide core training, providing more effective visual feedback than traditional 2D skeleton guidance.

Contribution

This paper introduces CoreUI, a novel user interface that visualizes 3D human shape differences for core training using monocular camera input, enhancing guidance accuracy.

Findings

Effective and convenient training guidance demonstrated in user studies.

Improved accuracy in posture maintenance over conventional 2D guidance.

Utilizes monocular images, reducing equipment costs.

Abstract

We present an interactive core training system for core training using a monocular camera image as input in this paper. It is commonly expensive to capture human pose using depth cameras or multiple cameras with conventional approaches. To solve this issue, we employ the skinned multi-person linear model of human shape to recover the 3D human pose from 2D images using pose estimation and human mesh recovery approaches. In order to support the user in maintaining the correct postures from target poses in the training, we adopt 3D human shape estimation for both the target image and input camera video. We propose CoreUI, a user interface for providing visual guidance showing the differences among the estimated targets and current human shapes in core training, which are visualized by markers at ten body parts with color changes. From our user studies, the proposed core training system is effective and convenient compared with the conventional guidance of 2D skeletons.