An Underwater 6-DoF Position and Orientation Estimation Method for Divers Based on the VideoPose5CH Model

TL;DR

This paper introduces a new method for estimating a diver's position and orientation underwater using a deep learning model called VideoPose5CH.

Contribution

The paper proposes a novel framework and network architecture, VideoPose5CH, for 6-DoF estimation of divers in underwater environments.

Findings

The proposed method achieves stable 6-DoF estimation for divers within a distance range of 2.643 m to 11.477 m.

Average position errors are 7.33 cm, 4.04 cm, and 27.15 cm along the three axes.

Average orientation errors are 6.96°, 8.47°, and 2.62°.

Abstract

Accurate perception of a diver’s position and orientation by Autonomous Underwater Vehicles (AUVs) is essential for effective human–robot collaboration in underwater environments. However, conventional position and orientation estimation methods that combine deep learning with Perspective-n-Point (PnP) algorithms are primarily designed for rigid objects. In contrast, divers exhibit highly variable postures underwater, with no fixed configuration. To address this limitation, this paper proposes a framework for estimating the six-degree-of-freedom (6-DoF) position and the orientation of a diver. In addition, a novel network architecture, termed “VideoPose5CH,” is proposed. In the proposed framework, temporal sequences of 2D joint coordinates are provided to VideoPose5CH, which then outputs the 3D joint coordinates of the current frame as well as the corresponding refined 2D joint locations. Subsequently, the diver’s 6-DoF position and orientation relative to the camera are further recovered via a PnP algorithm. To mitigate the scarcity of underwater 3D human pose datasets, a land-based 3D human pose dataset augmentation strategy tailored to underwater conditions is further proposed. With this strategy, diver pose estimation accuracy is improved and the robustness of the proposed method across diverse scenarios is enhanced. Experimental results demonstrate that the proposed method can stably estimate the 6-DoF position and orientation of the diver within a distance range of 2.643 m to 11.477 m. The average position errors along the three axes are 7.33 cm, 4.04 cm, and 27.15 cm, respectively, while the average orientation errors are 6.96°, 8.47°, and 2.62°.

Figures