# Research on High-Precision Localization Method of Curved Surface Feature Points Based on RGB-D Data Fusion

## TL;DR

This paper introduces a high-precision method for locating curved surface feature points using RGB-D data fusion, achieving sub-millimeter accuracy for industrial applications.

## Contribution

A novel RGB-D fusion method with sub-pixel refinement and 3D surface fitting for high-accuracy feature point localization.

## Key findings

- The method achieves a mean absolute error of 0.17 mm for various component types.
- Maximum error remains below 0.22 mm, suitable for precision manufacturing and quality inspection.
- Improved Prewitt operator and YOLOv10 with BMFM enhance 2D localization accuracy.

## Abstract

Although RGB images contain rich details, they lack 3D depth information. Depth data, while providing spatial positioning, is often affected by noise and suffers from sparsity or missing data at key feature points, leading to low accuracy and high computational complexity in traditional visual localization. To address this, this paper proposes a high-precision, sub-pixel-level localization method for workpiece feature points based on RGB-D data fusion. The method specifically targets two types of localization objects: planar corner keypoints and sharp-corner keypoints. It employs the YOLOv10 model combined with a Background Misdetection Filtering Module (BMFM) to classify and identify feature points in RGB images. An improved Prewitt operator (using 5 × 5 convolution kernels in 8 directions) and sub-pixel refinement techniques are utilized to enhance 2D localization accuracy. The 2D feature boundaries are then mapped into 3D point cloud space based on camera extrinsic parameters. After coarse error detection in the point cloud and local quadric surface fitting, 3D localization is achieved by intersecting spatial rays with the fitted surfaces. Experimental results demonstrate that the proposed method achieves a mean absolute error (MAE) of 0.17 mm for localizing flat, free-form, and grooved components, with a maximum error of less than 0.22 mm, meeting the requirements of high-precision industrial applications such as precision manufacturing and quality inspection.