A Super-Resolution and 3D Reconstruction Method Based on OmDF Endoscopic Images

TL;DR

This paper introduces a new method for improving endoscopic image quality and 3D reconstruction accuracy using advanced image processing techniques.

Contribution

Omni-Directional Focus and Scale Resolution (OmDF-SR) is a novel endoscopic image super-resolution and 3D reconstruction method.

Findings

OmDF-SR achieves a PSNR of 38.2902 dB and SSIM of 0.9746 at ×2 magnification.

The method improves 3D model reconstruction with enhanced point cloud density and mesh quality.

Abstract

In the field of endoscopic imaging, challenges such as low resolution, complex textures, and blurred edges often degrade the quality of 3D reconstructed models. To address these issues, this study introduces an innovative endoscopic image super-resolution and 3D reconstruction technique named Omni-Directional Focus and Scale Resolution (OmDF-SR). This method integrates an Omnidirectional Self-Attention (OSA) mechanism, an Omnidirectional Scale Aggregation Group (OSAG), a Dual-stream Adaptive Focus Mechanism (DAFM), and a Dynamic Edge Adjustment Framework (DEAF) to enhance the accuracy and efficiency of super-resolution processing. Additionally, it employs Structure from Motion (SfM) and Multi-View Stereo (MVS) technologies to achieve high-precision medical 3D models. Experimental results indicate significant improvements in image processing with a PSNR of 38.2902 dB and an SSIM of 0.9746 at a magnification factor of ×2, and a PSNR of 32.1723 dB and an SSIM of 0.9489 at ×4. Furthermore, the method excels in reconstructing detailed 3D models, enhancing point cloud density, mesh quality, and texture mapping richness, thus providing substantial support for clinical diagnosis and surgical planning.

Figures