Integrated Pipeline for Monocular 3D Reconstruction and Finite Element Simulation in Industrial Applications

TL;DR

This paper presents an integrated workflow combining monocular video-based 3D reconstruction, finite element analysis, and mixed reality visualization to create interactive digital twins for industrial applications, balancing accuracy and real-time performance.

Contribution

It introduces a novel pipeline that seamlessly integrates deep learning-based 3D reconstruction with finite element simulation and augmented reality visualization for industrial use.

Findings

High geometric accuracy in 3D reconstruction

Efficient finite element analysis with optimized meshes

Effective real-time AR visualization of simulation results

Abstract

To address the challenges of 3D modeling and structural simulation in industrial environment, such as the difficulty of equipment deployment, and the difficulty of balancing accuracy and real-time performance, this paper proposes an integrated workflow, which integrates high-fidelity 3D reconstruction based on monocular video, finite element simulation analysis, and mixed reality visual display, aiming to build an interactive digital twin system for industrial inspection, equipment maintenance and other scenes. Firstly, the Neuralangelo algorithm based on deep learning is used to reconstruct the 3D mesh model with rich details from the surround-shot video. Then, the QuadRemesh tool of Rhino is used to optimize the initial triangular mesh and generate a structured mesh suitable for finite element analysis. The optimized mesh is further discretized by HyperMesh, and the material parameter setting and stress simulation are carried out in Abaqus to obtain high-precision stress and deformation results. Finally, combined with Unity and Vuforia engine, the real-time superposition and interactive operation of simulation results in the augmented reality environment are realized, which improves users 'intuitive understanding of structural response. Experiments show that the method has good simulation efficiency and visualization effect while maintaining high geometric accuracy. It provides a practical solution for digital modeling, mechanical analysis and interactive display in complex industrial scenes, and lays a foundation for the deep integration of digital twin and mixed reality technology in industrial applications.