AR Visualization System for Ship Detection and Recognition Based on AI

TL;DR

This paper presents an AR system integrating AI for ship detection and recognition in remote sensing images, achieving high accuracy and enabling immersive visualization on Hololens2.

Contribution

It combines AI-based ship detection with AR visualization, deploying a novel system on Hololens2 that fuses computer vision with augmented reality.

Findings

Detection accuracy reaches 96% on RTX 2080Ti.

Successfully integrates AI detection with AR visualization.

System deployed on Hololens2 with interactive features.

Abstract

Augmented reality technology has been widely used in industrial design interaction, exhibition guide, information retrieval and other fields. The combination of artificial intelligence and augmented reality technology has also become a future development trend. This project is an AR visualization system for ship detection and recognition based on AI, which mainly includes three parts: artificial intelligence module, Unity development module and Hololens2AR module. This project is based on R3Det algorithm to complete the detection and recognition of ships in remote sensing images. The recognition rate of model detection trained on RTX 2080Ti can reach 96%. Then, the 3D model of the ship is obtained by ship categories and information and generated in the virtual scene. At the same time, voice module and UI interaction module are added. Finally, we completed the deployment of the project on Hololens2 through MRTK. The system realizes the fusion of computer vision and augmented reality technology, which maps the results of object detection to the AR field, and makes a brave step toward the future technological trend and intelligent application.