# AI-Based Augmented Reality Microscope for Real-Time Sperm Detection and Tracking in Micro-TESE

## TL;DR

This paper introduces an AI-powered augmented reality microscope that helps embryologists find and track sperm more efficiently during a complex infertility procedure.

## Contribution

The novel system combines real-time AI sperm detection with AR visualization to improve Micro-TESE efficiency.

## Key findings

- The YOLOv5 model achieved 0.81 precision and 0.52 recall for sperm detection in microscope images.
- The AR interface doubled the sperm detection rate compared to manual methods (66.9% vs. 30.8%).
- The system provides real-time sperm tracking and motility analysis to assist embryologists.

## Abstract

Non-obstructive azoospermia (NOA) is a severe male infertility condition characterized by extremely low or absent sperm production. In microdissection testicular sperm extraction (Micro-TESE) procedures for NOA, embryologists must manually search through testicular tissue under a microscope for rare sperm, a process that can take 1.8–7.5 h and impose significant fatigue and burden. This paper presents an augmented reality (AR) microscope system with AI-based image analysis to accelerate sperm retrieval in Micro-TESE. The proposed system integrates a deep learning model (YOLOv5) for real-time sperm detection in microscope images, a multi-object tracker (DeepSORT) for continuous sperm tracking, and a velocity calculation module for sperm motility analysis. Detected sperm positions and motility metrics are overlaid in the microscope’s eyepiece view via a microdisplay, providing immediate visual guidance to the embryologist. In experiments on seminiferous tubule sample images, the YOLOv5 model achieved a precision of 0.81 and recall of 0.52, outperforming previous classical methods in accuracy and speed. The AR interface allowed an operator to find sperm faster, roughly doubling the sperm detection rate (66.9% vs. 30.8%). These results demonstrate that the AR microscope system can significantly aid embryologists by highlighting sperm in real time and potentially shorten Micro-TESE procedure times. This application of AR and AI in sperm retrieval shows promise for improving outcomes in assisted reproductive technology.