# OBUSight: Clinically Aligned Generative AI for Ophthalmic Ultrasound Interpretation and Diagnosis

## TL;DR

OBUSight is a generative AI tool that improves ophthalmic ultrasound diagnosis by generating reports and aiding clinicians, especially those with less experience.

## Contribution

OBUSight introduces a clinically aligned AI model for joint report generation and disease diagnosis in ophthalmic ultrasound.

## Key findings

- OBUSight outperformed eight state-of-the-art models in report quality and clinical efficacy metrics.
- The AI model achieved diagnostic performance comparable to ophthalmologists and reduced diagnostic time.
- OBUSight provided clinically aligned reports requiring minimal corrections and aided less experienced clinicians.

## Abstract

Ocular B‐scan ultrasonography (OBU), widely used for diagnosing posterior segment ocular disorders, poses unique challenges for ophthalmologists in image interpretation. In this study, a clinically aligned generative artificial intelligence (AI) model, OBUSight, was proposed to jointly generate reports and diagnose diseases for comprehensive OBU image interpretation. OBUSight was trained and validated on a large multi‐center OBU dataset consisting of 39 654 images and 17 586 corresponding reports from 11 381 patients. By evaluating the quality of generated reports using natural language generation (NLG) metrics and clinical efficacy (CE) metrics, OBUSight outperformed eight state‐of‐the‐art models and demonstrated robust performance across multi‐center and multimorbidity validation datasets. The expert rating further indicated that OBUSight can provide clinically aligned reports without major corrections. The ancillary role of OBUSight in enhancing diagnostic efficiency was evaluated by providing ophthalmologists, residents, and ophthalmology students with its generated reports and predicted diagnoses during the diagnostic process. In both retrospective and prospective evaluations, OBUSight significantly outperformed residents and ophthalmology students (all p < 0.05), achieved diagnostic performance comparable to ophthalmologists, and reduced diagnostic time. In conclusion, OBUSight represents a promising AI tool for enhancing diagnostic efficiency in ophthalmic ultrasound practice, especially for less experienced clinicians.

OBUSight, a clinically aligned generative AI model that jointly generates reports and predicts diseases through multimodal semantic alignment, was trained and validated on a large multicenter dataset. OBUSight outperformed eight state‐of‐the‐art models, provided clinically reliable reports, enhanced diagnostic efficiency, and achieved performance comparable to ophthalmologists, particularly benefiting less experienced clinicians.