Radiology-Llama2: Best-in-Class Large Language Model for Radiology

TL;DR

Radiology-Llama2 is a specialized large language model for radiology that achieves state-of-the-art results in generating clinically useful impressions from radiological data, demonstrating the potential of domain-specific AI models.

Contribution

The paper presents Radiology-Llama2, a domain-specific Llama2-based model trained on radiology reports, achieving top performance and demonstrating clinical utility in radiology applications.

Findings

State-of-the-art ROUGE scores on MIMIC-CXR and OpenI datasets.

Radiology experts confirm the model's coherence and clinical relevance.

Potential to automate tasks and support radiologists.

Abstract

This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance compared to other generative language models, with a Rouge-1 score of 0.4834 on MIMIC-CXR and 0.4185 on OpenI. Additional assessments by radiology experts highlight the model's strengths in understandability, coherence, relevance, conciseness, and clinical utility. The work illustrates the potential of localized language models designed and tuned for specialized domains like radiology. When properly evaluated and deployed, such models can transform fields like radiology by automating rote tasks and enhancing human expertise.