# Automatic captioning for medical imaging (MIC): a rapid review of literature

**Authors:** Djamila-Romaissa Beddiar, Mourad Oussalah, Tapio Seppänen

PMC · DOI: 10.1007/s10462-022-10270-w · Artificial Intelligence Review · 2022-09-17

## TL;DR

This paper reviews recent advances in automatic captioning for medical images, focusing on how AI can help describe medical images for better diagnosis and treatment.

## Contribution

The paper provides a rapid review of the latest achievements in medical image captioning from a medical domain perspective.

## Key findings

- Medical image captioning combines computer vision and natural language processing for clinical applications.
- Current reviews are limited in scope, motivating a broader rapid review of recent advancements.
- The paper highlights datasets, applications, limitations, and future directions in medical image captioning.

## Abstract

Automatically understanding the content of medical images and delivering accurate descriptions is an emerging field of artificial intelligence that combines skills in both computer vision and natural language processing fields. Medical image captioning is involved in various applications related to diagnosis, treatment, report generation and computer-aided diagnosis to facilitate the decision making and clinical workflows. Unlike generic image captioning, medical image captioning highlights the relationships between image objects and clinical findings, which makes it a very challenging task. Although few review papers have already been published in this field, their coverage is still quite limited and only particular problems are addressed. This motivates the current paper where a rapid review protocol was adopted to review the latest achievements in automatic medical image captioning from the medical domain perspective. We aim through this review to provide the reader with an up-to-date literature in this field by summarizing the key findings and approaches in this field, including the related datasets, applications and limitations as well as highlighting the main competitions, challenges and future directions.

## Full-text entities

- **Diseases:** retinal diseases (MESH:D012164), thoracic disease (MESH:D013896), diabetic retinopathy diseases (MESH:D003930), bladder cancer (MESH:D001749), Brain Tumor (MESH:D001932), pulmonary abnormalities (MESH:D008171), papillary urothelial neoplasm (MESH:D002291), visually impaired (MESH:D014786), Alzheimer's disease (MESH:D000544), CHR (MESH:D015211), meningioma (MESH:D008579), Impression (MESH:D010985), COVID (MESH:D000086382), MIC (MESH:C564543), PMC (MESH:D020210), carcinoma (MESH:D009369)
- **Chemicals:** hydrogen (MESH:D006859), water (MESH:D014867)
- **Species:** Homo sapiens (human, species) [taxon 9606]

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC9483422/full.md

## Figures

18 figures with captions in the complete paper: https://tomesphere.com/paper/PMC9483422/full.md

## References

69 references — full list in the complete paper: https://tomesphere.com/paper/PMC9483422/full.md

---
Source: https://tomesphere.com/paper/PMC9483422