PadChest-GR: A Bilingual Chest X-ray Dataset for Grounded Radiology Report Generation

TL;DR

PadChest-GR is a novel bilingual dataset with detailed annotations for chest X-ray images, designed to facilitate grounded radiology report generation models that localize findings and generate descriptive reports.

Contribution

This work introduces the first manually curated dataset for grounded radiology report generation in chest X-rays, including bilingual annotations and localization data.

Findings

Provides 4,555 annotated CXR studies with bilingual reports.

Includes detailed localization with bounding boxes for findings.

Enables training and evaluation of grounded report generation models.

Abstract

Radiology report generation (RRG) aims to create free-text radiology reports from clinical imaging. Grounded radiology report generation (GRRG) extends RRG by including the localisation of individual findings on the image. Currently, there are no manually annotated chest X-ray (CXR) datasets to train GRRG models. In this work, we present a dataset called PadChest-GR (Grounded-Reporting) derived from PadChest aimed at training GRRG models for CXR images. We curate a public bi-lingual dataset of 4,555 CXR studies with grounded reports (3,099 abnormal and 1,456 normal), each containing complete lists of sentences describing individual present (positive) and absent (negative) findings in English and Spanish. In total, PadChest-GR contains 7,037 positive and 3,422 negative finding sentences. Every positive finding sentence is associated with up to two independent sets of bounding boxes labelled by different readers and has categorical labels for finding type, locations, and progression. To the best of our knowledge, PadChest-GR is the first manually curated dataset designed to train GRRG models for understanding and interpreting radiological images and generated text. By including detailed localization and comprehensive annotations of all clinically relevant findings, it provides a valuable resource for developing and evaluating GRRG models from CXR images. PadChest-GR can be downloaded under request from https://bimcv.cipf.es/bimcv-projects/padchest-gr/