Fracture Detection and Localisation in Wrist and Hand Radiographs using Detection Transformer Variants

TL;DR

This study applies detection transformer models to wrist and hand X-ray analysis, achieving high accuracy in fracture detection and localization, and demonstrating potential for real-time clinical deployment.

Contribution

It introduces a novel application of object detection transformers to extremity fracture analysis, with a fine-tuned pipeline that outperforms existing models in accuracy and efficiency.

Findings

Co-DETR achieved AP@50 of 0.615, outperforming RT-DETR.

The pipeline reached 83.1% accuracy, 85.1% precision, and 96.4% recall.

Visual inspection confirmed accurate fracture localization.

Abstract

Background: Accurate diagnosis of wrist and hand fractures using radiographs is essential in emergency care, but manual interpretation is slow and prone to errors. Transformer-based models show promise in improving medical image analysis, but their application to extremity fractures is limited. This study addresses this gap by applying object detection transformers to wrist and hand X-rays. Methods: We fine-tuned the RT-DETR and Co-DETR models, pre-trained on COCO, using over 26,000 annotated X-rays from a proprietary clinical dataset. Each image was labeled for fracture presence with bounding boxes. A ResNet-50 classifier was trained on cropped regions to refine abnormality classification. Supervised contrastive learning was used to enhance embedding quality. Performance was evaluated using AP@50, precision, and recall metrics, with additional testing on real-world X-rays. Results: RT-DETR showed moderate results (AP@50 = 0.39), while Co-DETR outperformed it with an AP@50 of 0.615 and faster convergence. The integrated pipeline achieved 83.1% accuracy, 85.1% precision, and 96.4% recall on real-world X-rays, demonstrating strong generalization across 13 fracture types. Visual inspection confirmed accurate localization. Conclusion: Our Co-DETR-based pipeline demonstrated high accuracy and clinical relevance in wrist and hand fracture detection, offering reliable localization and differentiation of fracture types. It is scalable, efficient, and suitable for real-time deployment in hospital workflows, improving diagnostic speed and reliability in musculoskeletal radiology.