OpenAI ChatGPT interprets Radiological Images: GPT-4 as a Medical Doctor for a Fast Check-Up

TL;DR

This paper evaluates GPT-4's ability to interpret radiological images, finding it can assist clinicians but is not yet reliable enough to replace medical professionals in image analysis.

Contribution

The study demonstrates GPT-4's image interpretation capabilities in radiology and assesses its potential as a decision-support tool in healthcare.

Findings

GPT-4 can interpret radiological images to some extent.

GPT-4 is not sufficiently accurate to replace radiologists.

GPT-4 can assist clinicians in decision-making.

Abstract

OpenAI released version GPT-4 on March 14, 2023, following the success of ChatGPT, which was announced in November 2022. In addition to the existing GPT-3 features, GPT-4 can interpret images. To achieve this, the processing power and model have been significantly improved. The ability to process and interpret images goes far beyond the applications and effectiveness of artificial intelligence. In this study, we first explored the interpretation of radiological images in healthcare using artificial intelligence (AI). Then, we experimented with the image interpretation capability of the GPT-4. In this way, we addressed the question of whether artificial intelligence (AI) can replace a healthcare professional (e.g., a medical doctor) or whether it can be used as a decision-support tool that makes decisions easier and more reliable. Our results showed that ChatGPT is not sufficient and accurate to analyze chest X-ray images, but it can provide interpretations that can assist medical doctors or clinicians.