Analyzing the Performance of ChatGPT in Cardiology and Vascular Pathologies

TL;DR

This study evaluates ChatGPT's accuracy in answering cardiology and vascular pathology questions, demonstrating its potential as a valuable tool in medical education by outperforming students in a quiz-based assessment.

Contribution

It provides the first comprehensive analysis of ChatGPT's performance in cardiology and vascular pathologies, highlighting its high accuracy compared to medical students.

Findings

ChatGPT scored 92.10% on the QCM dataset.

ChatGPT outperformed the two medical students.

The results suggest ChatGPT's potential in medical education.

Abstract

The article aims to analyze the performance of ChatGPT, a large language model developed by OpenAI, in the context of cardiology and vascular pathologies. The study evaluated the accuracy of ChatGPT in answering challenging multiple-choice questions (QCM) using a dataset of 190 questions from the Siamois-QCM platform. The goal was to assess ChatGPT potential as a valuable tool in medical education compared to two well-ranked students of medicine. The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively. These results showcase how ChatGPT has the potential to be highly effective in the fields of cardiology and vascular pathologies by providing accurate answers to relevant questions.