AI.vs.Clinician: Unveiling Intricate Interactions Between AI and Clinicians through an Open-Access Database

TL;DR

This paper introduces AI.vs.Clinician, a comprehensive open-access database capturing detailed interactions between AI systems and clinicians during sepsis diagnosis, aiming to understand their complex dynamics in medical practice.

Contribution

It presents the first extensive database of AI-clinician interactions in emergency sepsis diagnosis, facilitating research into their collaborative decision-making processes.

Findings

Curated from 7,500 diagnosis records across 14 centers in China.

Includes detailed AI and clinician decision-making data.

Enables analysis of AI influence on clinical decisions.

Abstract

Artificial Intelligence (AI) plays a crucial role in medical field and has the potential to revolutionize healthcare practices. However, the success of AI models and their impacts hinge on the synergy between AI and medical specialists, with clinicians assuming a dominant role. Unfortunately, the intricate dynamics and interactions between AI and clinicians remain undiscovered and thus hinder AI from being translated into medical practice. To address this gap, we have curated a groundbreaking database called AI.vs.Clinician. This database is the first of its kind for studying the interactions between AI and clinicians. It derives from 7,500 collaborative diagnosis records on a life-threatening medical emergency -- Sepsis -- from 14 medical centers across China. For the patient cohorts well-chosen from MIMIC databases, the AI-related information comprises the model property, feature input, diagnosis decision, and inferred probabilities of sepsis onset presently and within next three hours. The clinician-related information includes the viewed examination data and sequence, viewed time, preliminary and final diagnosis decisions with or without AI assistance, and recommended treatment.