Conversational AI for Automated Patient Questionnaire Completion: Development Insights and Design Principles

TL;DR

This paper presents the development of a GPT-5 based conversational agent for collecting patient-reported data on back pain, emphasizing innovative design principles for health data collection through dialogue.

Contribution

It introduces a topic-based conversational approach and key design principles extending clinical guidelines for effective patient questionnaire automation.

Findings

Engages users in topic-based conversations for efficient data collection

Identifies key design principles for health data collection CAs

Addresses challenges like conversation length and ambiguity handling

Abstract

Collecting patient-reported outcome measures (PROMs) is essential for clinical care and research, yet traditional form-based approaches are often tedious for patients and burdensome for clinicians. We developed a generative AI conversational agent(CA) using GPT-5 to collect back pain data according to the NIH Task Force's Recommended Minimal Dataset. Unlike prior CAs that ask questions one-by-one, our CA engages users in topic-based conversations, allowing multiple data items to be captured in a single exchange. Through iterative development and pilot testing with clinicians and a consumer panel, we identified key design principles for health data collection CAs. These principles extend established clinical decision support design guidelines to conversational interfaces, addressing: flexibility of interaction style, personality calibration, data quality assurance through confidence visualization, patient safety constraints, and interoperability requirements. We present our prompt design methodology and discuss challenges encountered, including managing conversation length, handling ambiguous responses, and adapting to LLM version changes. Our design principles provide a practical framework for developers creating conversational agents for patient questionnaire completion. The CA is available at https://chatgpt.com/g/g-68f4869548f48191af0544f110ee91c6-backpain-data-collection-assistant (requires ChatGPT registration and subscription for unlimited use).