# Analysis of AI-Generated Patient Education Guides for Urological Conditions: A Comparative Study Between ChatGPT and Gemini

## TL;DR

This study compared ChatGPT and Gemini in generating patient education guides for urological conditions and found no significant differences in readability, reliability, or originality.

## Contribution

The study provides a comparative analysis of the latest AI chatbots for generating patient education guides in urology.

## Key findings

- No statistically significant differences were found between ChatGPT and Gemini in readability, reliability, or similarity.
- Generated guides exceeded the recommended reading level and showed limited originality.
- Both AI chatbots demonstrated moderate reliability, suggesting the need for professional oversight.

## Abstract

Introduction

Artificial intelligence (AI) chatbots are increasingly being used to create patient education guides (PEGs). However, there are gaps in the literature comparing the latest version in terms of readability, reliability, and similarity. The aim of this study was to compare PEGs generated by ChatGPT 5.1 (OpenAI, San Francisco, California, US) and Gemini 3 Pro (Google LLC, Mountain View, CA, USA) for five common urological conditions, kidney stone, urinary tract infection, urinary retention, erectile dysfunction, and benign prostatic hyperplasia, across these domains.

Methods

This cross-sectional study analysed PEGs generated by both AI chatbots for five common urological conditions using identical prompts. Readability was assessed using the Flesch Reading Ease Score and Flesch-Kincaid Grade Level. Reliability and similarity were assessed using a modified DISCERN score and Turnitin, respectively. Statistical comparison was performed using the Mann-Whitney U test.

Results

None of the evaluated characteristics showed a statistically significant difference between the PEGs generated by AI chatbots.

Conclusion

PEGs generated by both AI chatbots exceeded the recommended reading level, demonstrated limited originality, and showed moderate reliability, highlighting the need for professional oversight. Continued refinement of AI chatbots is necessary before integrating AI-generated PEGs into routine patient education.