# Decoupled quality and readability in skin cancer education from large language models

## TL;DR

This study shows that high-quality skin cancer education from AI does not always match high readability, requiring careful model and content choices.

## Contribution

The paper reveals that quality and readability in AI-generated health content are largely independent factors.

## Key findings

- GPT-5 produced the highest quality skin cancer education content.
- Readability varied significantly across models and content categories.
- Quality and readability metrics showed little correlation.

## Abstract

Large language models (LLMs) are increasingly used by the public to obtain health information, yet the relationship between content quality and readability in LLM-generated patient education remains unclear.

We benchmarked five LLMs (Doubao, DeepSeek, Wenxin Yiyan, Tongyi Qianwen, and GPT-5) using an identical set of 20 Mandarin Chinese skin-cancer FAQs (100 total outputs). Quality was assessed using c-PEMAT-P and the Global Quality Scale (GQS), and readability was assessed using seven indices (ARI, FRES, GFOG, FKGL, CL, SMOG, and LW). Group differences and correlations were evaluated with appropriate statistical tests.

Models showed comparable understandability/actionability (c-PEMAT-P), while overall quality (GQS) differed, with GPT-5 scoring highest. Readability varied substantially by both model and content category, and no single model performed best across all readability metrics. Correlation analyses indicated that quality and readability were largely decoupled.

High-quality outputs do not necessarily have high readability. Optimizing AI-generated skin-cancer education requires multi-faceted strategies that jointly consider model choice and content topic.