Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-1874
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-10-19T06:53:35.964337Z
status: published
lens: p_space
sector: health
headline: Information quality, understandability, actionability and readability of large language models for HIV health education: A cross-platform evaluation
dek: Objectives: Large language models (LLMs) are increasingly used to generate health education materials, but their suitability for patient-facing human immunodeficiency virus (HIV) education remains insufficiently evaluated. We assessed the information quality, understandability, actionability, readability, text structure and source transparency of HIV patient education materials generated by six LLMs or artificial intelligence platforms.
Methods: In this cross-sectional study, 100 common HIV patient education que…
gain_title: (none)
problem_title: Chatbot-generated HIV patient education varied widely across platforms and topics, with limited actionability and high readability demands, so it is not suited to serve as an independent patient information source.
trace_subject: (none)
gain_reading: (none)
gain_evidence: (none)
problem_reading: Chatbot-generated HIV patient education varied widely across platforms and topics, with limited actionability and high readability demands, so it is not suited to serve as an independent patient information source.
problem_evidence: Overall actionability was limited and readability demands were high. | LLM-generated HIV patient education materials showed substantial cross-platform and topic-level heterogeneity.
quick_read: Researchers submitted 100 common HIV patient questions across 10 domains to six AI platforms, producing 600 English responses. They scored the outputs on understandability, actionability, information quality, readability, text structure and source transparency using several established tools.

The results suggest these tools should be treated as drafting aids that clinicians review rather than stand-alone sources for patients. Because factual accuracy, guideline concordance, hallucination and clinical safety were not assessed, the study cannot say whether the content was correct or safe.
limitation: The study did not assess direct factual accuracy, guideline concordance, hallucination or clinical safety, and each question was submitted only once in English.
tag: Evidence-backed problem
key_points: The study covered six platforms: ChatGPT 5.4-Thinking, DeepSeek-V3.2, Doubao, ERNIE Bot 5.0 Preview, Ant Afu and Gemini 3.1 Pro. | Platform differences were significant after family adjustment for all prespecified text-structure, quality/understandability/actionability and readability outcomes. | At topic level, PEMAT-P understandability and actionability and all seven readability indices differed significantly, while EQ IP-36, DISCERN, GQS, AIRM and JAMA scores did not. | Overall actionability was limited and readability demands were high.
rundown: The cross-sectional design asked each of 100 questions once in English, giving 600 responses in total. Evaluation used PEMAT-P, EQ IP-36, DISCERN, Global Quality Score, an AI response quality metric, JAMA benchmarks and seven readability indices.

Statistical comparisons between platforms used paired Friedman tests with Wilcoxon-Holm post hoc analyses. Topic analyses aggregated at question level and used Kruskal-Wallis and Dunn-Holm comparisons.

The authors conclude that substantial heterogeneity across platforms and topics supports using LLMs as expert-reviewed drafting tools rather than independent patient education sources.
sources:
- peer_reviewed | HIV Medicine | https://doi.org/10.1111/hiv.70329 | 2026-10-18
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

20446afe90aeb4efa3e6e59c09c2fe4d915d229d08b24c1304ab48e505f73cb9

previous

0000000000000000000000000000000000000000000000000000000000000000