Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-2374
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-05T00:02:01.506619Z
status: published
lens: trace
sector: health
headline: Quality, Readability, and Reliability of Artificial Intelligence Chatbot Responses to Parent-Centered Questions on Newborn Hearing Screening: A Cross-Sectional Comparative Study
dek: Aims and objectives: Parents increasingly use large language models (LLMs) to obtain health-related information; however, the quality, readability, and reliability of AI-generated patient education remain uncertain. This study evaluated the performance of three LLM-based chatbots in providing parent-centred information regarding newborn hearing screening.
Methods: Thirty-eight parent-centred questions regarding newborn hearing screening were submitted to ChatGPT-5.1, Gemini 2.5 Flash, and DeepSeek-V3. Responses…
gain_title: Three chatbots answered 38 parent questions on newborn hearing screening at acceptable quality, with mEQIP scores indicating good quality and DeepSeek-V3 leading on accuracy and comprehensiveness.
problem_title: Chatbot answers on newborn hearing screening stayed relatively hard for parents to read, with Flesch Reading Ease scores of 51.5-59.3 indicating difficult readability and quality varying across models.
trace_subject: AI chatbot answers to parent questions about newborn hearing screening
gain_reading: Three chatbots answered 38 parent questions on newborn hearing screening at acceptable quality, with mEQIP scores indicating good quality and DeepSeek-V3 leading on accuracy and comprehensiveness.
gain_evidence: mEQIP scores were not significant (p = 0.148) and indicated good quality | DeepSeek-V3 outperformed both ChatGPT-5.1 and Gemini 2.5 Flash in accuracy and comprehensiveness (p < 0.05)
problem_reading: Chatbot answers on newborn hearing screening stayed relatively hard for parents to read, with Flesch Reading Ease scores of 51.5-59.3 indicating difficult readability and quality varying across models.
problem_evidence: The FRES scores (51.5-59.3) indicated difficult readability | chatbot-generated content remains relatively difficult to read
quick_read: Researchers put 38 parent-centred questions about newborn hearing screening to three chatbots: ChatGPT-5.1, Gemini 2.5 Flash and DeepSeek-V3. Responses were rated on accuracy, comprehensiveness, clarity and credibility, plus a quality tool and readability formulas. Overall quality was rated good, but the answers were hard to read, with Flesch Reading Ease scores of 51.5-59.3.

The models differed. DeepSeek-V3 beat both rivals on accuracy and comprehensiveness but scored lower on clarity, while Gemini 2.5 Flash had higher reading-ease scores. Because parents use chatbots to look up health information, readability and variability across tools affect how useful the answers are.

The authors conclude the chatbots may serve as complementary information resources for parents, and say further research is needed before routine clinical use.
limitation: The authors say substantial variability was observed across models and that further research is needed before routine clinical use.
tag: Dual reading
key_points: The study submitted 38 parent-centred newborn hearing screening questions to ChatGPT-5.1, Gemini 2.5 Flash and DeepSeek-V3. | Responses were scored on a five-point Likert scale for accuracy, comprehensiveness, clarity and credibility. | DeepSeek-V3 outperformed both other chatbots on accuracy and comprehensiveness (p < 0.05) but had lower clarity scores (p < 0.05). | Flesch Reading Ease scores of 51.5-59.3 indicated difficult readability across the chatbots. | Flesch-Kincaid Grade Level scores of 8.4-8.9 corresponded to an eighth-grade reading level. | Gemini 2.5 Flash had higher reading-ease scores (p = 0.001). | Modified EQIP quality scores did not differ significantly between models (p = 0.148) and indicated good quality.
rundown: The cross-sectional comparison tested three large language model chatbots on 38 questions that parents might ask about newborn hearing screening. Each answer was rated for accuracy, comprehensiveness, clarity and credibility, and scored with the modified EQIP tool for quality.

Readability was measured with two formulas. Flesch Reading Ease scores of 51.5-59.3 signalled difficult text, while Flesch-Kincaid Grade Level scores of 8.4-8.9 matched roughly an eighth-grade reading level. Gemini 2.5 Flash scored higher on reading ease (p = 0.001).

On content, DeepSeek-V3 scored higher than ChatGPT-5.1 and Gemini 2.5 Flash for accuracy and comprehensiveness but lower for clarity. Quality scores on the modified EQIP tool did not differ significantly among the models and indicated good quality.

The authors judge chatbots generally acceptable and potentially complementary resources for parents, with substantial variability across models, and call for further research before routine clinical use.
sources:
- peer_reviewed | Journal of Evaluation in Clinical Practice | https://doi.org/10.1111/jep.70721 | 2026-12-01
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

9dd4058e3631d3746f3eed581da122d88fcbdd31e2d1a43171c712623f5fac7e

previous

0000000000000000000000000000000000000000000000000000000000000000