Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-2044
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-10-20T22:02:40.737870Z
status: published
lens: p_space
sector: health
headline: Large language model responses to structured textual descriptions of salivary gland imaging findings: impact of contextual enrichment on self-reported diagnostic confidence and reporting behavior
dek: Purpose: Large language models (LLMs) are increasingly applied in clinical decision support, yet their behavior when presented with structured textual descriptions of imaging findings, particularly in salivary gland disease, remains poorly defined. The present study was set out to evaluate how the responses of different LLMs change as the textual input is progressively enriched. The models did not receive imaging data; all inputs were text.
Methods: This exploratory, simulation-based observational study assessed…
gain_title: (none)
problem_title: Self-reported diagnostic confidence in three LLMs rose as prompts were enriched, which may reflect expressed certainty rather than better diagnostic reasoning, and no outputs were checked against a reference diagnosis.
trace_subject: (none)
gain_reading: (none)
gain_evidence: (none)
problem_reading: Self-reported diagnostic confidence in three LLMs rose as prompts were enriched, which may reflect expressed certainty rather than better diagnostic reasoning, and no outputs were checked against a reference diagnosis.
problem_evidence: This pattern may reflect the tendency of an LLM to express greater certainty when given richer input rather than genuinely improved diagnostic reasoning. | AI outputs were not benchmarked against a verified reference diagnosis.
quick_read: Researchers gave ChatGPT, Gemini and Claude text-only descriptions of imaging findings from 10 salivary gland cases. Each case was presented in three stages: a single-plane description, a multiplanar description, and a multiplanar description with clinical information, yielding 90 observations.

The results suggest that more detailed prompts can make a model sound more certain without showing that its reasoning improved. That matters for anyone considering LLMs in clinical support. The study was a small exploratory pilot with no reference diagnosis, no image interpretation and no support for standalone diagnostic use, so accuracy remains unknown.
limitation: The design was an exploratory pilot of 10 cases with text-only input and no reference diagnosis, so it cannot show diagnostic accuracy or image interpretation ability and does not support standalone diagnostic use.
tag: Evidence-backed problem
key_points: Self-reported confidence rose significantly with richer input (Friedman χ²=18.86; P < 0.001). | The cumulative odds ratio for confidence was 5.43 (95% CI 3.00-9.81) for the fullest input versus the single-plane description. | Severity scores did not differ significantly across the three models (P = 0.31). | Claude reported a mean of 5.67 additional anatomical structures versus 0.00 for ChatGPT. | Gemini gave lower severity scores but comparable self-reported confidence.
rundown: The study was simulation-based and observational. It used 10 salivary gland cases, each with a standardized textual description of imaging findings. No image files were uploaded, so the models never analyzed actual imaging.

The primary outcomes were the model-generated severity score, self-reported diagnostic confidence, and the number of additional anatomical structures reported. The main analysis used a proportional-odds model with cluster-robust standard errors by case, and non-parametric tests served as sensitivity analyses.

Reporting behavior varied by model. ChatGPT produced stable outputs with no additional structures, while Claude produced much more detailed reports, and a mixed model showed a significant effect of AI system on verbosity (P < 0.001). The authors treat the link between reported parenchymal changes and confidence as a within-output association, not an independent diagnostic relationship.
sources:
- peer_reviewed | European Archives of Oto-Rhino-Laryngology | https://doi.org/10.1007/s00405-026-10681-3 | 2026-10-20
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

ddef7518e1ec0921f64d821b5342cd490e5bb49138ccde5966e97e84c56ccd9c

previous

0000000000000000000000000000000000000000000000000000000000000000