acePerformance of Large Language Models in Answering Juvenile Systemic Lupus Erythematosus Questions: A Blinded Expert-based Comparative Study
Background Large language models are increasingly used to obtain medical information, but their performance in juvenile systemic lupus erythematosus remains insufficiently characterized. Objective To compare expert-rated response quality and clinical relevance across 4 artificial intelligence (AI) models using standardized juvenile systemic lupus erythematosus-related questions. Design Cross-sectional expert-based comparative study. Setting Freely accessible consumer-facing web interfaces evaluated on December 3…
Expert-rated quality of chatbot answers on juvenile lupus differed significantly across models, so outputs need caution and specialist oversight.
Each question was tested once at a single time point, so within-model reproducibility was not assessed, and the question set was not formally validated.
Evidence
- Peer-reviewedJCR: Journal of Clinical Rheumatology2026-10-08
How should this claim be treated?
Truvace Impact Record TRV-2026-1701, v1: “Performance of Large Language Models in Answering Juvenile Systemic Lupus Erythematosus Questions: A Blinded Expert-based Comparative Study.” Truvace, 2026-10-17. /record/TRV-2026-1701 (accessed at citation time). sha256 79ee357a9cc7dd45…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1701 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.