aceEvaluator-Masked Assessment of 4 Consumer-Facing Large Language Models on Expert Anterior Segment Ophthalmology Questions
Objective: To compare expert-rated quality and safety of responses from four contemporary large language models (LLMs)-ChatGPT, Gemini, Claude, and Grok-on expert-level anterior segment ophthalmology questions. Design: Cross-sectional, masked, randomized-display-order, multievaluator comparative study. Participants: Eleven fellowship-trained cornea and anterior segment subspecialists. Methods: Forty-five expert-level questions spanning six anterior segment domains were administered to each LLM under zero-shot co…
Eleven masked cornea specialists rated Claude and Grok answers to anterior segment questions as higher quality than ChatGPT and Gemini on accuracy, completeness and clarity.
A larger share of questions drew at least one severe overall-safety rating for Claude and Grok than for ChatGPT and Gemini, even though mean safety scores did not differ significantly.
The findings reflect expert preference rather than validated clinical correctness, were taken at a single time point without a reference answer key, and the severe-safety signal was a post hoc, hypothesis-generating result.
Evidence
- Peer-reviewedOphthalmology Science2026-09-04
How should this claim be treated?
Truvace Impact Record TRV-2026-2120, v1: “Evaluator-Masked Assessment of 4 Consumer-Facing Large Language Models on Expert Anterior Segment Ophthalmology Questions.” Truvace, 2026-10-21. /record/TRV-2026-2120 (accessed at citation time). sha256 fe1c54d5225f2861…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-2120 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.