Responses of large language models to common questions on premature ovarian insufficiency: A comparative analysis
Objective: Large language models are widely used in clinical care. Their reliability in specialized gynecological diseases such as premature ovarian insufficiency (POI) has not been fully verified. This study aimed to systematically evaluate and compare the accuracy and completeness of three mainstream large language models when answering standardized clinical questions about POI. Methods: We developed 34 standardized questions covering five core domains of POI according to international clinical guidelines. Two…
Two gynecologists rated GPT-5.5, Claude Opus-4.7 and DeepSeek-R1 as accurate and complete on 34 guideline-based POI questions, supporting supervised use for information retrieval and patient education.
Some individual-item comparisons between models exceeded the ±0.5 range, and the authors say all AI-generated content must be checked by qualified clinicians before clinical use.
Evidence
- Peer-reviewedInternational Journal of Gynecology & Obstetrics2026-10-17
How should this claim be treated?
Truvace Impact Record TRV-2026-1783, v1: “Responses of large language models to common questions on premature ovarian insufficiency: A comparative analysis.” Truvace, 2026-10-18. /record/TRV-2026-1783 (accessed at citation time). sha256 61d9c7fa41cc0cf4…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1783 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.
ace