Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-0181
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-07-13T09:14:18.292950Z
status: published
lens: p_space
sector: health
headline: ChatGPT Health performance in a structured test of triage recommendations
dek: ChatGPT Health was launched in January 2026 as OpenAI's consumer health tool and has reached millions of users. Here we conducted a structured stress test of triage recommendations using 60 clinician-authored vignettes across 21 clinical domains under 16 factorial conditions, yielding 960 total responses. Performance followed an inverted U-shaped pattern, with the most dangerous failures concentrated at clinical extremes-nonurgent presentations (35%) and emergency conditions (48%). Among gold-standard emergencie…
gain_title: (none)
problem_title: In a 960-response vignette test, ChatGPT Health undertriaged 52% of gold-standard emergencies, directing diabetic ketoacidosis and impending respiratory failure to 24-48 h evaluation instead of the emergency department, with failures concentrated at clinical extremes and triage shifting toward less urgent care when by-
trace_subject: (none)
gain_reading: (none)
gain_evidence: (none)
problem_reading: In a 960-response vignette test, ChatGPT Health undertriaged 52% of gold-standard emergencies, directing diabetic ketoacidosis and impending respiratory failure to 24-48 h evaluation instead of the emergency department, with failures concentrated at clinical extremes and triage shifting toward less urgent care when by-
problem_evidence: undertriaged 52% of cases, directing patients with diabetic ketoacidosis or impending respiratory failure to 24-48 h evaluation rather than the emergency department | most dangerous failures concentrated at clinical extremes-nonurgent presentations (35%) and emergency conditions (48%) | When family or friends minimized symptoms, indicating anchoring bias, triage recommendations shifted significantly in edge cases (odds ratio = 11.7, 95% confidence interval = 3.7-36.6), with the majority of shifts toward less urgent care
quick_read: In a structured stress test published February 23, 2026, researchers evaluated ChatGPT Health, OpenAI's consumer health tool launched in January 2026, using 60 clinician-authored vignettes across 21 clinical domains under 16 factorial conditions to generate 960 responses, assessing triage recommendations and contextual sensitivity.

The findings matter because the tool has reached millions of users while showing missed high-risk emergencies and inconsistent crisis safeguards, including undertriage of diabetic ketoacidosis and respiratory failure and unpredictable activation for suicidal ideation, raising safety concerns that the authors say warrant prospective validation before consumer-scale deployment, with uncertainty remaining about real-world performance outside vignettes.
limitation: Findings are based on clinician-authored vignettes rather than prospective real-world patient encounters, and analyses of race, sex and barriers to care were underpowered to exclude clinically meaningful differences, requiring prospective validation before consumer-scale deployment.
tag: Evidence-backed problem
key_points: Structured stress test used 60 clinician-authored vignettes across 21 clinical domains under 16 factorial conditions for 960 total responses. | ChatGPT Health launched January 2026 and has reached millions of users before prospective validation. | Undertriage of 52% of gold-standard emergencies included diabetic ketoacidosis and impending respiratory failure directed to 24-48 h evaluation. | Anchoring bias condition where family or friends minimized symptoms produced OR 11.7 shift toward less urgent care in edge cases. | Crisis-intervention messages for suicidal ideation activated unpredictably, more frequently when no specific method described than when method described.
rundown: Researchers tested ChatGPT Health, launched January 2026, using 60 clinician-authored vignettes across 21 domains under 16 factorial conditions to produce 960 responses, measuring triage accuracy and sensitivity to contextual factors.

Performance showed an inverted U-shaped pattern with 35% failure for nonurgent and 48% for emergency presentations; among gold-standard emergencies 52% were undertriaged to 24-48 h care, while stroke and anaphylaxis were correctly triaged, and anchoring bias from family minimization produced an odds ratio of 11.7 toward less urgent recommendations.

Crisis-intervention messaging for suicidal ideation activated unpredictably, occurring more frequently when patients described no specific method than when they did, and analyses found no significant effects for patient race, sex and barriers to care but confidence intervals did not exclude clinically meaningful differences.
sources:
- peer_reviewed | Nature Medicine | https://doi.org/10.1038/s41591-026-04297-7 | 2026-02-23
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

4bf89b7554fae7b23c26d5abd03fbfbfe192d44f396da5cc8f42019f73a26110

previous

0000000000000000000000000000000000000000000000000000000000000000