Version 2 of this summary, as approved on . It weighed 99 gains, 101 problems and 87 Traces. This is the current version. See the topic as it stands today
Most of the evidence is chatbots tested on written questions and small single-site studies; a few randomized trials and reviews carry more weight. TRV-2026-0355TRV-2026-1613TRV-2026-2032 Chatbots often match or beat doctors on structured written cases, while a 7294-patient trial of an AI alert in live care found no drop in delirium. TRV-2026-1797TRV-2026-1664
A randomized preclinical trial of 77 surgeons watching laparoscopic video shows AI assistance cut the time to find a bleeding site from 3.23 to 2.53 seconds on average. TRV-2026-2032 In a randomized crossover study, clinical trial staff using AI spent 2.71 fewer minutes per item reviewing charts for immunotherapy side effects, though severity grading was much weaker than event detection. TRV-2026-2318 Three randomized trials with over 90,000 US patients show that messages on personal high flu risk raised vaccination 1.7-3.5 percentage points over no message. TRV-2026-1852 A randomized trial of 130 final-year nursing students found AI-adaptive simulation raised leadership scores more than standard training, under controlled simulation conditions. TRV-2026-1262
In a test of 960 responses to clinician-written cases, ChatGPT Health undertriaged 52% of true emergencies, sending diabetic ketoacidosis and impending respiratory failure to 24-48 hour evaluation. TRV-2026-0181 A randomized trial of 7294 patients at Mount Sinai found an AI-triggered alert did not reduce delirium (35.1% vs 32.7%), though only 17.2% had a documented delirium assessment. TRV-2026-1664 In 16,254 responses to 29 standardized vignettes, all 21 chatbots failed differential diagnosis at rates above 0.80 even though final-diagnosis accuracy was high, a benchmark study found. TRV-2026-0145 A test of eight speech-to-text systems found at least one clinically significant error in 30% to 68% of 800 transcripts, and 39.6% of 53 errors with potential for severe harm involved medication type or dose. TRV-2026-1687
A review of 314 FDA-cleared surgical AI devices found only 5.1% had higher-quality prospective evidence. TRV-2026-1693 A scoping review of 1181 reports on AI decision tools found 62.7% stopped at clinical validation and 14.4% evaluated implementation or impact. TRV-2026-1613 A scoping review found only seven eligible studies of agentic AI in healthcare, with just one trial involving patients. TRV-2026-0166 A review of 310 publications found no study that measured AI's effect on critical thinking or clinical reasoning in medical education. TRV-2026-0458
Studies point in different directions on whether AI scribes ease clinician burnout. TRV-2026-0478TRV-2026-0330 An observational study of 263 clinicians in six US health systems reports that self-reported burnout fell from 51.9% to 38.8% after 30 days with an AI scribe. TRV-2026-0478 A systematic review of 6 real-world studies found clinicians reported less documentation time, but burnout on standardized scales was unaffected. TRV-2026-0330 At one cancer center, 190 of 958 clinicians used the AI scribe; after-hours time fell only from 86.9 to 81.4 minutes a week. TRV-2026-1819
Most tests find chatbot answers to patient questions accurate on average, yet poor readability and occasional unsafe answers recur. TRV-2026-1856TRV-2026-2452TRV-2026-1746TRV-2026-1715
Chatbots beat doctors on structured written cases, but results on triage and differential diagnosis are mixed. TRV-2026-1797TRV-2026-0181TRV-2026-0145TRV-2026-1421
AI scribes cut documentation time for many clinicians, though evidence on burnout and adoption is mixed. TRV-2026-1897TRV-2026-0478TRV-2026-0330TRV-2026-1819
AI virtual patients and simulation helped trainees in several small studies, while reviews and interviews raise skill erosion as a risk. TRV-2026-1262TRV-2026-1044TRV-2026-0490TRV-2026-0147
Surveys find patients and clinicians wary of AI, and regulation and the NHS Palantir contract draw scrutiny. TRV-2026-1843TRV-2026-2394TRV-2026-2335TRV-2026-0359
Surgical, imaging and prediction tools mostly rest on small retrospective or preclinical tests with little prospective evidence. TRV-2026-2032TRV-2026-1623TRV-2026-0787TRV-2026-1693
Each record sits in one thread at most. A record with both a gain and a problem counts on both sides. 44 records fit none of these threads.
ace