Hospitals & Care
99 gains87 Traces101 problems
Every measured gain and problem on the record for this topic, newest first. Updated .
AI in hospitals and care
One square per record, darker for stronger evidence:Evidence: 5 high176 moderate106 emerging
Most of the evidence is chatbots tested on written questions and small single-site studies; a few randomized trials and reviews carry more weight. TRV-2026-0355TRV-2026-1613TRV-2026-2032 Chatbots often match or beat doctors on structured written cases, while a 7294-patient trial of an AI alert in live care found no drop in delirium. TRV-2026-1797TRV-2026-1664
A randomized preclinical trial of 77 surgeons watching laparoscopic video shows AI assistance cut the time to find a bleeding site from 3.23 to 2.53 seconds on average. TRV-2026-2032 In a randomized crossover study, clinical trial staff using AI spent 2.71 fewer minutes per item reviewing charts for immunotherapy side effects, though severity grading was much weaker than event detection. TRV-2026-2318 Three randomized trials with over 90,000 US patients show that messages on personal high flu risk raised vaccination 1.7-3.5 percentage points over no message. TRV-2026-1852 A randomized trial of 130 final-year nursing students found AI-adaptive simulation raised leadership scores more than standard training, under controlled simulation conditions. TRV-2026-1262
In a test of 960 responses to clinician-written cases, ChatGPT Health undertriaged 52% of true emergencies, sending diabetic ketoacidosis and impending respiratory failure to 24-48 hour evaluation. TRV-2026-0181 A randomized trial of 7294 patients at Mount Sinai found an AI-triggered alert did not reduce delirium (35.1% vs 32.7%), though only 17.2% had a documented delirium assessment. TRV-2026-1664 In 16,254 responses to 29 standardized vignettes, all 21 chatbots failed differential diagnosis at rates above 0.80 even though final-diagnosis accuracy was high, a benchmark study found. TRV-2026-0145 A test of eight speech-to-text systems found at least one clinically significant error in 30% to 68% of 800 transcripts, and 39.6% of 53 errors with potential for severe harm involved medication type or dose. TRV-2026-1687
A review of 314 FDA-cleared surgical AI devices found only 5.1% had higher-quality prospective evidence. TRV-2026-1693 A scoping review of 1181 reports on AI decision tools found 62.7% stopped at clinical validation and 14.4% evaluated implementation or impact. TRV-2026-1613 A scoping review found only seven eligible studies of agentic AI in healthcare, with just one trial involving patients. TRV-2026-0166 A review of 310 publications found no study that measured AI's effect on critical thinking or clinical reasoning in medical education. TRV-2026-0458
Studies point in different directions on whether AI scribes ease clinician burnout. TRV-2026-0478TRV-2026-0330 An observational study of 263 clinicians in six US health systems reports that self-reported burnout fell from 51.9% to 38.8% after 30 days with an AI scribe. TRV-2026-0478 A systematic review of 6 real-world studies found clinicians reported less documentation time, but burnout on standardized scales was unaffected. TRV-2026-0330 At one cancer center, 190 of 958 clinicians used the AI scribe; after-hours time fell only from 86.9 to 81.4 minutes a week. TRV-2026-1819
Most tests find chatbot answers to patient questions accurate on average, yet poor readability and occasional unsafe answers recur. TRV-2026-1856TRV-2026-2452TRV-2026-1746TRV-2026-1715
See these 79 recordsChatbots beat doctors on structured written cases, but results on triage and differential diagnosis are mixed. TRV-2026-1797TRV-2026-0181TRV-2026-0145TRV-2026-1421
See these 26 recordsAI scribes cut documentation time for many clinicians, though evidence on burnout and adoption is mixed. TRV-2026-1897TRV-2026-0478TRV-2026-0330
A Trace is one record with both a gain and a problem, so it counts on both sides: 186 records show a gain and 188 show a problem. 128 context records are in the record list but not counted, because they report no measured gain or problem.
| Evidence | Gain side | Problem side |
|---|---|---|
| HighStrong study design, backed by at least two independent sources | 3 | 3 |
| ModerateA measured study or an official source | 113 | 107 |
| EmergingEarly, small, unreviewed or reported second-hand | 70 | 78 |
By type of evidence: 95 benchmark or lab tests; 43 observational studies; 42 controlled comparisons; 33 commentaries or narrative reviews; 29 surveys; 15 interview studies; 9 systematic reviews or meta-analyses; 9 randomized trials; 4 case reports; 3 investigations by reporters; 2 news reports; 2 regulatory or legal actions. How evidence is scored
In an online French study of 204 GPs and 942 patient histories, AI recorded histories more effectively than doctors, most clearly for older patients and for allergy and family cancer history.
In an observational study of 12,468 chronic disease patients in three Chinese provinces, AI-enabled care was linked to hypertension control targets met rising from 68% to 82%, with health data accuracy above 95%.
Clinicians using AI note-taking scribes in 6 real-world studies reported spending less time on documentation, though the evidence is sparse and based on self-reports.
A literature review linked AI decision support to vulnerabilities in doctors' physical examination, differential diagnosis, clinical judgment and patient communication skills, though magnitude and reversibility remain uncertain.
In 16,254 responses to 29 standardized clinical vignettes, all 21 AI chatbots tested failed differential diagnosis at rates above 0.80, even though final-diagnosis accuracy was high.
One review in this topic printed a pooled result: one figure calculated across many studies. They are the reviews’ own numbers, checked word for word against their abstracts. They often measure different things, so they are listed side by side, not added up.
AI predicts gallbladder surgery difficulty well, but 16 of 18 studies were at high risk of bias · TRV-2026-0787
AUC 0.818 (95% CI 0.797 to 0.840)
18 studies · search to March 2, 2026
For 32 validation models, the pooled AUC was 0.818 (95% CI, 0.797-0.840).
AUC 0.848 (95% CI 0.829 to 0.868)
18 studies · search to March 2, 2026
The pooled AUC for 27 training models was 0.848 (95% CI, 0.829-0.868).
AI virtual patients and simulation helped trainees in several small studies, while reviews and interviews raise skill erosion as a risk. TRV-2026-1262TRV-2026-1044TRV-2026-0490TRV-2026-0147
See these 39 recordsSurveys find patients and clinicians wary of AI, and regulation and the NHS Palantir contract draw scrutiny. TRV-2026-1843TRV-2026-2394TRV-2026-2335TRV-2026-0359
See these 32 recordsSurgical, imaging and prediction tools mostly rest on small retrospective or preclinical tests with little prospective evidence. TRV-2026-2032TRV-2026-1623TRV-2026-0787TRV-2026-1693
See these 53 recordsEach record sits in one thread at most. A record with both a gain and a problem counts on both sides. 44 records fit none of these threads.
In a 7294-patient trial at Mount Sinai, an AI-triggered health-record alert did not reduce delirium (35.1% vs 32.7%, P = .37) or change adherence to best practices, though only 17.2% had a documented delirium assessment.
79 records · page 3 of 6
Showing the records in one thread of the summary: Chatbot answers to patient questions. Show every record
Researchers built a patient simulator for testing conversational health AI, aligned with the NIST AI Risk Management Framework's Map and Measure functions. It combined medical profiles drawn from All of Us health records, linguistic profiles covering a health literacy gradient, and cooperative, distracted, or…
JMIR AI
Researchers put 17 patient-centered questions about carpal tunnel syndrome to ChatGPT (GPT-5 Mini), Gemini 3 Flash and Claude 4.5 Sonnet in English and Turkish, across 102 independent sessions.
Researchers took 18 commonly searched keywords on pelvic congestion syndrome, a vascular cause of chronic pelvic pain, and submitted them to ChatGPT-4o, Gemini and Perplexity.
Researchers built 34 standardized questions across five core domains of premature ovarian insufficiency, drawn from international clinical guidelines.
Researchers gathered 40 frequently asked caregiver questions about tetralogy of Fallot using Google's People Also Ask feature. They submitted each to ChatGPT-5.5 and to Google, yielding 80 responses.
Researchers submitted ten questions drawn from a 2025 international Delphi consensus on bone stress injuries to ChatGPT-5, Perplexity AI, Claude 4, Google Gemini 2.5 and Microsoft Copilot between 7…
Researchers compared ChatGPT, Gemini, Claude, DeepSeek and Doubao on 66 public-facing English questions spanning 11 emergency consultation domains.
Researchers tested four medical literature-specific AI tools, OpenEvidence, Heidi Evidence, Consensus and PubMed.ai, using 22 validated prompts on lacrimal drainage disorders, including general, rare…
Researchers analyzed 98 hand surgery topics from the American Society for Surgery of the Hand patient website and compared them with materials generated by Google Gemini 2.0 Flash and ChatGPT-4.
Researchers put 36 standardized patient-style questions on osteoporotic vertebral compression fractures to ChatGPT, Gemini, DeepSeek and Doubao on June 20, 2026, then repeated the exercise a week…
Researchers tested four commercial language models on 25 expert-curated cancer survivorship questions spanning five domains, in both English and Traditional Chinese.
Ten pediatric rheumatology experts rated responses from four consumer-facing AI models to twenty standardized questions about juvenile systemic lupus erythematosus, a total of 80 answers, on a 5-point…
Researchers gave Grok AI, ChatGPT-5 Plus and Gemini 2.5 Flash ten open-ended scenarios drawn from kidney transplantation practice, covering surgical technique, complications, immunosuppression and…
Researchers at the University of Otago put 23 frequently asked questions about oral lichen planus, a chronic inflammatory mouth disorder, to ChatGPT-4 and DeepSeek-v3.
Researchers built a scoring rubric to test how accurately four widely used large language models answered harm reduction questions.
ace