46/100

Emerging evidence

GainPublished recordHealthGood Space

Beyond the Black Box: A 30-Minute Artificial Intelligence Critical Appraisal Workshop for Internal Medicine Residents

Truvace record
TRV-2026-3012raw data (JSON)
Version
v1Published
First published
Evidence type
Survey
Sources
1 sourcePeer-reviewed
sha256
3945409cfad8…check it

Introduction: Artificial intelligence (AI) and large language models (LLMs) are rapidly entering resident workflows. However, formal training on appropriate LLM use is limited, and AI outputs may be inaccurate, outdated, or biased. This creates a curricular gap: residents may use AI before receiving guidance on evaluating AI-generated recommendations. Methods: We developed a 30-minute AI critical appraisal workshop for postgraduate year 1 to 3 (PGY-1-PGY-3) internal medicine residents. The workshop replaced 1 ev…

The gain

In an anonymous before-and-after survey at one internal medicine program, residents' confidence in critically appraising AI output rose from 60.4% before a 30-minute workshop to 79.5% after it.

What this doesn’t fix

Responses were anonymous and unpaired, with 53 pre-workshop and 44 post-workshop respondents out of 72 eligible residents, so the results were analyzed descriptively and cannot show change in individual residents.

Sources

1 on file
  1. MedEdPORTALdoi:10.15766/mep_2374-8265.11654
    Peer-reviewed2026-11-16

Cite this record

v1

Truvace Impact Record TRV-2026-3012, v1: “Beyond the Black Box: A 30-Minute Artificial Intelligence Critical Appraisal Workshop for Internal Medicine Residents.” Truvace, 2026-11-18. /record/TRV-2026-3012 (accessed on the day you copy it). sha256 3945409cfad8161e…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv13945409cfad8…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-3012 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.