Emerging evidence
Published recordHealthGood Space
More
Beyond the Black Box: A 30-Minute Artificial Intelligence Critical Appraisal Workshop for Internal Medicine Residents
- Truvace record
- TRV-2026-3012raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Survey
- Sources
- 1 sourcePeer-reviewed
- sha256
- 3945409cfad8…check it
Introduction: Artificial intelligence (AI) and large language models (LLMs) are rapidly entering resident workflows. However, formal training on appropriate LLM use is limited, and AI outputs may be inaccurate, outdated, or biased. This creates a curricular gap: residents may use AI before receiving guidance on evaluating AI-generated recommendations. Methods: We developed a 30-minute AI critical appraisal workshop for postgraduate year 1 to 3 (PGY-1-PGY-3) internal medicine residents. The workshop replaced 1 ev…
The gain
In an anonymous before-and-after survey at one internal medicine program, residents' confidence in critically appraising AI output rose from 60.4% before a 30-minute workshop to 79.5% after it.
What this doesn’t fix
Responses were anonymous and unpaired, with 53 pre-workshop and 44 post-workshop respondents out of 72 eligible residents, so the results were analyzed descriptively and cannot show change in individual residents.
Sources
1 on file- MedEdPORTALdoi:10.15766/mep_2374-8265.11654
Cite this record
v1Truvace Impact Record TRV-2026-3012, v1: “Beyond the Black Box: A 30-Minute Artificial Intelligence Critical Appraisal Workshop for Internal Medicine Residents.” Truvace, 2026-11-18. /record/TRV-2026-3012 (accessed on the day you copy it). sha256 3945409cfad8161e…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-3012 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace