Moderate evidence
Published recordHealthThe Trace
More
Medical Interview Performance Using an AI-Based Standardized Patient vs a Human Standardized Patient: Randomized Crossover Trial
- Truvace record
- TRV-2026-2979raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Randomized controlled trial
- Sources
- 1 sourcePeer-reviewed
- sha256
- 453bac8ee46c…check it
Background: In Japan, standardized patients (SPs) have traditionally been recruited to teach medical interview competencies. Recent advances in large language models have enabled increasingly natural conversational interactions, raising the possibility of using AI-based SPs (AI-SPs) for medical interview training. However, medical interview performance during interactions with AI-SPs compared with human SPs remains insufficiently understood. Objective: This randomized single-center crossover trial aimed to compa…
60Gain side
How the two sides scoreClose call
59Problem side
The gain
In a randomized crossover trial of 48 Chiba University medical students, self-rated active engagement in history taking was higher with a GPT-4o simulated patient (mean 6.2) than with a human simulated patient (mean 5.8).
The problem
In a randomized crossover trial of 48 Chiba University medical students, interview scores were lower with a GPT-4o simulated patient than with a human simulated patient (mean 22.7 vs 23.9 on selected Mini-CEX items; P=.001).
A fixed formula sets both scores from the evidence and its sources. Reader votes don’t move them.
What the scores mean
G is the gain side, out of 100. It goes up when the gain is specific, when it measurably helped people and when the sources behind it are strong.
P is the problem side, out of 100. It goes up when the problem is specific, when it measurably hurt people and when the sources behind it are strong.
What this doesn’t fix
The study assessed performance during simulated encounters rather than later learning gains or performance with real patients, and the AI patient was text-based with no nonverbal cues.
Sources
1 on file- JMIR Medical Educationdoi:10.2196/111030
Cite this record
v1Truvace Impact Record TRV-2026-2979, v1: “Medical Interview Performance Using an AI-Based Standardized Patient vs a Human Standardized Patient: Randomized Crossover Trial.” Truvace, 2026-11-17. /record/TRV-2026-2979 (accessed on the day you copy it). sha256 453bac8ee46c9f0f…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-2979 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace