70/100

Moderate evidence

Trace: a gain and a problemPublished recordHealthThe Trace

Medical Interview Performance Using an AI-Based Standardized Patient vs a Human Standardized Patient: Randomized Crossover Trial

Truvace record
TRV-2026-2979raw data (JSON)
Version
v1Published
First published
Evidence type
Randomized controlled trial
Sources
1 sourcePeer-reviewed
sha256
453bac8ee46c…check it

Background: In Japan, standardized patients (SPs) have traditionally been recruited to teach medical interview competencies. Recent advances in large language models have enabled increasingly natural conversational interactions, raising the possibility of using AI-based SPs (AI-SPs) for medical interview training. However, medical interview performance during interactions with AI-SPs compared with human SPs remains insufficiently understood. Objective: This randomized single-center crossover trial aimed to compa…

60Gain side

How the two sides scoreClose call

59Problem side

The gain

In a randomized crossover trial of 48 Chiba University medical students, self-rated active engagement in history taking was higher with a GPT-4o simulated patient (mean 6.2) than with a human simulated patient (mean 5.8).

The problem

In a randomized crossover trial of 48 Chiba University medical students, interview scores were lower with a GPT-4o simulated patient than with a human simulated patient (mean 22.7 vs 23.9 on selected Mini-CEX items; P=.001).

A fixed formula sets both scores from the evidence and its sources. Reader votes don’t move them.

What the scores mean

G is the gain side, out of 100. It goes up when the gain is specific, when it measurably helped people and when the sources behind it are strong.

P is the problem side, out of 100. It goes up when the problem is specific, when it measurably hurt people and when the sources behind it are strong.

What this doesn’t fix

The study assessed performance during simulated encounters rather than later learning gains or performance with real patients, and the AI patient was text-based with no nonverbal cues.

Sources

1 on file
  1. JMIR Medical Educationdoi:10.2196/111030
    Peer-reviewed2026-11-16

Cite this record

v1

Truvace Impact Record TRV-2026-2979, v1: “Medical Interview Performance Using an AI-Based Standardized Patient vs a Human Standardized Patient: Randomized Crossover Trial.” Truvace, 2026-11-17. /record/TRV-2026-2979 (accessed on the day you copy it). sha256 453bac8ee46c9f0f…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv1453bac8ee46c…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2979 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.