aceEmerging evidence
More
Ten nursing faculty rated an AI practice patient at 90.3% and an AI nurse at 69.0%
Study title: Coexistence of AI Nurse and AI-Simulated Patient in Nursing Education Using a Bidirectional Fine-Tuning Pipeline: Development and Content Analysis Study
- Evidence type
- Benchmark or lab evaluation
- Sample
- n = 10
- Sources
- 1 sourcePeer-reviewed
- Published
- 2 min read
- Truvace record
- TRV-2026-2458cite or check it
Study title: Coexistence of AI Nurse and AI-Simulated Patient in Nursing Education Using a Bidirectional Fine-Tuning Pipeline: Development and Content Analysis Study
Researchers built two specialized AI models for nursing education: NURSE-ONE, an AI nurse, and PATIENT-ONE, an AI-simulated patient. Ten nursing faculty tested them in a working web interface and rated the AI patient at 90.3%, the AI nurse at 69.0% and the interaction between the two at 84.8%. Role maintenance was rated at the ceiling (mean 5, SD 0).
Read the study abstract
Background Simulated patient systems are essential in nursing education but face actor scarcity, instructor burden, cost, and disrupted continuity where in-person simulation cannot be sustained. Existing large language model (LLM)-based systems address these issues but treat the dialogic partner-the AI nurse-as a static prompt or unspecialized model, compromising data collection quality and pedagogical applicability. Objective We report (1) the construction of 2 specialized fine-tuned models, NURSE-ONE (AI nurse…
The gain
In an exploratory evaluation, ten nursing faculty rated a fine-tuned AI-simulated patient at 90.3%, the pairing of AI patient and AI nurse at 84.8%, and the AI nurse at 69.0%, with all three modes responding within 3 seconds on one consumer graphics card.
In brief
The models were fine-tuned on a single consumer-grade Nvidia RTX 4090 with 24 GB of memory, starting from the Gemma-based gemma4-E4B-it model. The system supports three operating modes, including offline use for disaster preparedness, and all three met a 3-second response-time threshold.
This is an early development study. Faculty ratings came from ten evaluators, and the authors describe their findings on how the two models differ as a preliminary pattern awaiting replication. No student learning outcomes have been measured yet.
Main points
- The training base was 251 scenarios drawn from 29 institutionally authored nursing care plans and 20 items from the 115th Japanese National Nursing Examination.
- The AI nurse was fine-tuned with 245, 735 and 1225 cases; the patient model was adopted at 735 cases, which gave the lowest response-length variability (SD 24.5) and the highest information-providing rate (47.9%).
- Two independent nursing experts coded 196 blinded utterances (κ=0.770), and two AI raters largely agreed with them (κ=0.742).
- Ten nursing faculty scored the system on a 21-item rubric with an item-level content validity index of 1.00.
- The AI nurse scored lowest of the three components at 69.0%, below the AI patient at 90.3%.
- All three operating modes met the 3-second latency threshold on consumer hardware and can run offline.
The full story
The five-step pipeline first built a scenario base, then used a provisional dialogue system (AutoGen v18, maxmsg=25) to collect training dialogues. NURSE-ONE was fine-tuned across three training volumes, and PATIENT-ONE was then fine-tuned on dialogues generated by NURSE-ONE.
Content analysis compared the conditions using the Berelson method. The patient-side comparison showed no significant category shift (P=.30), but the 735-case condition had the steadiest response lengths. The authors say the nurse adapter mainly changed questioning style while the patient adapter mainly stabilised responses, which they call functional asymmetry.
The faculty evaluation covered three coexistence modes in a web interface. The authors say it supports exploratory educational applicability and provides a foundation for future learner outcome studies, which have not yet been run.
Talk it overFour questions for a class, a team or the dinner table
Who gets this benefit, and who was left out of the study or story?
The gain In an exploratory evaluation, ten nursing faculty rated a fine-tuned AI-simulated patient at 90.3%, the pairing of AI patient and AI nurse at 84.8%, and the AI nurse at 69.0%, with all three modes responding within 3 seconds on one consumer graphics card.
How do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a benchmark or lab test with a sample of 10, from JMIR Biomedical Engineering.
What does it leave open? What else would you want to know before acting on it?
The record’s own caveat The faculty evaluation was exploratory with ten evaluators, the reported asymmetry between the two models is a preliminary pattern pending replication, and learner outcomes have not been studied.
Have you seen AI used this way where you study, work or live? Did it go the same way?
The questions are the same on every record. The details under them are taken from this record as written.
Sources
1 on file- JMIR Biomedical Engineeringdoi:10.2196/100778
Related records
Evidence-backed problemHealth
Nurses like AI but know little about it, and only one study links it to patient safety
Nursing Reports
Evidence-backed problemEducation
Nursing students are more confused than educators about AI rules, a survey of 300 finds
Nurse Educator
Evidence-backed gainHealth
Interviews with 25 nurses: AI could ease workload; they also cite surveillance and bias risks
BMC Nursing
The debate