The exact text we saved

This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.

TRUVACE RECORD VERSION
record: TRV-2026-2771
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-12T17:21:34.350258Z
status: published
lens: g_space
sector: health
headline: Effectiveness of large language model-based teaching interventions in medical education: a systematic review and stratified meta-analysis of 14 studies
dek: BACKGROUND: In recent years, artificial intelligence has been adopted as an innovative educational approach and may substantially reshape health-care delivery systems. This systematic review and stratified meta-analysis compared large language model (LLM)-based teaching interventions with traditional teaching approaches in medical education. METHODS: Based on a four-database search conducted through 31 March 2026, we included comparative studies and feasibility studies evaluating LLM-based teaching tools in medi…
gain_title: A systematic review of 14 studies with 1,207 medical learners found AI chatbot-based teaching was linked to higher knowledge scores (SMD 0.80, 95% CI 0.07 to 1.53, 5 studies) than traditional teaching, though certainty was low.
problem_title: (none)
trace_subject: (none)
gain_reading: A systematic review of 14 studies with 1,207 medical learners found AI chatbot-based teaching was linked to higher knowledge scores (SMD 0.80, 95% CI 0.07 to 1.53, 5 studies) than traditional teaching, though certainty was low.
gain_evidence: strict knowledge acquisition showed a smaller but still positive signal (5 studies; SMD 0.80, 95% CI 0.07 to 1.53) | 14 studies comprising 1207 analyzable learners were included
problem_reading: (none)
problem_evidence: (none)
quick_read: A systematic review and meta-analysis compared teaching built on large language models with traditional teaching for medical learners. After searching four databases through 31 March 2026, the authors screened 8,103 records and included 14 studies covering 1,207 analyzable learners.

Pooled results favoured AI-based teaching for structured clinical performance (SMD 3.39, 95% CI 1.43 to 5.35, from 2 studies with 38 vs. 39 participants) and for strict knowledge acquisition (SMD 0.80, 95% CI 0.07 to 1.53, from 5 studies). Delayed retention showed no clear difference (SMD 0.15, 95% CI -0.50 to 0.80, 2 studies).

Certainty of evidence ranged from very low to low across pooled domains. The authors describe the findings as cautious signals rather than definitive estimates, with the clinical performance figure possibly inflated by small-study effects.
limitation: Pooled domains rested on only 2 to 5 studies, certainty was low to very low, and the clinical performance estimate may be inflated by small-study effects, selective reporting or measurement artifacts.
tag: Evidence-backed gain
key_points: Four databases (PubMed, Web of Science, Embase, Cochrane Library) yielded 8,103 records; 25 full texts were assessed and 14 studies were included. | Structured clinical performance: SMD 3.39 (95% CI 1.43 to 5.35) from 2 studies with 38 vs. 39 participants. | Strict knowledge acquisition: SMD 0.80 (95% CI 0.07 to 1.53) across 5 studies. | Delayed retention showed no clear difference: SMD 0.15 (95% CI -0.50 to 0.80) in 2 studies. | An exploratory pooled analysis of 7 studies (248 vs. 251 participants) gave SMD 0.90 with I² = 92.5%, indicating substantial heterogeneity. | An exploratory subgroup analysis suggested larger effects in practice courses than theory courses, but only 2 practice-oriented studies drove it. | GRADE-informed certainty ranged from very low to low.
rundown: The review was not prospectively registered and no public protocol was available; it grew out of a broader evidence-mapping exercise. Risk of bias was appraised with RoB 2, ROBINS-I or JBI-informed domains, and pooled analyses used an inverse-variance random-effects model.

Of the 14 included studies, seven did not enter the pooled score-based synthesis directly. One was kept in the structured clinical performance supplementary meta-analysis, and six were shown through classification summary figures and single-study exploratory displays.

The authors conclude that some LLM-based teaching interventions may improve structured clinical performance and certain short-term knowledge outcomes, while delayed retention remains uncertain. They say the broader pooled score should not be read as a single universal endpoint.
sources:
- peer_reviewed | BMC Medical Education | https://doi.org/10.1186/s12909-026-09879-0 | 2026-07-25
prev: 0000000000000000000000000000000000000000000000000000000000000000

SHA-256 hash

129eac06306b63d19879620b396a0724d7d55d9ea7d6548b9c8ecaba56df18a3

Previous version’s hash

0000000000000000000000000000000000000000000000000000000000000000