Truace
Subscribe
70/100

Moderate evidence

Cite
More
Export CSVExport JSONEmailLinkedInX

AI agents boost vocabulary learning, a review of 28 studies finds

Study title: Student–AI interaction: unveiling the impact of AI agents on vocabulary learning – A meta-analysis

Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
Published
2 min read
Truvace record
TRV-2026-2766cite or check it

Study title: Student–AI interaction: unveiling the impact of AI agents on vocabulary learning – A meta-analysis

A meta-analysis pooling 28 studies and 55 effect sizes found that AI agents had a significant positive effect on vocabulary learning, with an overall effect size of 0.904 (95% CI 0.724 to 1.084).

Read the study abstract

Abstract The rapid proliferation of artificial intelligence (AI)-driven educational interventions has generated substantial interest in their effectiveness for vocabulary acquisition; however, the existing literature presents inconsistent findings. This meta-analysis, drawing on 28 studies and integrating 55 effect sizes via a three-level random effects model, demonstrates a significant overall positive effect of AI agents on vocabulary learning (effect size = 0.904, 95 % CI: 0.724, 1.084, p < 0.0001). Furthermo…

Student–AI interaction: unveiling the impact of AI agents on vocabulary learning – A meta-analysis
"Ohio University Lecture Hall" by Garden Sprite, CC0.

The gain

A meta-analysis of 28 studies and 55 effect sizes found AI agents had a significant positive effect on vocabulary learning (effect size 0.904, 95% CI 0.724 to 1.084).

In brief

The authors used a three-level random effects model, which accounts for several effect sizes coming from the same study. They set out to resolve inconsistent findings in earlier research on AI-driven educational interventions for vocabulary acquisition.

Moderator analysis found that both the degree of AI embodiment and the duration of the intervention significantly shaped the size of the effect, so results varied with how the AI agent was designed and how long students used it.

Main points

  1. The meta-analysis covers 28 studies and 55 effect sizes on AI agents and vocabulary learning.
  2. The pooled effect size was 0.904 (95% CI 0.724 to 1.084, p < 0.0001).
  3. A three-level random effects model was used to combine the effect sizes.
  4. AI embodiment was a significant moderator (F(1, 53) = 7.446, p < 0.01).
  5. Intervention duration was also a significant moderator (F(20, 24) = 5.563, p < 0.001).
  6. The analysis draws on a student-AI interaction framework to interpret instructional designs.

What the review found when it combined the studies

These are the review’s own pooled results, copied from its abstract. Truvace did not recalculate them.

  • Vocabulary learning with AI agents compared with control conditions

    Effect size 0.904 (95% CI 0.724 to 1.084)

    28 studies

    The review’s own words
    This meta-analysis, drawing on 28 studies and integrating 55 effect sizes via a three-level random effects model, demonstrates a significant overall positive effect of AI agents on vocabulary learning (effect size = 0.904, 95 % CI: 0.724, 1.084, p < 0.0001).

Code checks every number above against the review’s text before it is shown. The short labels are an AI model’s reading of that text, so the review’s own sentence sits under each one. A pooled figure is only as strong as the studies behind it. How Truvace uses pooled results

The full story

The review was motivated by the rapid spread of AI-driven educational interventions and by inconsistent findings in the existing literature on their effect on vocabulary acquisition.

Researchers combined 55 effect sizes from 28 studies using a three-level random effects model and reported a significant overall positive effect of 0.904, with a confidence interval of 0.724 to 1.084.

Moderator tests showed that AI embodiment and intervention duration both significantly affected outcomes. The authors frame the findings within the student-AI interaction framework as a theory-informed synthesis of how AI-supported instructional designs relate to vocabulary learning.

Sources

1 on file
  1. International Review of Applied Linguistics in Language Teachingdoi:10.1515/iral-2025-0382
    Peer-reviewed2026-08-12

Talk it over

Four questions to start onWho gets this benefit, and who was left out of the study or story?

Start with a question

AI agents boost vocabulary learning, a review of 28 studies findshttps://truvace.com/item/student-ai-interaction-unveiling-the-impact-of-ai-agents-on-vocabulary-learning-

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 28 studies and 55 effect sizes found AI agents had a significant positive effect on vocabulary learning (effect size 0.904, 95% CI 0.724 to 1.084).

    Answer in the thread

  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis, from International Review of Applied Linguistics in Language Teaching.

    Answer in the thread

  3. What does it leave open? What else would you want to know before acting on it?

    Answer in the thread

  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say

More from Education