Moderate evidence
More
AI tools boost English learners' engagement, a review of 17 studies finds
Study title: A Meta-Analysis of the Effect of AI Use on English Learner Engagement
- Evidence type
- Systematic review or meta-analysis
- Sample
- n = 17
- Sources
- 1 sourcePeer-reviewed
- Published
- 2 min read
- Truvace record
- TRV-2026-2728cite or check it
Study title: A Meta-Analysis of the Effect of AI Use on English Learner Engagement
A meta-analysis in Language Teaching Research pooled 17 primary studies, yielding 36 effect sizes, to test how AI use affects engagement among learners of English. The pooled effect was large: g = 0.955, with a 95% confidence interval of 0.720 to 1.191.
Read the study abstract
This study investigates the effectiveness of artificial intelligence (AI) use on English learner engagement and conducts moderator analysis to identify the variables that exert a moderating effect on AI’s impact. A multi-database search was conducted to locate 846 records, and 17 primary studies yielding 36 effect sizes were included in this meta-analysis after deduplication, screening and full-text eligibility assessment. Aggregated results show that AI use has a large average impact on English learner engageme…
The gain
A meta-analysis of 17 studies (36 effect sizes) found AI use raised English learner engagement by a large average margin (g = 0.955, 95% CI 0.720 to 1.191).
In brief
The authors began with 846 records from a multi-database search and narrowed them through deduplication, screening and full-text eligibility checks. Because the included studies differed substantially from one another, the pooled figure is an average across them, not a fixed effect for every classroom.
Moderator analyses found that the effect varied significantly by the role AI played and by learners' major. The authors say the findings are relevant to researchers, instructors and administrators working in English as a second or foreign language settings.
Main points
- A multi-database search located 846 records; 17 primary studies met the inclusion criteria after deduplication, screening and full-text review.
- The 17 studies contributed 36 effect sizes to the analysis.
- The pooled effect of AI use on English learner engagement was g = 0.955 (95% CI 0.720 to 1.191).
- Between-study heterogeneity was substantial, so the pooled estimate is an average across studies.
- The effect varied significantly depending on the role AI played in learning.
- The effect also varied significantly by learners' major.
- The study covers English as a second language and as a foreign language contexts.
What the review found when it combined the studies
These are the review’s own pooled results, copied from its abstract. Truvace did not recalculate them.
English learner engagement with AI use compared with no AI use
Hedges' g 0.955 (95% CI 0.720 to 1.191)
17 studies
The review’s own words
Aggregated results show that AI use has a large average impact on English learner engagement ( g = 0.955, 95% CI [0.720, 1.191]).
Code checks every number above against the review’s text before it is shown. The short labels are an AI model’s reading of that text, so the review’s own sentence sits under each one. A pooled figure is only as strong as the studies behind it. How Truvace uses pooled results
The full story
The study searched multiple databases and found 846 records. After removing duplicates, screening and checking full texts for eligibility, 17 primary studies remained, which together supplied 36 effect sizes for pooling.
The aggregate result showed a large average impact of AI use on engagement among English learners, with g = 0.955 and a confidence interval of 0.720 to 1.191. The authors caution that substantial heterogeneity between studies means this is an average, not a uniform effect.
Moderator analyses tested which variables change the size of the effect. Two emerged as significant: the roles AI plays in learning and the learners' major. The authors frame the results as evidence on AI's effectiveness for engagement in English as a second and foreign language contexts.
Sources
1 on file- Language Teaching Researchdoi:10.1177/13621688261498089
Talk it over
Who gets this benefit, and who was left out of the study or story?
AI tools boost English learners' engagement, a review of 17 studies findshttps://truvace.com/item/a-meta-analysis-of-the-effect-of-ai-use-on-english-learner-engagement
Who gets this benefit, and who was left out of the study or story?
The gain A meta-analysis of 17 studies (36 effect sizes) found AI use raised English learner engagement by a large average margin (g = 0.955, 95% CI 0.720 to 1.191).
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a systematic review or meta-analysis with a sample of 17, from Language Teaching Research.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
The record’s own caveat Substantial between-study heterogeneity means the pooled effect is an average across the included studies, not a figure that applies uniformly to every setting.
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
ace
What readers say