aceModerate evidence
More
Meta-analysis of 85 studies finds AI tools linked to much higher student achievement
Study title: Investigating the effect of artificial intelligence in education (AIEd) on learning achievement: A meta-analysis and research synthesis
- Evidence type
- Systematic review or meta-analysis
- Sample
- n = 10,469
- Sources
- 1 sourcePeer-reviewed
- Published
- 1 min read
- Truvace record
- TRV-2026-2842cite or check it
Study title: Investigating the effect of artificial intelligence in education (AIEd) on learning achievement: A meta-analysis and research synthesis
A meta-analysis pooled 85 quantitative studies covering 10,469 students and found that AI applications in education had a very large effect on learning achievement, with a Hedges' g of 1.10 (p < 0.001).
Read the study abstract
Scant information exists about how AI with its different technologies might affect learning achievement in different educational fields across different educational levels and geographical distributions of students. Closing this gap can therefore help stakeholders understand under which learning conditions artificial intelligence in education (AIEd) might work or not, hence achieving better learning achievement. To address this research gap, this study conducted a meta-analysis and research synthesis of the effe…
The gain
A meta-analysis of 85 quantitative studies with 10,469 students found AI in education had a very large effect on learning achievement (Hedges' g = 1.10), with chatbots showing the largest effects.
In brief
The effect varied by technology. Chatbots showed a very large effect, while intelligent tutoring systems and personalized learning systems showed large effects.
The size of the effect also depended on the field of education, level of education, learning mode, intervention duration and where the students were located, so the average figure does not apply equally in every setting.
Main points
- The analysis coded 85 quantitative studies with 10,469 participants in total.
- Effect sizes were computed as Hedges' g; the overall effect on learning achievement was g = 1.10 (p < 0.001).
- Chatbots produced a very large effect on learning achievement.
- Intelligent tutoring systems and personalized learning systems produced large effects.
- Field of education, level of education, learning mode, intervention duration and geographical distribution each moderated the effect.
The full story
The authors set out to fill a gap: little was known about how different AI technologies affect learning achievement across educational fields, levels and regions. They pooled 85 quantitative studies with 10,469 participants and calculated Hedges' g effect sizes.
The overall effect was g = 1.10, which the authors classify as very large. By technology, chatbots had a very large effect, and intelligent tutoring systems and personalized learning systems had large effects.
The authors also tested five moderating variables: field of education, level of education, learning mode, intervention duration and geographical distribution. All five moderated the effect, which they say shows how and when AI integration in education can be effective.
Sources
1 on file- Information Developmentdoi:10.1177/02666669241304407
Talk it over
Who gets this benefit, and who was left out of the study or story?
Meta-analysis of 85 studies finds AI tools linked to much higher student achievementhttps://truvace.com/item/investigating-the-effect-of-artificial-intelligence-in-education-aied-on-learnin
Who gets this benefit, and who was left out of the study or story?
The gain A meta-analysis of 85 quantitative studies with 10,469 students found AI in education had a very large effect on learning achievement (Hedges' g = 1.10), with chatbots showing the largest effects.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a systematic review or meta-analysis with a sample of 10,469, from Information Development.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
The record’s own caveat The effect of AI in education was moderated by field of education, level of education, learning mode, intervention duration and geographical distribution, so the pooled result varies across settings.
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
What readers say