aceModerate evidence
More
Analysis of 24 studies finds AI tools lifted student learning results
Study title: The effectiveness of artificial intelligence on learning achievement and learning perception: A meta-analysis
- Evidence type
- Systematic review or meta-analysis
- Sample
- n = 2,908
- Sources
- 1 sourcePeer-reviewed
- Published
- 1 min read
- Truvace record
- TRV-2026-2809cite or check it
Study title: The effectiveness of artificial intelligence on learning achievement and learning perception: A meta-analysis
A meta-analysis pooled 24 articles published between 2001 and 2020, covering 2,908 participants, to test how AI in education affects learning. It found a high effect size on learning achievement and only a small effect size on how learners perceived their learning.
Read the study abstract
Recently, artificial intelligence (AI) technologies have been widely used in the field of education, and artificial intelligence in education (AIEd) has gained increasing attention. However, no quantitative meta-analysis has been conducted on the overall effectiveness of AI on learning achievement and learning perception. To close this research gap, this study conducted a comprehensive meta-analysis of the effects of AI on learning achievement and learning perception. The present meta-analysis synthesized 24 art…
The gain
A meta-analysis of 24 studies with 2,908 participants from 2001 to 2020 found AI had a high effect size on learning achievement and a small effect size on learning perception.
In brief
The authors say no earlier quantitative meta-analysis had covered the overall effect of AI on both outcomes. The work therefore gives a first pooled estimate for the field, though it rests on a modest number of studies.
Effects were not uniform. Sample size, sample level, learning domains, types of organization, roles of AI and hardware significantly moderated how well AI worked.
Main points
- The meta-analysis synthesized 24 articles with 2,908 participants, published from 2001 to 2020.
- AI had a high effect size on learning achievement.
- AI had only a small effect size on learning perception.
- Thirteen moderator variables were analyzed, including sample level, learning domain, research design, intervention duration and AI technologies.
- Sample size, sample level, learning domains, types of organization, roles of AI and hardware significantly moderated effectiveness.
The full story
The authors say that despite wide use of AI in education, no quantitative meta-analysis had examined its overall effect on learning achievement and learning perception. They pooled 24 articles with 2,908 participants from 2001 to 2020 to fill that gap.
The pooled results show a high effect size for achievement but a small one for perception. The analysis also tested 13 moderators, covering sample levels, learning methods, research design, research settings, intervention duration, role of AI, areas of AI application, AI software, AI hardware and AI technologies.
Six of those moderators made a significant difference: sample size, sample level, learning domains, types of organization for treatment, roles of AI and hardware.
Sources
1 on file- Interactive Learning Environmentsdoi:10.1080/10494820.2021.2015693
Talk it over
Who gets this benefit, and who was left out of the study or story?
Analysis of 24 studies finds AI tools lifted student learning resultshttps://truvace.com/item/the-effectiveness-of-artificial-intelligence-on-learning-achievement-and-learnin
Who gets this benefit, and who was left out of the study or story?
The gain A meta-analysis of 24 studies with 2,908 participants from 2001 to 2020 found AI had a high effect size on learning achievement and a small effect size on learning perception.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a systematic review or meta-analysis with a sample of 2,908, from Interactive Learning Environments.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
What readers say