Truace
Subscribe
70/100

Moderate evidence

Cite
More
Export CSVExport JSONEmailLinkedInX

Students taught with AI adaptive learning did better, a review of 45 studies finds

Study title: The Efficacy of Artificial Intelligence-Enabled Adaptive Learning Systems From 2010 to 2022 on Learner Outcomes: A Meta-Analysis

Evidence type
Systematic review or meta-analysis
Sample
n = 45
Sources
1 sourcePeer-reviewed
Published
2 min read
Truvace record
TRV-2026-2850cite or check it

Study title: The Efficacy of Artificial Intelligence-Enabled Adaptive Learning Systems From 2010 to 2022 on Learner Outcomes: A Meta-Analysis

A meta-analysis pooled 45 independent studies of adaptive learning systems run on artificial intelligence and compared them with non-adaptive learning interventions. It found a medium to large positive effect on students' cognitive learning outcomes, with a pooled effect size of g = 0.70.

Read the study abstract

The purpose of this research study was to examine the overall effect of adaptive learning systems deployed using artificial intelligence technology across a range of relevant variables (e.g., duration, student level, etc.). Following a systematic procedure, this meta-analysis examined literature from 18 academic databases and identified N = 45 independent studies utilizing AI-enabled adaptive learning. This meta-analysis examined the overall effect of AI-enabled adaptive learning systems on students’ cognitive l…

The gain

A meta-analysis of 45 independent studies found AI-enabled adaptive learning systems had a medium to large positive effect (g = 0.70) on students' cognitive learning outcomes compared with non-adaptive teaching.

In brief

The authors searched 18 academic databases for studies covering 2010 to 2022. The size of the effect varied with publication type, study origin, student level, discipline, duration and research design, so the average does not apply equally to every classroom.

Each of the three adaptive sources (cognitive, affective and behavioral) and both adaptive targets (navigation and assessment) significantly moderated the results. The specific type of AI used in the adaptive engine did not.

Main points

  1. The meta-analysis drew on literature from 18 academic databases and included 45 independent studies.
  2. AI-enabled adaptive learning beat non-adaptive interventions on cognitive learning outcomes, with a pooled effect of g = 0.70.
  3. Publication type, study origin, student classification level, discipline, duration and research design significantly moderated the effect.
  4. Cognitive, affective and behavioral adaptive sources were all significant moderators.
  5. Adaptive targets, navigation and assessment, were also significant moderators.
  6. The type of AI used in the adaptive engine did not change the effect.

The full story

The study followed a systematic procedure to find research on adaptive learning systems deployed with AI. It searched 18 academic databases and identified 45 independent studies, covering work published from 2010 to 2022.

The headline result is a medium to large positive effect (g = 0.70) on students' cognitive learning outcomes, measured against non-adaptive learning interventions.

Moderator analyses showed the effect differed by publication type, study origin, student level, discipline, duration and design. The adaptive engine could draw on cognitive, affective or behavioral signals and could target navigation or assessment; all of these were significant moderators, whereas the type of AI used was not.

Sources

1 on file
  1. Journal of Educational Computing Researchdoi:10.1177/07356331241240459
    Peer-reviewed2024-05-15

Talk it over

Four questions to start onWho gets this benefit, and who was left out of the study or story?

Start with a question

Students taught with AI adaptive learning did better, a review of 45 studies findshttps://truvace.com/item/the-efficacy-of-artificial-intelligence-enabled-adaptive-learning-systems-from-2

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 45 independent studies found AI-enabled adaptive learning systems had a medium to large positive effect (g = 0.70) on students' cognitive learning outcomes compared with non-adaptive teaching.

    Answer in the thread

  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis with a sample of 45, from Journal of Educational Computing Research.

    Answer in the thread

  3. What does it leave open? What else would you want to know before acting on it?

    The record’s own caveat The effect size varied significantly with publication type, study origin, student level, discipline, duration and research design, so the average of g = 0.70 may not hold in every setting.

    Answer in the thread

  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say

More from Education