Truace
Subscribe
70/100

Moderate evidence

Cite
More
Export CSVExport JSONEmailLinkedInX

Meta-analysis of 49 studies finds students learn more with AI chatbots, but the motivation boost fades

Study title: Effects of Generative Artificial Intelligence on K-12 and Higher Education Students’ Learning Outcomes: A Meta-Analysis

Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
Published
2 min read
Truvace record
TRV-2026-2836cite or check it

Study title: Effects of Generative Artificial Intelligence on K-12 and Higher Education Students’ Learning Outcomes: A Meta-Analysis

A meta-analysis pooling 49 articles examined how generative AI affects the learning outcomes of K-12 and higher education students. The mean effect size was 0.857 for learning achievement and 0.803 for learning motivation, both pointing to a positive impact.

Read the study abstract

Generative artificial intelligence (GenAI) has significant potential for educational innovation, although its impact on students’ learning outcomes remains controversial. This study aimed to examine the impact of GenAI on the learning outcomes of K-12 and higher education students, and explore the moderating factors influencing this impact. A meta-analysis of 49 articles showed that the mean effect sizes of GenAI on students’ learning achievement and learning motivation were 0.857 and 0.803, respectively, indica…

The gain

A meta-analysis of 49 articles found generative AI use was linked to higher student learning achievement (mean effect size 0.857) and learning motivation (0.803) across K-12 and higher education.

In brief

Effects differed by education level, subject, AI interface, how the AI was developed, how students interacted with it and how long the experiment ran. Higher education students saw a greater impact on academic performance, and text interaction worked better than mixed media such as images or audio.

The motivation effect appears to be partly a novelty effect: the authors report that its size decreases over time. They conclude the findings support beneficial effects of GenAI on education and can guide how it is used in teaching.

Main points

  1. The meta-analysis pooled 49 articles covering K-12 and higher education students.
  2. Mean effect size for learning achievement was 0.857.
  3. Mean effect size for learning motivation was 0.803.
  4. Higher education students showed a greater impact on academic performance.
  5. Students interacted more effectively with GenAI through text than through mixed media such as images or audio.
  6. The motivation effect shrinks as experiment time grows, which the authors link to novelty.

The full story

The study set out to settle a controversy over whether generative AI improves learning. It pooled 49 articles and tested which factors change the effect, including education level, subject classification, GenAI interface, GenAI development, interaction approach and experimentation time.

Results showed positive average effects on both achievement (0.857) and motivation (0.803). Impact on academic performance was larger for higher education students than for younger students, and text-based interaction outperformed mixed-media interaction.

The motivation gain was not stable: GenAI has a novel effect on motivation, and the effect size decreases over time. The authors say the results offer insights for optimizing GenAI use in teaching practice.

Sources

1 on file
  1. Journal of Educational Computing Researchdoi:10.1177/07356331251329185
    Peer-reviewed2025-04-11

Talk it over

Four questions to start onWho gets this benefit, and who was left out of the study or story?

Start with a question

Meta-analysis of 49 studies finds students learn more with AI chatbots, but the motivation boost fadeshttps://truvace.com/item/effects-of-generative-artificial-intelligence-on-k-12-and-higher-education-stude

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 49 articles found generative AI use was linked to higher student learning achievement (mean effect size 0.857) and learning motivation (0.803) across K-12 and higher education.

    Answer in the thread

  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis, from Journal of Educational Computing Research.

    Answer in the thread

  3. What does it leave open? What else would you want to know before acting on it?

    The record’s own caveat The effect on learning motivation is partly a novelty effect, and its size decreases as experiments run longer, so early gains may overstate lasting benefit.

    Answer in the thread

  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say

More from Education