Truace
Subscribe
70/100

Moderate evidence

Cite
More
Export CSVExport JSONEmailLinkedInX

Review of 15 studies finds AI helps English learners' skills, not motivation

Study title: AI in informal digital English learning: A meta-analysis of its effectiveness on proficiency, motivation, and self-regulation

Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
Published
1 min read
Truvace record
TRV-2026-2847cite or check it

Study title: AI in informal digital English learning: A meta-analysis of its effectiveness on proficiency, motivation, and self-regulation

A meta-analysis pooled 15 studies on generative AI in self-directed, out-of-classroom second-language learning. It found significant effects on English proficiency and on self-regulation, the ability to manage one's own learning.

Read the study abstract

This meta-analysis examines the efficacy of generative artificial intelligence (GenAI) in second language acquisition within self-directed, out-of-classroom informal contexts. A total of 15 studies meeting the inclusion criteria were identified that examined the impact of GenAI on second-language proficiency, motivation, and self-regulation. GenAI was shown to have significant effects on English proficiency and self-regulation, demonstrating its versatility in enhancing language learning outcomes. However, GenAI…

59Gain side

How the two sides scoreClose call

57Problem side

The gain

A meta-analysis of 15 studies found generative AI had significant effects on English proficiency and self-regulation among learners studying outside the classroom.

The problem

A meta-analysis of 15 studies found generative AI showed no significant effect on motivation among learners of English as a second language studying outside the classroom.

A fixed formula sets both scores from the evidence and its sources. Reader votes don’t move them.

What the scores mean

G is the gain side, out of 100. It goes up when the gain is specific, when it measurably helped people and when the sources behind it are strong.

P is the problem side, out of 100. It goes up when the problem is specific, when it measurably hurt people and when the sources behind it are strong.

In brief

The same analysis found no significant effect on learning motivation. The authors conclude that motivation measures suited to generative AI in education need to be developed, which suggests existing instruments may not capture what these tools change.

The findings cover informal learning outside classrooms, where people study without a teacher. The authors also discuss possible ways to apply generative AI in such settings, drawing on the included literature.

Main points

  1. The meta-analysis included 15 studies that met its inclusion criteria.
  2. It focused on self-directed, out-of-classroom informal English learning with generative AI.
  3. Generative AI had significant effects on English proficiency.
  4. Generative AI had significant effects on self-regulation.
  5. Generative AI showed no significant effect on learning motivation.
  6. The authors call for motivation measures suited to generative AI in education.

The full story

The study pooled research on generative AI used for second-language acquisition outside formal classes. It examined three outcomes: proficiency, motivation and self-regulation.

Two of the three outcomes improved significantly. The authors describe this as showing the versatility of generative AI in enhancing language learning outcomes.

Motivation did not show a significant effect. Based on that result, the authors argue that new motivation measures designed for generative AI in education are needed, and they discuss practical ways to apply the tools in informal learning.

What this doesn’t fix

The authors say the null motivation result points to a need for motivation measures suited to generative AI, which suggests current instruments may not capture its effects.

Sources

1 on file
  1. Computers and Education: Artificial Intelligencedoi:10.1016/j.caeai.2024.100323
    Peer-reviewed2024-10-30

Talk it over

Four questions to start onThis record found a gain and a problem in the same place. Which matters more to you, and who might answer differently?

Start with a question

Review of 15 studies finds AI helps English learners' skills, not motivationhttps://truvace.com/item/ai-in-informal-digital-english-learning-a-meta-analysis-of-its-effectiveness-on-

  1. This record found a gain and a problem in the same place. Which matters more to you, and who might answer differently?

    The gain A meta-analysis of 15 studies found generative AI had significant effects on English proficiency and self-regulation among learners studying outside the classroom.

    The problem A meta-analysis of 15 studies found generative AI showed no significant effect on motivation among learners of English as a second language studying outside the classroom.

    Answer in the thread

  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis, from Computers and Education: Artificial Intelligence.

    Answer in the thread

  3. What does it leave open? What else would you want to know before acting on it?

    The record’s own caveat The authors say the null motivation result points to a need for motivation measures suited to generative AI, which suggests current instruments may not capture its effects.

    Answer in the thread

  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say

More from Education