70/100

Moderate evidence

AI chatbots boost English learners' results, a review of 25 studies finds

Study title: Can AI chatbots effectively improve EFL learners’ learning effects?—A meta-analysis of empirical research from 2022–2024

Evidence type
Systematic review or meta-analysis
Sample
n = 25
Sources
1 sourcePeer-reviewed
Published
1 min read

Study title: Can AI chatbots effectively improve EFL learners’ learning effects?—A meta-analysis of empirical research from 2022–2024

A meta-analysis pooled 25 peer-reviewed studies published between 2022 and 2024 to test whether AI chatbots help people learning English as a foreign language. It found that chatbots significantly improved academic performance and also benefited language skills and psychological and emotional well-being.

Read the study abstract

Technology development has brought transformative changes to the field of education, with AI chatbots injecting new vitality into language learning. To clarify the effectiveness of AI-powered chatbots in enhancing learners’ English language acquisition, this study systematically employed meta-analysis to review 25 peer-reviewed studies published between 2022 and 2024. The results indicate that AI chatbots significantly enhance learners’ academic performance, positively influencing their language skills as well a…

The gain

A meta-analysis of 25 peer-reviewed studies from 2022 to 2024 found AI chatbots significantly improved English-as-a-foreign-language learners' academic performance, language skills and psychological and emotional well-being.

In brief

The size of the benefit varied with how the chatbots were used. Longer interventions went with better learning effects, chatbots acting as learning companions worked better, and chatbots with mechanical appearances had a greater impact on learning.

Educational level and teacher roles did not significantly change the effects. The authors offer recommendations for bringing chatbots into English-language teaching and suggest directions for future research.

Main points

  1. The review covers 25 peer-reviewed studies published between 2022 and 2024.
  2. AI chatbots significantly improved English learners' academic performance.
  3. Language skills and psychological and emotional well-being also improved.
  4. Longer intervention periods correlated with better learning effects.
  5. Chatbots acting as learning companions were more effective.
  6. Chatbots with mechanical appearances had a greater impact on learning than other forms.
  7. Educational level and teacher roles did not significantly affect the moderating effects.

The full story

The researchers used meta-analysis to combine results from 25 empirical studies of AI chatbots in English-as-a-foreign-language learning, all published in peer-reviewed venues between 2022 and 2024.

Outcomes were grouped into academic performance, language skills and psychological and emotional well-being, with all three improving. The analysis then tested which factors changed the size of the effect.

Intervention duration, chatbot role and chatbot form were key moderating factors: longer programmes, companion-style chatbots and mechanical-looking chatbots were associated with larger learning effects. Educational level and teacher roles showed no significant moderating effect.

The paper also gives practical recommendations for integrating chatbots into English-language teaching and proposes future research directions.

Sources

1 on file
  1. Computer Assisted Language Learningdoi:10.1080/09588221.2025.2456512
    Peer-reviewed2025-02-08

Talk it over

Four questions to start on
Who gets this benefit, and who was left out of the study or story?

Start with a question

AI chatbots boost English learners' results, a review of 25 studies findshttps://truvace.com/item/can-ai-chatbots-effectively-improve-efl-learners-learning-effects-a-meta-analysi

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 25 peer-reviewed studies from 2022 to 2024 found AI chatbots significantly improved English-as-a-foreign-language learners' academic performance, language skills and psychological and emotional well-being.

    Answer in the thread
  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis with a sample of 25, from Computer Assisted Language Learning.

    Answer in the thread
  3. What does it leave open? What else would you want to know before acting on it?

    Answer in the thread
  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say