70/100

Moderate evidence

GainPublished recordEducationGood Space

Chatbots in education: Hype or help? A meta-analysis

Truvace record
TRV-2026-2841raw data (JSON)
Version
v1Published
First published
Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
sha256
3d110224604a…check it

Artificial intelligence integration in education, primarily through chatbots , has emerged as a potential solution to address the challenges of catering to students' diverse learning backgrounds. This meta-analysis examined chatbot effectiveness in education, driven by amplified interest since ChatGPT's introduction in 2022. Adhering to PRISMA guidelines, we analyzed 135 effect sizes from 62 studies across diverse educational contexts. Initial results revealed a large positive effect of chatbots on learning perf…

The gain

A meta-analysis of 135 effect sizes from 62 studies found chatbots had a small to moderate positive effect on student learning performance after publication-bias correction, with the largest effects in STEM, text-based and longer interventions.

What this doesn’t fix

The authors say chatbots' impact may be overestimated because of publication bias, so the pooled effect on learning performance is likely smaller than early results suggested.

Sources

1 on file
  1. Learning and Individual Differencesdoi:10.1016/j.lindif.2025.102646
    Peer-reviewed2025-02-10

Cite this record

v1

Truvace Impact Record TRV-2026-2841, v1: “Chatbots in education: Hype or help? A meta-analysis.” Truvace, 2026-11-12. /record/TRV-2026-2841 (accessed on the day you copy it). sha256 3d110224604abc47…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv13d110224604a…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2841 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.