70/100

Moderate evidence

Meta-analysis finds AI gives elementary students a small maths boost

Study title: Examining the Effects of Artificial Intelligence on Elementary Students’ Mathematics Achievement: A Meta-Analysis

Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
Published
2 min read

Study title: Examining the Effects of Artificial Intelligence on Elementary Students’ Mathematics Achievement: A Meta-Analysis

A meta-analysis pooled 21 empirical studies with 30 independent samples, published between January 2000 and June 2022, to test whether AI improves elementary students' mathematics achievement. The overall effect was 0.351 under a random-effects model, which the authors describe as small.

Read the study abstract

With the increasing attention to artificial intelligence (AI) in education, this study aims to examine the overall effectiveness of AI on elementary students’ mathematics achievement using a meta-analysis method. A total of 21 empirical studies with 30 independent samples published between January 2000 and June 2022 were used in the study. The study findings revealed that AI had a small effect size on elementary students’ mathematics achievement. The overall effect of AI was 0.351 under the random-effects model.…

The gain

A meta-analysis of 21 studies (30 samples, 2000 to June 2022) found AI raised elementary students' mathematics achievement by a small overall effect of 0.351 under a random-effects model.

In brief

The review also tested eight moderating variables. Mathematics learning topic and grade level significantly changed how much AI helped, while research type, research design, sample size, intervention duration, AI type and organization did not show significant moderating effects.

The findings suggest AI tools may modestly support maths learning in primary schools, but the size of the benefit depends on what is taught and to which grade.

Main points

  1. The meta-analysis covered 21 empirical studies with 30 independent samples.
  2. Included studies were published between January 2000 and June 2022.
  3. The overall effect of AI on elementary maths achievement was 0.351 under a random-effects model, described as small.
  4. Eight moderators were examined: research type, research design, sample size, maths topic, intervention duration, AI type, grade level and organization.
  5. Mathematics learning topic and grade level significantly moderated the effect of AI.
  6. Research type, design, sample size, intervention duration, AI type and organization showed no significant moderating effects.

The full story

The study pooled evidence from 21 empirical studies with 30 independent samples published between January 2000 and June 2022, using a random-effects meta-analysis to estimate AI's effect on elementary students' mathematics achievement.

The pooled effect was 0.351, which the authors classed as small. They then examined three research characteristic variables (research type, research design and sample size) and five opportunity-to-learn variables (maths topic, intervention duration, AI type, grade level and organization).

Only maths learning topic and grade level significantly moderated the effect, so the benefit differed across topics and grades. The authors drew practical and research implications from these results.

Sources

1 on file
  1. Sustainabilitydoi:10.3390/su142013185
    Peer-reviewed2022-10-14

Talk it over

Four questions to start on
Who gets this benefit, and who was left out of the study or story?

Start with a question

Meta-analysis finds AI gives elementary students a small maths boosthttps://truvace.com/item/examining-the-effects-of-artificial-intelligence-on-elementary-students-mathemat

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 21 studies (30 samples, 2000 to June 2022) found AI raised elementary students' mathematics achievement by a small overall effect of 0.351 under a random-effects model.

    Answer in the thread
  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis, from Sustainability.

    Answer in the thread
  3. What does it leave open? What else would you want to know before acting on it?

    Answer in the thread
  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say