70/100

Moderate evidence

AI feedback boosts college English writing, a review of 43 studies finds

Study title: Effects of AI feedback on students’ English writing performance in higher education: a meta-analysis

Evidence type
Systematic review or meta-analysis
Sources
1 sourcePeer-reviewed
Published
1 min read

Study title: Effects of AI feedback on students’ English writing performance in higher education: a meta-analysis

A three-level meta-analysis pooled 234 effect sizes from 43 studies on AI-based assessment of English writing in higher education. It found a significant, moderate overall benefit for writing performance (g = 0.58, p < 0.001).

Read the study abstract

The integration of artificial intelligence (AI) to assess English writing has become prevalent in higher education, though empirical research on its efficacy has yielded inconsistent results. To clarify this variability and identify moderating factors, this study conducted a three-level meta-analysis synthesizing 234 effect sizes from 43 valid studies. The analysis demonstrated a significant, moderate overall impact of AI feedback on writing performance (g = 0.58, p < 0.001). The finding also revealed that AI fe…

The gain

A meta-analysis of 43 studies (234 effect sizes) found that AI feedback raised university students' English writing performance by a moderate margin (g = 0.58), with larger gains when paired with teacher feedback.

In brief

Earlier research on AI writing feedback had produced inconsistent results, which the analysis set out to explain by testing moderating factors. Feedback worked better when combined with human input, especially from teachers, and the biggest effect appeared on narrative writing tasks.

Main points

  1. The analysis combined 234 effect sizes from 43 valid studies using a three-level meta-analytic model.
  2. The overall effect of AI feedback on English writing performance was moderate and significant (g = 0.58, p < 0.001).
  3. Feedback was more effective when AI was combined with human feedback in a hybrid intelligence framework.
  4. The pairing of AI with teacher feedback was singled out as particularly effective.
  5. AI had its largest effect on narrative writing tasks.

The full story

The study addressed inconsistent results in earlier research on AI tools that assess English writing in universities. By pooling 234 effect sizes from 43 studies in a three-level model, it estimated an overall effect of g = 0.58, described as moderate and statistically significant.

Moderator analysis showed that outcomes depended on how feedback was delivered. Hybrid arrangements that combined AI with human feedback, notably teacher feedback, outperformed AI alone, and narrative writing tasks showed the largest gains from AI feedback.

Sources

1 on file
  1. Cogent Educationdoi:10.1080/2331186x.2026.2665494
    Peer-reviewed2026-04-30

Talk it over

Four questions to start on
Who gets this benefit, and who was left out of the study or story?

Start with a question

AI feedback boosts college English writing, a review of 43 studies findshttps://truvace.com/item/effects-of-ai-feedback-on-students-english-writing-performance-in-higher-educati

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 43 studies (234 effect sizes) found that AI feedback raised university students' English writing performance by a moderate margin (g = 0.58), with larger gains when paired with teacher feedback.

    Answer in the thread
  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis, from Cogent Education.

    Answer in the thread
  3. What does it leave open? What else would you want to know before acting on it?

    Answer in the thread
  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say