70/100

Moderate evidence

GainPublished recordEducationGood Space

Curriculum-aligned analysis of assessment feedback: a retrieval-augmented large language model approach for revealing fine-grained student error patterns in higher education

Truvace record
TRV-2026-2995raw data (JSON)
Version
v1Published
First published
Evidence type
Controlled or validated comparison
Sources
1 sourcePeer-reviewed
sha256
e8e975807401…check it

Abstract Assessment feedback in higher education provides fine-grained evidence about students’ specific errors but remains underutilized as a data source for teaching improvement. This study proposes a method based on a large language model (LLM) that transforms unstructured feedback into curriculum-aligned error analysis in three steps, deriving an error taxonomy from the feedback, mapping each piece to curriculum content by retrieval-augmented generation, and aggregating the annotations into error patterns wi…

The gain

In a study of 6,072 marker comments from four engineering cohorts (2022–2025), an AI pipeline using a taxonomy built from the feedback itself agreed with a human reviewer on 89.1% of error labels, versus 74.7% with an expert-designed taxonomy.

What this doesn’t fix

The case study covered a single engineering course at one institution with group-based project reports, and the taxonomy was generated from one year of data; its performance in other disciplines, assessment formats and institutions remains untested.

Sources

1 on file
  1. Peer-reviewed2026-11-15

Cite this record

v1

Truvace Impact Record TRV-2026-2995, v1: “Curriculum-aligned analysis of assessment feedback: a retrieval-augmented large language model approach for revealing fine-grained student error patterns in higher education.” Truvace, 2026-11-17. /record/TRV-2026-2995 (accessed on the day you copy it). sha256 e8e9758074017374…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv1e8e975807401…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2995 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.