Moderate evidence
Published recordEducationGood Space
More
Curriculum-aligned analysis of assessment feedback: a retrieval-augmented large language model approach for revealing fine-grained student error patterns in higher education
- Truvace record
- TRV-2026-2995raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Controlled or validated comparison
- Sources
- 1 sourcePeer-reviewed
- sha256
- e8e975807401…check it
Abstract Assessment feedback in higher education provides fine-grained evidence about students’ specific errors but remains underutilized as a data source for teaching improvement. This study proposes a method based on a large language model (LLM) that transforms unstructured feedback into curriculum-aligned error analysis in three steps, deriving an error taxonomy from the feedback, mapping each piece to curriculum content by retrieval-augmented generation, and aggregating the annotations into error patterns wi…
The gain
In a study of 6,072 marker comments from four engineering cohorts (2022–2025), an AI pipeline using a taxonomy built from the feedback itself agreed with a human reviewer on 89.1% of error labels, versus 74.7% with an expert-designed taxonomy.
What this doesn’t fix
The case study covered a single engineering course at one institution with group-based project reports, and the taxonomy was generated from one year of data; its performance in other disciplines, assessment formats and institutions remains untested.
Sources
1 on file- International Journal of Educational Technology in Higher Educationdoi:10.1186/s41239-026-00640-7
Cite this record
v1Truvace Impact Record TRV-2026-2995, v1: “Curriculum-aligned analysis of assessment feedback: a retrieval-augmented large language model approach for revealing fine-grained student error patterns in higher education.” Truvace, 2026-11-17. /record/TRV-2026-2995 (accessed on the day you copy it). sha256 e8e9758074017374…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-2995 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace