Certified into the record
The exact text we saved
This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.
TRUVACE RECORD VERSION record: TRV-2026-3033 version: 1 kind: certified reason: Certified into the record timestamp: 2026-11-18T18:01:52.636764Z status: published lens: g_space sector: education headline: Using Artificial Intelligence to Evaluate the Quality of Narrative Feedback in Surgical Entrustable Professional Activities dek: Background: Narrative feedback quality in surgical Entrustable Professional Activity (EPA) assessments is variable, limiting consistent evaluation and opportunities for improvement. We evaluated whether fine-tuned large language models (LLMs) could reproduce expert-assigned feedback quality scores and whether a simplified scoring rubric improved assessment consistency. Study design: This observational study evaluated 1,509 narrative comments from EPA micro-assessments in a general surgery residency program durin… gain_title: In an observational study of 1,509 surgical residency feedback comments, fine-tuned encoder language models matched expert quality scores with accuracy of 0.93 for evidence, 0.96 for suggestion and 0.95 for connection. problem_title: (none) trace_subject: (none) gain_reading: In an observational study of 1,509 surgical residency feedback comments, fine-tuned encoder language models matched expert quality scores with accuracy of 0.93 for evidence, 0.96 for suggestion and 0.95 for connection. gain_evidence: the encoder outperformed the generative model for evidence (0.93 vs 0.77) | Fine-tuned LLMs reproduced expert assessments of surgical narrative feedback with high domain-specific accuracy problem_reading: (none) problem_evidence: (none) quick_read: Researchers tested whether fine-tuned language models could score the quality of written feedback given to surgical residents. They used 1,509 narrative comments from entrustable professional activity micro-assessments in one general surgery residency program, collected over the 2023-2025 academic years. Two surgical education experts scored each comment on evidence, suggestion and connection. Encoder models reached accuracy of 0.93 for evidence, 0.96 for suggestion and 0.95 for connection, while a generative model scored 0.77 for evidence. The experts themselves disagreed on 27.8% of evidence scores under the original rubric. A simplified rubric with one point per domain cut that disagreement to 8.5% and gave the models their best performance. The authors say the results support further evaluation of AI-assisted feedback scoring in residency programs. limitation: The observational study used comments from a single general surgery residency program, and the authors call only for further evaluation of AI-assisted feedback assessment in residency programs. tag: Evidence-backed gain key_points: The study analysed 1,509 narrative comments from entrustable professional activity micro-assessments in a general surgery residency program during 2023-2025. | Two surgical education experts scored comments using the Quality of Assessment for Learning rubric, which covers evidence, suggestion and connection on a 0-5 scale. | Interrater reliability between the experts was high (κ = 0.85), yet they disagreed on 27.8% of evidence scores. | A modified rubric awarding 1 point per domain on a 3-point scale cut evidence disagreement to 8.5%. | Encoder and generative models scored similarly for suggestion (0.96 vs 0.94) and connection (0.95 vs 0.91). | For evidence, the encoder model reached 0.93 accuracy against 0.77 for the generative model. | Model performance was strongest with the modified rubric. rundown: Feedback on surgical trainees' performance is often variable in quality, which limits consistent evaluation and chances to improve. The team asked whether fine-tuned language models could reproduce expert judgments of that quality. They compared fine-tuned encoder models and generative models with scores from two surgical education experts, using accuracy and F1 score. Encoder models led on evidence scoring, and both model types did well on suggestion and connection. The rubric change mattered for people as well as machines. Making evidence scoring binary in the modified rubric reduced human disagreement from 27.8% to 8.5% and improved model performance. sources: - peer_reviewed | Journal of the American College of Surgeons | https://doi.org/10.1097/xcs.0000000000002297 | 2026-11-18 prev: 0000000000000000000000000000000000000000000000000000000000000000
- SHA-256 hash
- f5d62d00af8fb959ba9ab35cbc54a361ab4a2a8d812db504d4fb0c5a980e80f7
- Previous version’s hash
- 0000000000000000000000000000000000000000000000000000000000000000
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-3033 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace