Moderate evidence
Published recordEducationGood Space
More
Human versus AI scoring of surgical mental practice in the FingerFix Smart® procedure
- Truvace record
- TRV-2026-3019raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Controlled or validated comparison
- Sources
- 1 sourcePeer-reviewed
- sha256
- 383cbee08ebe…check it
Introduction: Assessment of surgical procedural knowledge remains largely dependent on human expertise, which may limit reproducibility and scalability. This study evaluated whether generative artificial intelligence could score a surgical mental practice task from audio transcripts after video-based learning of FingerFix Smart® dynamic external fixator placement. Methods: Thirty-six medical students who had completed a rotation in a hand surgery department watched a reference video performed by an expert surgeo…
The gain
In a study of 36 medical students describing a hand-surgery fixator procedure, the fourth AI prompt scored their narrations within a mean bias of +0.92 points of an expert human grader, with an intraclass correlation of 0.940.
What this doesn’t fix
Prompt development and scoring were done on the same transcripts, so the findings do not establish the reliability or generalizability of AI-based scoring; independent validation is required.
Sources
1 on file- Hand Surgery and Rehabilitationdoi:10.1016/j.hansur.2026.103056
Cite this record
v1Truvace Impact Record TRV-2026-3019, v1: “Human versus AI scoring of surgical mental practice in the FingerFix Smart® procedure.” Truvace, 2026-11-18. /record/TRV-2026-3019 (accessed on the day you copy it). sha256 383cbee08ebe24ed…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-3019 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace