Automating Injury Severity Score Calculation From Free-Text Discharge Diagnoses Using Domain-Specific Retrieval-Augmented Large Language Models: Retrospective Validation Study
Background: Trauma registries are crucial for evaluating the prognosis of injuries and the quality of trauma care. However, the calculation of Injury Severity Score (ISS) remains a predominantly manual process, which is labor-intensive, potentially error-prone, and difficult to scale. Automating this process is a critical step toward enhancing the efficiency and quality of trauma registry data. Objective: This study conducts a feasibility test on the use of large language models (LLMs) to automatically calculate…
A domain-specific retriever fine-tuned on trauma ICD-10 codes raised LLM exact-match accuracy for Injury Severity Score calculation, reaching 75.3% with GPT-4.1 versus 70.0% for the ICDPIC-R baseline.
Standard retrieval augmentation gave no consistent gains, and baseline LLMs reached only 47.3% to 64.7% exact-match accuracy, so off-the-shelf models are unreliable for this task.
The study is a single-center retrospective feasibility test, so the findings need confirmation across multiple institutions.
Evidence
- Peer-reviewedJMIR Medical Informatics2026-10-13
How should this claim be treated?
Truvace Impact Record TRV-2026-1356, v1: “Automating Injury Severity Score Calculation From Free-Text Discharge Diagnoses Using Domain-Specific Retrieval-Augmented Large Language Models: Retrospective Validation Study.” Truvace, 2026-10-14. /record/TRV-2026-1356 (accessed at citation time). sha256 d48d5b3ba2edf2f6…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1356 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.
ace