Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-1394
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-10-15T01:09:50.385758Z
status: published
lens: trace
sector: health
headline: Reliable Detection, Unreliable Clinical Decision-making: Artificial Intelligence Models in Burn Assessment
dek: Background: Multimodal artificial intelligence (AI) systems are increasingly used for visual interpretation tasks. Whether commercially available models can be applied to burn surgery, and to what extent, remains unclear. We evaluated a clinical chain from visual recognition (distinguishing burns from nonburned skin) to treatment decision-making (debridement versus immediate skin grafting), including accuracy, output consistency, and skin tone subgroup performance.
Methods: Four multimodal large language models…
gain_title: Four multimodal models distinguished burns from nonburned skin with 97.2%-100% accuracy, with equivalent performance across Fitzpatrick skin tone strata.
problem_title: The same models gave unreliable treatment recommendations for burns (debridement versus immediate skin grafting), with accuracy of 24.8% to 72.8% and inconsistent outputs for identical images.
trace_subject: Multimodal AI models assessing burn photographs, from detection to treatment recommendation
gain_reading: Four multimodal models distinguished burns from nonburned skin with 97.2%-100% accuracy, with equivalent performance across Fitzpatrick skin tone strata.
gain_evidence: Burn detection was near-perfect (97.2%-100%, κ = 0.896-1.000) and equivalent across Fitzpatrick skin tone strata.
problem_reading: The same models gave unreliable treatment recommendations for burns (debridement versus immediate skin grafting), with accuracy of 24.8% to 72.8% and inconsistent outputs for identical images.
problem_evidence: Treatment accuracy in burn cases ranged from 24.8% to 72.8%, with 3 models performing below the majority-class baseline. | with inconsistent recommendations for identical images
quick_read: Researchers tested four commercially available multimodal language models on 50 cropped clinical photographs, 25 showing burns and 25 showing nonburned skin, repeating each assessment five times for 4000 assessments. Models had to say whether a burn was present and then recommend debridement or immediate skin grafting, judged against a consensus of plastic surgeons.

The pattern suggests that a model that looks competent at seeing may still be unsafe at deciding, so strong recognition scores should not be read as readiness for treatment guidance. The study used a small set of cropped images and named model versions, so how far the findings carry to real clinical workflows remains open. The authors see detection as a possible base for future triage support.
limitation: The study tested a small set of 50 cropped photographs and concluded that current applicability in burn surgery is limited, so results do not establish performance in real-world clinical decision-making.
tag: Dual reading
key_points: Burn detection accuracy ranged from 97.2% to 100% across the four models, with sensitivity of 94.4%-100% and specificity of 100%. | Detection performed equivalently across Fitzpatrick skin tone strata. | Treatment accuracy in burn cases ranged from 24.8% to 72.8%, and three models fell below the majority-class baseline. | Agreement on treatment decisions fell to κ = 0.132-0.385 in three models, versus κ = 0.896-1.000 for detection. | Error patterns were systematic and opposed across models.
rundown: The evaluation covered GPT-5.4 Pro, Grok 4.1, Gemini 3.1 Pro and Claude Opus 4.6. Each model assessed the same 50 images across five independent runs, and plastic surgeons' expert consensus set the ground truth. Reproducibility was measured with Fleiss κ.

Visual recognition was both accurate and consistent, with κ between 0.896 and 1.000. Treatment decisions were far less stable: in three models the κ dropped to 0.132-0.385, meaning identical images often drew different recommendations.

The authors describe the clinical chain as breaking at the transition from perception to decision, which limits current applicability in burn surgery. They suggest that reliable visual recognition may be a foundation for future AI-assisted triage in burn care.
sources:
- peer_reviewed | Plastic and Reconstructive Surgery - Global Open | https://doi.org/10.1097/gox.0000000000008141 | 2026-10-14
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

758dba5df4034da773fc1de6943394f9777efa95c37163eeffbe1cd84b827749

previous

0000000000000000000000000000000000000000000000000000000000000000