aceEvaluation of Large Language Model Concordance With AAOS Clinical Practice Guidelines for Carpal Tunnel Syndrome
Background Large language models (LLMs) such as ChatGPT, Gemini, Claude, and Mistral are increasingly used to obtain medical information, but their accuracy in carpal tunnel syndrome (CTS) management is uncertain. This study evaluated whether LLM-generated recommendations align with American Academy of Orthopaedic Surgeons (AAOS) clinical practice guidelines (CPGs). Methods Four LLMs (ChatGPT-4, Gemini, Claude-3, Mistral-7B) were queried with standardized prompts derived from AAOS CTS CPGs. Each prompt was asked…
More than one in four chatbot recommendations for carpal tunnel syndrome did not match AAOS guidelines, and weaker models such as Mistral-7B performed far worse than ChatGPT-4.
The authors say performance varied across models and that careful validation and clinician oversight are needed before clinical use, so the results do not establish safety for real-world care.
Evidence
- Peer-reviewedHAND2026-10-27
How should this claim be treated?
Truvace Impact Record TRV-2026-2306, v1: “Evaluation of Large Language Model Concordance With AAOS Clinical Practice Guidelines for Carpal Tunnel Syndrome.” Truvace, 2026-10-29. /record/TRV-2026-2306 (accessed at citation time). sha256 c3647bc03bf7db7e…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-2306 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.