aceUser Beware: Inaccuracy and Inconsistency of Large Language Models in Providing Precision Dosing Recommendations for Patients With Kidney Impairment-A Case Series
Introduction Evidence-based dosing guidance for medications in critically ill patients with acute kidney injury (AKI) and receiving continuous kidney replacement therapy (CKRT) is limited. Freely available large language models (LLMs) can generate confident, human-like outputs. The accuracy and reproducibility of LLMs in providing precision drug dosing recommendations in the setting of AKI and CKRT have not been evaluated. Objectives We sought to characterize literature concordance and internal consistency of LL…
Six freely available LLMs matched literature-based cefepime and meropenem dosing only 63% of the time on average, and repeated prompts from the same user produced widely varying daily doses.
The evaluation covered only two antibiotics, three vignettes, and the freely available versions of six models during July to September 2025, so the findings may not generalize to other drugs or later model versions.
Evidence
- Peer-reviewedPharmacotherapy: The Journal of Human Pharmacology and Drug Therapy2026-10-01
How should this claim be treated?
Truvace Impact Record TRV-2026-1498, v1: “User Beware: Inaccuracy and Inconsistency of Large Language Models in Providing Precision Dosing Recommendations for Patients With Kidney Impairment-A Case Series.” Truvace, 2026-10-15. /record/TRV-2026-1498 (accessed at citation time). sha256 2490d18e1869dd57…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1498 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.