aceOsteoCHAT: real-world patient evaluation and benchmarking of a guideline-grounded osteoporosis chatbot
Patients with osteoporosis have information needs that routine care inconsistently addresses. In this multicenter real-world evaluation, the LLM-based, guideline-grounded chatbot OsteoCHAT showed high participant acceptability and achieved expert-rated answer quality comparable to general-purpose LLMs. Despite challenges in complex treatment and safety-related topics, guideline-grounded chatbots may represent useful educational adjuncts. Purpose Patients with osteoporosis have information needs that routine care…
Expert reviewers found OsteoCHAT and the other LLMs weak on pharmacological treatment indications and on communicating adverse and rare safety-critical events.
Experts identified limitations in safety communication across all examined systems, and trust in OsteoCHAT was comparatively lower than other measures.
Evidence
- Peer-reviewedOsteoporosis International2026-10-03
How should this claim be treated?
Truvace Impact Record TRV-2026-1350, v1: “OsteoCHAT: real-world patient evaluation and benchmarking of a guideline-grounded osteoporosis chatbot.” Truvace, 2026-10-14. /record/TRV-2026-1350 (accessed at citation time). sha256 5b27ce202e899013…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1350 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.