Performance of large language models in complex coronary artery disease decision-making and potential improvement strategy in a real-world cohort
Objective: Previous studies have demonstrated that large language models (LLMs) can achieve performance comparable to multidisciplinary heart teams (HTs) in coronary revascularisation decision-making but limited by population bias. We aimed to assess LLMs’ performance in complex coronary artery disease (CAD) decision-making using a real-world cohort and to explore the potential improvement strategy. Methods: Patients with stable CAD and angiographically confirmed three-vessel or left main disease randomly select…
Three predefined prompting strategies raised LLM agreement with heart-team revascularisation decisions from 47.0% to 79.3% in the same complex coronary artery disease cohort.
With a typical patient-style prompt, ChatGPT-4.1 agreed with heart-team decisions in only 47.0% of complex coronary artery disease cases and never identified cases needing further testing.
Even after prompting improvements, agreement with heart teams was not complete, and the authors emphasise that potential safety risk remains.
Evidence
- Peer-reviewedBMJ Health & Care Informatics2026-10-13
How should this claim be treated?
Truvace Impact Record TRV-2026-1470, v1: “Performance of large language models in complex coronary artery disease decision-making and potential improvement strategy in a real-world cohort.” Truvace, 2026-10-15. /record/TRV-2026-1470 (accessed at citation time). sha256 ce8c377833b19356…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-1470 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.
ace