Moderate evidence
Published recordScienceThe Trace
More
Displayed confidence amplifies reliance on AI verdicts: Benefits when correct, costs when wrong
- Truvace record
- TRV-2026-3045raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Controlled or validated comparison
- Sources
- 1 sourcePeer-reviewed
- sha256
- 7be184d38dea…check it
Large language models (LLMs) produce fluent text that is often only partially correct; therefore, users must decide what to accept. How certainty is displayed may shape these decisions, independent of whether the underlying claim is correct. In a fully within-subject experiment (N = 149), participants judged 16 general knowledge statements in a fixed order before and after viewing a simulated assistant's true/false verdicts accompanied by a high- or low-confidence badge. Verdict accuracy was fixed at 50%, and ac…
58Gain side
How the two sides scoreClose call
58Problem side
The gain
In an experiment with 149 participants, a high-confidence badge on a simulated AI assistant's verdicts raised final accuracy by 4.2 percentage points when the verdict was correct.
The problem
In an experiment with 149 participants, a high-confidence badge on a simulated AI assistant's verdicts lowered final accuracy by 6.7 percentage points when the verdict was wrong, though the badge carried no information about correctness.
A fixed formula sets both scores from the evidence and its sources. Reader votes don’t move them.
What the scores mean
G is the gain side, out of 100. It goes up when the gain is specific, when it measurably helped people and when the sources behind it are strong.
P is the problem side, out of 100. It goes up when the problem is specific, when it measurably hurt people and when the sources behind it are strong.
What this doesn’t fix
The assistant was simulated, verdict accuracy was fixed at 50%, and the task was general knowledge statements, so results may not carry over to real LLM use.
Sources
1 on file- Acta Psychologicadoi:10.1016/j.actpsy.2026.108130
Cite this record
v1Truvace Impact Record TRV-2026-3045, v1: “Displayed confidence amplifies reliance on AI verdicts: Benefits when correct, costs when wrong.” Truvace, 2026-11-19. /record/TRV-2026-3045 (accessed on the day you copy it). sha256 7be184d38dea7c6d…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-3045 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace