68/100

Moderate evidence

Trace: a gain and a problemPublished recordScienceThe Trace

Displayed confidence amplifies reliance on AI verdicts: Benefits when correct, costs when wrong

Truvace record
TRV-2026-3045raw data (JSON)
Version
v1Published
First published
Evidence type
Controlled or validated comparison
Sources
1 sourcePeer-reviewed
sha256
7be184d38dea…check it

Large language models (LLMs) produce fluent text that is often only partially correct; therefore, users must decide what to accept. How certainty is displayed may shape these decisions, independent of whether the underlying claim is correct. In a fully within-subject experiment (N = 149), participants judged 16 general knowledge statements in a fixed order before and after viewing a simulated assistant's true/false verdicts accompanied by a high- or low-confidence badge. Verdict accuracy was fixed at 50%, and ac…

58Gain side

How the two sides scoreClose call

58Problem side

The gain

In an experiment with 149 participants, a high-confidence badge on a simulated AI assistant's verdicts raised final accuracy by 4.2 percentage points when the verdict was correct.

The problem

In an experiment with 149 participants, a high-confidence badge on a simulated AI assistant's verdicts lowered final accuracy by 6.7 percentage points when the verdict was wrong, though the badge carried no information about correctness.

A fixed formula sets both scores from the evidence and its sources. Reader votes don’t move them.

What the scores mean

G is the gain side, out of 100. It goes up when the gain is specific, when it measurably helped people and when the sources behind it are strong.

P is the problem side, out of 100. It goes up when the problem is specific, when it measurably hurt people and when the sources behind it are strong.

What this doesn’t fix

The assistant was simulated, verdict accuracy was fixed at 50%, and the task was general knowledge statements, so results may not carry over to real LLM use.

Sources

1 on file
  1. Acta Psychologicadoi:10.1016/j.actpsy.2026.108130
    Peer-reviewed2026-11-18

Cite this record

v1

Truvace Impact Record TRV-2026-3045, v1: “Displayed confidence amplifies reliance on AI verdicts: Benefits when correct, costs when wrong.” Truvace, 2026-11-19. /record/TRV-2026-3045 (accessed on the day you copy it). sha256 7be184d38dea7c6d…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv17be184d38dea…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-3045 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.