TruaceTracing the truth around AITuesday, August 25, 2026
TRV-2026-0881Certified recordPeer-reviewed

AI-Assisted Thematic Analysis in a Quality Improvement Evaluation: Replicable Findings and Subtle Misrepresentations

Using artificial intelligence to identify themes in interview data from a quality improvement program evaluation produced 4 replicable themes grounded in the data. However, 2 consistently identified themes resulted from subtle misrepresentations and could have easily misled results without thorough data knowledge and output audit by the human research team.

Science · The Trace — both readings · certified 2026-08-25 · v1 · article view · machine-readable

Current reading — gain

AI-assisted analysis of interview data from a quality improvement evaluation generated four themes that were replicable and grounded in the data.

Current reading — problem

The same AI analysis consistently produced two themes based on subtle misrepresentations that could have misled evaluation results without human auditing.

What this doesn’t fix

Findings depend on thorough data knowledge and output audit by the human research team to prevent misleading results from AI-generated themes.

Evidence

Reader signal

How should this claim be treated?

Cite this record

Truvace Impact Record TRV-2026-0881, v1: “AI-Assisted Thematic Analysis in a Quality Improvement Evaluation: Replicable Findings and Subtle Misrepresentations.” Truvace, 2026-08-25. /record/TRV-2026-0881 (accessed at citation time). sha256 8fb04c8d723591d5

Calibration history

Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.

  1. Certifiedv18fb04c8d7235

    Certified into the record

Verify this record
How to verify without trusting this page

Fetch the canonical text of any version from /api/record/TRV-2026-0881 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.