"That's another doom I haven't thought about": A User Study on AI Labels as a Safeguard Against Image-Based Misinformation
As generative AI is increasingly contributing to the spread of deceptively realistic misinformation, lawmakers have introduced regulations requiring the disclosure of AI-generated content. However, it is unclear if labels reduce the risk of users falling for AI-generated misinformation. To address this research gap, we study the effect of labels on users’ perception and the implications of mislabeling, focusing on AI-generated images. We first explored users’ opinions and expectations of labels using five focus…
Comparing participants and nonparticipants in the home health prospective payment demonstration : do their differences affect our view of the evaluation results? : final report by Foster, Leslie, 1968- Grady, April Zambrowski, Amy Meadow, Ann Cheh, Valerie Brown, Randall S Phillips, Barbara B United States. Health Care Financing Administration Centers for Medicare & Medicaid Services (U.S.) Mathematica Policy Research, Inc. Public domain
Researchers studied whether legally mandated disclosure labels help users avoid deception from AI-generated images. After five focus groups, they surveyed 1,354 participants on how labels changed their judgments of true and false claims illustrated with different image types.
The findings matter for current disclosure regulations. Labels helped in the targeted case but created a heuristic that users over-applied, raising questions about how to design labeling systems that do not undermine trust in true information or miss misinformation using human-made imagery.
- Researchers ran five focus groups to explore opinions and expectations of AI disclosure labels.
- A follow-up survey with 1,354 participants tested how labels affect recognition of misinformation with images.
- Focus group participants were wary of practical implementations but saw labels as helpful for avoiding deception.
- The work was presented at CHI 2026 and examines mislabeling implications for AI-generated images.
The same survey found overreliance on labels, making participants more susceptible to false claims with human-made images and more hesitant to believe true claims illustrated with labeled AI-generated images.
The rundown
The project combined qualitative and quantitative methods. Five focus groups probed expectations about disclosure, followed by a survey of 1,354 people measuring belief in true and false claims paired with AI-generated versus human-made images.
Results were mixed. Labeling lowered belief in false claims supported by AI images, but also produced overreliance: false claims with human-made images were believed more, and true claims with labeled AI images were believed less.
Sources
- Peer-reviewedProceedings of the 2026 CHI Conference on Human Factors in Computing Systems2026-04-13
How should this claim be treated?
ace
The debate