Moderate evidence
More
Loan decisions with AI got better over 10 rounds, experiment finds
Study title: Human–machine collaboration and algorithmic decision-making: The role of organizational incentives and AI capabilities
- Evidence type
- Randomized controlled trial
- Sources
- 1 sourcePeer-reviewed
- Published
- 2 min read
- Truvace record
- TRV-2026-2689cite or check it
Study title: Human–machine collaboration and algorithmic decision-making: The role of organizational incentives and AI capabilities
A randomized controlled experiment asked financially incentivized participants to evaluate 100 loan applications with AI assistance across 10 decision rounds. Joint human-AI performance improved as participants gained experience.
Read the study abstract
Despite growing investment in artificial intelligence (AI), organizations have yet to realize its potential for complex decision-making. We draw on the absorptive capacity (ACAP) view to conceptualize AI systems as organizational knowledge structures and incentive policies as knowledge transfer mechanisms, examining their effects on human–machine collaboration over time. We conduct a randomized controlled experiment wherein financially incentivized participants evaluate 100 loan applications with AI assistance o…
The gain
In a randomized controlled experiment where paid participants evaluated 100 loan applications with AI assistance over 10 decision rounds, human-AI joint performance improved as experience accumulated.
In brief
The study varied two factors: how accurate the AI's predictions were and how well incentives were aligned with organizational goals. Both affected outcomes on their own and in combination. Incentive alignment mattered most when the AI's predictive power was low.
The authors read this as a sign that aligned incentives may cushion organizations when AI performance degrades. They also report that cognitive capabilities, trust in AI, algorithm integration and decision quality shaped how individuals engaged with organizational learning processes.
Main points
- Participants were financially incentivized and evaluated 100 loan applications with AI assistance over 10 rounds.
- The design was a randomized controlled experiment testing AI predictive power and incentive alignment.
- Both factors influenced outcomes independently and interactively.
- Incentive alignment mattered most when AI predictive power was low.
- Human-AI joint performance improved as experience accumulated over the rounds.
- Cognitive capabilities, AI trust, algorithm integration and decision quality shaped individual engagement with organizational learning processes.
The full story
The researchers draw on the absorptive capacity view, treating AI systems as organizational knowledge structures and incentive policies as mechanisms that transfer knowledge between people and algorithms. They examine how collaboration changes over time rather than at a single point.
In the experiment, financially incentivized participants assessed loan applications with AI help. The setup let the team vary AI predictive power and incentive alignment and observe their separate and combined effects on organizational outcomes.
The interaction result is that incentive alignment mattered most when the AI's predictive power was low. The authors suggest aligned incentives may buffer organizations against the negative effects of AI degradation, and argue human-machine collaboration could become a new source of organizational learning.
Sources
1 on file- Information & Managementdoi:10.1016/j.im.2026.104384
Talk it over
Who gets this benefit, and who was left out of the study or story?
Loan decisions with AI got better over 10 rounds, experiment findshttps://truvace.com/item/human-machine-collaboration-and-algorithmic-decision-making-the-role-of-organiza
Who gets this benefit, and who was left out of the study or story?
The gain In a randomized controlled experiment where paid participants evaluated 100 loan applications with AI assistance over 10 decision rounds, human-AI joint performance improved as experience accumulated.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a randomized controlled trial, from Information & Management.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
ace
What readers say