Moderate evidence
More
AI-led interviews with 132 workers found 79 tasks missing from O*NET, a study reports
Study title: TaskNet: Building Occupational Task Inventories from Worker Interviews at Scale
- Evidence type
- Controlled or validated comparisonPreprint, not yet peer reviewed
- Sample
- n = 132
- Sources
- 1 sourcePeer-reviewed
- Published
- 3 min read
- Truvace record
- TRV-2026-2484cite or check it
Study title: TaskNet: Building Occupational Task Inventories from Worker Interviews at Scale
Stanford researchers built TaskNet, a system in which an AI interviewer talks with workers about their jobs and turns the answers into task lists. Across six occupations, 132 workers gave 2,726 task reports, which became 202 task statements. Analysts at the National Center for O*NET Development accepted every one, compared with roughly 65% of the write-in task suggestions workers submit through O*NET's current process.
Read the study abstract
Understanding how AI is reshaping work requires an accurate account of the tasks workers perform. Workers are often the first to see how their jobs are changing, as new responsibilities and tools often appear in everyday work before these changes reach formal descriptions. Interviews with workers can help capture these emerging changes in job tasks. Yet existing methods support standardized ratings across workers, while open-ended conversations with workers remain costly to collect and synthesize at scale. We in…
The gain
In a study of 132 workers in six occupations, an AI interviewer produced 202 task statements that all passed O*NET analyst review and covered 89% of tasks reported by held-out workers, versus 79% for O*NET.
In brief
Measured against the O*NET 31.0 database, TaskNet covered 75% of its 118 published tasks, added 79 tasks with no O*NET counterpart and refined 58 others. In interviews with 57 additional workers held out from the build, it covered 89.3% of reported tasks versus 78.6% for O*NET, and it was ahead in five of six occupations.
The choice of task list moves AI exposure estimates, which are used to guide workforce policy and training. Under TaskNet, exposure scores rose for Lawyers, Software Developers and Elementary School Teachers and fell for Personal Care Aides. The authors say much of the shift comes from newly documented coordination and oversight tasks. The paper is an NBER working paper and has not been peer reviewed.
Main points
- The AI interviewer worked with 132 workers (20 to 25 per occupation); median interview length was 29 minutes, and 318 other workers gave 7,923 ratings of task relevance and importance.
- Workers reviewed 2,798 task proposals made after their interviews and confirmed 94.2% unchanged, revised 5.3%, deleted 0.5% and added 163 tasks of their own.
- Of the 202 TaskNet tasks, 79 (39%) had no O*NET counterpart, from 15% for Dishwashers to 52% for Software Developers, and 180 (89%) were rated core tasks versus 82% of O*NET's tasks for these jobs.
- On held-out worker reports, coverage gains over O*NET were largest for Software Developers (17.0 points), Emergency Medicine Physicians (16.9) and Personal Care Aides (14.6); Dishwashers were tied at 85.7%.
- Against 12,474 activities from 2,186 job postings, TaskNet covered 72.5% versus 70.2% for O*NET, but trailed O*NET for Elementary School Teachers (8.8 points lower) and Dishwashers (7.4 points lower).
- Lawyers saw the largest exposure increase (9.6 points on RL feasibility, 0.16 on Eloundou-β), followed by Software Developers (9.1, 0.07); Personal Care Aides fell by 6.5 points and 0.11, and Dishwashers were unchanged.
- About 53% of new tasks fell into invisible-work themes such as oversight and quality assurance, coordination, and teaching; 20% of new tasks depended on a recent tool or practice, against 3% of shared tasks.
The full story
The system works in three stages. An AI interviewer runs a semi-structured conversation and probes for tasks the worker has not mentioned by comparing the reported list with a model-inferred list for the role. Reports are then clustered into task statements using a task definition drawn from hierarchical task analysis and functional job analysis, and only tasks reported by at least two workers are kept, following O*NET's emerging-tasks rule.
Validation had two parts. Two O*NET Center analysts reviewed 229 system-generated statements and judged all of them valid tasks, though their feedback led the authors to rewrite 21% and classify 11% as adjacent work belonging to other occupations. Incumbents then rated the 204 remaining statements, and two were dropped for being relevant to fewer than a quarter of workers, leaving 202.
Compared with O*NET, TaskNet splits broad tasks into finer ones. For example, Lawyers' 'represent clients in court' became drafting motions and briefs, preparing exhibits and witnesses, and presenting arguments. TaskNet refined 28 O*NET tasks into 58 statements, and one Emergency Medicine Physician coordination task split into communicating patient status (more AI-exposed) and supervising residents (not exposed). Thirty O*NET tasks had no TaskNet counterpart, and 37% of those were specialized or dated, such as probating wills or setting up banquet tables.
The authors say the exposure differences may stem from the interview method, from more recent task data, or from different worker samples, and their design cannot separate the three. They note that newly documented oversight and coordination tasks score as highly exposed to AI but depend on human accountability and tacit knowledge, so exposure may reflect complementarity as much as substitution.
Sources
1 on file- NBER Working Paperdoi:10.3386/w35987
Talk it over
Who gets this benefit, and who was left out of the study or story?
AI-led interviews with 132 workers found 79 tasks missing from O*NET, a study reportshttps://truvace.com/item/tasknet-building-occupational-task-inventories-from-worker-interviews-at-scale
Who gets this benefit, and who was left out of the study or story?
The gain In a study of 132 workers in six occupations, an AI interviewer produced 202 task statements that all passed O*NET analyst review and covered 89% of tasks reported by held-out workers, versus 79% for O*NET.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a controlled comparison with a sample of 132, from NBER Working Paper. It is a preprint, not yet peer reviewed.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
The record’s own caveat Workers were recruited through a single AI data platform, about twenty per occupation and not matched to the U.S. workforce, and the design cannot separate why TaskNet's exposure estimates differ from O*NET's.
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
ace
What readers say