Moderate evidence
More
Freelance translators: ChatGPT cut demand for routine and creative work, study finds
Study title: AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT
- Evidence type
- Observational study
- Sources
- 1 sourcePeer-reviewed
- Published
- 2 min read
- Truvace record
- TRV-2026-2504cite or check it
Study title: AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT
A peer-reviewed study in Management Science compared two AI shocks in the translation industry on a major online labor market: Google Neural Machine Translation (GNMT) and, later, ChatGPT. Using transaction-level data from 2016 to 2017 and 2022 to 2023, it found both reduced demand for human work, but to very different degrees.
Read the study abstract
We examine how different generations of artificial intelligence (AI) substitute for human knowledge worker tasks, leveraging two sequential natural experiments in the translation industry. We study the introduction of Google Neural Machine Translation (GNMT), a predictive, task-specific AI, as well as ChatGPT, a broad, general-purpose generative AI, in a major online labor market. Distinguishing between analytical tasks (regular translations) and intuitive tasks (transcreations, which require creative and cultur…

The problem
A difference-in-differences study of an online labor market found ChatGPT produced substantially larger and more uniform drops in demand for both regular translations and creative transcreations than Google Neural Machine Translation did.
In brief
GNMT cut demand for analytical tasks, meaning regular translations, by economically meaningful amounts. It had no detectable effect on intuitive tasks, or transcreations, which need creative and cultural adaptation. ChatGPT, by contrast, reduced demand for both kinds of work, with larger and more uniform reductions.
The authors say this means conclusions about which kinds of human work resist automation do not straightforwardly carry over from predictive AI to generative AI. Creative and culturally adaptive work that looked safe from GNMT was not protected from ChatGPT.
Main points
- The study examined two sequential natural experiments in one online labor market for translation.
- GNMT is described as a predictive, task-specific AI; ChatGPT as a broad, general-purpose generative AI.
- Tasks were split into analytical (regular translations) and intuitive (transcreations needing creative and cultural adaptation).
- Researchers estimated difference-in-differences models on transaction-level data from 2016 to 2017 and 2022 to 2023.
- GNMT reduced demand for analytical tasks by economically meaningful magnitudes, with no detectable effect on intuitive tasks.
- ChatGPT produced substantially larger and more uniform reductions for both task types.
The full story
The researchers treated the launch of GNMT and, later, ChatGPT as natural experiments in a major online labor market for translators. Difference-in-differences models on transaction-level data covered two windows, 2016 to 2017 and 2022 to 2023.
They separated work into analytical tasks, regular translations, and intuitive tasks, transcreations that require creative and cultural adaptation. This split allowed them to test whether creative work was shielded from automation.
For GNMT, demand fell for analytical tasks while intuitive tasks showed no detectable change. For ChatGPT, the reductions were substantially larger and applied to both categories, which the authors describe as a marked expansion in the scope and magnitude of AI substitution.
Sources
1 on file- Management Sciencedoi:10.1287/mnsc.2024.06740
Talk it over
Who carries this cost, and what would have to change to prevent it?
Freelance translators: ChatGPT cut demand for routine and creative work, study findshttps://truvace.com/item/ai-driven-human-task-substitution-evidence-from-google-translate-and-chatgpt
Who carries this cost, and what would have to change to prevent it?
The problem A difference-in-differences study of an online labor market found ChatGPT produced substantially larger and more uniform drops in demand for both regular translations and creative transcreations than Google Neural Machine Translation did.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on an observational study, from Management Science.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
ace
What readers say