60/100

Moderate evidence

Freelance translators: ChatGPT cut demand for routine and creative work, study finds

Study title: AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT

Evidence type
Observational study
Sources
1 sourcePeer-reviewed
Published
2 min read

Study title: AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT

A peer-reviewed study in Management Science compared two AI shocks in the translation industry on a major online labor market: Google Neural Machine Translation (GNMT) and, later, ChatGPT. Using transaction-level data from 2016 to 2017 and 2022 to 2023, it found both reduced demand for human work, but to very different degrees.

Read the study abstract

We examine how different generations of artificial intelligence (AI) substitute for human knowledge worker tasks, leveraging two sequential natural experiments in the translation industry. We study the introduction of Google Neural Machine Translation (GNMT), a predictive, task-specific AI, as well as ChatGPT, a broad, general-purpose generative AI, in a major online labor market. Distinguishing between analytical tasks (regular translations) and intuitive tasks (transcreations, which require creative and cultur…

AI-Driven Human Task Substitution: Evidence from Google Translate and ChatGPT
"Chinese Factory Worker" by Cory M. Grenier, CC BY-SA 2.0.

The problem

A difference-in-differences study of an online labor market found ChatGPT produced substantially larger and more uniform drops in demand for both regular translations and creative transcreations than Google Neural Machine Translation did.

In brief

GNMT cut demand for analytical tasks, meaning regular translations, by economically meaningful amounts. It had no detectable effect on intuitive tasks, or transcreations, which need creative and cultural adaptation. ChatGPT, by contrast, reduced demand for both kinds of work, with larger and more uniform reductions.

The authors say this means conclusions about which kinds of human work resist automation do not straightforwardly carry over from predictive AI to generative AI. Creative and culturally adaptive work that looked safe from GNMT was not protected from ChatGPT.

Main points

  1. The study examined two sequential natural experiments in one online labor market for translation.
  2. GNMT is described as a predictive, task-specific AI; ChatGPT as a broad, general-purpose generative AI.
  3. Tasks were split into analytical (regular translations) and intuitive (transcreations needing creative and cultural adaptation).
  4. Researchers estimated difference-in-differences models on transaction-level data from 2016 to 2017 and 2022 to 2023.
  5. GNMT reduced demand for analytical tasks by economically meaningful magnitudes, with no detectable effect on intuitive tasks.
  6. ChatGPT produced substantially larger and more uniform reductions for both task types.

The full story

The researchers treated the launch of GNMT and, later, ChatGPT as natural experiments in a major online labor market for translators. Difference-in-differences models on transaction-level data covered two windows, 2016 to 2017 and 2022 to 2023.

They separated work into analytical tasks, regular translations, and intuitive tasks, transcreations that require creative and cultural adaptation. This split allowed them to test whether creative work was shielded from automation.

For GNMT, demand fell for analytical tasks while intuitive tasks showed no detectable change. For ChatGPT, the reductions were substantially larger and applied to both categories, which the authors describe as a marked expansion in the scope and magnitude of AI substitution.

Sources

1 on file
  1. Management Sciencedoi:10.1287/mnsc.2024.06740
    Peer-reviewed2026-10-14

Talk it over

Four questions to start on
Who carries this cost, and what would have to change to prevent it?

Start with a question

Freelance translators: ChatGPT cut demand for routine and creative work, study findshttps://truvace.com/item/ai-driven-human-task-substitution-evidence-from-google-translate-and-chatgpt

  1. Who carries this cost, and what would have to change to prevent it?

    The problem A difference-in-differences study of an online labor market found ChatGPT produced substantially larger and more uniform drops in demand for both regular translations and creative transcreations than Google Neural Machine Translation did.

    Answer in the thread
  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on an observational study, from Management Science.

    Answer in the thread
  3. What does it leave open? What else would you want to know before acting on it?

    Answer in the thread
  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say