Truace
Subscribe

Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity

A widespread view is that Artificial Intelligence cannot be creative. We tested this assumption by comparing human-generated ideas with those generated by six Generative Artificial Intelligence (GAI) chatbots: alpa.ai, Copy.ai, ChatGPT (versions 3 and 4), Studio.ai, and YouChat. Humans and a specifically trained AI independently assessed the quality and quantity of ideas. We found no qualitative difference between AI and human-generated creativity, although there are differences in how ideas are generated. Inter…

By the Truvace desk1 min read1 sourcePeer-reviewedTRV-2026-1192· cite & verify
Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity
Chatbot by James grills. CC BY-SA 4.0 · https://creativecommons.org/licenses/by-sa/4.0

In brief

In a study published October 9, 2023, researchers tested the view that AI cannot be creative by having humans and six generative chatbots generate ideas, then having humans and a trained AI evaluate them. The evaluation found no qualitative difference between the two sources on average.

The result matters because it positions current chatbots as usable collaborators in creative tasks rather than mere tools, while the persistence of a small human edge and differing generation methods leaves uncertainty about originality, true creativity, and long-term effects on creative practice.

Main points

  1. Comparison involved six GAI chatbots: alpa.ai, Copy.ai, ChatGPT versions 3 and 4, Studio.ai, and YouChat versus human-generated ideas.
  2. Quality and quantity were assessed independently by humans and a specifically trained AI.
  3. 9.4% of humans were more creative than the most creative GAI, GPT-4, and generation methods differed between humans and AI.

The gain

By October 2023 testing, six generative chatbots including GPT-4 produced ideas judged equal in quality to human ideas, indicating they can function as assistants in creative work.

The rundown

The study compared human-generated ideas to ideas from alpa.ai, Copy.ai, ChatGPT 3 and 4, Studio.ai, and YouChat, with quality and quantity judged by both human raters and a specifically trained AI.

Results reported no qualitative difference overall, but noted different generation processes and that 9.4% of humans outranked GPT-4, leading authors to frame GAIs as assistants while raising the question of truly creative capability.

Sources

  1. Peer-reviewedJournal of Creativity2023-10-09

The debate