Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis

• URL: http://arxiv.org/abs/2505.17241v1
• Date: Thu, 22 May 2025 19:39:10 GMT
• Title: Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis
• Abstract summary: We conduct a meta-analysis to evaluate the effect of GenAI on the performance in creative tasks.<n>Our results show no significant difference in creative performance between GenAI and humans.<n>GenAI has a significant negative effect on the diversity of ideas for such collaborations between humans and GenAI.
• Score: 20.57872238271025
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative artificial intelligence (GenAI) is increasingly used to support a wide range of human tasks, yet empirical evidence on its effect on creativity remains scattered. Can GenAI generate ideas that are creative? To what extent can it support humans in generating ideas that are both creative and diverse? In this study, we conduct a meta-analysis to evaluate the effect of GenAI on the performance in creative tasks. For this, we first perform a systematic literature search, based on which we identify n = 28 relevant studies (m = 8214 participants) for inclusion in our meta-analysis. We then compute standardized effect sizes based on Hedges' g. We compare different outcomes: (i) how creative GenAI is; (ii) how creative humans augmented by GenAI are; and (iii) the diversity of ideas by humans augmented by GenAI. Our results show no significant difference in creative performance between GenAI and humans (g = -0.05), while humans collaborating with GenAI significantly outperform those working without assistance (g = 0.27). However, GenAI has a significant negative effect on the diversity of ideas for such collaborations between humans and GenAI (g = -0.86). We further analyze heterogeneity across different GenAI models (e.g., GPT-3.5, GPT-4), different tasks (e.g., creative writing, ideation, divergent thinking), and different participant populations (e.g., laypeople, business, academia). Overall, our results position GenAI as an augmentative tool that can support, rather than replace, human creativity-particularly in tasks benefiting from ideation support.

Related papers

• Quick Build, Careful Check? Generative AI Use in Hackathons [83.0493885475068]
  We report an exploratory interview study with participants at an AI-themed hackathon in central Europe.<n>We found that participants used GenAI for purposes beyond coding, including learning unfamiliar topics, brainstorming, and preparing documentation.<n>We also found that all participants converged on an unwritten practice of checking GenAI output before using it, yet their ability to actually verify was constrained by time pressure and limited domain knowledge.
  arXiv  Detail & Related papers  (2026-07-31T08:59:18Z)
• The next question after Turing's question: Introducing the Grow-AI test [51.56484100374058]
  This study aims to extend the framework for assessing artificial intelligence, called GROW-AI.<n>GROW-AI is designed to answer the question "Can machines grow up?" -- a natural successor to the Turing Test.<n>The originality of the work lies in the conceptual transposition of the process of "growing" from the human world to that of artificial intelligence.
  arXiv  Detail & Related papers  (2025-08-22T10:19:42Z)
• From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
  We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
  arXiv  Detail & Related papers  (2025-05-17T08:30:10Z)
• Using Generative AI Personas Increases Collective Diversity in Human Ideation [0.0]
  This study challenges the widely-reported tradeoff between generative AI's (GenAI) contribution to creative outcomes and decreased diversity of these outcomes.<n>We modified the design of such a study, by Doshi and Hauser (2024), in which participants wrote short stories either aided or unaided by GenAI plot ideas.<n>Our findings demonstrate that introducing diversity at the AI input stage through distinct personas can preserve and potentially enhance the collective diversity of human creative outputs when collaborating with GenAI.
  arXiv  Detail & Related papers  (2025-03-29T12:43:29Z)
• Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspective [54.152639172274]
  Large-scale generative AI techniques have the potential to enhance data storytelling with their power in visual and narration generation.<n>We compare the collaboration patterns of the latest tools with those of earlier ones using a dedicated framework for understanding human-AI collaboration in data storytelling.<n>The benefits of these AI techniques and implications to human-AI collaboration are also revealed.
  arXiv  Detail & Related papers  (2025-03-04T13:56:18Z)
• Human Misperception of Generative-AI Alignment: A Laboratory Experiment [0.393259574660092]
  We study people's perception of generative artificial intelligence (GenAI) alignment in the context of economic decision-making.<n>We find that people overestimate the degree of alignment between GenAI's choices and human choices.
  arXiv  Detail & Related papers  (2025-02-20T16:32:42Z)
• Dimensions of Generative AI Evaluation Design [51.541816010127256]
  We propose a set of general dimensions that capture critical choices involved in GenAI evaluation design. These dimensions include the evaluation setting, the task type, the input source, the interaction style, the duration, the metric type, and the scoring method.
  arXiv  Detail & Related papers  (2024-11-19T18:25:30Z)
• Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinking [19.713133349166778]
  We asked participants to design advertisements both with and without GenAI support. Expert evaluators rated GenAI-supported designs as more creative and unconventional "weird" Native English speakers experienced reduced relaxation when using AI, whereas designers new to GenAI exhibited gains in divergent thinking.
  arXiv  Detail & Related papers  (2024-10-31T19:23:34Z)
• "I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AI [55.99010491370177]
  We argue that we cannot thoroughly map the social impacts of generative AI without mapping the social impacts of anthropomorphic AI. anthropomorphic AI systems are increasingly prone to generating outputs that are perceived to be human-like.
  arXiv  Detail & Related papers  (2024-10-11T04:57:41Z)
• Measuring Human Contribution in AI-Assisted Content Generation [66.06040950325969]
  This study raises the research question of measuring human contribution in AI-assisted content generation.<n>By calculating mutual information between human input and AI-assisted output relative to self-information of AI-assisted output, we quantify the proportional information contribution of humans in content generation.
  arXiv  Detail & Related papers  (2024-08-27T05:56:04Z)
• Model-based Maintenance and Evolution with GenAI: A Look into the Future [47.93555901495955]
  We argue that Generative Artificial Intelligence (GenAI) can be used as a means to address the limitations of Model-Based Engineering (MBM&E) We propose that GenAI can be used in MBM&E for: reducing engineers' learning curve, maximizing efficiency with recommendations, or serving as a reasoning tool to understand domain problems.
  arXiv  Detail & Related papers  (2024-07-09T23:13:26Z)
• Teacher agency in the age of generative AI: towards a framework of hybrid intelligence for learning design [0.0]
  Generative AI (genAI) is being used in education for different purposes. From the teachers' perspective, genAI can support activities such as learning design. However, GenAI has the potential to negatively affect professional agency due to teachers' limited power.
  arXiv  Detail & Related papers  (2024-07-09T08:28:05Z)
• Can AI Be as Creative as Humans? [84.43873277557852]
  We prove in theory that AI can be as creative as humans under the condition that it can properly fit the data generated by human creators. The debate on AI's creativity is reduced into the question of its ability to fit a sufficient amount of data.
  arXiv  Detail & Related papers  (2024-01-03T08:49:12Z)
• Generative artificial intelligence enhances creativity but reduces the diversity of novel content [0.0]
  Generative artificial intelligence (GenAI) holds promise for humans to be more creative by offering new ideas, or less creative by anchoring on GenAI ideas. Access to GenAI ideas causes an increase in the writer's creativity with stories being evaluated as better written and more enjoyable. However, GenAI-enabled stories are more similar to each other than stories by humans alone.
  arXiv  Detail & Related papers  (2023-12-01T11:20:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.