CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse

• URL: http://arxiv.org/abs/2607.01433v1
• Date: Wed, 01 Jul 2026 19:54:39 GMT
• Title: CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse
• Abstract summary: We introduce CreativityNeuro, a data-free method for enhancing divergent thinking in large language models (LLMs)<n>On the Divergent Association Task ( DAT), CreativityNeuro improves performance by up to 14 human percentile points.<n>In a large-scale human evaluation (N=720), CreativityNeuro achieves significant improvements in originality, surprise, and creativity, transferring to longer-form and more open-ended tasks.
• Score: 16.388226447545566
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Divergent thinking is a crucial aspect of creativity, yet large language models (LLMs) tend to consistently generate similar responses to open-ended questions, in what has been termed the artificial hivemind effect. Here, we introduce CreativityNeuro, a data-free method for enhancing divergent thinking in LLMs via contrastive weight steering. We evaluate our method across multiple creativity assessments and report several main findings. On the Divergent Association Task (DAT), a vocabulary-space creativity test, CreativityNeuro improves performance by up to 14 human percentile points. Next, in a large-scale human evaluation (N=720) on the Alternative Uses Test (AUT) and the Task Task, CreativityNeuro achieves significant improvements in originality, surprise, and creativity, transferring to longer-form and more open-ended tasks. Importantly, we find that across all three tasks, CreativityNeuro demonstrably reduces measures of mode collapse. Moreover, activation steering achieves comparable performance to CreativityNeuro on the DAT, but it does not transfer to the AUT and Task Task, demonstrating the effectiveness of weight-space steering in generalizing to unseen tasks. In conclusion, CreativityNeuro improves divergent thinking and reduces mode collapse without requiring behavioral data, re-training, or gradient-based fine-tuning, providing a straightforward way to enhance LLM performance in creative domains.

Related papers

• CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity [67.74087963315213]
  CreativeInstruct is an instruction-tuning method that teaches large language models to balance creative, base-model-like generations with the quality of post-trained models.<n>We show that CreativeInstruct matches or exceeds the diversity of both multi-model baselines and distilled variants of their outputs.<n>We also show the benefits of creative models as a substrate for RL: GRPO applied to a CreativeInstruct checkpoint improves by 4% on AMC and 5% points on MATH.
  arXiv  Detail & Related papers  (2026-08-07T17:55:48Z)
• Automated Creativity Evaluation of Language Models Across Open-Ended Tasks [3.6948012022450776]
  Large language models (LLMs) have achieved remarkable progress in language understanding, reasoning, and generation.<n>We introduce an automated, domain-agnostic framework for quantifying LLM creativity across open-ended tasks.<n>Our approach separates the measurement apparatus from the creative task itself, enabling scalable, task-agnostic assessment.
  arXiv  Detail & Related papers  (2026-06-10T07:37:06Z)
• Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers [39.942029670113115]
  It has become common in recent years to administer tests of human creativity to large language models (LLMs)<n>These tests provide a convenient and fully automated way to score "creativity," but their validity as measures of machine creativity has not been established.<n>We conduct the first large-scale, systematic study assessing the effectiveness of human creativity tests for predicting the creative achievement of LLMs.
  arXiv  Detail & Related papers  (2026-05-13T12:46:05Z)
• CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing [67.2958108309687]
  CreativityBench is a benchmark for evaluating affordance-based creativity in LLMs.<n>We generate 14K grounded tasks that require identifying non-obvious yet physically plausible solutions under constraints.<n> Evaluations across 10 state-of-the-art LLMs, including closed and open-source models, show that models can often select a plausible object, but fail to identify the correct parts.
  arXiv  Detail & Related papers  (2026-04-06T16:33:23Z)
• Large Language Models Align with the Human Brain during Creative Thinking [19.08997828415446]
  We study brain alignment during creative thinking using fMRI data from 170 participants performing the Alternate Uses Task (AUT)<n>We find that brain-LLM alignment scales with model size (default mode network only) and idea originality (both networks)<n>We further show that post-training objectives shape alignment in functionally selective ways.
  arXiv  Detail & Related papers  (2026-04-03T22:02:15Z)
• CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challenges [69.3795501613098]
  We introduce CreativeBench, a benchmark for evaluating machine creativity in code generation.<n>CreativeBench objectively distinguishes creativity from hallucination via a unified metric defined as the product of quality and novelty.<n>We propose EvoRePE, a plug-and-play inference-time steering strategy that internalizes evolutionary search patterns to consistently enhance machine creativity.
  arXiv  Detail & Related papers  (2026-03-12T12:36:56Z)
• Beyond Divergent Creativity: A Human-Based Evaluation of Creativity in Large Language Models [6.036586911740041]
  Large language models (LLMs) are increasingly used in verbal creative tasks.<n>The widely used Divergent Association Task ( DAT) focuses on novelty, ignoring appropriateness.<n>We evaluate a range of state-of-the-art LLMs on DAT and show that their scores on the task are lower than those of two baselines that do not possess any creative abilities.
  arXiv  Detail & Related papers  (2026-01-28T12:41:32Z)
• CreativityPrism: A Holistic Benchmark for Large Language Model Creativity [64.18257552903151]
  Creativity is often seen as a hallmark of human intelligence.<n>There is still no holistic framework to evaluate their creativity across diverse scenarios.<n>We propose CreativityPrism, an evaluation analysis framework that decomposes creativity into three dimensions: quality, novelty, and diversity.
  arXiv  Detail & Related papers  (2025-10-23T00:22:10Z)
• Jointly Reinforcing Diversity and Quality in Language Model Generations [64.72289248044514]
  Post-training of Large Language Models (LMs) often prioritizes accuracy and helpfulness at the expense of diversity.<n>We address this challenge with Diversity-Aware Reinforcement Learning (DARLING), a framework that jointly optimize for response quality and semantic diversity.
  arXiv  Detail & Related papers  (2025-09-02T17:38:47Z)
• Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement [101.77467538102924]
  Large reasoning models (LRMs) exhibit overthinking, which hinders efficiency and inflates inference cost.<n>We propose two lightweight methods to enhance LRM efficiency.<n>First, we introduce Efficiency Steering, a training-free activation steering technique that modulates reasoning behavior via a single direction.<n>Second, we develop Self-Rewarded Efficiency RL, a reinforcement learning framework that dynamically balances task accuracy and brevity.
  arXiv  Detail & Related papers  (2025-06-18T17:18:12Z)
• Creative Preference Optimization [17.849454438382995]
  We propose a novel alignment method that injects signals from multiple creativity dimensions into the preference optimization objective in a modular fashion.<n>We train and evaluate creativity-augmented versions of several models using CrPO and MuCE, a new large-scale human preference dataset.<n>Our models outperform strong baselines, including GPT-4o, on both automated and human evaluations.
  arXiv  Detail & Related papers  (2025-05-20T14:43:41Z)
• LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition [67.96794382040547]
  $LLM-DA$ is a novel data augmentation technique based on large language models (LLMs) for the few-shot NER task. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness.
  arXiv  Detail & Related papers  (2024-02-22T14:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.