Model Collapse: On Recursion, Noise, and Uncharted Machine Visions

• URL: http://arxiv.org/abs/2607.09705v1
• Date: Mon, 22 Jun 2026 07:32:36 GMT
• Title: Model Collapse: On Recursion, Noise, and Uncharted Machine Visions
• Abstract summary: Since 2023, computer scientists have warned against model collapse.<n>Model collapse is the contamination of training sets with AI-generated outputs.<n>This paper argues that the potential effects of collapse challenge transhumanist ideals.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Since 2023, computer scientists have warned against model collapse -- the contamination of training sets with AI-generated outputs that progressively degrade model performance. Exemplifying a positive-feedback-driven failure, it produces effects such as word repetition or pixel noise, ultimately leading to a loss of meaning and coherence -- at least from an engineering standpoint. From a creative one, however, collapse is not merely a breakdown: it also functions as a recursive mirror that recalls early analog video feedback experiments, raising once again the question of what happens when a system turns inward and sees itself. In such cases, so-called machine vision no longer transmits the world (as in tele-vision) but increasingly generates worlds from within. Drawing on media archaeology through case studies of both historical video synthesis techniques and contemporary artistic uses of machine learning, this paper examines what recursive training reveals about the dependent nature of AI-generated data. It argues that the potential effects of collapse challenge transhumanist ideals while inviting an aesthetic perspective, positioning noise and recursion as key concepts for understanding both artmaking and the AI ecosystem. Distributing agency across scales and networks, the latter currently remains reliant on new human-produced content, particularly within foundation models trained on massive datasets.

Related papers

• On the Plasticity Collapse in Continual Machine Unlearning [26.744674850970625]
  Machine unlearning enables networks to selectively remove the influence of specific data in response to privacy and regulatory requirements.<n>While prior work largely studies single-shot unlearning, real-world systems must accommodate continual unlearning.<n>We show that continual unlearning operations accumulate geometric constraints in parameter space, leading to saturated subspaces that restrict future updates.
  arXiv  Detail & Related papers  (2026-08-30T02:33:40Z)
• Primate vision reveals a missing principle for robust dynamic AI [9.82700229401299]
  We compare human perception and neural activity in macaque inferior temporal cortex with representations from image- and video-based neural networks.<n>We find progressive integration of motion into object representations as a principle of robust dynamic vision.
  arXiv  Detail & Related papers  (2026-08-24T19:38:54Z)
• Human-AI Co-Evolution and Epistemic Collapse: A Dynamical Systems Perspective [2.1061291753905405]
  Humans and language models form a coupled dynamical system linked by a feedback loop of usage, generation, and retraining.<n>We show that increasing reliance on AI can induce a transition toward a low-diversity, suboptimal equilibrium.<n>Results suggest that the trajectory of AI systems is shaped not only by model design, but by the dynamics of human-AI co-evolution.
  arXiv  Detail & Related papers  (2026-05-07T14:31:17Z)
• Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling [183.5907213030813]
  We argue that the field should move beyond appearance synthesis toward intelligent visual generation.<n>We introduce a five-level taxonomy: Atomic Generation, Conditional Generation, In-Context Generation, Agentic Generation, and World-Modeling Generation.<n>We analyze key technical drivers, including flow matching, unified understanding-and-generation models, improved visual representations, post-training, reward modeling, data curation, and sampling acceleration.
  arXiv  Detail & Related papers  (2026-04-30T17:59:02Z)
• RealRAG: Retrieval-augmented Realistic Image Generation via Self-reflective Contrastive Learning [54.07026389388881]
  We present the first real-object-based retrieval-augmented generation framework (RealRAG)<n>RealRAG augments fine-grained and unseen novel object generation by learning and retrieving real-world images to overcome the knowledge gaps of generative models.<n>Our framework integrates fine-grained visual knowledge for the generative models, tackling the distortion problem and improving the realism for fine-grained object generation.
  arXiv  Detail & Related papers  (2025-02-02T16:41:54Z)
• Generative Physical AI in Vision: A Survey [78.07014292304373]
  Gene Artificial Intelligence (AI) has rapidly advanced the field of computer vision by enabling machines to create and interpret visual data with unprecedented sophistication.<n>This transformation builds upon a foundation of generative models to produce realistic images, videos, and 3D/4D content.<n>As generative models evolve to increasingly integrate physical realism and dynamic simulation, their potential to function as "world simulators" expands.
  arXiv  Detail & Related papers  (2025-01-19T03:19:47Z)
• Learning by Surprise: Surplexity for Mitigating Model Collapse in Generative AI [1.6545633988217645]
  As synthetic content infiltrates the web, generative AI models may be retrained on their own outputs.<n>This leads to model collapse: a progressive loss of performance and diversity across generations.<n>We introduce new measures that characterise collapse directly from a model's next-token probability distributions.
  arXiv  Detail & Related papers  (2024-10-16T08:02:48Z)
• Nepotistically Trained Generative-AI Models Collapse [13.106063755117399]
  We show that when retrained on even small amounts of their own creation, generative-AI models produce highly distorted images.<n>This distortion extends beyond the text prompts used in retraining, and that once affected, the models struggle to fully heal.
  arXiv  Detail & Related papers  (2023-11-20T21:43:32Z)
• AI-Generated Images as Data Source: The Dawn of Synthetic Era [61.879821573066216]
  generative AI has unlocked the potential to create synthetic images that closely resemble real-world photographs. This paper explores the innovative concept of harnessing these AI-generated images as new data sources. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability.
  arXiv  Detail & Related papers  (2023-10-03T06:55:19Z)
• Degraded Polygons Raise Fundamental Questions of Neural Network Perception [5.423100066629618]
  We revisit the task of recovering images under degradation, first introduced over 30 years ago in the Recognition-by-Components theory of human vision. We implement the Automated Shape Recoverability Test for rapidly generating large-scale datasets of perimeter-degraded regular polygons. We find that neural networks' behavior on this simple task conflicts with human behavior.
  arXiv  Detail & Related papers  (2023-06-08T06:02:39Z)
• Bridging the Gap to Real-World Object-Centric Learning [66.55867830853803]
  We show that reconstructing features from models trained in a self-supervised manner is a sufficient training signal for object-centric representations to arise in a fully unsupervised way. Our approach, DINOSAUR, significantly out-performs existing object-centric learning models on simulated data.
  arXiv  Detail & Related papers  (2022-09-29T15:24:47Z)
• State of the Art on Neural Rendering [141.22760314536438]
  We focus on approaches that combine classic computer graphics techniques with deep generative models to obtain controllable and photo-realistic outputs. This report is focused on the many important use cases for the described algorithms such as novel view synthesis, semantic photo manipulation, facial and body reenactment, relighting, free-viewpoint video, and the creation of photo-realistic avatars for virtual and augmented reality telepresence.
  arXiv  Detail & Related papers  (2020-04-08T04:36:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.