Local Coverage Governs Memorization in Diffusion Models

• URL: http://arxiv.org/abs/2606.14390v1
• Date: Fri, 12 Jun 2026 12:25:13 GMT
• Title: Local Coverage Governs Memorization in Diffusion Models
• Abstract summary: We show that memorization is governed by emphlocal data coverage.<n>We show that classes with higher intra-class sparsity (and thus lower local coverage) are more strongly memorized.
• Score: 10.085837353469737
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Memorization in diffusion models is often treated as a global property of the model or dataset. In practice, however, a single diffusion model can simultaneously generate both memorized and novel samples. Which training samples are most likely to be memorized? In this work, we show that memorization is governed by \emph{local data coverage}. Leveraging the connection between diffusion models and kernel density estimation (KDE), we derive a theoretical criterion that predicts whether a point is memorized based on the density of training data in its neighborhood and the size of the training dataset. In the high-dimensional limit, this leads to a sharp, local transition: regions of low coverage are dominated by isolated training samples, which are memorized, while dense regions support interpolation and generalization. We validate these predictions empirically, showing that memorization increases with local sparsity and that diffusion models exhibit a coexistence of memorized and novel samples within the same model. Extending this framework to multi-class settings, we further show that classes with higher intra-class sparsity (and thus lower local coverage) are more strongly memorized. Our results provide a local view of memorization in diffusion models, explaining when and where memorization occurs in terms of data geometry.

Related papers

• An exact information theory of generalization phase transitions in Bayesian diffusion models [11.82439668395711]
  We show how diffusion models circumvent the curse of dimensionality to learn over high dimensional spaces from a finite training set, instead of memorizing it.<n>A BIRD model time-reverses diffusion by inferring which past training sample produced its current restricted observation.<n>We find that generation proceeds near the edge of memorization: both spatially local BIRD models and early-training diffusion models track the memorization-generalization phase boundary.
  arXiv  Detail & Related papers  (2026-07-09T01:33:11Z)
• Localizing Memorized Regions in Diffusion Models via Coordinate-Wise Curvature Differences [7.519872646378835]
  Diffusion models can unintentionally memorize training samples, raising concerns about privacy and copyright.<n>We provide a geometric characterization of local memorization as a coordinate-wise variance collapse.<n>We derive a score-difference proxy that provides a geometric explanation for the widely used score-difference-based detection metric.
  arXiv  Detail & Related papers  (2026-05-26T09:28:43Z)
• Selective Underfitting in Diffusion Models [62.51850508420274]
  We argue that diffusion models underfit the empirical score due to training-time inductive biases.<n>Instead of underfitting the score everywhere, better diffusion models more accurately approximate the score in certain regions of input space, while underfitting it in others.<n>Our results establish that selective underfitting is essential for understanding diffusion models, yielding new, testable insights into their generalization and generative performance.
  arXiv  Detail & Related papers  (2025-10-01T19:06:20Z)
• On the Edge of Memorization in Diffusion Models [25.927892368310868]
  We introduce a scientific and mathematical "laboratory" for investigating memorization and generalization in practical diffusion models.<n>Our work provides an analytically tractable and practically meaningful setting for future theoretical and empirical investigations.
  arXiv  Detail & Related papers  (2025-08-25T05:56:05Z)
• Memorization to Generalization: Emergence of Diffusion Models from Associative Memory [27.677278702224687]
  We study the memorization-generalization phenomenon in diffusion models via the lens of AMs.<n>Our findings provide: a novel perspective on the memorization-generalization phenomenon in diffusion models via the lens of AMs.
  arXiv  Detail & Related papers  (2025-05-27T21:20:57Z)
• Bigger Isn't Always Memorizing: Early Stopping Overparameterized Diffusion Models [56.032091696552094]
  Generalization in natural data domains is progressively achieved during training before the onset of memorization.<n>Generalization vs. memorization is then best understood as a competition between time scales.<n>We show that this phenomenology is recovered in diffusion models learning a simple probabilistic context-free grammar with random rules.
  arXiv  Detail & Related papers  (2025-05-22T17:40:08Z)
• Exploring Local Memorization in Diffusion Models via Bright Ending Attention [62.979954692036685]
  "bright ending" (BE) anomaly in text-to-image diffusion models prone to memorizing training images.<n>We propose a simple yet effective method to integrate BE into existing frameworks.
  arXiv  Detail & Related papers  (2024-10-29T02:16:01Z)
• Extracting Training Data from Unconditional Diffusion Models [76.85077961718875]
  diffusion probabilistic models (DPMs) are being employed as mainstream models for generative artificial intelligence (AI) We aim to establish a theoretical understanding of memorization in DPMs with 1) a memorization metric for theoretical analysis, 2) an analysis of conditional memorization with informative and random labels, and 3) two better evaluation metrics for measuring memorization. Based on the theoretical analysis, we propose a novel data extraction method called textbfSurrogate condItional Data Extraction (SIDE) that leverages a trained on generated data as a surrogate condition to extract training data directly from unconditional diffusion models.
  arXiv  Detail & Related papers  (2024-06-18T16:20:12Z)
• Causal Estimation of Memorisation Profiles [58.20086589761273]
  Understanding memorisation in language models has practical and societal implications. Memorisation is the causal effect of training with an instance on the model's ability to predict that instance. This paper proposes a new, principled, and efficient method to estimate memorisation based on the difference-in-differences design from econometrics.
  arXiv  Detail & Related papers  (2024-06-06T17:59:09Z)
• On Memorization in Diffusion Models [44.031805633114985]
  We show that memorization behaviors tend to occur on smaller-sized datasets.<n>We quantify the impact of the influential factors on these memorization behaviors in terms of effective model memorization (EMM)<n>Our study holds practical significance for diffusion model users and offers clues to theoretical research in deep generative models.
  arXiv  Detail & Related papers  (2023-10-04T09:04:20Z)
• Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data [68.62134204367668]
  This paper studies score approximation, estimation, and distribution recovery of diffusion models, when data are supported on an unknown low-dimensional linear subspace. We show that with a properly chosen neural network architecture, the score function can be both accurately approximated and efficiently estimated. The generated distribution based on the estimated score function captures the data geometric structures and converges to a close vicinity of the data distribution.
  arXiv  Detail & Related papers  (2023-02-14T17:02:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.