A Comprehensive Review on Noise Control of Diffusion Model

• URL: http://arxiv.org/abs/2502.04669v1
• Date: Fri, 07 Feb 2025 05:26:29 GMT
• Title: A Comprehensive Review on Noise Control of Diffusion Model
• Abstract summary: Noise schedules govern the rate of noise injection during the diffusion process.<n>Noise schedules substantially influences sampling quality and training quality.<n>Various noise schedules are examined, and their distinguishing features and performance characteristics are highlighted.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Diffusion models have recently emerged as powerful generative frameworks for producing high-quality images. A pivotal component of these models is the noise schedule, which governs the rate of noise injection during the diffusion process. Since the noise schedule substantially influences sampling quality and training quality, understanding its design and implications is crucial. In this discussion, various noise schedules are examined, and their distinguishing features and performance characteristics are highlighted.

Related papers

• Class-frequency Guided Noise Schedule for Diffusion Models [83.19018650759415]
  We first examine the correlations between class frequency and the multi-scale noise schedule within diffusion models.<n>We propose the textitClass-frequency Guided (CFRG) noise schedule, leveraging the insight that low-frequency classes should be endowed with larger-scale noises.
  arXiv  Detail & Related papers  (2026-06-26T03:43:23Z)
• Spectrally-Guided Diffusion Noise Schedules [17.155540752990518]
  Noise schedules define the distribution of noise levels applied during training and the sequence of noise levels traversed during sampling.<n>Noise schedules are typically handcrafted and require manual tuning across different resolutions.<n>We propose a principled way to design per-instance noise schedules for pixel diffusion, based on the image's spectral properties.
  arXiv  Detail & Related papers  (2026-03-19T17:59:12Z)
• Mitigating the Noise Shift for Denoising Generative Models via Noise Awareness Guidance [54.88271057438763]
  Noise Awareness Guidance (NAG) is a correction method that explicitly steers sampling trajectories to remain consistent with the pre-defined noise schedule.<n>NAG consistently mitigates noise shift and substantially improves the generation quality of mainstream diffusion models.
  arXiv  Detail & Related papers  (2025-10-14T13:31:34Z)
• Noise Synthesis for Low-Light Image Denoising with Diffusion Models [22.897202020483576]
  Low-light photography produces images with low signal-to-noise ratios due to limited photons. Deep-learning methods perform well, but they require large datasets of paired images that are impractical to acquire. In this paper, we investigate the ability of diffusion models to capture the complex distribution of low-light noise.
  arXiv  Detail & Related papers  (2025-03-14T10:16:54Z)
• Revealing the Implicit Noise-based Imprint of Generative Models [71.94916898756684]
  This paper presents a novel framework that leverages noise-based model-specific imprint for the detection task. By aggregating imprints from various generative models, imprints of future models can be extrapolated to expand training data. Our approach achieves state-of-the-art performance across three public benchmarks including GenImage, Synthbuster and Chameleon.
  arXiv  Detail & Related papers  (2025-03-12T12:04:53Z)
• Is Noise Conditioning Necessary for Denoising Generative Models? [19.2998909343441]
  We investigate a variety of denoising-based generative models in the absence of noise conditioning.<n>Most models exhibit graceful degradation, and in some cases, they even perform better without noise conditioning.<n>We introduce a noise-unconditional model that achieves a competitive FID of 2.23 on CIFAR-10, significantly narrowing the gap to leading noise-conditional models.
  arXiv  Detail & Related papers  (2025-02-18T18:53:24Z)
• Understanding Representation Dynamics of Diffusion Models via Low-Dimensional Modeling [25.705179111920806]
  This work addresses the question of why and when diffusion models excel at learning high-quality representations in a self-supervised manner. We develop a mathematical framework based on a low-dimensional data model and posterior estimation, revealing a fundamental trade-off between generation and representation quality near the final stage of image generation. Building on these insights, we propose an ensemble method that aggregates features across noise levels, significantly improving both clean performance and robustness under label noise.
  arXiv  Detail & Related papers  (2025-02-09T01:58:28Z)
• Towards Robust Transcription: Exploring Noise Injection Strategies for Training Data Augmentation [55.752737615873464]
  This study investigates the impact of white noise at various Signal-to-Noise Ratio (SNR) levels on state-of-the-art APT models. We hope this research provides valuable insights as preliminary work toward developing transcription models that maintain consistent performance across a range of acoustic conditions.
  arXiv  Detail & Related papers  (2024-10-18T02:31:36Z)
• Improved Noise Schedule for Diffusion Training [51.849746576387375]
  We propose a novel approach to design the noise schedule for enhancing the training of diffusion models.<n>We empirically demonstrate the superiority of our noise schedule over the standard cosine schedule.
  arXiv  Detail & Related papers  (2024-07-03T17:34:55Z)
• The Uncanny Valley: A Comprehensive Analysis of Diffusion Models [1.223779595809275]
  Diffusion Models (DMs) have made significant advances in generating high-quality images. We explore key aspects across various DM architectures, including noise schedules, samplers, and guidance. Our comparative analysis reveals that Denoising Diffusion Probabilistic Model (DDPM)-based diffusion dynamics consistently outperform Noise Conditioned Score Network (NCSN)-based ones.
  arXiv  Detail & Related papers  (2024-02-20T20:49:22Z)
• Blue noise for diffusion models [50.99852321110366]
  We introduce a novel and general class of diffusion models taking correlated noise within and across images into account. Our framework allows introducing correlation across images within a single mini-batch to improve gradient flow. We perform both qualitative and quantitative evaluations on a variety of datasets using our method.
  arXiv  Detail & Related papers  (2024-02-07T14:59:25Z)
• Noise-aware Speech Enhancement using Diffusion Probabilistic Model [35.17225451626734]
  We propose a noise-aware speech enhancement (NASE) approach that extracts noise-specific information to guide the reverse process in diffusion model. NASE is shown to be a plug-and-play module that can be generalized to any diffusion SE models.
  arXiv  Detail & Related papers  (2023-07-16T12:46:11Z)
• Realistic Noise Synthesis with Diffusion Models [44.404059914652194]
  Deep denoising models require extensive real-world training data, which is challenging to acquire.<n>We propose a novel Realistic Noise Synthesis Diffusor (RNSD) method using diffusion models to address these challenges.
  arXiv  Detail & Related papers  (2023-05-23T12:56:01Z)
• Inference and Denoise: Causal Inference-based Neural Speech Enhancement [83.4641575757706]
  This study addresses the speech enhancement (SE) task within the causal inference paradigm by modeling the noise presence as an intervention. The proposed causal inference-based speech enhancement (CISE) separates clean and noisy frames in an intervened noisy speech using a noise detector and assigns both sets of frames to two mask-based enhancement modules (EMs) to perform noise-conditional SE.
  arXiv  Detail & Related papers  (2022-11-02T15:03:50Z)
• SAR Despeckling using a Denoising Diffusion Probabilistic Model [52.25981472415249]
  The presence of speckle degrades the image quality and adversely affects the performance of SAR image understanding applications. We introduce SAR-DDPM, a denoising diffusion probabilistic model for SAR despeckling. The proposed method achieves significant improvements in both quantitative and qualitative results over the state-of-the-art despeckling methods.
  arXiv  Detail & Related papers  (2022-06-09T14:00:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.