Spectrally-Guided Diffusion Noise Schedules

• URL: http://arxiv.org/abs/2603.19222v1
• Date: Thu, 19 Mar 2026 17:59:12 GMT
• Title: Spectrally-Guided Diffusion Noise Schedules
• Abstract summary: Noise schedules define the distribution of noise levels applied during training and the sequence of noise levels traversed during sampling.<n>Noise schedules are typically handcrafted and require manual tuning across different resolutions.<n>We propose a principled way to design per-instance noise schedules for pixel diffusion, based on the image's spectral properties.
• Score: 17.155540752990518
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Denoising diffusion models are widely used for high-quality image and video generation. Their performance depends on noise schedules, which define the distribution of noise levels applied during training and the sequence of noise levels traversed during sampling. Noise schedules are typically handcrafted and require manual tuning across different resolutions. In this work, we propose a principled way to design per-instance noise schedules for pixel diffusion, based on the image's spectral properties. By deriving theoretical bounds on the efficacy of minimum and maximum noise levels, we design ``tight'' noise schedules that eliminate redundant steps. During inference, we propose to conditionally sample such noise schedules. Experiments show that our noise schedules improve generative quality of single-stage pixel diffusion models, particularly in the low-step regime.

Related papers

• sRGB Real Noise Modeling via Noise-Aware Sampling with Normalizing Flows [27.338824932164417]
  We introduce a new NF framework that allows us to both classify noise based on camera settings and generate various noisy images.<n>Our model demonstrates exceptional noise quality and leads in denoising performance on benchmark datasets.
  arXiv  Detail & Related papers  (2026-08-29T04:16:07Z)
• Class-frequency Guided Noise Schedule for Diffusion Models [83.19018650759415]
  We first examine the correlations between class frequency and the multi-scale noise schedule within diffusion models.<n>We propose the textitClass-frequency Guided (CFRG) noise schedule, leveraging the insight that low-frequency classes should be endowed with larger-scale noises.
  arXiv  Detail & Related papers  (2026-06-26T03:43:23Z)
• Information-Guided Noise Allocation for Efficient Diffusion Training [50.49440376762109]
  InfoNoise is a principled data-adaptive training noise schedule that replaces schedule design with an information-guided noise sampling distribution.<n>Across natural-image benchmarks, InfoNoise matches or surpasses tuned EDM-style schedules, in some cases with a substantial training speedup.<n>Overall, InfoNoise makes noise scheduling data-adaptive, reducing the need for per-dataset schedule design as diffusion models expand across domains.
  arXiv  Detail & Related papers  (2026-02-20T22:45:01Z)
• Mitigating the Noise Shift for Denoising Generative Models via Noise Awareness Guidance [54.88271057438763]
  Noise Awareness Guidance (NAG) is a correction method that explicitly steers sampling trajectories to remain consistent with the pre-defined noise schedule.<n>NAG consistently mitigates noise shift and substantially improves the generation quality of mainstream diffusion models.
  arXiv  Detail & Related papers  (2025-10-14T13:31:34Z)
• Dark Noise Diffusion: Noise Synthesis for Low-Light Image Denoising [22.897202020483576]
  Low-light photography produces images with low signal-to-noise ratios due to limited photons.<n>Deep-learning methods perform well, but they require large datasets of paired images that are impractical to acquire.<n>In this paper, we investigate the ability of diffusion models to capture the complex distribution of low-light noise.
  arXiv  Detail & Related papers  (2025-03-14T10:16:54Z)
• A Comprehensive Review on Noise Control of Diffusion Model [0.0]
  Noise schedules govern the rate of noise injection during the diffusion process.<n>Noise schedules substantially influences sampling quality and training quality.<n>Various noise schedules are examined, and their distinguishing features and performance characteristics are highlighted.
  arXiv  Detail & Related papers  (2025-02-07T05:26:29Z)
• Enhancing Sample Generation of Diffusion Models using Noise Level Correction [9.014666170540304]
  We propose a novel method to enhance sample generation by aligning the estimated noise level with the true distance of noisy samples to the manifold.<n> Specifically, we introduce a noise level correction network, leveraging a pre-trained denoising network, to refine noise level estimates during the denoising process.<n> Experimental results demonstrate that our method significantly improves sample quality in both unconstrained and constrained generation scenarios.
  arXiv  Detail & Related papers  (2024-12-07T01:19:14Z)
• NoiseDiffusion: Correcting Noise for Image Interpolation with Diffusion Models beyond Spherical Linear Interpolation [86.7260950382448]
  We propose a novel approach to correct noise for image validity, NoiseDiffusion. NoiseDiffusion performs within the noisy image space and injects raw images into these noisy counterparts to address the challenge of information loss.
  arXiv  Detail & Related papers  (2024-03-13T12:32:25Z)
• Blue noise for diffusion models [50.99852321110366]
  We introduce a novel and general class of diffusion models taking correlated noise within and across images into account. Our framework allows introducing correlation across images within a single mini-batch to improve gradient flow. We perform both qualitative and quantitative evaluations on a variety of datasets using our method.
  arXiv  Detail & Related papers  (2024-02-07T14:59:25Z)
• SVNR: Spatially-variant Noise Removal with Denoising Diffusion [43.2405873681083]
  We present a novel formulation of denoising diffusion that assumes a more realistic, spatially-variant noise model. In experiments we demonstrate the advantages of our approach over a strong diffusion model baseline, as well as over a state-of-the-art single image denoising method.
  arXiv  Detail & Related papers  (2023-06-28T09:32:00Z)
• Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training [50.018580462619425]
  We propose a novel framework, namely Pixel-level Noise-aware Generative Adrial Network (PNGAN) PNGAN employs a pre-trained real denoiser to map the fake and real noisy images into a nearly noise-free solution space. For better noise fitting, we present an efficient architecture Simple Multi-versa-scale Network (SMNet) as the generator.
  arXiv  Detail & Related papers  (2022-04-06T14:09:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.