Asynchronous Denoising Diffusion Models for Aligning Text-to-Image Generation

• URL: http://arxiv.org/abs/2510.04504v1
• Date: Mon, 06 Oct 2025 05:45:56 GMT
• Title: Asynchronous Denoising Diffusion Models for Aligning Text-to-Image Generation
• Abstract summary: We propose a novel framework that allocates distinct timesteps to different pixels and reformulates the pixel-wise denoising process.<n>Our experiments demonstrate that our asynchronous diffusion models can significantly improve text-to-image alignment across diverse prompts.
• Score: 48.203403471536866
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Diffusion models have achieved impressive results in generating high-quality images. Yet, they often struggle to faithfully align the generated images with the input prompts. This limitation arises from synchronous denoising, where all pixels simultaneously evolve from random noise to clear images. As a result, during generation, the prompt-related regions can only reference the unrelated regions at the same noise level, failing to obtain clear context and ultimately impairing text-to-image alignment. To address this issue, we propose asynchronous diffusion models -- a novel framework that allocates distinct timesteps to different pixels and reformulates the pixel-wise denoising process. By dynamically modulating the timestep schedules of individual pixels, prompt-related regions are denoised more gradually than unrelated regions, thereby allowing them to leverage clearer inter-pixel context. Consequently, these prompt-related regions achieve better alignment in the final images. Extensive experiments demonstrate that our asynchronous diffusion models can significantly improve text-to-image alignment across diverse prompts. The code repository for this work is available at https://github.com/hu-zijing/AsynDM.

Related papers

• AsyncPatch Diffusion: spatially-flexible image generation [24.854661299695156]
  AsyncPatch Diffusion is a joint-diffusion framework that assigns distinct noise levels to different input dimensions.<n>We show how this asynchronous corruption defines a valid generative process.<n>We demonstrate adaptive generation strategies including uncertainty-guided acceleration and autoregressive sampling.
  arXiv  Detail & Related papers  (2026-06-05T09:16:51Z)
• ImageRAGTurbo: Towards One-step Text-to-Image Generation with Retrieval-Augmented Diffusion Models [33.09645476860831]
  We propose ImageRAGTurbo, a novel approach to efficiently finetune few-step diffusion models via retrieval augmentation.<n>Given a text prompt, we retrieve relevant text-image pairs from a database and use them to condition the generation process.<n>Experiments show that our approach produces high-fidelity images without compromising latency compared to existing methods.
  arXiv  Detail & Related papers  (2026-02-13T05:59:57Z)
• One Stone with Two Birds: A Null-Text-Null Frequency-Aware Diffusion Models for Text-Guided Image Inpainting [10.830941311992746]
  Text-guided image inpainting aims at reconstructing the masked regions as per text prompts.<n>We propose a null-text-null frequency-aware diffusion models, dubbed textbfNTN-Diff, for text-guided image inpainting.
  arXiv  Detail & Related papers  (2025-10-09T14:30:34Z)
• SAGA: Learning Signal-Aligned Distributions for Improved Text-to-Image Generation [9.212970624261272]
  State-of-the-art text-to-image models produce visually impressive results but often struggle with precise alignment to text prompts.<n>We propose a novel approach that learns a high-success-rate distribution conditioned on a target prompt.<n>Our method explicitly models the signal component during the denoising process, offering fine-grained control that mitigates over-optimization.
  arXiv  Detail & Related papers  (2025-08-19T14:31:15Z)
• From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusion [98.31811240195324]
  ConFill is a novel framework that reduces discrepancies between generated and original images at each diffusion step.<n>It outperforms current methods, setting a new benchmark in image completion.
  arXiv  Detail & Related papers  (2025-04-19T13:40:46Z)
• Fast constrained sampling in pre-trained diffusion models [80.99262780028015]
  We propose an algorithm that enables fast, high-quality generation under arbitrary constraints.<n>Our approach produces results that rival or surpass the state-of-the-art training-free inference methods.
  arXiv  Detail & Related papers  (2024-10-24T14:52:38Z)
• SemanticDraw: Towards Real-Time Interactive Content Creation from Image Diffusion Models [43.04874003852966]
  We introduce SemanticDraw, a new paradigm of interactive content creation where high-quality images are generated in near real-time from given multiple hand-drawn regions.<n>Our proposed framework is generalizable to any existing diffusion models and acceleration schedulers, allowing sub-second (0.64 seconds) image content creation application.
  arXiv  Detail & Related papers  (2024-03-14T02:51:01Z)
• Interpolating between Images with Diffusion Models [2.6027967363792865]
  Interpolating between two input images is a task missing from image generation pipelines. We propose a method for zero-shot using latent diffusion models. For greater consistency, or to specify additional criteria, we can generate several candidates and use CLIP to select the highest quality image.
  arXiv  Detail & Related papers  (2023-07-24T07:03:22Z)
• Diffusion in Diffusion: Cyclic One-Way Diffusion for Text-Vision-Conditioned Generation [11.80682025950519]
  In this work, we investigate the diffusion (physics) in diffusion (machine learning) properties. We propose our Cyclic One-Way Diffusion (COW) method to control the direction of diffusion phenomenon. Our method provides a novel perspective to understand the task needs and is applicable to a wider range of customization scenarios.
  arXiv  Detail & Related papers  (2023-06-14T05:25:06Z)
• Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis [59.10787643285506]
  Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. One critical limitation of these models is the low fidelity of generated images with respect to the text description. We propose a new text-to-image algorithm that adds explicit control over spatial-temporal cross-attention in diffusion models.
  arXiv  Detail & Related papers  (2023-04-07T23:49:34Z)
• SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers [50.90457644954857]
  In this work, we apply diffusion models to approach sequence-to-sequence text generation. We propose SeqDiffuSeq, a text diffusion model for sequence-to-sequence generation. Experiment results illustrate the good performance on sequence-to-sequence generation in terms of text quality and inference time.
  arXiv  Detail & Related papers  (2022-12-20T15:16:24Z)
• Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising [104.59305271099967]
  We present a pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising. We develop a pixel aggregation network for video denoising to sample pixels across the spatial-temporal space. Our method is able to solve the misalignment issues caused by large motion in dynamic scenes.
  arXiv  Detail & Related papers  (2021-01-26T13:00:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.