Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation
- URL: http://arxiv.org/abs/2608.29997v1
- Date: Sun, 30 Aug 2026 19:44:38 GMT
- Title: Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation
- Abstract summary: DDB is a framework designed to resolve the fundamental misalignment of standard discrete diffusion in image translation and generation.<n>We introduce a hybrid absorption mechanism that absorbs the state to a mixture of mask and source tokens, effectively injecting source prior as spatial anchors into the latent space.<n>Experiments validate the versatility and robustness of our framework across diverse generative paradigms.
- Score: 44.1310706833305
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose Discrete Diffusion Bridges (DDB), a novel framework designed to resolve the fundamental spatiotemporal misalignment of standard discrete diffusion in image translation and generation. By corrupting data into a pure mask state via a random schedule, the conventional forward process induces a twofold misalignment: spatially, this pure-mask destination entirely discards the rich structural priors of the source image; temporally, the random masking order inherently contradicts the ``easy-first, hard-last'' decoding mechanism used during inference. To address this, DDB constructs a direct and efficient trajectory between domains. Spatially, we introduce a hybrid absorption mechanism that redefines the absorbing state to a stochastic mixture of mask and source tokens, effectively injecting source prior as spatial anchors into the latent space. Temporally, we design an information-guided noise schedule that quantifies semantic variation to prioritize the corruption of high-information regions at earlier timesteps. This ensures the model learns to resolve difficult semantic changes using robust context from invariant regions. Extensive experiments validate the versatility and robustness of our framework across diverse generative paradigms. DDB effectively balances edit alignment with structural fidelity across both text-guided semantic manipulation and pure structural image translation, while inherently complementing text-to-image generation and guaranteeing robust high-quality decoding under extremely low sampling steps. Code and models are available at \href{https://github.com/HKU-HealthAI/DDB}{https://github.com/HKU-HealthAI/DDB}.
Related papers
- Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking [2.0673681624647844]
We propose a source-agnostic framework that dynamically refines a binary mask throughout the reverse diffusion process.<n>Our method introduces a time-dependent statistical thresholding scheme derived from the empirical mean and standard deviation of prediction discrepancies.<n>Our approach enables precise, automated localization and seamless translation across diverse source distributions without any specialized training.
arXiv Detail & Related papers (2026-08-14T07:51:40Z) - No Prompt, No Leaks: A Robust Generative Steganography Framework via Prompt-Free Diffusion [15.432428509145703]
Generative image steganography synthesizes stego images directly from secret information to achieve inherent security advantages.<n>Latent Diffusion Models have emerged as a fundamental image steganography framework that modulates secret latent representations with text prompts.<n>We propose a prompt-free diffusion image steganography framework that integrates style semantic priors to control more robust and reliable stego image generation.
arXiv Detail & Related papers (2026-06-30T09:51:34Z) - LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models [10.535207607235046]
Locality-Aware Dynamic Rescue (LADR) is a training-free method that expedites inference by exploiting the spatial Markov property of images.<n>LADR prioritizes the recovery of tokens at the ''generation frontier'', regions spatially adjacent to observed pixels.<n>Experiments on four text-to-image generation benchmarks demonstrate that our LADR achieves an approximate 4 x speedup over standard baselines.
arXiv Detail & Related papers (2026-03-13T15:12:41Z) - Unpaired Image-to-Image Translation via a Self-Supervised Semantic Bridge [59.247871132422006]
Adversarial diffusion and diffusion-inversion methods have advanced unpaired image-to-image translation, but each faces key limitations.<n>We propose the Self-Supervised Semantic Bridge ( SSB), a versatile framework that integrates external semantic priors into diffusion bridge models.<n>Our key idea is to leverage self-supervised visual encoders to learn representations that are invariant to appearance changes but capture geometric structure.
arXiv Detail & Related papers (2026-02-18T18:05:00Z) - Bridging the Discrete-Continuous Gap: Unified Multimodal Generation via Coupled Manifold Discrete Absorbing Diffusion [60.186310080523135]
Bifurcation of generative modeling into autoregressive approaches for discrete data (text) and diffusion approaches for continuous data (images) hinders development of truly unified multimodal systems.<n>We propose textbfCoM-DAD, a novel probabilistic framework that reformulates multimodal generation as a hierarchical dual-process.<n>Our method demonstrates superior stability over standard masked modeling, establishing a new paradigm for scalable, unified text-image generation.
arXiv Detail & Related papers (2026-01-07T16:21:19Z) - AnchorDS: Anchoring Dynamic Sources for Semantically Consistent Text-to-3D Generation [56.399153019429605]
This work shows that ignoring source dynamics yields inconsistent trajectories that suppress or merge semantic cues.<n>We reformulate text-to-3D optimization as mapping a dynamically evolving source distribution to a fixed target distribution.<n>We introduce AnchorDS, an improved score distillation mechanism that provides state-anchored guidance with image conditions.
arXiv Detail & Related papers (2025-11-12T09:51:23Z) - Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling [87.34677262370924]
Standard discrete diffusion models treat all unobserved states identically by mapping them to an absorbing [MASK] token.<n>This creates an 'information void' where semantic information that could be inferred from unmasked tokens is lost between denoising steps.<n>We introduce Continuously Augmented Discrete Diffusion, a framework that augments the discrete state space with a paired diffusion in a continuous latent space.
arXiv Detail & Related papers (2025-10-01T18:00:56Z) - Semantic Image Synthesis via Diffusion Models [174.24523061460704]
Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in various image generation tasks.<n>Recent work on semantic image synthesis mainly follows the de facto GAN-based approaches.<n>We propose a novel framework based on DDPM for semantic image synthesis.
arXiv Detail & Related papers (2022-06-30T18:31:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.