Dequantified Diffusion-Schr{ö}dinger Bridge for Density Ratio Estimation

• URL: http://arxiv.org/abs/2505.05034v5
• Date: Sat, 01 Nov 2025 07:15:53 GMT
• Title: Dequantified Diffusion-Schr{ö}dinger Bridge for Density Ratio Estimation
• Abstract summary: Density ratio estimation is fundamental to tasks involving $f$-divergences.<n>We propose a unified framework for textbfrobust, textbfstable and textbfefficient density ratio estimation.
• Score: 15.067770053726534
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Density ratio estimation is fundamental to tasks involving $f$-divergences, yet existing methods often fail under significantly different distributions or inadequately overlapping supports -- the density-chasm and the support-chasm problems. Additionally, prior approaches yield divergent time scores near boundaries, leading to instability. We design $\textbf{D}^3\textbf{RE}$, a unified framework for \textbf{robust}, \textbf{stable} and \textbf{efficient} density ratio estimation. We propose the dequantified diffusion bridge interpolant (DDBI), which expands support coverage and stabilizes time scores via diffusion bridges and Gaussian dequantization. Building on DDBI, the proposed dequantified Schr{\"o}dinger bridge interpolant (DSBI) incorporates optimal transport to solve the Schr{\"o}dinger bridge problem, enhancing accuracy and efficiency. Our method offers uniform approximation and bounded time scores in theory, and outperforms baselines empirically in mutual information and density estimation tasks.

Related papers

• Twisted Schrödinger Bridge Matching [34.126987447337534]
  Diffusion-based Schrdinger bridge models have been proposed to approximate optimal transport dynamics between two prescribed boundary distributions.<n>We introduce Twisted Schrdinger Bridge Matching, a diffusion-based method designed to handle both continuous- and discrete-time potentials.
  arXiv  Detail & Related papers  (2026-07-18T22:30:43Z)
• Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization [11.418398950934671]
  IaMSB is an inconsistency-aware multimodal Schrdinger Bridge.<n>It unifies consistency estimation, cross-modal information selection, and bridge-step scheduling.<n>It stabilizes strict-IoU boundary precision, raising AP@0.95 by 3%10%, and yields improved high-precision localization.
  arXiv  Detail & Related papers  (2026-05-22T00:17:16Z)
• Distributional Reinforcement Learning with Diffusion Bridge Critics [57.70134665595571]
  We propose a novel distributional reinforcement learning method with Diffusion Bridge Critics (DBC)<n>DBC directly models the inverse cumulative distribution function (CDF) of the Q value.<n>We derive an analytic integral formula to address discretization errors in DBC.
  arXiv  Detail & Related papers  (2026-02-05T15:40:14Z)
• Exponential Convergence Guarantees for Iterative Markovian Fitting [15.697611355182005]
  We provide the first non-asymptotic exponential convergence guarantees for Iterative Proportional Fitting (IMF)<n>Our results encompass two key regimes: one where the marginals are log-concave, and another where they are weakly log-concave.<n>The analysis relies on new contraction results for the Markovian projection operator and paves the way to theoretical guarantees for DSBM.
  arXiv  Detail & Related papers  (2025-10-23T08:34:04Z)
• RNE: a plug-and-play framework for diffusion density estimation and inference-time control [39.11222855119757]
  Radon-Nikodym Estimator (RNE) is a flexible, plug-and-play framework for diffusion inference-time density estimation and control.<n>RNE connects and unifies a variety of existing density estimation and inference-time control methods.
  arXiv  Detail & Related papers  (2025-06-06T01:32:14Z)
• Single-Step Bidirectional Unpaired Image Translation Using Implicit Bridge Consistency Distillation [55.45188329646137]
  Implicit Bridge Consistency Distillation (IBCD) enables single-step bidirectional unpaired translation without using adversarial loss.<n>IBCD achieves state-of-the-art performance on benchmark datasets in a single generation step.
  arXiv  Detail & Related papers  (2025-03-19T09:48:04Z)
• DPBridge: Latent Diffusion Bridge for Dense Prediction [49.1574468325115]
  We introduce DPBridge, the first latent diffusion bridge framework for dense prediction tasks.<n>Our method consistently achieves superior performance, demonstrating its effectiveness and capability generalization under different scenarios.
  arXiv  Detail & Related papers  (2024-12-29T15:50:34Z)
• Latent Schrodinger Bridge: Prompting Latent Diffusion for Fast Unpaired Image-to-Image Translation [58.19676004192321]
  Diffusion models (DMs), which enable both image generation from noise and inversion from data, have inspired powerful unpaired image-to-image (I2I) translation algorithms. We tackle this problem with Schrodinger Bridges (SBs), which are differential equations (SDEs) between distributions with minimal transport cost. Inspired by this observation, we propose Latent Schrodinger Bridges (LSBs) that approximate the SB ODE via pre-trained Stable Diffusion. We demonstrate that our algorithm successfully conduct competitive I2I translation in unsupervised setting with only a fraction of cost required by previous DM-
  arXiv  Detail & Related papers  (2024-11-22T11:24:14Z)
• Robust Barycenter Estimation using Semi-Unbalanced Neural Optimal Transport [84.51977664336056]
  We propose a novel scalable approach for estimating the robust continuous barycenter.<n>Our method is framed as a min-max optimization problem and is adaptable to general cost functions.
  arXiv  Detail & Related papers  (2024-10-04T23:27:33Z)
• Plug-in estimation of Schrödinger bridges [15.685006881635209]
  We propose a procedure for estimating the Schr"odinger bridge between two probability distributions. We show that our proposal, which we call the emphSinkhorn bridge, provably estimates the Schr"odinger bridge with a rate of convergence that depends on the intrinsic dimensionality of the target measure.
  arXiv  Detail & Related papers  (2024-08-21T15:07:25Z)
• Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts [11.048463491646993]
  Density-Regression is a method that leverages the density function in uncertainty estimation and achieves fast inference by a single forward pass. We show that Density-Regression has competitive uncertainty estimation performance under distribution shifts with modern deep regressors.
  arXiv  Detail & Related papers  (2024-03-07T23:20:34Z)
• Soft-constrained Schrodinger Bridge: a Stochastic Control Approach [4.922305511803267]
  Schr"odinger bridge can be viewed as a continuous-time control problem where the goal is to find an optimally controlled diffusion process. We propose to generalize this problem by allowing the terminal distribution to differ from the target but penalizing the Kullback-Leibler divergence between the two distributions. One application is the development of robust generative diffusion models.
  arXiv  Detail & Related papers  (2024-03-04T04:10:24Z)
• Generalized Schrödinger Bridge Matching [54.171931505066]
  Generalized Schr"odinger Bridge (GSB) problem setup is prevalent in many scientific areas both within and without machine learning. We propose Generalized Schr"odinger Bridge Matching (GSBM), a new matching algorithm inspired by recent advances. We show that such a generalization can be cast as solving conditional optimal control, for which variational approximations can be used.
  arXiv  Detail & Related papers  (2023-10-03T17:42:11Z)
• Anomaly Detection with Variance Stabilized Density Estimation [49.46356430493534]
  We present a variance-stabilized density estimation problem for maximizing the likelihood of the observed samples. To obtain a reliable anomaly detector, we introduce a spectral ensemble of autoregressive models for learning the variance-stabilized distribution. We have conducted an extensive benchmark with 52 datasets, demonstrating that our method leads to state-of-the-art results.
  arXiv  Detail & Related papers  (2023-06-01T11:52:58Z)
• Distributionally Robust Bayesian Optimization with $\varphi$-divergences [45.48814080654241]
  We consider robustness against data-shift in $varphi$-divergences, which subsumes many popular choices, such as the Total Variation, and the extant Kullback-Leibler divergence. We show that the DRO-BO problem in this setting is equivalent to a finite-dimensional optimization problem which, even in the continuous context setting, can be easily implemented with provable sublinear regret bounds.
  arXiv  Detail & Related papers  (2022-03-04T04:34:52Z)
• Density Ratio Estimation via Infinitesimal Classification [85.08255198145304]
  We propose DRE-infty, a divide-and-conquer approach to reduce Density ratio estimation (DRE) to a series of easier subproblems. Inspired by Monte Carlo methods, we smoothly interpolate between the two distributions via an infinite continuum of intermediate bridge distributions. We show that our approach performs well on downstream tasks such as mutual information estimation and energy-based modeling on complex, high-dimensional datasets.
  arXiv  Detail & Related papers  (2021-11-22T06:26:29Z)
• Deep Generative Learning via Schr\"{o}dinger Bridge [14.138796631423954]
  We learn a generative model via entropy with a Schr"odinger Bridge. We show that the generative model via Schr"odinger Bridge is comparable with state-of-the-art GANs.
  arXiv  Detail & Related papers  (2021-06-19T03:35:42Z)
• BORE: Bayesian Optimization by Density-Ratio Estimation [34.22533785573784]
  We cast the expected improvement (EI) function as a binary classification problem, building on the link between class-probability estimation and density-ratio estimation. This reformulation provides numerous advantages, not least in terms of versatility, and scalability.
  arXiv  Detail & Related papers  (2021-02-17T20:04:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.