Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval
- URL: http://arxiv.org/abs/2607.20984v1
- Date: Thu, 23 Jul 2026 07:07:28 GMT
- Title: Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval
- Abstract summary: This paper proposes a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching.<n>By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty.<n>We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process.
- Score: 6.5819669635975915
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching. By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty. We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process. This approach unifies probabilistic embedding and distributional transformation into a cohesive, end-to-end trainable system. To optimize cross-modal similarity, we introduce a distribution-aware contrastive loss based on Kullback-Leibler divergence. Extensive evaluations on MSR-VTT, MSVD, and VATEX benchmarks confirm that DAB significantly outperforms existing probabilistic and diffusion-based baselines, while providing calibrated uncertainty-aware ranking through bridge-induced distributional margins.
Related papers
- Rethinking Likelihood distributions: Student's t Likelihood Boosts Bayesian Neural Network Performance [0.0]
We investigate whether alternative assumptions for the likelihood distribution can outperform the commonly used Gaussian.<n>Student's t yields better predictive performance than a Gaussian likelihood distribution, independent of the data distribution and architecture.<n>In some cases, Student's t can also lead to shorter training times, while still being easy to implement.
arXiv Detail & Related papers (2026-07-28T07:32:02Z) - Implicit Variational Rejection Sampling [49.24060583051337]
Variational Inference (VI) is a fundamental inference technique in Bayesian machine learning for approxing complex posterior distributions.<n>Recent advancements have leveraged neural networks to model implicit distributions, offering increased flexibility.<n>We propose a method called Implicit Variational Rejection Sampling (IVRS), which integrates implicit distributions with rejection sampling to improve the posterior approximation.
arXiv Detail & Related papers (2026-06-12T08:17:45Z) - Accelerating Speculative Diffusions via Block Verification [77.23389794645801]
Speculative decoding speeds up LLM inference by using a draft model to generate tokens, with an acceptance-rejection scheme.<n>Existing diffusion adaptations either use inefficient sampling techniques or rely on an alternative scheme.<n>We introduce a novel scheme that efficiently implements the original speculative sampling mechanism for diffusion models.
arXiv Detail & Related papers (2026-06-11T14:54:13Z) - DISCOVER: A Solver for Distributional Counterfactual Explanations [7.673379790081033]
DISCOVER is a model-agnostic solver for distributional counterfactual explanations.<n>It exploits a sample-wise decomposition of the transport objective to compute per-row impact scores and enforce a top-$k$ intervention budget.<n> Experiments on multiple datasets demonstrate strong joint alignment of input and output distributions.
arXiv Detail & Related papers (2026-03-17T12:18:27Z) - Evidence-based Distributional Alignment for Large Language Models [58.65469623911573]
We propose Evi-DA, an evidence-based alignment technique that improves the fidelity and robustness of LLM-based distribution estimation.<n>Given a target country, Evi-DA retrieves related World Values Survey items and their answer distributions, predicts a coarse Welzel value signature for each option, and infers the country-conditioned answer distribution in a structured format.
arXiv Detail & Related papers (2026-03-03T03:34:06Z) - Better Source, Better Flow: Learning Condition-Dependent Source Distribution for Flow Matching [34.811045663987805]
Flow matching has emerged as a promising alternative to diffusion-based generative models.<n>We show that principled design of the source distribution is not only feasible but also beneficial at the scale of modern text-to-image systems.
arXiv Detail & Related papers (2026-02-05T18:08:20Z) - Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement [51.54933696252104]
We introduce Iterative Reward-Guided Refinement (IterRef), a novel test-time scaling method tailored to discrete diffusion.<n>We formalize this process within a Multiple-Try Metropolis framework, proving convergence to the reward-aligned distribution.<n>IterRef achieves striking gains under low compute budgets, far surpassing prior state-of-the-art baselines.
arXiv Detail & Related papers (2025-11-04T02:33:23Z) - Direct Distributional Optimization for Provable Alignment of Diffusion Models [39.048284342436666]
We introduce a novel alignment method for diffusion models from distribution optimization perspectives.<n>We first formulate the problem as a generic regularized loss minimization over probability distributions.<n>We enable sampling from the learned distribution by approximating its score function via Doob's $h$-transform technique.
arXiv Detail & Related papers (2025-02-05T07:35:15Z) - Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts [33.677249894085186]
We explore the potential of Concept Bottleneck Models for transforming complex, non-interpretable foundation models into interpretable decision-making pipelines.<n>Specifically, we focus on the test-time deployment of such an interpretable CBM pipeline "in the wild"<n>Our adaptation method produces concept-based interpretations better aligned with the test data and boosts post-deployment accuracy by up to 28%.
arXiv Detail & Related papers (2024-12-18T17:47:46Z) - Uncertainty Quantification via Stable Distribution Propagation [60.065272548502]
We propose a new approach for propagating stable probability distributions through neural networks.
Our method is based on local linearization, which we show to be an optimal approximation in terms of total variation distance for the ReLU non-linearity.
arXiv Detail & Related papers (2024-02-13T09:40:19Z) - Distribution Shift Inversion for Out-of-Distribution Prediction [57.22301285120695]
We propose a portable Distribution Shift Inversion algorithm for Out-of-Distribution (OoD) prediction.
We show that our method provides a general performance gain when plugged into a wide range of commonly used OoD algorithms.
arXiv Detail & Related papers (2023-06-14T08:00:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.