Simultaneous Learning of Optimal Transports for Training All-to-All Flow-Based Condition Transfer Model
- URL: http://arxiv.org/abs/2504.03188v1
- Date: Fri, 04 Apr 2025 05:32:54 GMT
- Title: Simultaneous Learning of Optimal Transports for Training All-to-All Flow-Based Condition Transfer Model
- Authors: Kotaro Ikeda, Masanori Koyama, Jinzhe Zhang, Kohei Hayashi, Kenji Fukumizu,
- Abstract summary: We introduce a novel cost function that enables simultaneous learning of optimal transports for all pairs of conditional distributions.<n>Our method is supported by a theoretical guarantee that, in the limit, it converges to pairwise optimal transports among infinite pairs of conditional distributions.<n>The learned transport maps are subsequently used to couple data points in conditional flow matching.
- Score: 19.71452214879951
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we propose a flow-based method for learning all-to-all transfer maps among conditional distributions, approximating pairwise optimal transport. The proposed method addresses the challenge of handling continuous conditions, which often involve a large set of conditions with sparse empirical observations per condition. We introduce a novel cost function that enables simultaneous learning of optimal transports for all pairs of conditional distributions. Our method is supported by a theoretical guarantee that, in the limit, it converges to pairwise optimal transports among infinite pairs of conditional distributions. The learned transport maps are subsequently used to couple data points in conditional flow matching. We demonstrate the effectiveness of this method on synthetic and benchmark datasets, as well as on chemical datasets where continuous physical properties are defined as conditions.
Related papers
- Convex Physics Informed Neural Networks for the Monge-Ampère Optimal Transport Problem [49.1574468325115]
Optimal transportation of raw material from suppliers to customers is an issue arising in logistics.<n>A physics informed neuralnetwork method is advocated here for the solution of the corresponding generalized Monge-Ampere equation.<n>A particular focus is set on the enforcement of transport boundary conditions in the loss function.
arXiv Detail & Related papers (2025-01-17T12:51:25Z) - Conditional Variable Flow Matching: Transforming Conditional Densities with Amortized Conditional Optimal Transport [0.0]
We propose a framework for learning flows transforming conditional distributions with amortization across continuous conditioning variables.
In particular, simultaneous sample conditioned flows over the main and conditioning variables, alongside a conditional Wasserstein distance combined with a loss reweighting kernel conditional optimal transport.
We demonstrate CVFM on a suite of increasingly challenging problems, including discrete and continuous conditional mapping benchmarks, image-to-image domain transfer, and modeling the temporal evolution of materials internal structure during manufacturing processes.
arXiv Detail & Related papers (2024-11-13T03:42:55Z) - Sequential Conditional Transport on Probabilistic Graphs for Interpretable Counterfactual Fairness [0.3749861135832073]
We extend "Knothe's rearrangement" and "triangular transport" to probabilistic graphical models.
We use this counterfactual approach, referred to as sequential transport, to discuss fairness at the individual level.
arXiv Detail & Related papers (2024-08-06T20:02:57Z) - Distributed Markov Chain Monte Carlo Sampling based on the Alternating
Direction Method of Multipliers [143.6249073384419]
In this paper, we propose a distributed sampling scheme based on the alternating direction method of multipliers.
We provide both theoretical guarantees of our algorithm's convergence and experimental evidence of its superiority to the state-of-the-art.
In simulation, we deploy our algorithm on linear and logistic regression tasks and illustrate its fast convergence compared to existing gradient-based methods.
arXiv Detail & Related papers (2024-01-29T02:08:40Z) - Conditional Optimal Transport on Function Spaces [53.9025059364831]
We develop a theory of constrained optimal transport problems that describe block-triangular Monge maps.
This generalizes the theory of optimal triangular transport to separable infinite-dimensional function spaces with general cost functions.
We present numerical experiments that demonstrate the computational applicability of our theoretical results for amortized and likelihood-free inference of functional parameters.
arXiv Detail & Related papers (2023-11-09T18:44:42Z) - Optimal Conditions for Environment-Assisted Quantum Transport on the
Fully Connected Network [0.0]
We present a theoretical analysis of the efficiency and rate of excitation transport on a network described by a complete graph in which every site is connected to every other.
The long-time transport properties are analytically calculated for networks of arbitrary size that are symmetric except for the trapping site, start with a range of initial states, and are subject to dephasing and excitation decay.
arXiv Detail & Related papers (2023-08-31T23:00:11Z) - Consistent Optimal Transport with Empirical Conditional Measures [0.6562256987706128]
We consider the problem of Optimal Transportation (OT) between two joint distributions when conditioned on a common variable.
We use kernelized-least-squares terms computed over the joint samples, which implicitly match the transport plan's conditional objective.
Our methodology improves upon state-of-the-art methods when employed in applications like prompt learning for few-shot classification and conditional-generation in the context of predicting cell responses to treatment.
arXiv Detail & Related papers (2023-05-25T10:01:57Z) - Manifold Interpolating Optimal-Transport Flows for Trajectory Inference [64.94020639760026]
We present a method called Manifold Interpolating Optimal-Transport Flow (MIOFlow)
MIOFlow learns, continuous population dynamics from static snapshot samples taken at sporadic timepoints.
We evaluate our method on simulated data with bifurcations and merges, as well as scRNA-seq data from embryoid body differentiation, and acute myeloid leukemia treatment.
arXiv Detail & Related papers (2022-06-29T22:19:03Z) - Label Propagation Through Optimal Transport [0.0]
We tackle the transductive semi-supervised learning problem that aims to obtain label predictions for the given unlabeled data points.
Our proposed approach is based on optimal transport, a mathematical theory that has been successfully used to address various machine learning problems.
arXiv Detail & Related papers (2021-10-01T11:25:55Z) - Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds
with Optimal Transport and Random Walk [59.87525177207915]
We develop a self-supervised method to establish correspondences between two point clouds to approximate scene flow.
Our method achieves state-of-the-art performance among self-supervised learning methods.
arXiv Detail & Related papers (2021-05-18T03:12:42Z) - Comparing Probability Distributions with Conditional Transport [63.11403041984197]
We propose conditional transport (CT) as a new divergence and approximate it with the amortized CT (ACT) cost.
ACT amortizes the computation of its conditional transport plans and comes with unbiased sample gradients that are straightforward to compute.
On a wide variety of benchmark datasets generative modeling, substituting the default statistical distance of an existing generative adversarial network with ACT is shown to consistently improve the performance.
arXiv Detail & Related papers (2020-12-28T05:14:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.