Saving Foundation Flow-Matching Priors for Inverse Problems
- URL: http://arxiv.org/abs/2511.16520v1
- Date: Thu, 20 Nov 2025 16:35:57 GMT
- Title: Saving Foundation Flow-Matching Priors for Inverse Problems
- Authors: Yuxiang Wan, Ryan Devera, Wenjie Zhang, Ju Sun,
- Abstract summary: Foundation flow-matching (FM) models promise a universal prior for solving inverse problems (IPs)<n>We introduce FMPlug, a plug-in framework that redefines how foundation FMs are used in IPs.<n>Our results point to a path for making foundation FM models practical, reusable priors for IP solving.
- Score: 9.257036746938422
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Foundation flow-matching (FM) models promise a universal prior for solving inverse problems (IPs), yet today they trail behind domain-specific or even untrained priors. How can we unlock their potential? We introduce FMPlug, a plug-in framework that redefines how foundation FMs are used in IPs. FMPlug combines an instance-guided, time-dependent warm-start strategy with a sharp Gaussianity regularization, adding problem-specific guidance while preserving the Gaussian structures. This leads to a significant performance boost across image restoration and scientific IPs. Our results point to a path for making foundation FM models practical, reusable priors for IP solving.
Related papers
- Trajectory Stitching for Solving Inverse Problems with Flow-Based Models [68.36374645801901]
Flow-based generative models have emerged as powerful priors for solving inverse problems.<n>We propose MS-Flow, which represents the trajectory as a sequence of intermediate latent states rather than a single initial code.<n>We demonstrate the effectiveness of MS-Flow over existing methods on image recovery and inverse problems, including inpainting, super-resolution, and computed tomography.
arXiv Detail & Related papers (2026-02-09T11:36:41Z) - Prior-Informed Flow Matching for Graph Reconstruction [38.96153306484745]
We introduce Prior-Informed Flow Matching (PIFM), a conditional flow model for graph reconstruction.<n>PIFM bridges the gap by integrating embedding-based priors with continuous-time flow matching.<n> Experiments on different datasets demonstrate that PIFM consistently enhances classical embeddings, outperforming them and state-of-the-art generative baselines in reconstruction accuracy.
arXiv Detail & Related papers (2026-01-29T18:38:02Z) - FMPlug: Plug-In Foundation Flow-Matching Priors for Inverse Problems [6.3140989721044445]
We present FMPlug, a novel plug-in framework that enhances foundation flow-matching (FM) priors.<n>Unlike traditional approaches that rely on domain-specific or untrained priors, FMPlug smartly leverages two simple but powerful insights.
arXiv Detail & Related papers (2025-08-01T15:40:37Z) - FiRe: Fixed-points of Restoration Priors for Solving Inverse Problems [11.441644020200549]
Implicit priors based on denoising neural networks have become central to widely-used algorithms.<n>We introduce Fixed-points of Restoration (FiRe) priors as a new framework for expanding the notion of priors in.<n>to general restoration models.
arXiv Detail & Related papers (2024-11-28T07:40:16Z) - FedPFT: Federated Proxy Fine-Tuning of Foundation Models [55.58899993272904]
Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges as a promising strategy for protecting data privacy and valuable FMs.
Existing methods fine-tune FM by allocating sub-FM to clients in FL, leading to suboptimal performance due to insufficient tuning and inevitable error accumulations of gradients.
We propose Federated Proxy Fine-Tuning (FedPFT), a novel method enhancing FMs adaptation in downstream tasks through FL by two key modules.
arXiv Detail & Related papers (2024-04-17T16:30:06Z) - Optimal Flow Matching: Learning Straight Trajectories in Just One Step [89.37027530300617]
We develop and theoretically justify the novel textbf Optimal Flow Matching (OFM) approach.
It allows recovering the straight OT displacement for the quadratic transport in just one FM step.
The main idea of our approach is the employment of vector field for FM which are parameterized by convex functions.
arXiv Detail & Related papers (2024-03-19T19:44:54Z) - Chasing Fairness in Graphs: A GNN Architecture Perspective [73.43111851492593]
We propose textsfFair textsfMessage textsfPassing (FMP) designed within a unified optimization framework for graph neural networks (GNNs)
In FMP, the aggregation is first adopted to utilize neighbors' information and then the bias mitigation step explicitly pushes demographic group node presentation centers together.
Experiments on node classification tasks demonstrate that the proposed FMP outperforms several baselines in terms of fairness and accuracy on three real-world datasets.
arXiv Detail & Related papers (2023-12-19T18:00:15Z) - GIFD: A Generative Gradient Inversion Method with Feature Domain
Optimization [52.55628139825667]
Federated Learning (FL) has emerged as a promising distributed machine learning framework to preserve clients' privacy.
Recent studies find that an attacker can invert the shared gradients and recover sensitive data against an FL system by leveraging pre-trained generative adversarial networks (GAN) as prior knowledge.
We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD), which disassembles the GAN model and searches the feature domains of the intermediate layers.
arXiv Detail & Related papers (2023-08-09T04:34:21Z) - NF-ULA: Langevin Monte Carlo with Normalizing Flow Prior for Imaging
Inverse Problems [7.38079566297881]
We introduce NF-ULA (Normalizing Flow-based Unadjusted Langevin algorithm), which involves learning a normalizing flow (NF) as the image prior.
NF-ULA is found to perform better than competing methods for severely ill-posed inverse problems.
arXiv Detail & Related papers (2023-04-17T15:03:45Z) - Content Popularity Prediction Based on Quantized Federated Bayesian
Learning in Fog Radio Access Networks [76.16527095195893]
We investigate the content popularity prediction problem in cache-enabled fog radio access networks (F-RANs)
In order to predict the content popularity with high accuracy and low complexity, we propose a Gaussian process based regressor to model the content request pattern.
We utilize Bayesian learning to train the model parameters, which is robust to overfitting.
arXiv Detail & Related papers (2022-06-23T03:05:12Z) - A data-driven choice of misfit function for FWI using reinforcement
learning [0.0]
We use a deep-Q network (DQN) to learn an optimal policy to determine the proper timing to switch between different misfit functions.
Specifically, we train the state-action value function (Q) to predict when to use the conventional L2-norm misfit function or the more advanced optimal-transport matching-filter (OTMF) misfit.
arXiv Detail & Related papers (2020-02-08T12:31:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.