RFMSR: Residual Flow Matching for Image Super-Resolution
- URL: http://arxiv.org/abs/2607.12753v1
- Date: Tue, 14 Jul 2026 13:19:36 GMT
- Title: RFMSR: Residual Flow Matching for Image Super-Resolution
- Abstract summary: Residual Flow Matching for Image Super-Resolution (RFMSR)<n>Phase I pretrains the velocity field via conditional flow matching, while Phase II applies end-to-end supervision to the single-step prediction.<n>RFMSR achieves comparable or even superior perceptual quality compared to state-of-the-art (SOTA) methods.
- Score: 43.28301144364581
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image super-resolution (ISR) has witnessed remarkable progress with diffusion models and flow matching. The dominant text-to-image (T2I) based approaches leverage large-scale foundation models as generative priors, achieving impressive perceptual quality but at the cost of massive model sizes and prohibitive training expenses. Recent flow-matching-based vision-only approaches have made significant strides; however, they adopt standard flow formulations that transport from a pure Gaussian prior to the data distribution, discarding the rich structural information already present in the low-quality (LQ) input. Furthermore, existing single-step acceleration techniques often forfeit the model's multi-step inference capability. In this paper, we propose Residual Flow Matching for Image Super-Resolution (RFMSR), a vision-only framework that centers the source distribution at the LQ latent, reducing transport distance and preserving structural priors throughout the flow trajectory. We further introduce a two-phase training strategy: Phase I pretrains the velocity field via conditional flow matching, while Phase II applies end-to-end supervision to the single-step prediction while retaining the velocity loss across all timesteps, achieving high-quality single-step generation without sacrificing multi-step refinement. Extensive experiments demonstrate that RFMSR achieves comparable or even superior perceptual quality compared to state-of-the-art (SOTA) methods. The source code is available at https://github.com/Faze-Hsw/RFMSR.
Related papers
- ScaleResfusion: Residual Rectified Flow based on Residual Vector Field [24.544037828084154]
Real-world Image Restoration (Real-IR) aims to recover high-quality (HQ) images from complex and unknown degradations.<n>Recent diffusion-based methods have substantially improved perceptual quality, but their current designs leave two key challenges unresolved.<n>We present ScaleResfusion, a scalable diffusion framework for real-world image restoration built on pre-trained text-to-image rectified-flow models.
arXiv Detail & Related papers (2026-07-28T04:26:05Z) - Fast Image Super-Resolution via Consistency Rectified Flow [65.54302099728712]
Diffusion models (DMs) have demonstrated remarkable success in real-world image super-resolution (SR)<n>Recent efforts have introduced few- or single-step solutions, but existing methods inefficiently model the process from noisy input.<n>We propose FlowSR, a novel approach that reformulates the SR problem as a rectified flow from low-resolution (LR) to high-resolution (HR) images.
arXiv Detail & Related papers (2026-05-12T16:42:38Z) - Allo{SR}$^2$: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows [32.29950358173077]
Real-world image super-resolution (Real-SR) has been revolutionized by leveraging the powerful generative priors of large-scale diffusion and flow-based models.<n>AlloSR$2$ is a novel framework that rectifies one-step SR trajectories via allomorphic generative flows to maintain high-fidelity generative realism.
arXiv Detail & Related papers (2026-04-21T08:44:40Z) - Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models [26.002982722748726]
ResFlow-Tuner is an image restoration framework based on the state-of-the-art flow matching model, FLUX.1-dev.<n>We propose a training-free test-time scaling paradigm tailored for image restoration.
arXiv Detail & Related papers (2026-03-23T14:33:43Z) - Reflective Flow Sampling Enhancement [51.824959905209774]
We propose Reflective Flow Sampling (RF-Sampling) as a theoretically-grounded and training-free inference enhancement framework for flow models.<n>RF-Sampling consistently improves both generation quality and prompt alignment.<n>It is also the first inference enhancement method that can exhibit test-time scaling ability to some extent on FLUX.
arXiv Detail & Related papers (2026-03-06T11:17:37Z) - One-Step Face Restoration via Shortcut-Enhanced Coupling Flow [2.8265172105754104]
We propose Shortcut-enhanced Coupling flow for Face Restoration (SCFlowFR)<n>It explicitly models the LQ--HQ dependency, minimizing path crossovers and promoting near-linear transport.<n> Experiments demonstrate that SCFlowFR achieves state-of-the-art one-step face restoration quality with inference speed comparable to traditional non-diffusion methods.
arXiv Detail & Related papers (2026-03-04T02:11:15Z) - FlowConsist: Make Your Flow Consistent with Real Trajectory [99.22869983378062]
We argue that current fast-flow training paradigms suffer from two fundamental issues.<n> conditional velocities constructed from randomly paired noise-data samples introduce systematic trajectory drift.<n>We propose FlowConsist, a training framework designed to enforce trajectory consistency in fast flows.
arXiv Detail & Related papers (2026-02-06T03:24:23Z) - Fast, faithful and photorealistic diffusion-based image super-resolution with enhanced Flow Map models [8.773008452897791]
FlowMapSR is a novel diffusion-based framework for image super-resolution explicitly designed for efficient inference.<n>We show that FlowMapSR achieves a better balance between reconstruction faithfulness and photorealism than recent state-of-the-art methods for both x4 and x8 upscaling.
arXiv Detail & Related papers (2026-01-23T11:25:04Z) - Single-Step Latent Consistency Model for Remote Sensing Image Super-Resolution [7.920423405957888]
We propose a novel single-step diffusion approach designed to enhance both efficiency and visual quality in RSISR tasks.<n>The proposed LCMSR reduces the iterative steps of traditional diffusion models from 50-1000 or more to just a single step.<n> Experimental results demonstrate that LCMSR effectively balances efficiency and performance, achieving inference times comparable to non-diffusion models.
arXiv Detail & Related papers (2025-03-25T09:56:21Z) - One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillation [60.54811860967658]
FluxSR is a novel one-step diffusion Real-ISR based on flow matching models.<n>First, we introduce Flow Trajectory Distillation (FTD) to distill a multi-step flow matching model into a one-step Real-ISR.<n>Second, to improve image realism and address high-frequency artifact issues in generated images, we propose TV-LPIPS as a perceptual loss.
arXiv Detail & Related papers (2025-02-04T04:11:29Z) - Normalizing Flows with Multi-Scale Autoregressive Priors [131.895570212956]
We introduce channel-wise dependencies in their latent space through multi-scale autoregressive priors (mAR)
Our mAR prior for models with split coupling flow layers (mAR-SCF) can better capture dependencies in complex multimodal data.
We show that mAR-SCF allows for improved image generation quality, with gains in FID and Inception scores compared to state-of-the-art flow-based models.
arXiv Detail & Related papers (2020-04-08T09:07:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.