Locally-Supervised Global Image Restoration
- URL: http://arxiv.org/abs/2511.01998v1
- Date: Mon, 03 Nov 2025 19:12:25 GMT
- Title: Locally-Supervised Global Image Restoration
- Abstract summary: We address the problem of image reconstruction from incomplete measurements, encompassing both upsampling and inpainting.<n>We consider fixed, deterministic sampling patterns with inherently incomplete coverage, even in expectation.<n>We validate our method on optical-resolution image upsampling in photoacoustic microscopy.
- Score: 2.1423215611990094
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We address the problem of image reconstruction from incomplete measurements, encompassing both upsampling and inpainting, within a learning-based framework. Conventional supervised approaches require fully sampled ground truth data, while self-supervised methods allow incomplete ground truth but typically rely on random sampling that, in expectation, covers the entire image. In contrast, we consider fixed, deterministic sampling patterns with inherently incomplete coverage, even in expectation. To overcome this limitation, we exploit multiple invariances of the underlying image distribution, which theoretically allows us to achieve the same reconstruction performance as fully supervised approaches. We validate our method on optical-resolution image upsampling in photoacoustic microscopy (PAM), demonstrating competitive or superior results while requiring substantially less ground truth data.
Related papers
- ZeroIDIR: Zero-Reference Illumination Degradation Image Restoration with Perturbed Consistency Diffusion Models [72.4683657127516]
We propose a zero-reference diffusion-based framework, named ZeroIDIR, for illumination image restoration.<n>The framework decouples the restoration process into adaptive illumination correction and diffusion-based reconstruction.<n>Experiments on publicly available benchmarks show that the proposed method outperforms state-of-the-art unsupervised competitors.
arXiv Detail & Related papers (2026-05-12T02:36:49Z) - SFBD-OMNI: Bridge models for lossy measurement restoration with limited clean samples [22.912528721457473]
In many real-world scenarios, obtaining fully observed samples is expensive or even infeasible.<n>In this work, we study distribution restoration with abundant noisy samples, assuming the corruption process is available as a black-box generator.<n>We show that this task can be framed as a one-sided optimal transport problem and solved via an EM-like algorithm.
arXiv Detail & Related papers (2025-12-18T20:37:56Z) - Unsupervised Imaging Inverse Problems with Diffusion Distribution Matching [35.01013208265617]
This work addresses image restoration tasks through the lens of inverse problems using unpaired datasets.<n>The proposed method operates under minimal assumptions and relies only on small, unpaired datasets.<n>It is particularly well-suited for real-world scenarios, where the forward model is often unknown or misspecified.
arXiv Detail & Related papers (2025-06-17T15:06:43Z) - Scale-Equivariant Imaging: Self-Supervised Learning for Image Super-Resolution and Deblurring [9.587978273085296]
Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems.<n>We propose scale-equivariant imaging, a new self-supervised approach that leverages the fact that many image distributions are approximately scale-invariant.<n>We demonstrate throughout a series of experiments on real datasets that the proposed method outperforms other self-supervised approaches.
arXiv Detail & Related papers (2023-12-18T14:30:54Z) - Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction [75.91471250967703]
We introduce a novel sampling framework called Steerable Conditional Diffusion.<n>This framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement.<n>We achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities.
arXiv Detail & Related papers (2023-08-28T08:47:06Z) - Crafting Training Degradation Distribution for the
Accuracy-Generalization Trade-off in Real-World Super-Resolution [53.0437282872811]
We introduce a novel approach to craft training degradation distributions using a small set of reference images.
Our results indicate that the proposed technique significantly improves the performance of test images while preserving generalization capabilities in real-world applications.
arXiv Detail & Related papers (2023-05-29T14:22:48Z) - Exploiting Diffusion Prior for Real-World Image Super-Resolution [75.5898357277047]
We present a novel approach to leverage prior knowledge encapsulated in pre-trained text-to-image diffusion models for blind super-resolution.
By employing our time-aware encoder, we can achieve promising restoration results without altering the pre-trained synthesis model.
arXiv Detail & Related papers (2023-05-11T17:55:25Z) - Single-photon Image Super-resolution via Self-supervised Learning [6.218646347012887]
Single-Photon Image Super-Resolution (SPISR) aims to recover a high-resolution photon counting cube from a noisy low-resolution one by computational imaging algorithms.
By extending Equivariant Imaging (EI) to single-photon data, we propose a self-supervised learning framework for the SPISR task.
arXiv Detail & Related papers (2023-03-03T15:52:01Z) - Deblurring via Stochastic Refinement [85.42730934561101]
We present an alternative framework for blind deblurring based on conditional diffusion models.
Our method is competitive in terms of distortion metrics such as PSNR.
arXiv Detail & Related papers (2021-12-05T04:36:09Z) - Toward Real-World Super-Resolution via Adaptive Downsampling Models [58.38683820192415]
This study proposes a novel method to simulate an unknown downsampling process without imposing restrictive prior knowledge.
We propose a generalizable low-frequency loss (LFL) in the adversarial training framework to imitate the distribution of target LR images without using any paired examples.
arXiv Detail & Related papers (2021-09-08T06:00:32Z) - Uncertainty-aware Generalized Adaptive CycleGAN [44.34422859532988]
Unpaired image-to-image translation refers to learning inter-image-domain mapping in an unsupervised manner.
Existing methods often learn deterministic mappings without explicitly modelling the robustness to outliers or predictive uncertainty.
We propose a novel probabilistic method called Uncertainty-aware Generalized Adaptive Cycle Consistency (UGAC)
arXiv Detail & Related papers (2021-02-23T15:22:35Z) - Frequency Consistent Adaptation for Real World Super Resolution [64.91914552787668]
We propose a novel Frequency Consistent Adaptation (FCA) that ensures the frequency domain consistency when applying Super-Resolution (SR) methods to the real scene.
We estimate degradation kernels from unsupervised images and generate the corresponding Low-Resolution (LR) images.
Based on the domain-consistent LR-HR pairs, we train easy-implemented Convolutional Neural Network (CNN) SR models.
arXiv Detail & Related papers (2020-12-18T08:25:39Z) - SIR: Self-supervised Image Rectification via Seeing the Same Scene from
Multiple Different Lenses [82.56853587380168]
We propose a novel self-supervised image rectification (SIR) method based on an important insight that the rectified results of distorted images of the same scene from different lens should be the same.
We leverage a differentiable warping module to generate the rectified images and re-distorted images from the distortion parameters.
Our method achieves comparable or even better performance than the supervised baseline method and representative state-of-the-art methods.
arXiv Detail & Related papers (2020-11-30T08:23:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.