Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noise
- URL: http://arxiv.org/abs/2503.19468v1
- Date: Tue, 25 Mar 2025 08:59:11 GMT
- Title: Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noise
- Authors: Nadja Gruber, Johannes Schwab, Markus Haltmeier, Ander Biguri, Clemens Dlaska, Gyeongha Hwang,
- Abstract summary: Noisier2Inverse is a correction-free self-supervised deep learning approach for general inverse prob- lems.<n>We numerically demonstrate that our method clearly outperforms previous self-supervised approaches that account for correlated noise.
- Score: 1.099532646524593
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose Noisier2Inverse, a correction-free self-supervised deep learning approach for general inverse prob- lems. The proposed method learns a reconstruction function without the need for ground truth samples and is ap- plicable in cases where measurement noise is statistically correlated. This includes computed tomography, where detector imperfections or photon scattering create correlated noise patterns, as well as microscopy and seismic imaging, where physical interactions during measurement introduce dependencies in the noise structure. Similar to Noisier2Noise, a key step in our approach is the generation of noisier data from which the reconstruction net- work learns. However, unlike Noisier2Noise, the proposed loss function operates in measurement space and is trained to recover an extrapolated image instead of the original noisy one. This eliminates the need for an extrap- olation step during inference, which would otherwise suffer from ill-posedness. We numerically demonstrate that our method clearly outperforms previous self-supervised approaches that account for correlated noise.
Related papers
- Behind the Noise: Conformal Quantile Regression Reveals Emergent Representations [0.2445561610325265]
We present a machine learning approach that denoises low-quality measurements with calibrated uncertainty bounds.<n>By using ensembles of lightweight, randomly structured neural networks trained via conformal quantile regression, our method performs reliable denoising.<n>We validate the approach on real-world geobiochemical imaging data, showing how it supports confident interpretation and guides experimental design.
arXiv Detail & Related papers (2025-05-13T02:27:12Z) - Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration [64.84134880709625]
We show that it is possible to perform domain adaptation via the noise space using diffusion models.<n>In particular, by leveraging the unique property of how auxiliary conditional inputs influence the multi-step denoising process, we derive a meaningful diffusion loss.<n>We present crucial strategies such as channel-shuffling layer and residual-swapping contrastive learning in the diffusion model.
arXiv Detail & Related papers (2024-06-26T17:40:30Z) - DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detection [80.20339155618612]
DiffusionAD is a novel anomaly detection pipeline comprising a reconstruction sub-network and a segmentation sub-network.<n>A rapid one-step denoising paradigm achieves hundreds of times acceleration while preserving comparable reconstruction quality.<n>Considering the diversity in the manifestation of anomalies, we propose a norm-guided paradigm to integrate the benefits of multiple noise scales.
arXiv Detail & Related papers (2023-03-15T16:14:06Z) - Diffusion Model for Generative Image Denoising [17.897180118637856]
In supervised learning for image denoising, usually the paired clean images and noisy images are collected and synthesised to train a denoising model.
In this paper, we regard the denoising task as a problem of estimating the posterior distribution of clean images conditioned on noisy images.
arXiv Detail & Related papers (2023-02-05T14:53:07Z) - The role of noise in denoising models for anomaly detection in medical
images [62.0532151156057]
Pathological brain lesions exhibit diverse appearance in brain images.
Unsupervised anomaly detection approaches have been proposed using only normal data for training.
We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
arXiv Detail & Related papers (2023-01-19T21:39:38Z) - Representing Noisy Image Without Denoising [91.73819173191076]
Fractional-order Moments in Radon space (FMR) is designed to derive robust representation directly from noisy images.
Unlike earlier integer-order methods, our work is a more generic design taking such classical methods as special cases.
arXiv Detail & Related papers (2023-01-18T10:13:29Z) - FINO: Flow-based Joint Image and Noise Model [23.9749061109964]
Flow-based joint Image and NOise model (FINO)
We propose a novel Flow-based joint Image and NOise model (FINO) that distinctly decouples the image and noise in the latent space and losslessly reconstructs them via a series of invertible transformations.
arXiv Detail & Related papers (2021-11-11T02:51:54Z) - ISCL: Interdependent Self-Cooperative Learning for Unpaired Image
Denoising [3.796436257221662]
We propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL)
ISCL combines cyclic adversarial learning with self-supervised residual learning.
We demonstrate that ISCL is superior to conventional and current state-of-the-art deep learning-based image denoising methods.
arXiv Detail & Related papers (2021-02-19T10:54:25Z) - Unpaired Learning of Deep Image Denoising [80.34135728841382]
This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation.
For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images.
Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
arXiv Detail & Related papers (2020-08-31T16:22:40Z) - Self-supervised Denoising via Diffeomorphic Template Estimation:
Application to Optical Coherence Tomography [6.197149831796131]
We propose a joint diffeomorphic template estimation and denoising framework which enables the use of self-supervised denoising for motion deformed repeat acquisitions.
Strong qualitative and quantitative improvements are achieved in denoising OCT images, with generic utility in any imaging modality amenable to multiple exposures.
arXiv Detail & Related papers (2020-08-18T16:52:10Z) - Dual Adversarial Network: Toward Real-world Noise Removal and Noise
Generation [52.75909685172843]
Real-world image noise removal is a long-standing yet very challenging task in computer vision.
We propose a novel unified framework to deal with the noise removal and noise generation tasks.
Our method learns the joint distribution of the clean-noisy image pairs.
arXiv Detail & Related papers (2020-07-12T09:16:06Z) - Noise2Inverse: Self-supervised deep convolutional denoising for
tomography [0.0]
Noise2Inverse is a deep CNN-based denoising method for linear image reconstruction algorithms.
We develop a theoretical framework which shows that such training indeed obtains a denoising CNN.
On simulated CT datasets, Noise2Inverse demonstrates an improvement in peak signal-to-noise ratio and structural similarity index.
arXiv Detail & Related papers (2020-01-31T12:50:24Z) - Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
Blind image denoising is an important yet very challenging problem in computer vision.
We propose a new variational inference method, which integrates both noise estimation and image denoising.
arXiv Detail & Related papers (2019-08-29T15:54:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.