Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imaging
- URL: http://arxiv.org/abs/2106.12175v1
- Date: Wed, 23 Jun 2021 05:50:19 GMT
- Title: Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imaging
- Authors: Junshen Xu, Elfar Adalsteinsson
- Abstract summary: We propose Deformed2Self, an end-to-end self-supervised deep learning framework for dynamic imaging denoising.
It combines single-image and multi-image denoising to improve image quality and use a spatial transformer network to model motion between different slices.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image denoising is of great importance for medical imaging system, since it
can improve image quality for disease diagnosis and downstream image analyses.
In a variety of applications, dynamic imaging techniques are utilized to
capture the time-varying features of the subject, where multiple images are
acquired for the same subject at different time points. Although
signal-to-noise ratio of each time frame is usually limited by the short
acquisition time, the correlation among different time frames can be exploited
to improve denoising results with shared information across time frames. With
the success of neural networks in computer vision, supervised deep learning
methods show prominent performance in single-image denoising, which rely on
large datasets with clean-vs-noisy image pairs. Recently, several
self-supervised deep denoising models have been proposed, achieving promising
results without needing the pairwise ground truth of clean images. In the field
of multi-image denoising, however, very few works have been done on extracting
correlated information from multiple slices for denoising using self-supervised
deep learning methods. In this work, we propose Deformed2Self, an end-to-end
self-supervised deep learning framework for dynamic imaging denoising. It
combines single-image and multi-image denoising to improve image quality and
use a spatial transformer network to model motion between different slices.
Further, it only requires a single noisy image with a few auxiliary
observations at different time frames for training and inference. Evaluations
on phantom and in vivo data with different noise statistics show that our
method has comparable performance to other state-of-the-art unsupervised or
self-supervised denoising methods and outperforms under high noise levels.
Related papers
- Self2Self+: Single-Image Denoising with Self-Supervised Learning and
Image Quality Assessment Loss [4.035753155957699]
The proposed method achieves state-of-the-art denoising performance on both synthetic and real-world datasets.
This highlights the effectiveness and practicality of our method as a potential solution for various noise removal tasks.
arXiv Detail & Related papers (2023-07-20T08:38:01Z) - A Comparison of Image Denoising Methods [23.69991964391047]
We compare a variety of denoising methods on both synthetic and real-world datasets for different applications.
We show that a simple matrix-based algorithm may be able to produce similar results compared with its tensor counterparts.
In spite of the progress in recent years, we discuss shortcomings and possible extensions of existing techniques.
arXiv Detail & Related papers (2023-04-18T13:41:42Z) - Masked Image Training for Generalizable Deep Image Denoising [53.03126421917465]
We present a novel approach to enhance the generalization performance of denoising networks.
Our method involves masking random pixels of the input image and reconstructing the missing information during training.
Our approach exhibits better generalization ability than other deep learning models and is directly applicable to real-world scenarios.
arXiv Detail & Related papers (2023-03-23T09:33:44Z) - Linear Combinations of Patches are Unreasonably Effective for Single-Image Denoising [5.893124686141782]
Deep neural networks have revolutionized image denoising in achieving significant accuracy improvements.
To alleviate the requirement to learn image priors externally, single-image methods perform denoising solely based on the analysis of the input noisy image.
This work investigates the effectiveness of linear combinations of patches for denoising under this constraint.
arXiv Detail & Related papers (2022-12-01T10:52:03Z) - Enhancing convolutional neural network generalizability via low-rank weight approximation [6.763245393373041]
Sufficient denoising is often an important first step for image processing.
Deep neural networks (DNNs) have been widely used for image denoising.
We introduce a new self-supervised framework for image denoising based on the Tucker low-rank tensor approximation.
arXiv Detail & Related papers (2022-09-26T14:11:05Z) - IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance.
Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising.
To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
arXiv Detail & Related papers (2021-11-29T07:22:53Z) - ISCL: Interdependent Self-Cooperative Learning for Unpaired Image
Denoising [3.796436257221662]
We propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL)
ISCL combines cyclic adversarial learning with self-supervised residual learning.
We demonstrate that ISCL is superior to conventional and current state-of-the-art deep learning-based image denoising methods.
arXiv Detail & Related papers (2021-02-19T10:54:25Z) - Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [98.82804259905478]
We present Neighbor2Neighbor to train an effective image denoising model with only noisy images.
In detail, input and target used to train a network are images sub-sampled from the same noisy image.
A denoising network is trained on sub-sampled training pairs generated in the first stage, with a proposed regularizer as additional loss for better performance.
arXiv Detail & Related papers (2021-01-08T02:03:25Z) - Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising [54.730707387866076]
We introduce Noise2Same, a novel self-supervised denoising framework.
In particular, Noise2Same requires neither J-invariance nor extra information about the noise model.
Our results show that our Noise2Same remarkably outperforms previous self-supervised denoising methods.
arXiv Detail & Related papers (2020-10-22T18:12:26Z) - Unpaired Learning of Deep Image Denoising [80.34135728841382]
This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation.
For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images.
Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
arXiv Detail & Related papers (2020-08-31T16:22:40Z) - Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
Blind image denoising is an important yet very challenging problem in computer vision.
We propose a new variational inference method, which integrates both noise estimation and image denoising.
arXiv Detail & Related papers (2019-08-29T15:54:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.