Towards Deep Unsupervised SAR Despeckling with Blind-Spot Convolutional
Neural Networks
- URL: http://arxiv.org/abs/2001.05264v1
- Date: Wed, 15 Jan 2020 12:21:12 GMT
- Title: Towards Deep Unsupervised SAR Despeckling with Blind-Spot Convolutional
Neural Networks
- Authors: Andrea Bordone Molini, Diego Valsesia, Giulia Fracastoro, Enrico Magli
- Abstract summary: Deep learning techniques have outperformed classical model-based despeckling algorithms.
In this paper, we propose a self-supervised Bayesian despeckling method.
We show that the performance of the proposed network is very close to the supervised training approach on synthetic data and competitive on real data.
- Score: 30.410981386006394
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: SAR despeckling is a problem of paramount importance in remote sensing, since
it represents the first step of many scene analysis algorithms. Recently, deep
learning techniques have outperformed classical model-based despeckling
algorithms. However, such methods require clean ground truth images for
training, thus resorting to synthetically speckled optical images since clean
SAR images cannot be acquired. In this paper, inspired by recent works on
blind-spot denoising networks, we propose a self-supervised Bayesian
despeckling method. The proposed method is trained employing only noisy images
and can therefore learn features of real SAR images rather than synthetic data.
We show that the performance of the proposed network is very close to the
supervised training approach on synthetic data and competitive on real data.
Related papers
- Adaptive Convolutional Dictionary Network for CT Metal Artifact
Reduction [62.691996239590125]
We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction.
Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image.
Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
arXiv Detail & Related papers (2022-05-16T06:49:36Z) - Neural Maximum A Posteriori Estimation on Unpaired Data for Motion
Deblurring [87.97330195531029]
We propose a Neural Maximum A Posteriori (NeurMAP) estimation framework for training neural networks to recover blind motion information and sharp content from unpaired data.
The proposed NeurMAP is an approach to existing deblurring neural networks, and is the first framework that enables training image deblurring networks on unpaired datasets.
arXiv Detail & Related papers (2022-04-26T08:09:47Z) - Comparison of convolutional neural networks for cloudy optical images
reconstruction from single or multitemporal joint SAR and optical images [0.21079694661943604]
We focus on the evaluation of convolutional neural networks that use jointly SAR and optical images to retrieve the missing contents in one single polluted optical image.
We propose a simple framework that eases the creation of datasets for the training of deep nets targeting optical image reconstruction.
We show how space partitioning data structures help to query samples in terms of cloud coverage, relative acquisition date, pixel validity and relative proximity between SAR and optical images.
arXiv Detail & Related papers (2022-04-01T13:31:23Z) - Low-light Image Enhancement by Retinex Based Algorithm Unrolling and
Adjustment [50.13230641857892]
We propose a new deep learning framework for the low-light image enhancement (LIE) problem.
The proposed framework contains a decomposition network inspired by algorithm unrolling, and adjustment networks considering both global brightness and local brightness sensitivity.
Experiments on a series of typical LIE datasets demonstrated the effectiveness of the proposed method, both quantitatively and visually, as compared with existing methods.
arXiv Detail & Related papers (2022-02-12T03:59:38Z) - Transformer-based SAR Image Despeckling [53.99620005035804]
We introduce a transformer-based network for SAR image despeckling.
The proposed despeckling network comprises of a transformer-based encoder which allows the network to learn global dependencies between different image regions.
Experiments show that the proposed method achieves significant improvements over traditional and convolutional neural network-based despeckling methods.
arXiv Detail & Related papers (2022-01-23T20:09:01Z) - Hyperspectral Denoising Using Unsupervised Disentangled Spatio-Spectral
Deep Priors [10.65207459525818]
In recent years, data-driven neural network priors have shown promising performance for RGB natural image denoising.
Data-driven priors are hard to acquire for hyperspectral images due to the lack of training data.
This work puts forth an unsupervised DIP framework that is based on the classic-spectral decomposition of HSIs.
arXiv Detail & Related papers (2021-02-24T14:38:51Z) - Speckle2Void: Deep Self-Supervised SAR Despeckling with Blind-Spot
Convolutional Neural Networks [30.410981386006394]
despeckling is a crucial preliminary step in scene analysis algorithms.
Recent success of deep learning envisions a new generation of despeckling techniques.
We propose a self-supervised Bayesian despeckling method.
arXiv Detail & Related papers (2020-07-04T11:38:48Z) - SAR Image Despeckling by Deep Neural Networks: from a pre-trained model
to an end-to-end training strategy [8.097773654147105]
convolutional neural networks (CNNs) have recently shown to reach state-of-the-art performance for SAR image restoration.
CNN training requires good training data: many pairs of speckle-free / speckle-corrupted images.
This paper analyzes different strategies one can adopt, depending on the speckle removal task one wishes to perform.
arXiv Detail & Related papers (2020-06-28T09:47:31Z) - Syn2Real Transfer Learning for Image Deraining using Gaussian Processes [92.15895515035795]
CNN-based methods for image deraining have achieved excellent performance in terms of reconstruction error as well as visual quality.
Due to challenges in obtaining real world fully-labeled image deraining datasets, existing methods are trained only on synthetically generated data.
We propose a Gaussian Process-based semi-supervised learning framework which enables the network in learning to derain using synthetic dataset.
arXiv Detail & Related papers (2020-06-10T00:33:18Z) - Virtual SAR: A Synthetic Dataset for Deep Learning based Speckle Noise
Reduction Algorithms [3.0448872422956432]
We propose a standard way of generating synthetic data for the training of speckle reduction algorithms.
We demonstrate a use-case to advance research in this domain.
arXiv Detail & Related papers (2020-04-23T08:27:45Z) - Deep CG2Real: Synthetic-to-Real Translation via Image Disentanglement [78.58603635621591]
Training an unpaired synthetic-to-real translation network in image space is severely under-constrained.
We propose a semi-supervised approach that operates on the disentangled shading and albedo layers of the image.
Our two-stage pipeline first learns to predict accurate shading in a supervised fashion using physically-based renderings as targets.
arXiv Detail & Related papers (2020-03-27T21:45:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.