DELAD: Deep Landweber-guided deconvolution with Hessian and sparse prior
- URL: http://arxiv.org/abs/2209.15377v1
- Date: Fri, 30 Sep 2022 11:15:03 GMT
- Title: DELAD: Deep Landweber-guided deconvolution with Hessian and sparse prior
- Authors: Tomas Chobola, Anton Theileis, Jan Taucher, Tingying Peng
- Abstract summary: We present a model for non-blind image deconvolution that incorporates the classic iterative method into a deep learning application.
We build our network based on the iterative Landweber deconvolution algorithm, which is integrated with trainable convolutional layers to enhance the recovered image structures and details.
- Score: 0.22940141855172028
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present a model for non-blind image deconvolution that incorporates the
classic iterative method into a deep learning application. Instead of using
large over-parameterised generative networks to create sharp picture
representations, we build our network based on the iterative Landweber
deconvolution algorithm, which is integrated with trainable convolutional
layers to enhance the recovered image structures and details. Additional to the
data fidelity term, we also add Hessian and sparse constraints as
regularization terms to improve the image reconstruction quality. Our proposed
model is \textit{self-supervised} and converges to a solution based purely on
the input blurred image and respective blur kernel without the requirement of
any pre-training. We evaluate our technique using standard computer vision
benchmarking datasets as well as real microscope images obtained by our
enhanced depth-of-field (EDOF) underwater microscope, demonstrating the
capabilities of our model in a real-world application. The quantitative results
demonstrate that our approach is competitive with state-of-the-art non-blind
image deblurring methods despite having a fraction of the parameters and not
being pre-trained, demonstrating the efficiency and efficacy of embedding a
classic deconvolution approach inside a deep network.
Related papers
- Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems [80.62854148838359]
Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate.
We use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data.
Our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
arXiv Detail & Related papers (2024-03-23T22:32:06Z) - Distance Weighted Trans Network for Image Completion [52.318730994423106]
We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components.
CNNs are used to augment the local texture information of coarse priors.
DWT blocks are used to recover certain coarse textures and coherent visual structures.
arXiv Detail & Related papers (2023-10-11T12:46:11Z) - Leveraging Classic Deconvolution and Feature Extraction in Zero-Shot
Image Restoration [0.4398130586098371]
Non-blind deconvolution aims to restore a sharp image from its blurred counterpart given an obtained kernel.
We propose a novel non-blind deconvolution method that leverages the power of deep learning and classic iterative deconvolution algorithms.
Our method demonstrates significant improvements in various real-world applications non-blind deconvolution tasks.
arXiv Detail & Related papers (2023-10-03T14:41:30Z) - Spherical Image Inpainting with Frame Transformation and Data-driven
Prior Deep Networks [13.406134708071345]
In this work, we focus on the challenging task of spherical image inpainting with deep learning-based regularizer.
We employ a fast directional spherical Haar framelet transform and develop a novel optimization framework based on a sparsity assumption of the framelet transform.
We show that the proposed algorithms can greatly recover damaged spherical images and achieve the best performance over purely using deep learning denoiser and plug-and-play model.
arXiv Detail & Related papers (2022-09-29T07:51:27Z) - Adaptive Convolutional Dictionary Network for CT Metal Artifact
Reduction [62.691996239590125]
We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction.
Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image.
Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
arXiv Detail & Related papers (2022-05-16T06:49:36Z) - Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms.
Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
arXiv Detail & Related papers (2021-11-27T12:12:57Z) - DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurring [66.91879314310842]
We propose an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features.
A multi-scale cascaded feature refinement module then predicts the deblurred image from the deconvolved deep features.
We show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts and quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin.
arXiv Detail & Related papers (2021-03-18T00:38:11Z) - SIR: Self-supervised Image Rectification via Seeing the Same Scene from
Multiple Different Lenses [82.56853587380168]
We propose a novel self-supervised image rectification (SIR) method based on an important insight that the rectified results of distorted images of the same scene from different lens should be the same.
We leverage a differentiable warping module to generate the rectified images and re-distorted images from the distortion parameters.
Our method achieves comparable or even better performance than the supervised baseline method and representative state-of-the-art methods.
arXiv Detail & Related papers (2020-11-30T08:23:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.