Explore Image Deblurring via Blur Kernel Space
- URL: http://arxiv.org/abs/2104.00317v2
- Date: Sat, 3 Apr 2021 12:58:29 GMT
- Title: Explore Image Deblurring via Blur Kernel Space
- Authors: Phong Tran and Anh Tran and Quynh Phung and Minh Hoai
- Abstract summary: We propose an alternating optimization algorithm for blind image deblurring.
It approximates an unseen blur operator by a kernel in the encoded space and searches for the corresponding sharp image.
Our method can be used for blur synthesis by transferring existing blur operators from a given dataset into a new domain.
- Score: 17.67255729783263
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper introduces a method to encode the blur operators of an arbitrary
dataset of sharp-blur image pairs into a blur kernel space. Assuming the
encoded kernel space is close enough to in-the-wild blur operators, we propose
an alternating optimization algorithm for blind image deblurring. It
approximates an unseen blur operator by a kernel in the encoded space and
searches for the corresponding sharp image. Unlike recent deep-learning-based
methods, our system can handle unseen blur kernel, while avoiding using
complicated handcrafted priors on the blur operator often found in classical
methods. Due to the method's design, the encoded kernel space is fully
differentiable, thus can be easily adopted in deep neural network models.
Moreover, our method can be used for blur synthesis by transferring existing
blur operators from a given dataset into a new domain. Finally, we provide
experimental results to confirm the effectiveness of the proposed method.
Related papers
- Deep Dynamic Scene Deblurring from Optical Flow [53.625999196063574]
Deblurring can provide visually more pleasant pictures and make photography more convenient.
It is difficult to model the non-uniform blur mathematically.
We develop a convolutional neural network (CNN) to restore the sharp images from the deblurred features.
arXiv Detail & Related papers (2023-01-18T06:37:21Z) - SVBR-NET: A Non-Blind Spatially Varying Defocus Blur Removal Network [2.4975981795360847]
We propose a non-blind approach for image deblurring that can deal with spatially-varying kernels.
We introduce two encoder-decoder sub-networks that are fed with the blurry image and the estimated blur map.
The network is trained with synthetically blur kernels that are augmented to emulate blur maps produced by existing blur estimation methods.
arXiv Detail & Related papers (2022-06-26T17:21:12Z) - Unfolded Deep Kernel Estimation for Blind Image Super-resolution [23.798845090992728]
Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise.
We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
arXiv Detail & Related papers (2022-03-10T07:54:59Z) - Autoencoding Low-Resolution MRI for Semantically Smooth Interpolation of
Anisotropic MRI [1.281734910003263]
We propose an unsupervised deep learning semantic approach that synthesizes new intermediate slices from encoded low-resolution examples.
The method produces significantly better results in terms of Structural Similarity Index Measure and Peak Signal-to-Noise Ratio than a cubic B-spline approach.
arXiv Detail & Related papers (2022-02-18T15:40:00Z) - Mutual Affine Network for Spatially Variant Kernel Estimation in Blind
Image Super-Resolution [130.32026819172256]
Existing blind image super-resolution (SR) methods mostly assume blur kernels are spatially invariant across the whole image.
This paper proposes a mutual affine network (MANet) for spatially variant kernel estimation.
arXiv Detail & Related papers (2021-08-11T16:11:17Z) - DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurring [66.91879314310842]
We propose an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features.
A multi-scale cascaded feature refinement module then predicts the deblurred image from the deconvolved deep features.
We show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts and quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin.
arXiv Detail & Related papers (2021-03-18T00:38:11Z) - Blind Image Deblurring based on Kernel Mixture [0.0]
This paper regulates the structure of the blur kernel.
We propose a kernel mixture structure while using the Gaussian kernel as a base kernel.
A data-driven decision for the number of base kernels to combine makes the structure even more flexible.
arXiv Detail & Related papers (2021-01-15T17:56:37Z) - Blur Invariant Kernel-Adaptive Network for Single Image Blind deblurring [0.886014926770622]
We present a novel, blind, single image deblurring method that utilizes information regarding blur kernels.
We first introduce a kernel estimation network that produces adaptive blur kernels based on the analysis of the blurred image.
We propose a deblurring network that restores sharp images using the estimated blur kernel.
arXiv Detail & Related papers (2020-07-09T03:53:33Z) - End-to-end Interpretable Learning of Non-blind Image Deblurring [102.75982704671029]
Non-blind image deblurring is typically formulated as a linear least-squares problem regularized by natural priors on the corresponding sharp picture's gradients.
We propose to precondition the Richardson solver using approximate inverse filters of the (known) blur and natural image prior kernels.
arXiv Detail & Related papers (2020-07-03T15:45:01Z) - Multiple Video Frame Interpolation via Enhanced Deformable Separable
Convolution [67.83074893311218]
Kernel-based methods predict pixels with a single convolution process that convolves source frames with spatially adaptive local kernels.
We propose enhanced deformable separable convolution (EDSC) to estimate not only adaptive kernels, but also offsets, masks and biases.
We show that our method performs favorably against the state-of-the-art methods across a broad range of datasets.
arXiv Detail & Related papers (2020-06-15T01:10:59Z) - Cross-modal Deep Face Normals with Deactivable Skip Connections [77.83961745760216]
We present an approach for estimating surface normals from in-the-wild color images of faces.
We propose a method that can leverage all available image and normal data, whether paired or not.
We show that our approach can achieve significant improvements, both quantitative and qualitative, with natural face images.
arXiv Detail & Related papers (2020-03-21T16:26:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.