Blur Invariant Kernel-Adaptive Network for Single Image Blind deblurring

• URL: http://arxiv.org/abs/2007.04543v3
• Date: Tue, 15 Dec 2020 07:28:07 GMT
• Title: Blur Invariant Kernel-Adaptive Network for Single Image Blind deblurring
• Authors: Sungkwon An, Hyungmin Roh and Myungjoo Kang
• Abstract summary: We present a novel, blind, single image deblurring method that utilizes information regarding blur kernels. We first introduce a kernel estimation network that produces adaptive blur kernels based on the analysis of the blurred image. We propose a deblurring network that restores sharp images using the estimated blur kernel.
• Score: 0.886014926770622
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a novel, blind, single image deblurring method that utilizes information regarding blur kernels. Our model solves the deblurring problem by dividing it into two successive tasks: (1) blur kernel estimation and (2) sharp image restoration. We first introduce a kernel estimation network that produces adaptive blur kernels based on the analysis of the blurred image. The network learns the blur pattern of the input image and trains to generate the estimation of image-specific blur kernels. Subsequently, we propose a deblurring network that restores sharp images using the estimated blur kernel. To use the kernel efficiently, we propose a kernel-adaptive AE block that encodes features from both blurred images and blur kernels into a low dimensional space and then decodes them simultaneously to obtain an appropriately synthesized feature representation. We evaluate our model on REDS, GOPRO and Flickr2K datasets using various Gaussian blur kernels. Experiments show that our model can achieve state-of-the-art results on each dataset.

Related papers

• Unfolded Deep Kernel Estimation for Blind Image Super-resolution [23.798845090992728]
  Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise. We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
  arXiv  Detail & Related papers  (2022-03-10T07:54:59Z)
• Spectrum-to-Kernel Translation for Accurate Blind Image Super-Resolution [33.59749785182318]
  We propose a novel blind SR framework to super-resolve LR images degraded by arbitrary blur kernel. We first demonstrate that feature representation in frequency domain is more conducive for blur kernel reconstruction than in spatial domain. Experiments on both synthetic and real-world images demonstrate that our proposed method sufficiently reduces blur kernel estimation error.
  arXiv  Detail & Related papers  (2021-10-23T06:03:22Z)
• Summarize and Search: Learning Consensus-aware Dynamic Convolution for Co-Saliency Detection [139.10628924049476]
  Humans perform co-saliency detection by first summarizing the consensus knowledge in the whole group and then searching corresponding objects in each image. Previous methods usually lack robustness, scalability, or stability for the first process and simply fuse consensus features with image features for the second process. We propose a novel consensus-aware dynamic convolution model to explicitly and effectively perform the "summarize and search" process.
  arXiv  Detail & Related papers  (2021-10-01T12:06:42Z)
• End-to-end Alternating Optimization for Blind Super Resolution [68.395664154041]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate the blur kernel and restore the SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at a much higher speed.
  arXiv  Detail & Related papers  (2021-05-14T15:05:30Z)
• Explore Image Deblurring via Blur Kernel Space [17.67255729783263]
  We propose an alternating optimization algorithm for blind image deblurring. It approximates an unseen blur operator by a kernel in the encoded space and searches for the corresponding sharp image. Our method can be used for blur synthesis by transferring existing blur operators from a given dataset into a new domain.
  arXiv  Detail & Related papers  (2021-04-01T07:52:53Z)
• Blind Image Deblurring based on Kernel Mixture [0.0]
  This paper regulates the structure of the blur kernel. We propose a kernel mixture structure while using the Gaussian kernel as a base kernel. A data-driven decision for the number of base kernels to combine makes the structure even more flexible.
  arXiv  Detail & Related papers  (2021-01-15T17:56:37Z)
• Unfolding the Alternating Optimization for Blind Super Resolution [60.39409203244474]
  Two-step solution involves two independently trained models, which may not be well compatible with each other. We adopt an alternating optimization algorithm, which can estimate blur kernel and restore SR image in a single model. Our model can largely outperform state-of-the-art methods and produce more visually favorable results at much higher speed.
  arXiv  Detail & Related papers  (2020-10-06T11:27:27Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment [33.945579916184364]
  An adaptive fractional dilated convolution (AFDC) is developed to tackle this issue in convolutional kernel level. We provide a concise formulation for mini-batch training and utilize a grouping strategy to reduce computational overhead. Our experimental results demonstrate that our proposed method achieves state-of-the-art performance on image aesthetics assessment over the AVA dataset.
  arXiv  Detail & Related papers  (2020-04-06T21:56:29Z)
• Deep Blind Video Super-resolution [85.79696784460887]
  We propose a deep convolutional neural network (CNN) model to solve video SR by a blur kernel modeling approach. The proposed CNN model consists of motion blur estimation, motion estimation, and latent image restoration modules. We show that the proposed algorithm is able to generate clearer images with finer structural details.
  arXiv  Detail & Related papers  (2020-03-10T13:43:24Z)
• Self-Supervised Linear Motion Deblurring [112.75317069916579]
  Deep convolutional neural networks are state-of-the-art for image deblurring. We present a differentiable reblur model for self-supervised motion deblurring. Our experiments demonstrate that self-supervised single image deblurring is really feasible.
  arXiv  Detail & Related papers  (2020-02-10T20:15:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.