Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Prior

• URL: http://arxiv.org/abs/2210.05361v4
• Date: Sun, 19 Mar 2023 08:16:50 GMT
• Title: Uncertainty-Aware Unsupervised Image Deblurring with Deep Residual Prior
• Authors: Xiaole Tang, Xile Zhao, Jun Liu, Jianli Wang, Yuchun Miao, Tieyong Zeng
• Abstract summary: Non-blind deblurring methods achieve decent performance under the accurate blur kernel assumption. Hand-crafted prior, incorporating domain knowledge, generally performs well but may lead to poor performance when kernel (or induced) error is complex. Data-driven prior, which excessively depends on the diversity and abundance of training data, is vulnerable to out-of-distribution blurs and images. We propose an unsupervised semi-blind deblurring model which recovers the latent image from the blurry image and inaccurate blur kernel.
• Score: 23.417096880297702
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Non-blind deblurring methods achieve decent performance under the accurate blur kernel assumption. Since the kernel uncertainty (i.e. kernel error) is inevitable in practice, semi-blind deblurring is suggested to handle it by introducing the prior of the kernel (or induced) error. However, how to design a suitable prior for the kernel (or induced) error remains challenging. Hand-crafted prior, incorporating domain knowledge, generally performs well but may lead to poor performance when kernel (or induced) error is complex. Data-driven prior, which excessively depends on the diversity and abundance of training data, is vulnerable to out-of-distribution blurs and images. To address this challenge, we suggest a dataset-free deep residual prior for the kernel induced error (termed as residual) expressed by a customized untrained deep neural network, which allows us to flexibly adapt to different blurs and images in real scenarios. By organically integrating the respective strengths of deep priors and hand-crafted priors, we propose an unsupervised semi-blind deblurring model which recovers the latent image from the blurry image and inaccurate blur kernel. To tackle the formulated model, an efficient alternating minimization algorithm is developed. Extensive experiments demonstrate the favorable performance of the proposed method as compared to data-driven and model-driven methods in terms of image quality and the robustness to the kernel error.

Related papers

• Fast constrained sampling in pre-trained diffusion models [77.21486516041391]
  Diffusion models have dominated the field of large, generative image models. We propose an algorithm for fast-constrained sampling in large pre-trained diffusion models.
  arXiv  Detail & Related papers  (2024-10-24T14:52:38Z)
• PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimage [19.02295657801464]
  This work addresses the task of zero-shot monocular depth estimation. A recent advance in this field has been the idea of utilising Text-to-Image foundation models, such as Stable Diffusion. We present PrimeDepth, a method that is highly efficient at test time while keeping, or even enhancing, the positive aspects of diffusion-based approaches.
  arXiv  Detail & Related papers  (2024-09-13T19:03:48Z)
• Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding [46.40894748268764]
  Blind image encoding is a classic yet challenging problem in the field of image processing. Recent advances in deep image prior (DBID) have motivated a series of methods that demonstrate a-generative approaches. We propose a new pre-generative approach that better considers the prior modeling, and a generative approach for blur kernels.
  arXiv  Detail & Related papers  (2024-07-20T09:23:56Z)
• Blind Image Deblurring with FFT-ReLU Sparsity Prior [1.179778723980276]
  Blind image deblurring is the process of recovering a sharp image from a blurred one without prior knowledge about the blur kernel. We introduce a method that leverages a prior which targets the blur kernel to achieve effective deblurring across a wide range of image types.
  arXiv  Detail & Related papers  (2024-06-12T15:51:39Z)
• BlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-Resolution [52.47005445345593]
  BlindDiff is a DM-based blind SR method to tackle the blind degradation settings in SISR. BlindDiff seamlessly integrates the MAP-based optimization into DMs. Experiments on both synthetic and real-world datasets show that BlindDiff achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-03-15T11:21:34Z)
• Unfolded Deep Kernel Estimation for Blind Image Super-resolution [23.798845090992728]
  Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise. We propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency.
  arXiv  Detail & Related papers  (2022-03-10T07:54:59Z)
• A Deep Variational Bayesian Framework for Blind Image Deblurring [46.585763459441154]
  Blind image deblurring is an important yet very challenging problem in low-level vision. We present a deep variational Bayesian framework for blind image deblurring.
  arXiv  Detail & Related papers  (2021-06-05T12:47:36Z)
• Flow-based Kernel Prior with Application to Blind Super-Resolution [143.21527713002354]
  Kernel estimation is generally one of the key problems for blind image super-resolution (SR) This paper proposes a normalizing flow-based kernel prior (FKP) for kernel modeling. Experiments on synthetic and real-world images demonstrate that the proposed FKP can significantly improve the kernel estimation accuracy.
  arXiv  Detail & Related papers  (2021-03-29T22:37:06Z)
• Blind Image Deblurring based on Kernel Mixture [0.0]
  This paper regulates the structure of the blur kernel. We propose a kernel mixture structure while using the Gaussian kernel as a base kernel. A data-driven decision for the number of base kernels to combine makes the structure even more flexible.
  arXiv  Detail & Related papers  (2021-01-15T17:56:37Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.