Reference-based Motion Blur Removal: Learning to Utilize Sharpness in the Reference Image

• URL: http://arxiv.org/abs/2307.02875v1
• Date: Thu, 6 Jul 2023 09:24:55 GMT
• Title: Reference-based Motion Blur Removal: Learning to Utilize Sharpness in the Reference Image
• Authors: Han Zou, Masanori Suganuma, Takayuki Okatani
• Abstract summary: A typical setting is deburring an image using a nearby sharp image in a video sequence. This paper proposes a better method to use the information present in a reference image. Our method can be integrated into pre-existing networks designed for single image deblurring.
• Score: 29.52731707976695
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the recent advancement in the study of removing motion blur in an image, it is still hard to deal with strong blurs. While there are limits in removing blurs from a single image, it has more potential to use multiple images, e.g., using an additional image as a reference to deblur a blurry image. A typical setting is deburring an image using a nearby sharp image(s) in a video sequence, as in the studies of video deblurring. This paper proposes a better method to use the information present in a reference image. The method does not need a strong assumption on the reference image. We can utilize an alternative shot of the identical scene, just like in video deblurring, or we can even employ a distinct image from another scene. Our method first matches local patches of the target and reference images and then fuses their features to estimate a sharp image. We employ a patch-based feature matching strategy to solve the difficult problem of matching the blurry image with the sharp reference. Our method can be integrated into pre-existing networks designed for single image deblurring. The experimental results show the effectiveness of the proposed method.

Related papers

• Blur2Blur: Blur Conversion for Unsupervised Image Deblurring on Unknown Domains [19.573629029170128]
  This paper presents an innovative framework designed to train an image deblurring algorithm tailored to a specific camera device. It works by transforming a blurry input image, which is challenging to deblur, into another blurry image that is more amenable to deblurring.
  arXiv  Detail & Related papers  (2024-03-24T15:58:48Z)
• Semi-Blind Image Deblurring Based on Framelet Prior [0.3626013617212666]
  Image blurring is caused by various factors such as hand or camera shake. To restore the blurred image, it is necessary to know information about the point spread function (PSF)
  arXiv  Detail & Related papers  (2023-10-02T07:25:05Z)
• Multi-level Cross-modal Feature Alignment via Contrastive Learning towards Zero-shot Classification of Remote Sensing Image Scenes [7.17717863134783]
  Cross-modal feature alignment methods have been proposed to address the zero-shot image scene classification. We propose a multi-level cross-modal feature alignment method via contrastive learning for zero-shot classification of remote sensing image scenes. Our proposed method outperforms state of the art methods for zero-shot remote sensing image scene classification.
  arXiv  Detail & Related papers  (2023-05-31T10:00:45Z)
• Parallax-Tolerant Unsupervised Deep Image Stitching [57.76737888499145]
  We propose UDIS++, a parallax-tolerant unsupervised deep image stitching technique. First, we propose a robust and flexible warp to model the image registration from global homography to local thin-plate spline motion. To further eliminate the parallax artifacts, we propose to composite the stitched image seamlessly by unsupervised learning for seam-driven composition masks.
  arXiv  Detail & Related papers  (2023-02-16T10:40:55Z)
• Take a Prior from Other Tasks for Severe Blur Removal [52.380201909782684]
  Cross-level feature learning strategy based on knowledge distillation to learn the priors. Semantic prior embedding layer with multi-level aggregation and semantic attention transformation to integrate the priors effectively. Experiments on natural image deblurring benchmarks and real-world images, such as GoPro and RealBlur datasets, demonstrate our method's effectiveness and ability.
  arXiv  Detail & Related papers  (2023-02-14T08:30:51Z)
• Saliency Constrained Arbitrary Image Style Transfer using SIFT and DCNN [22.57205921266602]
  When common neural style transfer methods are used, the textures and colors in the style image are usually transferred imperfectly to the content image. This paper proposes a novel saliency constrained method to reduce or avoid such effects. The experiments show that the saliency maps of source images can help find the correct matching and avoid artifacts.
  arXiv  Detail & Related papers  (2022-01-14T09:00:55Z)
• Clean Images are Hard to Reblur: A New Clue for Deblurring [56.28655168605079]
  We propose a novel low-level perceptual loss to make image sharper. To better focus on image blurriness, we train a reblurring module amplifying the unremoved motion blur. The supervised reblurring loss at training stage compares the amplified blur between the deblurred image and the reference sharp image. The self-blurring loss at inference stage inspects if the deblurred image still contains noticeable blur to be amplified.
  arXiv  Detail & Related papers  (2021-04-26T15:49:21Z)
• Polyblur: Removing mild blur by polynomial reblurring [21.08846905569241]
  The proposed algorithm first estimates image blur and then compensates for it by combining multiple applications of the estimated blur in a principled way. Our experiments show that, in the context of mild blur, the proposed method outperforms traditional and modern blind deblurring methods and runs in a fraction of the time.
  arXiv  Detail & Related papers  (2020-12-16T23:38:39Z)
• Contrastive Learning for Unpaired Image-to-Image Translation [64.47477071705866]
  In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a framework based on contrastive learning to maximize mutual information between the two. We demonstrate that our framework enables one-sided translation in the unpaired image-to-image translation setting, while improving quality and reducing training time.
  arXiv  Detail & Related papers  (2020-07-30T17:59:58Z)
• Deblurring by Realistic Blurring [110.54173799114785]
  We propose a new method which combines two GAN models, i.e., a learning-to-blurr GAN (BGAN) and learning-to-DeBlur GAN (DBGAN) The first model, BGAN, learns how to blur sharp images with unpaired sharp and blurry image sets, and then guides the second model, DBGAN, to learn how to correctly deblur such images. As an additional contribution, this paper also introduces a Real-World Blurred Image (RWBI) dataset including diverse blurry images.
  arXiv  Detail & Related papers  (2020-04-04T05:25:15Z)
• Self-Supervised Linear Motion Deblurring [112.75317069916579]
  Deep convolutional neural networks are state-of-the-art for image deblurring. We present a differentiable reblur model for self-supervised motion deblurring. Our experiments demonstrate that self-supervised single image deblurring is really feasible.
  arXiv  Detail & Related papers  (2020-02-10T20:15:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.