Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurring

• URL: http://arxiv.org/abs/2404.13153v1
• Date: Fri, 19 Apr 2024 19:44:24 GMT
• Title: Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurring
• Authors: Chengxu Liu, Xuan Wang, Xiangyu Xu, Ruhao Tian, Shuai Li, Xueming Qian, Ming-Hsuan Yang,
• Abstract summary: Eliminating image blur produced by various kinds of motion has been a challenging problem. We propose a novel real-world deblurring filtering model called the Motion-adaptive Separable Collaborative Filter. Our method provides an effective solution for real-world motion blur removal and achieves state-of-the-art performance.
• Score: 71.60457491155451
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Eliminating image blur produced by various kinds of motion has been a challenging problem. Dominant approaches rely heavily on model capacity to remove blurring by reconstructing residual from blurry observation in feature space. These practices not only prevent the capture of spatially variable motion in the real world but also ignore the tailored handling of various motions in image space. In this paper, we propose a novel real-world deblurring filtering model called the Motion-adaptive Separable Collaborative (MISC) Filter. In particular, we use a motion estimation network to capture motion information from neighborhoods, thereby adaptively estimating spatially-variant motion flow, mask, kernels, weights, and offsets to obtain the MISC Filter. The MISC Filter first aligns the motion-induced blurring patterns to the motion middle along the predicted flow direction, and then collaboratively filters the aligned image through the predicted kernels, weights, and offsets to generate the output. This design can handle more generalized and complex motion in a spatially differentiated manner. Furthermore, we analyze the relationships between the motion estimation network and the residual reconstruction network. Extensive experiments on four widely used benchmarks demonstrate that our method provides an effective solution for real-world motion blur removal and achieves state-of-the-art performance. Code is available at https://github.com/ChengxuLiu/MISCFilter

Related papers

• COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation [98.05046790227561]
  COIN is a control-inpainting motion diffusion prior that enables fine-grained control to disentangle human and camera motions. COIN outperforms the state-of-the-art methods in terms of global human motion estimation and camera motion estimation.
  arXiv  Detail & Related papers  (2024-08-29T10:36:29Z)
• Engineering an Efficient Object Tracker for Non-Linear Motion [0.0]
  The goal of multi-object tracking is to detect and track all objects in a scene while maintaining unique identifiers for each. This task is especially hard in case of scenarios involving dynamic and non-linear motion patterns. In this paper, we introduce DeepMoveSORT, a novel, carefully engineered multi-object tracker designed specifically for such scenarios.
  arXiv  Detail & Related papers  (2024-06-30T15:50:54Z)
• EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformer [30.470336098766765]
  Video Motion Magnification (VMM) aims to break the resolution limit of human visual perception capability. This paper proposes a novel dynamic filtering strategy to achieve static-dynamic field adaptive denoising. We demonstrate extensive experiments that EulerMormer achieves more robust video motion magnification from the Eulerian perspective.
  arXiv  Detail & Related papers  (2023-12-07T09:10:16Z)
• Treating Motion as Option with Output Selection for Unsupervised Video Object Segmentation [17.71871884366252]
  Video object segmentation (VOS) aims to detect the most salient object in a video without external guidance about the object. Recent methods collaboratively use motion cues extracted from optical flow maps with appearance cues extracted from RGB images. We propose a novel motion-as-option network by treating motion cues as optional.
  arXiv  Detail & Related papers  (2023-09-26T09:34:13Z)
• Alignment-free HDR Deghosting with Semantics Consistent Transformer [76.91669741684173]
  High dynamic range imaging aims to retrieve information from multiple low-dynamic range inputs to generate realistic output. Existing methods often focus on the spatial misalignment across input frames caused by the foreground and/or camera motion. We propose a novel alignment-free network with a Semantics Consistent Transformer (SCTNet) with both spatial and channel attention modules.
  arXiv  Detail & Related papers  (2023-05-29T15:03:23Z)
• Adaptive Multi-source Predictor for Zero-shot Video Object Segmentation [68.56443382421878]
  We propose a novel adaptive multi-source predictor for zero-shot video object segmentation (ZVOS) In the static object predictor, the RGB source is converted to depth and static saliency sources, simultaneously. Experiments show that the proposed model outperforms the state-of-the-art methods on three challenging ZVOS benchmarks.
  arXiv  Detail & Related papers  (2023-03-18T10:19:29Z)
• A Constrained Deformable Convolutional Network for Efficient Single Image Dynamic Scene Blind Deblurring with Spatially-Variant Motion Blur Kernels Estimation [12.744989551644744]
  We propose a novel constrained deformable convolutional network (CDCN) for efficient single image dynamic scene blind deblurring. CDCN simultaneously achieves accurate spatially-variant motion blur kernels estimation and the high-quality image restoration.
  arXiv  Detail & Related papers  (2022-08-23T03:28:21Z)
• Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
  Motion blur in an image may have practical interests in fundamental computer vision problems. We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-03-04T12:45:18Z)
• Learning to Segment Rigid Motions from Two Frames [72.14906744113125]
  We propose a modular network, motivated by a geometric analysis of what independent object motions can be recovered from an egomotion field. It takes two consecutive frames as input and predicts segmentation masks for the background and multiple rigidly moving objects, which are then parameterized by 3D rigid transformations. Our method achieves state-of-the-art performance for rigid motion segmentation on KITTI and Sintel.
  arXiv  Detail & Related papers  (2021-01-11T04:20:30Z)
• Semantic Flow-guided Motion Removal Method for Robust Mapping [7.801798747561309]
  We propose a novel motion removal method, leveraging semantic information and optical flow to extract motion regions. The ORB-SLAM2 integrated with the proposed motion removal method achieved the best performance in both indoor and outdoor dynamic environments.
  arXiv  Detail & Related papers  (2020-10-14T08:40:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.