Restoring Real-World Degraded Events Improves Deblurring Quality

• URL: http://arxiv.org/abs/2407.20502v1
• Date: Tue, 30 Jul 2024 02:29:59 GMT
• Title: Restoring Real-World Degraded Events Improves Deblurring Quality
• Abstract summary: We model the degradation of events and propose RDNet to improve the quality of image deblurring. To better assess the deblurring performance of different methods on real-world degraded events, we present a new real-world dataset named DavisMCR.
• Score: 1.841128448495454
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Due to its high speed and low latency, DVS is frequently employed in motion deblurring. Ideally, high-quality events would adeptly capture intricate motion information. However, real-world events are generally degraded, thereby introducing significant artifacts into the deblurred results. In response to this challenge, we model the degradation of events and propose RDNet to improve the quality of image deblurring. Specifically, we first analyze the mechanisms underlying degradation and simulate paired events based on that. These paired events are then fed into the first stage of the RDNet for training the restoration model. The events restored in this stage serve as a guide for the second-stage deblurring process. To better assess the deblurring performance of different methods on real-world degraded events, we present a new real-world dataset named DavisMCR. This dataset incorporates events with diverse degradation levels, collected by manipulating environmental brightness and target object contrast. Our experiments are conducted on synthetic datasets (GOPRO), real-world datasets (REBlur), and the proposed dataset (DavisMCR). The results demonstrate that RDNet outperforms classical event denoising methods in event restoration. Furthermore, RDNet exhibits better performance in deblurring tasks compared to state-of-the-art methods. DavisMCR are available at https://github.com/Yeeesir/DVS_RDNet.

Related papers

• EvReflection: Event-Driven Micro-Dynamics for Reflection Removal [8.328713790877119]
  EvReflection is a novel event-driven reflection removal network.<n>EvReflection achieves state-of-the-art performance on both synthetic and real-world benchmarks.
  arXiv  Detail & Related papers  (2026-08-06T15:44:10Z)
• Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model [3.1333320740278623]
  Saliency prediction has been extensively studied in RGB images and videos as a computational model of human visual attention.<n>We introduce SEST (Swin Event-based Saliency Transformer), a transformer-based model for saliency prediction from event data.<n>We introduce two new benchmark datasets, N-DHF1K and N-UCF Sports, generated from large-scale RGB saliency benchmarks.
  arXiv  Detail & Related papers  (2026-05-22T15:52:01Z)
• Event-Enhanced Blurry Video Super-Resolution [52.894824081586776]
  We tackle the task of blurry video super-resolution (BVSR), aiming to generate high-resolution (HR) videos from low-resolution (LR) and blurry inputs. Current BVSR methods often fail to restore sharp details at high resolutions, resulting in noticeable artifacts and jitter. We introduce event signals into BVSR and propose a novel event-enhanced network, Ev-DeVSR.
  arXiv  Detail & Related papers  (2025-04-17T15:55:41Z)
• Bilateral Event Mining and Complementary for Event Stream Super-Resolution [28.254644673666903]
  Event Stream Super-Resolution (ESR) aims to address the challenge of insufficient spatial resolution in event streams. We propose a bilateral event mining and complementary network (BMCNet) to fully leverage the potential of each event. Our method significantly enhances the performance of event-based downstream tasks such as object recognition and video reconstruction.
  arXiv  Detail & Related papers  (2024-05-16T12:16:25Z)
• Implicit Event-RGBD Neural SLAM [54.74363487009845]
  Implicit neural SLAM has achieved remarkable progress recently. Existing methods face significant challenges in non-ideal scenarios. We propose EN-SLAM, the first event-RGBD implicit neural SLAM framework.
  arXiv  Detail & Related papers  (2023-11-18T08:48:58Z)
• DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration [66.01846902242355]
  Blind face restoration usually synthesizes degraded low-quality data with a pre-defined degradation model for training. It is expensive and infeasible to include every type of degradation to cover real-world cases in the training data. We propose Robust Degradation Remover (DR2) to first transform the degraded image to a coarse but degradation-invariant prediction, then employ an enhancement module to restore the coarse prediction to a high-quality image.
  arXiv  Detail & Related papers  (2023-03-13T06:05:18Z)
• Learning to Super-Resolve Blurry Images with Events [62.61911224564196]
  Super-Resolution from a single motion Blurred image (SRB) is a severely ill-posed problem due to the joint degradation of motion blurs and low spatial resolution. We employ events to alleviate the burden of SRB and propose an Event-enhanced SRB (E-SRB) algorithm. We show that the proposed eSL-Net++ outperforms state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2023-02-27T13:46:42Z)
• Investigating Tradeoffs in Real-World Video Super-Resolution [90.81396836308085]
  Real-world video super-resolution (VSR) models are often trained with diverse degradations to improve generalizability. To alleviate the first tradeoff, we propose a degradation scheme that reduces up to 40% of training time without sacrificing performance. To facilitate fair comparisons, we propose the new VideoLQ dataset, which contains a large variety of real-world low-quality video sequences.
  arXiv  Detail & Related papers  (2021-11-24T18:58:21Z)
• Robust Event Classification Using Imperfect Real-world PMU Data [58.26737360525643]
  We study robust event classification using imperfect real-world phasor measurement unit (PMU) data. We develop a novel machine learning framework for training robust event classifiers.
  arXiv  Detail & Related papers  (2021-10-19T17:41:43Z)
• EventSR: From Asynchronous Events to Image Reconstruction, Restoration, and Super-Resolution via End-to-End Adversarial Learning [75.17497166510083]
  Event cameras sense intensity changes and have many advantages over conventional cameras. Some methods have been proposed to reconstruct intensity images from event streams. The outputs are still in low resolution (LR), noisy, and unrealistic. We propose a novel end-to-end pipeline that reconstructs LR images from event streams, enhances the image qualities and upsamples the enhanced images, called EventSR.
  arXiv  Detail & Related papers  (2020-03-17T10:58:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.