EvTurb: Event Camera Guided Turbulence Removal
- URL: http://arxiv.org/abs/2508.10582v1
- Date: Thu, 14 Aug 2025 12:22:18 GMT
- Title: EvTurb: Event Camera Guided Turbulence Removal
- Authors: Yixing Liu, Minggui Teng, Yifei Xia, Peiqi Duan, Boxin Shi,
- Abstract summary: Atmospheric turbulence degrades image quality by introducing blur and geometric tilt distortions.<n>We propose EvTurb, an event guided turbulence removal framework.<n>We present TurbEvent, the first real-captured dataset featuring diverse turbulence scenarios.
- Score: 48.08239137843974
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Atmospheric turbulence degrades image quality by introducing blur and geometric tilt distortions, posing significant challenges to downstream computer vision tasks. Existing single-image and multi-frame methods struggle with the highly ill-posed nature of this problem due to the compositional complexity of turbulence-induced distortions. To address this, we propose EvTurb, an event guided turbulence removal framework that leverages high-speed event streams to decouple blur and tilt effects. EvTurb decouples blur and tilt effects by modeling event-based turbulence formation, specifically through a novel two-step event-guided network: event integrals are first employed to reduce blur in the coarse outputs. This is followed by employing a variance map, derived from raw event streams, to eliminate the tilt distortion for the refined outputs. Additionally, we present TurbEvent, the first real-captured dataset featuring diverse turbulence scenarios. Experimental results demonstrate that EvTurb surpasses state-of-the-art methods while maintaining computational efficiency.
Related papers
- EvDiff: High Quality Video with an Event Camera [77.07279880903009]
Reconstructing intensity images from events is a highly ill-posed task due to the inherent ambiguity of absolute brightness.<n>We propose EvDiff, an event-based diffusion model that follows a surrogate training framework to produce high-quality videos.
arXiv Detail & Related papers (2025-11-21T18:49:18Z) - EGTM: Event-guided Efficient Turbulence Mitigation [19.09752432962073]
Turbulence mitigation (TM) aims to remove the distortions and blurs introduced by atmospheric turbulence into frame cameras.<n>We present a novel EGTM framework that extracts pixel-level reliable turbulence-free guidance from noisy turbulent events for temporal lucky fusion.<n>We build the first turbulence data acquisition system to contribute the first real-world event-driven TM dataset.
arXiv Detail & Related papers (2025-09-04T01:49:13Z) - Blur Interpolation Transformer for Real-World Motion from Blur [52.10523711510876]
We propose a encoded blur transformer (BiT) to unravel the underlying temporal correlation in blur.
Based on multi-scale residual Swin transformer blocks, we introduce dual-end temporal supervision and temporally symmetric ensembling strategies.
In addition, we design a hybrid camera system to collect the first real-world dataset of one-to-many blur-sharp video pairs.
arXiv Detail & Related papers (2022-11-21T13:10:10Z) - AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using
Denoising Diffusion Probabilistic Models [64.24948495708337]
Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion.
Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed.
Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
arXiv Detail & Related papers (2022-08-24T03:13:04Z) - Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A
New Physics-Inspired Transformer Model [82.23276183684001]
We propose a physics-inspired transformer model for imaging through atmospheric turbulence.
The proposed network utilizes the power of transformer blocks to jointly extract a dynamical turbulence distortion map.
We present two new real-world turbulence datasets that allow for evaluation with both classical objective metrics and a new task-driven metric using text recognition accuracy.
arXiv Detail & Related papers (2022-07-20T17:09:16Z) - Imaging through the Atmosphere using Turbulence Mitigation Transformer [15.56320865332645]
Restoring images distorted by atmospheric turbulence is a ubiquitous problem in long-range imaging applications.
Existing deep-learning-based methods have demonstrated promising results in specific testing conditions.
We introduce the turbulence mitigation transformer (TMT) that explicitly addresses these issues.
arXiv Detail & Related papers (2022-07-13T18:33:26Z) - T$^2$-Net: A Semi-supervised Deep Model for Turbulence Forecasting [65.498967509424]
Air turbulence forecasting can help airlines avoid hazardous turbulence, guide routes that keep passengers safe, maximize efficiency, reduce costs.
Traditional forecasting approaches rely on painstakingly customized turbulence indexes, which are less effective in dynamic and complex weather conditions.
We propose a machine learning based turbulence forecasting system due to two challenges: (1) Complex-temporal correlations, and (2) scarcity, very limited turbulence labels can be obtained.
arXiv Detail & Related papers (2020-10-26T21:14:15Z) - Learning to Restore a Single Face Image Degraded by Atmospheric
Turbulence using CNNs [93.72048616001064]
Images captured under such condition suffer from a combination of geometric deformation and space varying blur.
We present a deep learning-based solution to the problem of restoring a turbulence-degraded face image.
arXiv Detail & Related papers (2020-07-16T15:25:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.