High-Quality and Efficient Turbulence Mitigation with Events

• URL: http://arxiv.org/abs/2603.20708v1
• Date: Sat, 21 Mar 2026 08:10:20 GMT
• Title: High-Quality and Efficient Turbulence Mitigation with Events
• Abstract summary: Turbulence mitigation (TM) is ill-posed due to the nature of atmospheric turbulence.<n>Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios.<n>We present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences.
• Score: 36.16150258581428
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent ``event tubes'' in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively. Our code is available at: https://github.com/Xavier667/EHETM.

Related papers

• ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes [4.282240730573401]
  Atmospheric turbulence severely degrades video quality by introducing distortions such as geometric warping, blur, and temporal flickering.<n>We propose ReMATF, a lightweight recurrent framework that restores videos using only two frames at a time while preserving spatial detail and temporal stability.
  arXiv  Detail & Related papers  (2026-05-20T17:28:49Z)
• EvDiff: High Quality Video with an Event Camera [77.07279880903009]
  Reconstructing intensity images from events is a highly ill-posed task due to the inherent ambiguity of absolute brightness.<n>We propose EvDiff, an event-based diffusion model that follows a surrogate training framework to produce high-quality videos.
  arXiv  Detail & Related papers  (2025-11-21T18:49:18Z)
• HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking [80.07224739976911]
  Event cameras offer exceptional temporal resolution and a range (modal)<n> RGB cameras excel at capturing rich texture with high resolution, whereas event cameras offer exceptional temporal resolution and a range (modal)
  arXiv  Detail & Related papers  (2025-10-22T13:15:13Z)
• EGTM: Event-guided Efficient Turbulence Mitigation [19.09752432962073]
  Turbulence mitigation (TM) aims to remove the distortions and blurs introduced by atmospheric turbulence into frame cameras.<n>We present a novel EGTM framework that extracts pixel-level reliable turbulence-free guidance from noisy turbulent events for temporal lucky fusion.<n>We build the first turbulence data acquisition system to contribute the first real-world event-driven TM dataset.
  arXiv  Detail & Related papers  (2025-09-04T01:49:13Z)
• RMFAT: Recurrent Multi-scale Feature Atmospheric Turbulence Mitigator [4.021926055330021]
  Atmospheric turbulence severely degrades video quality by introducing distortions such as geometric warping, blur, and temporal flickering.<n>We propose RMFAT: Recurrent Multi-scale Feature Atmospheric Turbulence Mitigator, designed for efficient and temporally consistent video restoration under AT conditions.
  arXiv  Detail & Related papers  (2025-08-15T11:20:18Z)
• EvTurb: Event Camera Guided Turbulence Removal [48.08239137843974]
  Atmospheric turbulence degrades image quality by introducing blur and geometric tilt distortions.<n>We propose EvTurb, an event guided turbulence removal framework.<n>We present TurbEvent, the first real-captured dataset featuring diverse turbulence scenarios.
  arXiv  Detail & Related papers  (2025-08-14T12:22:18Z)
• PMR: Physical Model-Driven Multi-Stage Restoration of Turbulent Dynamic Videos [9.48544376032391]
  We introduce a Dynamic Efficiency Index ($DEI$), which combines turbulence intensity, optical flow, and proportions of dynamic regions to accurately quantify video dynamic intensity under varying turbulence conditions.<n>We also propose a Physical Model-Driven Multi-Stage Video Restoration ($PMR$) framework that consists of three stages: textbfde-tilting for geometric stabilization, textbfmotion segmentation enhancement, and textbfde-blurring for quality restoration.<n>$PMR$ employs lightweight backbones and stage-wise joint training to ensure both efficiency and high restoration quality.
  arXiv  Detail & Related papers  (2025-08-01T08:06:41Z)
• SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields [12.428456822446947]
  Event cameras offer advantages such as low latency, low power consumption, low bandwidth, and high dynamic range.<n>Reconstructing geometrically consistent and photometrically accurate 3D representations from event data remains fundamentally challenging.<n>We present SaENeRF, a novel self-supervised framework that effectively suppresses artifacts and enables 3D-consistent, dense radiance, and photorealistic NeRF reconstruction of static scenes solely from event streams.
  arXiv  Detail & Related papers  (2025-04-23T03:33:20Z)
• AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [64.24948495708337]
  Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
  arXiv  Detail & Related papers  (2022-08-24T03:13:04Z)
• Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model [82.23276183684001]
  We propose a physics-inspired transformer model for imaging through atmospheric turbulence. The proposed network utilizes the power of transformer blocks to jointly extract a dynamical turbulence distortion map. We present two new real-world turbulence datasets that allow for evaluation with both classical objective metrics and a new task-driven metric using text recognition accuracy.
  arXiv  Detail & Related papers  (2022-07-20T17:09:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.