Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Framework

• URL: http://arxiv.org/abs/2407.08377v2
• Date: Wed, 17 Jul 2024 07:26:01 GMT
• Title: Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Framework
• Authors: Shengqi Xu, Run Sun, Yi Chang, Shuning Cao, Xueyao Xiao, Luxin Yan,
• Abstract summary: We construct a large-scale real long-range atmospheric turbulence dataset (RLR-AT) This dataset includes 1500 turbulence sequences spanning distances from 1 Km to 13 Km. We propose a coarse-to-fine framework to handle severe distortions, which cooperates dynamic turbulence and static background priors.
• Score: 12.869617522032986
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Long-range imaging inevitably suffers from atmospheric turbulence with severe geometric distortions due to random refraction of light. The further the distance, the more severe the disturbance. Despite existing research has achieved great progress in tackling short-range turbulence, there is less attention paid to long-range turbulence with significant distortions. To address this dilemma and advance the field, we construct a large-scale real long-range atmospheric turbulence dataset (RLR-AT), including 1500 turbulence sequences spanning distances from 1 Km to 13 Km. The advantages of RLR-AT compared to existing ones: turbulence with longer-distances and higher-diversity, scenes with greater-variety and larger-scale. Moreover, most existing work adopts either registration-based or decomposition-based methods to address distortions through one-step mitigation. However, they fail to effectively handle long-range turbulence due to its significant pixel displacements. In this work, we propose a coarse-to-fine framework to handle severe distortions, which cooperates dynamic turbulence and static background priors (CDSP). On the one hand, we discover the pixel motion statistical prior of turbulence, and propose a frequency-aware reference frame for better large-scale distortion registration, greatly reducing the burden of refinement. On the other hand, we take advantage of the static prior of background, and propose a subspace-based low-rank tensor refinement model to eliminate the misalignments inevitably left by registration while well preserving details. The dynamic and static priors complement to each other, facilitating us to progressively mitigate long-range turbulence with severe distortions. Extensive experiments demonstrate that the proposed method outperforms SOTA methods on different datasets.

Related papers

• Non rigid geometric distortions correction -- Application to atmospheric turbulence stabilization [2.4094285826152597]
  A novel approach is presented to recover an image degraded by atmospheric turbulence. Given a sequence of frames affected by turbulence, we construct a variational model to characterize the static image. Our algorithm is simple, efficient, and can be easily generalized for different scenarios.
  arXiv  Detail & Related papers  (2024-11-04T04:21:41Z)
• Spatio-Temporal Turbulence Mitigation: A Translational Perspective [13.978156774471744]
  We present the Deep Atmospheric TUrbulence Mitigation network ( DATUM) DATUM aims to overcome major challenges when transitioning from classical to deep learning approaches. A large-scale training dataset, ATSyn, is presented as a co-invention to enable generalization in real turbulence.
  arXiv  Detail & Related papers  (2024-01-08T21:35:05Z)
• Low-Light Image Enhancement with Wavelet-based Diffusion Models [50.632343822790006]
  Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration. We propose a robust and efficient Diffusion-based Low-Light image enhancement approach, dubbed DiffLL.
  arXiv  Detail & Related papers  (2023-06-01T03:08:28Z)
• Semidefinite Relaxations for Robust Multiview Triangulation [53.360555898338106]
  We extend existing relaxation approaches to non-robust multiview triangulation by incorporating a truncated least squares cost function. We demonstrate through extensive experiments that the proposed approaches allow us to compute provably optimal reconstructions even under significant noise and a large percentage of outliers.
  arXiv  Detail & Related papers  (2023-01-26T21:31:32Z)
• Diffusion Posterior Sampling for General Noisy Inverse Problems [50.873313752797124]
  We extend diffusion solvers to handle noisy (non)linear inverse problems via approximation of the posterior sampling. Our method demonstrates that diffusion models can incorporate various measurement noise statistics.
  arXiv  Detail & Related papers  (2022-09-29T11:12:27Z)
• AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [64.24948495708337]
  Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
  arXiv  Detail & Related papers  (2022-08-24T03:13:04Z)
• Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model [82.23276183684001]
  We propose a physics-inspired transformer model for imaging through atmospheric turbulence. The proposed network utilizes the power of transformer blocks to jointly extract a dynamical turbulence distortion map. We present two new real-world turbulence datasets that allow for evaluation with both classical objective metrics and a new task-driven metric using text recognition accuracy.
  arXiv  Detail & Related papers  (2022-07-20T17:09:16Z)
• T$^2$-Net: A Semi-supervised Deep Model for Turbulence Forecasting [65.498967509424]
  Air turbulence forecasting can help airlines avoid hazardous turbulence, guide routes that keep passengers safe, maximize efficiency, reduce costs. Traditional forecasting approaches rely on painstakingly customized turbulence indexes, which are less effective in dynamic and complex weather conditions. We propose a machine learning based turbulence forecasting system due to two challenges: (1) Complex-temporal correlations, and (2) scarcity, very limited turbulence labels can be obtained.
  arXiv  Detail & Related papers  (2020-10-26T21:14:15Z)
• Image Reconstruction of Static and Dynamic Scenes through Anisoplanatic Turbulence [1.6114012813668934]
  We present a unified method for atmospheric turbulence mitigation in both static and dynamic sequences. We are able to achieve better results compared to existing methods by utilizing a novel space-time non-local averaging method.
  arXiv  Detail & Related papers  (2020-08-31T19:20:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.