Deep learning image burst stacking to reconstruct high-resolution ground-based solar observations

• URL: http://arxiv.org/abs/2506.04781v1
• Date: Thu, 05 Jun 2025 09:10:31 GMT
• Title: Deep learning image burst stacking to reconstruct high-resolution ground-based solar observations
• Authors: Christoph Schirninger, Robert Jarolim, Astrid M. Veronig, Christoph Kuckein,
• Abstract summary: Current reconstruction methods using short exposure bursts face challenges with strong turbulence and high computational costs.<n>We introduce a deep learning approach that reconstructs 100 short exposure images into one high quality image in real time.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large aperture ground based solar telescopes allow the solar atmosphere to be resolved in unprecedented detail. However, observations are limited by Earths turbulent atmosphere, requiring post image corrections. Current reconstruction methods using short exposure bursts face challenges with strong turbulence and high computational costs. We introduce a deep learning approach that reconstructs 100 short exposure images into one high quality image in real time. Using unpaired image to image translation, our model is trained on degraded bursts with speckle reconstructions as references, improving robustness and generalization. Our method shows an improved robustness in terms of perceptual quality, especially when speckle reconstructions show artifacts. An evaluation with a varying number of images per burst demonstrates that our method makes efficient use of the combined image information and achieves the best reconstructions when provided with the full image burst.

Related papers

• Astrophotography turbulence mitigation via generative models [3.435619322951694]
  Most astronomical images captured by ground-based telescopes suffer from atmospheric turbulence, resulting in degraded imaging quality.<n>We propose AstroDiff, a generative restoration method that leverages both the high-quality generative priors and restoration capabilities of diffusion models to mitigate atmospheric turbulence.
  arXiv  Detail & Related papers  (2025-06-03T15:18:48Z)
• AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesis [57.249817395828174]
  We propose a scalable framework combining pseudo-synthetic renderings from 3D city-wide meshes with real, ground-level crowd-sourced images.<n>The pseudo-synthetic data simulates a wide range of aerial viewpoints, while the real, crowd-sourced images help improve visual fidelity for ground-level images.<n>Using this hybrid dataset, we fine-tune several state-of-the-art algorithms and achieve significant improvements on real-world, zero-shot aerial-ground tasks.
  arXiv  Detail & Related papers  (2025-04-17T17:57:05Z)
• Exposure Bracketing Is All You Need For A High-Quality Image [50.822601495422916]
  Multi-exposure images are complementary in denoising, deblurring, high dynamic range imaging, and super-resolution.<n>We propose to utilize exposure bracketing photography to get a high-quality image by combining these tasks in this work.<n>In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed.
  arXiv  Detail & Related papers  (2024-01-01T14:14:35Z)
• Reconstruction Distortion of Learned Image Compression with Imperceptible Perturbations [69.25683256447044]
  We introduce an attack approach designed to effectively degrade the reconstruction quality of Learned Image Compression (LIC) We generate adversarial examples by introducing a Frobenius norm-based loss function to maximize the discrepancy between original images and reconstructed adversarial examples. Experiments conducted on the Kodak dataset using various LIC models demonstrate effectiveness.
  arXiv  Detail & Related papers  (2023-06-01T20:21:05Z)
• Infrared Image Deturbulence Restoration Using Degradation Parameter-Assisted Wide & Deep Learning [12.305318121246277]
  We propose DparNet, a parameter-assisted multi-frame network with a wide & deep architecture.<n>DparNet learns a degradation prior directly from degraded images without external knowledge.<n>It significantly outperforms State-of-the-Art (SOTA) methods in restoration performance and efficiency.
  arXiv  Detail & Related papers  (2023-05-30T03:24:09Z)
• Learning to restore images degraded by atmospheric turbulence using uncertainty [93.72048616001064]
  Atmospheric turbulence can significantly degrade the quality of images acquired by long-range imaging systems. We propose a deep learning-based approach for restring a single image degraded by atmospheric turbulence.
  arXiv  Detail & Related papers  (2022-07-07T17:24:52Z)
• S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Image [2.469794902645761]
  We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single image. Compared to state-of-the-art methods, our method achieves more visually appealing reconstruction.
  arXiv  Detail & Related papers  (2022-03-15T08:55:45Z)
• Underwater Image Restoration via Contrastive Learning and a Real-world Dataset [59.35766392100753]
  We present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images.
  arXiv  Detail & Related papers  (2021-06-20T16:06:26Z)
• Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing [49.759478460828504]
  Methods combining deep neural network encoders with differentiable rendering have opened up the path for very fast monocular reconstruction of geometry, lighting and reflectance. ray tracing was introduced for monocular face reconstruction within a classic optimization-based framework. We propose a new method that greatly improves reconstruction quality and robustness in general scenes.
  arXiv  Detail & Related papers  (2021-03-29T08:58:10Z)
• Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets [11.96518190758417]
  We propose a new data-driven image restoration method based on generative adversarial networks with option-driven learning. Our method can obtain very stable image restoration results, regardless of the number of reference images.
  arXiv  Detail & Related papers  (2020-11-07T05:05:55Z)
• Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images [59.906948203578544]
  We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object. We first estimate per-view depth maps using a deep multi-view stereo network. These depth maps are used to coarsely align the different views. We propose a novel multi-view reflectance estimation network architecture.
  arXiv  Detail & Related papers  (2020-03-27T21:28:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.