The model is the message: Lightweight convolutional autoencoders applied to noisy imaging data for planetary science and astrobiology

• URL: http://arxiv.org/abs/2507.11400v1
• Date: Tue, 15 Jul 2025 15:11:15 GMT
• Title: The model is the message: Lightweight convolutional autoencoders applied to noisy imaging data for planetary science and astrobiology
• Authors: Caleb Scharf,
• Abstract summary: The application of convolutional autoencoder deep learning to imaging data for planetary science and astrobiological use is briefly reviewed.<n>One application is the reconstruction of incomplete or noisy data.<n>It is shown that, in certain use cases, multi-color image reconstruction can be usefully applied even with extensive random destructive noise.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The application of convolutional autoencoder deep learning to imaging data for planetary science and astrobiological use is briefly reviewed and explored with a focus on the need to understand algorithmic rationale, process, and results when machine learning is utilized. Successful autoencoders train to build a model that captures the features of data in a dimensionally reduced form (the latent representation) that can then be used to recreate the original input. One application is the reconstruction of incomplete or noisy data. Here a baseline, lightweight convolutional autoencoder is used to examine the utility for planetary image reconstruction or inpainting in situations where there is destructive random noise (i.e., either luminance noise with zero returned data in some image pixels, or color noise with random additive levels across pixel channels). It is shown that, in certain use cases, multi-color image reconstruction can be usefully applied even with extensive random destructive noise with 90% areal coverage and higher. This capability is discussed in the context of intentional masking to reduce data bandwidth, or situations with low-illumination levels and other factors that obscure image data (e.g., sensor degradation or atmospheric conditions). It is further suggested that for some scientific use cases the model latent space and representations have more utility than large raw imaging datasets.

Related papers

• bit2bit: 1-bit quanta video reconstruction via self-supervised photon prediction [57.199618102578576]
  We propose bit2bit, a new method for reconstructing high-quality image stacks at original resolution from sparse binary quantatemporal image data. Inspired by recent work on Poisson denoising, we developed an algorithm that creates a dense image sequence from sparse binary photon data. We present a novel dataset containing a wide range of real SPAD high-speed videos under various challenging imaging conditions.
  arXiv  Detail & Related papers  (2024-10-30T17:30:35Z)
• Compressive Sensing with Tensorized Autoencoder [22.89029876274012]
  In many cases, different images in a collection are articulated versions of one another. In this paper, our goal is to recover images without access to the ground-truth (clean) images using the articulations as structural prior to the data. We propose to learn autoencoder with tensor ring factorization on the the embedding space to impose structural constraints on the data.
  arXiv  Detail & Related papers  (2023-03-10T22:59:09Z)
• Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction [6.907847093036819]
  Sparse-view computed tomography (CT) can be used to reduce radiation dose greatly but suffers from severe image artifacts. Deep learning based method for sparse-view CT reconstruction has attracted a major attention. We propose a patch-based denoising diffusion probabilistic model (DDPM) for sparse-view CT reconstruction.
  arXiv  Detail & Related papers  (2022-11-18T17:35:36Z)
• Noise Self-Regression: A New Learning Paradigm to Enhance Low-Light Images Without Task-Related Data [86.68013790656762]
  We propose Noise SElf-Regression (NoiSER) without access to any task-related data.<n>NoiSER is highly competitive in enhancement quality, yet with a much smaller model size, and much lower training and inference cost.
  arXiv  Detail & Related papers  (2022-11-09T06:18:18Z)
• Convolutional Deep Denoising Autoencoders for Radio Astronomical Images [0.0]
  We apply a Machine Learning technique known as Convolutional Denoising Autoencoder to denoise synthetic images of state-of-the-art radio telescopes. Our autoencoder can effectively denoise complex images identifying and extracting faint objects at the limits of the instrumental sensitivity.
  arXiv  Detail & Related papers  (2021-10-16T17:08:30Z)
• Learning to See by Looking at Noise [87.12788334473295]
  We investigate a suite of image generation models that produce images from simple random processes. These are then used as training data for a visual representation learner with a contrastive loss. Our findings show that it is important for the noise to capture certain structural properties of real data but that good performance can be achieved even with processes that are far from realistic.
  arXiv  Detail & Related papers  (2021-06-10T17:56:46Z)
• Blind microscopy image denoising with a deep residual and multiscale encoder/decoder network [0.0]
  Deep multiscale convolutional encoder-decoder neural network is proposed. The proposed model reaches on average 38.38 of PSNR and 0.98 of SSIM on a test set of 57458 images.
  arXiv  Detail & Related papers  (2021-05-01T14:54:57Z)
• Robust Data Hiding Using Inverse Gradient Attention [82.73143630466629]
  In the data hiding task, each pixel of cover images should be treated differently since they have divergent tolerabilities. We propose a novel deep data hiding scheme with Inverse Gradient Attention (IGA), combing the ideas of adversarial learning and attention mechanism. Empirically, extensive experiments show that the proposed model outperforms the state-of-the-art methods on two prevalent datasets.
  arXiv  Detail & Related papers  (2020-11-21T19:08:23Z)
• Neural Sparse Representation for Image Restoration [116.72107034624344]
  Inspired by the robustness and efficiency of sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden neurons. Experiments show that sparse representation is crucial in deep neural networks for multiple image restoration tasks.
  arXiv  Detail & Related papers  (2020-06-08T05:15:17Z)
• CycleISP: Real Image Restoration via Improved Data Synthesis [166.17296369600774]
  We present a framework that models camera imaging pipeline in forward and reverse directions. By training a new image denoising network on realistic synthetic data, we achieve the state-of-the-art performance on real camera benchmark datasets.
  arXiv  Detail & Related papers  (2020-03-17T15:20:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.