AtomDiffuser: Time-Aware Degradation Modeling for Drift and Beam Damage in STEM Imaging

• URL: http://arxiv.org/abs/2508.10359v1
• Date: Thu, 14 Aug 2025 05:56:31 GMT
• Title: AtomDiffuser: Time-Aware Degradation Modeling for Drift and Beam Damage in STEM Imaging
• Abstract summary: AtomDiffuser is a time-aware degradation modeling framework for scanning transmission electron microscopy.<n>It disentangles sample drift and attenuation by predicting an affine transformation and a spatially varying decay map.<n>It supports high-resolution degradation inference and drift alignment, offering tools for visualizing and quantifying degradation patterns.
• Score: 9.740325299883024
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Scanning transmission electron microscopy (STEM) plays a critical role in modern materials science, enabling direct imaging of atomic structures and their evolution under external interferences. However, interpreting time-resolved STEM data remains challenging due to two entangled degradation effects: spatial drift caused by mechanical and thermal instabilities, and beam-induced signal loss resulting from radiation damage. These factors distort both geometry and intensity in complex, temporally correlated ways, making it difficult for existing methods to explicitly separate their effects or model material dynamics at atomic resolution. In this work, we present AtomDiffuser, a time-aware degradation modeling framework that disentangles sample drift and radiometric attenuation by predicting an affine transformation and a spatially varying decay map between any two STEM frames. Unlike traditional denoising or registration pipelines, our method leverages degradation as a physically heuristic, temporally conditioned process, enabling interpretable structural evolutions across time. Trained on synthetic degradation processes, AtomDiffuser also generalizes well to real-world cryo-STEM data. It further supports high-resolution degradation inference and drift alignment, offering tools for visualizing and quantifying degradation patterns that correlate with radiation-induced atomic instabilities.

Related papers

• Scale-Aware Adversarial Analysis: A Diagnostic for Generative AI in Multiscale Complex Systems [5.173587482427292]
  We introduce a diagnostic framework driven by Constrained Diffusion Decomposition (CDD)<n>We execute deterministic interventions directly within the continuous, CDD-based scale space.<n>We demonstrate that under moderate physical perturbations, the unconstrained generative model exhibits localized structural freezing and non-linear instability.
  arXiv  Detail & Related papers  (2026-05-01T08:36:52Z)
• Architectural Unification for Polarimetric Imaging Across Multiple Degradations [54.83037963738918]
  We propose a unified architectural framework for polarimetric imaging that is structurally shared across multiple degradation scenarios.<n>The model performs single-stage joint image-Stokes processing, avoiding error accumulation and explicitly preserving physical consistency.
  arXiv  Detail & Related papers  (2026-03-06T02:38:57Z)
• Continuous Exposure-Time Modeling for Realistic Atmospheric Turbulence Synthesis [65.19146708498346]
  Atmospheric turbulence significantly degrades long-range imaging by introducing geometric warping and exposure-timedependent blur.<n>Existing methods for turbulence effects often oversimplify the relationship between blur and exposure-time.<n>We construct ET-Turb, a large-scale synthetic turbulence dataset that explicitly incorporates continuous exposure-time modeling.
  arXiv  Detail & Related papers  (2026-03-02T02:58:44Z)
• CASCADE: Cross-scale Advective Super-resolution with Climate Assimilation and Downscaling Evolution [51.56484100374058]
  CASCADE reconstructs fine structure by iteratively advecting coarse information along learned, flow-conditioned velocity warping fields.<n> evaluated on SEVIR radar data for 4x super-resolution of severe convective storms.<n> produces temporally coherent, physically consistent, and mass-conserving reconstructions well suited to advection-dominated extremes in atmospheric and oceanic applications.
  arXiv  Detail & Related papers  (2026-02-18T14:41:54Z)
• Latent Causal Diffusions for Single-Cell Perturbation Modeling [83.47931153555321]
  We present a generative model that frames single-cell gene expression as a stationary diffusion process observed under measurement noise.<n> LCD outperforms established approaches in predicting the distributional shifts of unseen perturbation combinations in single-cell RNA-sequencing screens.<n>We develop an approach we call causal linearization via perturbation responses (CLIPR), which yields an approximation of the direct causal effects between all genes.
  arXiv  Detail & Related papers  (2026-01-20T16:15:38Z)
• HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking [80.07224739976911]
  Event cameras offer exceptional temporal resolution and a range (modal)<n> RGB cameras excel at capturing rich texture with high resolution, whereas event cameras offer exceptional temporal resolution and a range (modal)
  arXiv  Detail & Related papers  (2025-10-22T13:15:13Z)
• PhyDAE: Physics-Guided Degradation-Adaptive Experts for All-in-One Remote Sensing Image Restoration [8.834663340762562]
  complex and heterogeneous degradations pose severe challenges to image quality and downstream interpretation tasks.<n>This paper proposes Physics-Guided Degradation-Adaptive Experts (PhyDAE)<n>The method employs a two-stage cascaded architecture transforming degradation information from implicit features into explicit decision signals.<n>PhyDAE substantially improves restoration quality while achieving significant reductions in parameter count and computational complexity.
  arXiv  Detail & Related papers  (2025-10-09T08:14:24Z)
• Direct Dual-Energy CT Material Decomposition using Model-based Denoising Diffusion Model [105.95160543743984]
  We propose a deep learning procedure called Dual-Energy Decomposition Model-based Diffusion (DEcomp-MoD) for quantitative material decomposition.<n>We show that DEcomp-MoD outperform state-of-the-art unsupervised score-based model and supervised deep learning networks.
  arXiv  Detail & Related papers  (2025-07-24T01:00:06Z)
• Physical Degradation Model-Guided Interferometric Hyperspectral Reconstruction with Unfolding Transformer [10.761506243784744]
  Interferometric Hyperspectral Imaging (IHI) is a critical technique for large-scale remote sensing tasks.<n>IHI is susceptible to complex errors arising from imaging steps, and its quality is limited by existing signal processing-based reconstruction algorithms.<n>We propose a novel IHI reconstruction pipeline to address two key challenges: the lack of training datasets and the difficulty in eliminating IHI-specific degradation components.
  arXiv  Detail & Related papers  (2025-06-27T03:36:00Z)
• 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning [79.60829508459753]
  Current commercial Digital Subtraction Angiography (DSA) systems typically demand hundreds of scanning views to perform reconstruction. The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task. We propose to use a time-agnostic vessel probability field to solve this problem effectively.
  arXiv  Detail & Related papers  (2024-05-17T11:23:33Z)
• Solving Energy-Independent Density for CT Metal Artifact Reduction via Neural Representation [46.57879724994237]
  Reconstructing CT images from metal-corrupted measurements becomes a challenging nonlinear inverse problem.<n>Existing state-of-the-art (SOTA) metal artifact reduction (MAR) algorithms rely on supervised learning with numerous paired CT samples.<n>In this work, we propose Density neural representation (Diner), a novel unsupervised MAR method.
  arXiv  Detail & Related papers  (2024-05-11T16:30:39Z)
• Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning [5.109422776828829]
  We present an end-to-end, self-supervised machine learning approach to recover particle orientations and estimate reciprocal space intensities from diffraction images only. Our method demonstrates great robustness under demanding experimental conditions with significantly enhanced reconstruction capabilities compared with conventional algorithms.
  arXiv  Detail & Related papers  (2023-11-28T10:05:44Z)
• Physics-Driven Turbulence Image Restoration with Stochastic Refinement [80.79900297089176]
  Image distortion by atmospheric turbulence is a critical problem in long-range optical imaging systems. Fast and physics-grounded simulation tools have been introduced to help the deep-learning models adapt to real-world turbulence conditions. This paper proposes the Physics-integrated Restoration Network (PiRN) to help the network to disentangle theity from the degradation and the underlying image.
  arXiv  Detail & Related papers  (2023-07-20T05:49:21Z)
• TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecasting [8.086595073181604]
  Time-series forecasting can address real-world problems across various domains, including energy, weather, traffic, and economy. Time-series forecasting is a well-researched field, predicting complex temporal patterns such as sudden changes in sequential data still poses a challenge with current models. We propose a novel, compact loss function called TILDEQ that considers not only amplitude and phase distortions but also allows models to capture the shape of time-series sequences.
  arXiv  Detail & Related papers  (2022-10-26T21:32:20Z)
• AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models [64.24948495708337]
  Atmospheric turbulence causes significant degradation to image quality by introducing blur and geometric distortion. Various deep learning-based single image atmospheric turbulence mitigation methods, including CNN-based and GAN inversion-based, have been proposed. Denoising Diffusion Probabilistic Models (DDPMs) have recently gained some traction because of their stable training process and their ability to generate high quality images.
  arXiv  Detail & Related papers  (2022-08-24T03:13:04Z)
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data [137.47124933818066]
  We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture. We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
  arXiv  Detail & Related papers  (2022-02-22T15:39:00Z)
• Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders [0.0]
  We develop shift-invariant variational autoencoders (shift-VAE) that allow disentangling characteristic repeating features in the images. We show that shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction.
  arXiv  Detail & Related papers  (2021-06-23T15:39:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.