Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders

• URL: http://arxiv.org/abs/2106.12472v1
• Date: Wed, 23 Jun 2021 15:39:07 GMT
• Title: Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders
• Authors: Maxim Ziatdinov, Chun Yin Wong, and Sergei V. Kalinin
• Abstract summary: We develop shift-invariant variational autoencoders (shift-VAE) that allow disentangling characteristic repeating features in the images. We show that shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in scanning tunneling and transmission electron microscopies (STM and STEM) have allowed routine generation of large volumes of imaging data containing information on the structure and functionality of materials. The experimental data sets contain signatures of long-range phenomena such as physical order parameter fields, polarization and strain gradients in STEM, or standing electronic waves and carrier-mediated exchange interactions in STM, all superimposed onto scanning system distortions and gradual changes of contrast due to drift and/or mis-tilt effects. Correspondingly, while the human eye can readily identify certain patterns in the images such as lattice periodicities, repeating structural elements, or microstructures, their automatic extraction and classification are highly non-trivial and universal pathways to accomplish such analyses are absent. We pose that the most distinctive elements of the patterns observed in STM and (S)TEM images are similarity and (almost-) periodicity, behaviors stemming directly from the parsimony of elementary atomic structures, superimposed on the gradual changes reflective of order parameter distributions. However, the discovery of these elements via global Fourier methods is non-trivial due to variability and lack of ideal discrete translation symmetry. To address this problem, we develop shift-invariant variational autoencoders (shift-VAE) that allow disentangling characteristic repeating features in the images, their variations, and shifts inevitable for random sampling of image space. Shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction. This approach is illustrated for model 1D data, and further extended to synthetic and experimental STM and STEM 2D data.

Related papers

• Noise Calibration and Spatial-Frequency Interactive Network for STEM Image Enhancement [8.497362811837627]
  In this paper, we develop noise calibration, data synthesis, and enhancement methods for STEM images. We first present a STEM noise calibration method, which is used to synthesize more realistic STEM images. We then use these parameters to develop a more general dataset that considers both regular and random atomic arrangements. Finally, we design a spatial-frequency interactive network for STEM image enhancement, which can explore the information in the frequency domain formed by the periodicity of atomic arrangement.
  arXiv  Detail & Related papers  (2025-04-03T13:11:57Z)
• Characterizing Nonlinear Dynamics via Smooth Prototype Equivalences [10.04533025864868]
  We introduce smooth prototype equivalences (SPE), a framework that fits a diffeomorphism using normalizing flows to distinct prototypes. SPE enables classification by comparing the deformation loss of the observed sparse, high-dimensional measurements to the prototype dynamics. We show how our method can be used for the detection of biological processes like the cell cycle trajectory from high-dimensional single-cell gene expression data.
  arXiv  Detail & Related papers  (2025-03-13T13:15:04Z)
• Spectral State Space Model for Rotation-Invariant Visual Representation Learning [15.131672925920995]
  State Space Models (SSMs) have emerged as an alternative to Vision Transformers (ViTs) SSMs fail to identify relationships between conceptually related yet not adjacent patches. Current vision-based SSMs are highly sensitive to transformations such as rotation. We introduce Spectral VMamba, a novel approach that effectively captures the global structure within an image.
  arXiv  Detail & Related papers  (2025-03-09T00:37:43Z)
• EqNIO: Subequivariant Neural Inertial Odometry [33.96552018734359]
  We show that IMU data transforms equivariantly, when rotated around the gravity vector and reflected with respect to arbitrary planes parallel to gravity. We then map the IMU data into this frame, thereby achieving an invariant canonicalization that can be directly used with off-the-shelf inertial odometry networks.
  arXiv  Detail & Related papers  (2024-08-12T17:42:46Z)
• Invariant Discovery of Features Across Multiple Length Scales: Applications in Microscopy and Autonomous Materials Characterization [3.386918190302773]
  Variational Autoencoders (VAEs) have emerged as powerful tools for identifying underlying factors of variation in image data. We introduce the scale-invariant VAE approach (SI-VAE) based on the progressive training of the VAE with the descriptors sampled at different length scales.
  arXiv  Detail & Related papers  (2024-08-01T01:48:46Z)
• Learning and Controlling Silicon Dopant Transitions in Graphene using Scanning Transmission Electron Microscopy [58.51812955462815]
  We introduce a machine learning approach to determine the transition dynamics of silicon atoms on a single layer of carbon atoms. The data samples are processed and filtered to produce symbolic representations, which we use to train a neural network to predict transition probabilities. These learned transition dynamics are then leveraged to guide a single silicon atom throughout the lattice to pre-determined target destinations.
  arXiv  Detail & Related papers  (2023-11-21T21:51:00Z)
• On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
  Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input. DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases. We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
  arXiv  Detail & Related papers  (2023-06-23T03:09:03Z)
• DiffUCD:Unsupervised Hyperspectral Image Change Detection with Semantic Correlation Diffusion Model [46.68717345017946]
  Hyperspectral image change detection (HSI-CD) has emerged as a crucial research area in remote sensing. We propose a novel unsupervised HSI-CD with semantic correlation diffusion model (DiffUCD) Our method can achieve comparable results to those fully supervised methods requiring numerous samples.
  arXiv  Detail & Related papers  (2023-05-21T09:21:41Z)
• Exploring Invariant Representation for Visible-Infrared Person Re-Identification [77.06940947765406]
  Cross-spectral person re-identification, which aims to associate identities to pedestrians across different spectra, faces a main challenge of the modality discrepancy. In this paper, we address the problem from both image-level and feature-level in an end-to-end hybrid learning framework named robust feature mining network (RFM) Experiment results on two standard cross-spectral person re-identification datasets, RegDB and SYSU-MM01, have demonstrated state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-02-02T05:24:50Z)
• Oracle-Preserving Latent Flows [58.720142291102135]
  We develop a methodology for the simultaneous discovery of multiple nontrivial continuous symmetries across an entire labelled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to transformations invariant with respect to high-dimensional oracles.
  arXiv  Detail & Related papers  (2023-02-02T00:13:32Z)
• Change Detection in Heterogeneous Optical and SAR Remote Sensing Images via Deep Homogeneous Feature Fusion [20.152363214309446]
  This paper presents a new homogeneous transformation model termed deep homogeneous feature fusion (DHFF) based on image style transfer (IST) Unlike the existing methods, the DHFF method segregates the semantic content and the style features in the heterogeneous images to perform homogeneous transformation. The experiments demonstrate that the proposed DHFF method achieves significant improvement for change detection in heterogeneous optical and SAR remote sensing images.
  arXiv  Detail & Related papers  (2020-04-08T06:27:37Z)
• Inverse Learning of Symmetries [71.62109774068064]
  We learn the symmetry transformation with a model consisting of two latent subspaces. Our approach is based on the deep information bottleneck in combination with a continuous mutual information regulariser. Our model outperforms state-of-the-art methods on artificial and molecular datasets.
  arXiv  Detail & Related papers  (2020-02-07T13:48:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.