3D variational autoencoder for fingerprinting microstructure volume elements

• URL: http://arxiv.org/abs/2503.17427v3
• Date: Wed, 25 Jun 2025 09:14:01 GMT
• Title: 3D variational autoencoder for fingerprinting microstructure volume elements
• Authors: Michael D. White, Michael D. Atkinson, Adam J. Plowman, Pratheek Shanthraj,
• Abstract summary: We present a 3D variational autoencoder (VAE) for encoding microstructure volume elements (VEs)<n>Crystal symmetries in the orientation space are accounted for by mapping to the crystallographic fundamental zone as a preprocessing step.<n>VAE is then used to encode a training set of VEs with an equiaxed polycrystalline microstructure with random texture.<n>We show that the model generalises well to microstructures with textures, grain sizes and aspect ratios outside the training distribution.
• Score: 0.5892638927736115
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Microstructure quantification is an important step towards establishing structure-property relationships in materials. Machine learning-based image processing methods have been shown to outperform conventional image processing techniques and are increasingly applied to microstructure quantification tasks. In this work, we present a 3D variational autoencoder (VAE) for encoding microstructure volume elements (VEs) comprising voxelated crystallographic orientation data. Crystal symmetries in the orientation space are accounted for by mapping to the crystallographic fundamental zone as a preprocessing step, which allows for a continuous loss function to be used and improves the training convergence rate. The VAE is then used to encode a training set of VEs with an equiaxed polycrystalline microstructure with random texture. Accurate reconstructions are achieved with a relative average misorientation error of 3x10^-2 on the test dataset, for a continuous latent space with dimension 256. We show that the model generalises well to microstructures with textures, grain sizes and aspect ratios outside the training distribution. Structure-property relationships are explored through using the training set of VEs as initial configurations in various crystal plasticity (CP) simulations. Microstructural fingerprints extracted from the VAE, which parameterise the VEs in a low-dimensional latent space, are stored alongside the volume-averaged stress response, at each strain increment, to uniaxial tensile deformation from CP simulations. This is then used to train a fully connected neural network mapping the input fingerprint to the resulting stress response, which acts as a surrogate model for the CP simulation. The fingerprint-based surrogate model is shown to accurately predict the microstructural dependence in the CP stress response, with a relative mean-squared error of 2.75 MPa on unseen test data.

Related papers

• Aligned Manifold Property and Topology Point Clouds for Learning Molecular Properties [55.2480439325792]
  This work introduces AMPTCR, a molecular surface representation that combines local quantum-derived scalar fields and custom topological descriptors within an aligned point cloud format.<n>For molecular weight, results confirm that AMPTCR encodes physically meaningful data, with a validation R2 of 0.87.<n>In the bacterial inhibition task, AMPTCR enables both classification and direct regression of E. coli inhibition values.
  arXiv  Detail & Related papers  (2025-07-22T04:35:50Z)
• STEM Diffraction Pattern Analysis with Deep Learning Networks [0.0]
  This work presents a machine learning-based approach for predicting Euler angles directly from scanning transmission electron microscopy (STEM) diffraction patterns (DPs)<n>It enables the automated generation of high-resolution crystal orientation maps, facilitating the analysis of internal microstructures at the nanoscale.<n>Three deep learning architectures--convolutional neural networks (CNNs), Dense Convolutional Networks (DenseNets), and Shifted Windows (Swin) Transformers--are evaluated, using an experimentally acquired dataset labelled via a commercial TM algorithm.
  arXiv  Detail & Related papers  (2025-07-02T16:58:09Z)
• Foundation Model for Composite Microstructures: Reconstruction, Stiffness, and Nonlinear Behavior Prediction [0.0]
  We present the Material Masked Autoencoder (MMAE), a self-supervised Vision Transformer pretrained on a large corpus of short-fiber composite images.<n>We demonstrate two key applications: (i) predicting homogenized stiffness components through fine-tuning on limited data, and (ii) inferring physically interpretable parameters by coupling MMAE with an interaction-based material network.
  arXiv  Detail & Related papers  (2024-11-10T19:06:25Z)
• Fast and Reliable Probabilistic Reflectometry Inversion with Prior-Amortized Neural Posterior Estimation [73.81105275628751]
  Finding all structures compatible with reflectometry data is computationally prohibitive for standard algorithms. We address this lack of reliability with a probabilistic deep learning method that identifies all realistic structures in seconds. Our method, Prior-Amortized Neural Posterior Estimation (PANPE), combines simulation-based inference with novel adaptive priors.
  arXiv  Detail & Related papers  (2024-07-26T10:29:16Z)
• GPU-Accelerated RSF Level Set Evolution for Large-Scale Microvascular Segmentation [2.5003043942194236]
  We propose a reformulation and implementation of the region-scalable fitting (RSF) level set model. This makes it amenable to three-dimensional evaluation using both single-instruction multiple data (SIMD) and single-program multiple-data (SPMD) parallel processing. We tested this 3D parallel RSF approach on multiple data sets acquired using state-of-the-art imaging techniques to acquire microvascular data.
  arXiv  Detail & Related papers  (2024-04-03T15:37:02Z)
• Effect of structure-based training on 3D localization precision and quality [0.0]
  This study introduces a structural-based training approach for CNN-based algorithms in single-molecule localization microscopy. We compare this approach with the traditional random-based training method, utilizing the LUENN package as our AI pipeline. Our findings highlight the potential of the structural-based training approach to advance super-resolution microscopy.
  arXiv  Detail & Related papers  (2023-09-29T14:17:31Z)
• A Neural Network Transformer Model for Composite Microstructure Homogenization [1.2277343096128712]
  Homogenization methods, such as the Mori-Tanaka method, offer rapid homogenization for a wide range of constituent properties. This paper illustrates a transformer neural network architecture that captures the knowledge of various microstructures. The network predicts the history-dependent, non-linear, and homogenized stress-strain response.
  arXiv  Detail & Related papers  (2023-04-16T19:57:52Z)
• Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics [77.34726150561087]
  This work proposes a generative adversarial network tailored towards three-dimensional microstructure generation. The lightweight algorithm is able to learn the underlying properties of the material from a single microCT-scan without the need of explicit descriptors.
  arXiv  Detail & Related papers  (2022-05-31T13:26:51Z)
• A microstructure estimation Transformer inspired by sparse representation for diffusion MRI [11.761543033212797]
  We present a learning-based framework based on Transformer for dMRI-based microstructure estimation with downsampled q-space data. The proposed method achieved up to 11.25 folds of acceleration in scan time and outperformed the other state-of-the-art learning-based methods.
  arXiv  Detail & Related papers  (2022-05-13T05:14:22Z)
• Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns [48.53244254413104]
  We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images. We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
  arXiv  Detail & Related papers  (2022-02-01T03:53:39Z)
• CSformer: Bridging Convolution and Transformer for Compressive Sensing [65.22377493627687]
  This paper proposes a hybrid framework that integrates the advantages of leveraging detailed spatial information from CNN and the global context provided by transformer for enhanced representation learning. The proposed approach is an end-to-end compressive image sensing method, composed of adaptive sampling and recovery. The experimental results demonstrate the effectiveness of the dedicated transformer-based architecture for compressive sensing.
  arXiv  Detail & Related papers  (2021-12-31T04:37:11Z)
• A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructures [68.8204255655161]
  It is shown that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches. It is shown, that the proposed method is able to predict central moments of interest while being magnitudes faster to evaluate than traditional approaches.
  arXiv  Detail & Related papers  (2021-10-26T07:02:14Z)
• 3D Reconstruction of Curvilinear Structures with Stereo Matching DeepConvolutional Neural Networks [52.710012864395246]
  We propose a fully automated pipeline for both detection and matching of curvilinear structures in stereo pairs. We mainly focus on 3D reconstruction of dislocations from stereo pairs of TEM images.
  arXiv  Detail & Related papers  (2021-10-14T23:05:47Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.