Machine learning of microstructure--property relationships in materials with robust features from foundational vision transformers

• URL: http://arxiv.org/abs/2501.18637v1
• Date: Tue, 28 Jan 2025 17:06:47 GMT
• Title: Machine learning of microstructure--property relationships in materials with robust features from foundational vision transformers
• Authors: Sheila E. Whitman, Marat I. Latypov,
• Abstract summary: Machine learning of microstructure--property relationships from data is an emerging approach in computational materials science. We propose utilizing pre-trained foundational vision transformers for the extraction of task-agnostic microstructure features.
• Score: 0.0
• License:
• Abstract: Machine learning of microstructure--property relationships from data is an emerging approach in computational materials science. Most existing machine learning efforts focus on the development of task-specific models for each microstructure--property relationship. We propose utilizing pre-trained foundational vision transformers for the extraction of task-agnostic microstructure features and subsequent light-weight machine learning of a microstructure-dependent property. We demonstrate our approach with pre-trained state-of-the-art vision transformers (CLIP, DINOV2, SAM) in two case studies on machine-learning: (i) elastic modulus of two-phase microstructures based on simulations data; and (ii) Vicker's hardness of Ni-base and Co-base superalloys based on experimental data published in literature. Our results show the potential of foundational vision transformers for robust microstructure representation and efficient machine learning of microstructure--property relationships without the need for expensive task-specific training or fine-tuning of bespoke deep learning models.

Related papers

• Revealing the Evolution of Order in Materials Microstructures Using Multi-Modal Computer Vision [4.6481041987538365]
  Development of high-performance materials for microelectronics depends on our ability to describe and direct property-defining microstructural order. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La$_1-x$Sr$_x$FeO$_3$. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.
  arXiv  Detail & Related papers  (2024-11-15T02:44:32Z)
• Learning Correlation Structures for Vision Transformers [93.22434535223587]
  We introduce a new attention mechanism, dubbed structural self-attention (StructSA) We generate attention maps by recognizing space-time structures of key-query correlations via convolution. This effectively leverages rich structural patterns in images and videos such as scene layouts, object motion, and inter-object relations.
  arXiv  Detail & Related papers  (2024-04-05T07:13:28Z)
• Learning to Extract Structured Entities Using Language Models [52.281701191329]
  Recent advances in machine learning have significantly impacted the field of information extraction. We reformulate the task to be entity-centric, enabling the use of diverse metrics. We contribute to the field by introducing Structured Entity Extraction and proposing the Approximate Entity Set OverlaP metric.
  arXiv  Detail & Related papers  (2024-02-06T22:15:09Z)
• Mechanical Characterization and Inverse Design of Stochastic Architected Metamaterials Using Neural Operators [2.4918888803900727]
  Machine learning is emerging as a transformative tool for the design of architected materials. Here, we introduce a new end-to-end scientific ML framework, leveraging deep neural operators (DeepONet) Results obtained from spinodal microstructures, printed using two-photon lithography, reveal that the prediction error for mechanical responses is within a range of 5 - 10%.
  arXiv  Detail & Related papers  (2023-11-23T05:23:15Z)
• Multimodal machine learning for materials science: composition-structure bimodal learning for experimentally measured properties [4.495968252019426]
  This paper introduces a novel approach to multimodal machine learning in materials science via composition-structure bimodal learning. The proposed COmposition-Structure Bimodal Network (COSNet) is designed to enhance learning and predictions of experimentally measured materials properties that have incomplete structure information.
  arXiv  Detail & Related papers  (2023-08-04T02:04:52Z)
• DA-VEGAN: Differentiably Augmenting VAE-GAN for microstructure reconstruction from extremely small data sets [110.60233593474796]
  DA-VEGAN is a model with two central innovations. A $beta$-variational autoencoder is incorporated into a hybrid GAN architecture. A custom differentiable data augmentation scheme is developed specifically for this architecture.
  arXiv  Detail & Related papers  (2023-02-17T08:49:09Z)
• SIM-Trans: Structure Information Modeling Transformer for Fine-grained Visual Categorization [59.732036564862796]
  We propose the Structure Information Modeling Transformer (SIM-Trans) to incorporate object structure information into transformer for enhancing discriminative representation learning. The proposed two modules are light-weighted and can be plugged into any transformer network and trained end-to-end easily. Experiments and analyses demonstrate that the proposed SIM-Trans achieves state-of-the-art performance on fine-grained visual categorization benchmarks.
  arXiv  Detail & Related papers  (2022-08-31T03:00:07Z)
• Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics [77.34726150561087]
  This work proposes a generative adversarial network tailored towards three-dimensional microstructure generation. The lightweight algorithm is able to learn the underlying properties of the material from a single microCT-scan without the need of explicit descriptors.
  arXiv  Detail & Related papers  (2022-05-31T13:26:51Z)
• Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction [64.03526633651218]
  Click-Through Rate (CTR) prediction is one of the most important machine learning tasks in recommender systems. We propose an automated interaction architecture discovering framework for CTR prediction named AutoCTR.
  arXiv  Detail & Related papers  (2020-06-29T04:33:01Z)
• Deep Generative Modeling for Mechanistic-based Learning and Design of Metamaterial Systems [20.659457956055366]
  We propose a novel data-driven metamaterial design framework based on deep generative modeling. We show in this study that the latent space of VAE provides a distance metric to measure shape similarity. We demonstrate our framework by designing both functionally graded and heterogeneous metamaterial systems.
  arXiv  Detail & Related papers  (2020-06-27T03:56:55Z)
• Intelligent multiscale simulation based on process-guided composite database [0.0]
  We present an integrated data-driven modeling framework based on process modeling, material homogenization, and machine learning. We are interested in the injection-molded short fiber reinforced composites, which have been identified as key material systems in automotive, aerospace, and electronics industries.
  arXiv  Detail & Related papers  (2020-03-20T20:39:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.