STEM image analysis based on deep learning: identification of vacancy
defects and polymorphs of ${MoS_2}$
- URL: http://arxiv.org/abs/2206.04272v1
- Date: Thu, 9 Jun 2022 04:43:56 GMT
- Title: STEM image analysis based on deep learning: identification of vacancy
defects and polymorphs of ${MoS_2}$
- Authors: Kihyun Lee, Jinsub Park, Soyeon Choi, Yangjin Lee, Sol Lee, Joowon
Jung, Jong-Young Lee, Farman Ullah, Zeeshan Tahir, Yong Soo Kim, Gwan-Hyoung
Lee, and Kwanpyo Kim
- Abstract summary: We apply a fully convolutional network (FCN) for identification of important structural features of two-dimensional crystals.
FCN is trained with simulated images in the presence of different levels of noise, aberrations, and carbon contamination.
The accuracy of the FCN models toward extensive experimental STEM images is comparable to that of careful hands-on analysis.
- Score: 0.49583061314078714
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Scanning transmission electron microscopy (STEM) is an indispensable tool for
atomic-resolution structural analysis for a wide range of materials. The
conventional analysis of STEM images is an extensive hands-on process, which
limits efficient handling of high-throughput data. Here we apply a fully
convolutional network (FCN) for identification of important structural features
of two-dimensional crystals. ResUNet, a type of FCN, is utilized in identifying
sulfur vacancies and polymorph types of ${MoS_2}$ from atomic resolution STEM
images. Efficient models are achieved based on training with simulated images
in the presence of different levels of noise, aberrations, and carbon
contamination. The accuracy of the FCN models toward extensive experimental
STEM images is comparable to that of careful hands-on analysis. Our work
provides a guideline on best practices to train a deep learning model for STEM
image analysis and demonstrates FCN's application for efficient processing of a
large volume of STEM data.
Related papers
- Noise Calibration and Spatial-Frequency Interactive Network for STEM Image Enhancement [8.497362811837627]
In this paper, we develop noise calibration, data synthesis, and enhancement methods for STEM images.
We first present a STEM noise calibration method, which is used to synthesize more realistic STEM images.
We then use these parameters to develop a more general dataset that considers both regular and random atomic arrangements.
Finally, we design a spatial-frequency interactive network for STEM image enhancement, which can explore the information in the frequency domain formed by the periodicity of atomic arrangement.
arXiv Detail & Related papers (2025-04-03T13:11:57Z) - MaskTerial: A Foundation Model for Automated 2D Material Flake Detection [48.73213960205105]
We present a deep learning model, called MaskTerial, that uses an instance segmentation network to reliably identify 2D material flakes.
The model is extensively pre-trained using a synthetic data generator, that generates realistic microscopy images from unlabeled data.
We demonstrate significant improvements over existing techniques in the detection of low-contrast materials such as hexagonal boron nitride.
arXiv Detail & Related papers (2024-12-12T15:01:39Z) - Deep-Learning Recognition of Scanning Transmission Electron Microscopy: Quantifying and Mitigating the Influence of Gaussian Noises [8.027522565741402]
We present a deep-learning mask region-based neural network (Mask R-CNN) for the recognition of nanoparticles imaged by Scanning transmission electron microscopy (STEM)
The Mask R-CNN model was tested on simulated STEM-HAADF results with different Gaussian noises, particle shapes and particle sizes, and the results indicated that Gaussian noise has determining influence on the accuracy of recognition.
This filtering-recognition approach was further applied to experimental STEM-HAADF results, which yields satisfying accuracy compared with the traditional threshold methods.
arXiv Detail & Related papers (2024-09-25T05:30:18Z) - Unsupervised Reward-Driven Image Segmentation in Automated Scanning Transmission Electron Microscopy Experiments [0.22795086293129713]
Automated experiments in scanning transmission electron microscopy (STEM) require rapid image segmentation to optimize data representation for human interpretation, decision-making, site-selective spectroscopies, and atomic manipulation.
Here, we operationalize and benchmark a recently proposed reward-driven optimization workflow for on-the fly image analysis in STEM.
This unsupervised approach is much more robust, as it does not rely on human labels and is fully explainable.
arXiv Detail & Related papers (2024-09-19T04:51:13Z) - Determination of droplet size from wide-angle light scattering image
data using convolutional neural networks [0.0]
We introduce a fully automatic machine learning-based approach that employs convolutional neural networks (CNNs) in order to streamline the droplet sizing process.
We consider WALS data from an ethanol spray flame process at various heights above the burner surface (HABs)
The models are trained and cross-validated on a large dataset comprising nearly 35000 WALS images.
arXiv Detail & Related papers (2023-11-03T18:05:47Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Multi-View Photometric Stereo Revisited [100.97116470055273]
Multi-view photometric stereo (MVPS) is a preferred method for detailed and precise 3D acquisition of an object from images.
We present a simple, practical approach to MVPS, which works well for isotropic as well as other object material types such as anisotropic and glossy.
The proposed approach shows state-of-the-art results when tested extensively on several benchmark datasets.
arXiv Detail & Related papers (2022-10-14T09:46:15Z) - Tracking perovskite crystallization via deep learning-based feature
detection on 2D X-ray scattering data [137.47124933818066]
We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture.
We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
arXiv Detail & Related papers (2022-02-22T15:39:00Z) - Disentangling multiple scattering with deep learning: application to
strain mapping from electron diffraction patterns [48.53244254413104]
We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images.
We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures.
Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
arXiv Detail & Related papers (2022-02-01T03:53:39Z) - The Preliminary Results on Analysis of TAIGA-IACT Images Using
Convolutional Neural Networks [68.8204255655161]
The aim of the work is to study the possibility of the machine learning application to solve the tasks set for TAIGA-IACT.
The method of Convolutional Neural Networks (CNN) was applied to process and analyze Monte-Carlo events simulated with CORSIKA.
arXiv Detail & Related papers (2021-12-19T15:17:20Z) - Deep Learning Segmentation of Complex Features in Atomic-Resolution
Phase Contrast Transmission Electron Microscopy Images [0.8049701904919516]
It is difficult to develop fully-automated analysis routines for phase contrast TEM studies using conventional image processing tools.
For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures.
We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm.
arXiv Detail & Related papers (2020-12-09T21:17:34Z) - Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR
Images using a GAN [59.60954255038335]
The proposed framework consists of a stretch-out up-sampling module, a brain atlas encoder, a segmentation consistency module, and multi-scale label-wise discriminators.
Experiments on real clinical data demonstrate that the proposed model can perform significantly better than the state-of-the-art synthesis methods.
arXiv Detail & Related papers (2020-06-26T02:50:09Z) - Fast reconstruction of atomic-scale STEM-EELS images from sparse
sampling [11.624024992823928]
We propose a fast and accurate reconstruction method suited for atomic-scale EELS.
This method is compared to popular solutions such as beta process factor analysis (BPFA) which is used for the first time on STEM-EELS images.
arXiv Detail & Related papers (2020-02-04T11:07:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.