EMCNet : Graph-Nets for Electron Micrographs Classification
- URL: http://arxiv.org/abs/2409.03767v2
- Date: Tue, 10 Sep 2024 13:23:57 GMT
- Title: EMCNet : Graph-Nets for Electron Micrographs Classification
- Authors: Sakhinana Sagar Srinivas, Rajat Kumar Sarkar, Venkataramana Runkana,
- Abstract summary: We propose an effective end-to-end electron micrograph representation learning-based framework for nanomaterial identification.
We demonstrate that our framework outperforms the popular baselines on the open-source datasets in nanomaterials-based identification tasks.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Characterization of materials via electron micrographs is an important and challenging task in several materials processing industries. Classification of electron micrographs is complex due to the high intra-class dissimilarity, high inter-class similarity, and multi-spatial scales of patterns. However, existing methods are ineffective in learning complex image patterns. We propose an effective end-to-end electron micrograph representation learning-based framework for nanomaterial identification to overcome the challenges. We demonstrate that our framework outperforms the popular baselines on the open-source datasets in nanomaterials-based identification tasks. The ablation studies are reported in great detail to support the efficacy of our approach.
Related papers
- Exploring structure diversity in atomic resolution microscopy with graph neural networks [18.903519247639355]
Deep learning is a powerful tool to explore structure diversity in a fast, accurate, and intelligent manner.
This work provides a powerful tool to explore structure diversity in a fast, accurate, and intelligent manner.
arXiv Detail & Related papers (2024-10-23T07:48:35Z) - Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models [0.0]
We propose an innovative backbone architecture for analyzing electron micrographs.
We create multi-modal representations of the micrographs by tokenizing them into patch sequences and, additionally, representing them as vision graphs.
Our framework outperforms traditional methods, overcoming challenges posed by distributional shifts.
arXiv Detail & Related papers (2024-08-24T19:24:44Z) - Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models [0.0]
This study introduces an innovative architecture that leverages the generative capabilities of zero-shot prompting.
It fuses knowledge across image based and linguistic insights for accurate nanomaterial category prediction.
arXiv Detail & Related papers (2024-08-24T16:28:00Z) - Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes [0.0]
We propose a hypergraph neural network backbone architecture to better model the complex relationships in electron micrographs.
By utilizing cost-effective GPU hardware, our proposed framework outperforms popular baselines.
arXiv Detail & Related papers (2024-08-21T05:36:53Z) - Multilinear Operator Networks [60.7432588386185]
Polynomial Networks is a class of models that does not require activation functions.
We propose MONet, which relies solely on multilinear operators.
arXiv Detail & Related papers (2024-01-31T16:52:19Z) - Learning and Controlling Silicon Dopant Transitions in Graphene using
Scanning Transmission Electron Microscopy [58.51812955462815]
We introduce a machine learning approach to determine the transition dynamics of silicon atoms on a single layer of carbon atoms.
The data samples are processed and filtered to produce symbolic representations, which we use to train a neural network to predict transition probabilities.
These learned transition dynamics are then leveraged to guide a single silicon atom throughout the lattice to pre-determined target destinations.
arXiv Detail & Related papers (2023-11-21T21:51:00Z) - StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized
Image-Dialogue Data [129.92449761766025]
We propose a novel data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning.
This approach harnesses the power of generative models, marrying the abilities of ChatGPT and text-to-image generative models.
Our research includes comprehensive experiments conducted on various datasets.
arXiv Detail & Related papers (2023-08-20T12:43:52Z) - Automatically Predict Material Properties with Microscopic Image Example
Polymer Compatibility [94.40113383292139]
Computer image recognition with machine learning method can make up the defects of artificial judging.
We achieve automatic miscibility recognition utilizing convolution neural network and transfer learning method.
The proposed method can be widely applied to the quantitative characterization of the microstructure and properties of various materials.
arXiv Detail & Related papers (2023-03-22T07:51:32Z) - Digital Fingerprinting of Microstructures [44.139970905896504]
Finding efficient means of fingerprinting microstructural information is a critical step towards harnessing data-centric machine learning approaches.
Here, we consider microstructure classification and utilise the resulting features over a range of related machine learning tasks.
In particular, methods that leverage transfer learning with convolutional neural networks (CNNs), pretrained on the ImageNet dataset, are generally shown to outperform other methods.
arXiv Detail & Related papers (2022-03-25T15:40:44Z) - Model-Agnostic Graph Regularization for Few-Shot Learning [60.64531995451357]
We present a comprehensive study on graph embedded few-shot learning.
We introduce a graph regularization approach that allows a deeper understanding of the impact of incorporating graph information between labels.
Our approach improves the performance of strong base learners by up to 2% on Mini-ImageNet and 6.7% on ImageNet-FS.
arXiv Detail & Related papers (2021-02-14T05:28:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.