MicroEvoEval: A Systematic Evaluation Framework for Image-Based Microstructure Evolution Prediction
- URL: http://arxiv.org/abs/2511.08955v2
- Date: Tue, 18 Nov 2025 06:31:29 GMT
- Title: MicroEvoEval: A Systematic Evaluation Framework for Image-Based Microstructure Evolution Prediction
- Authors: Qinyi Zhang, Duanyu Feng, Ronghui Han, Yangshuai Wang, Hao Wang,
- Abstract summary: We introduce MicroEvoEval, the first comprehensive benchmark for image-based evolution prediction.<n>We evaluate 14 models, encompassing both domain-specific and general-purpose architectures, across four representative MicroEvo tasks.
- Score: 5.114987417721577
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Simulating microstructure evolution (MicroEvo) is vital for materials design but demands high numerical accuracy, efficiency, and physical fidelity. Although recent studies on deep learning (DL) offer a promising alternative to traditional solvers, the field lacks standardized benchmarks. Existing studies are flawed due to a lack of comparing specialized MicroEvo DL models with state-of-the-art spatio-temporal architectures, an overemphasis on numerical accuracy over physical fidelity, and a failure to analyze error propagation over time. To address these gaps, we introduce MicroEvoEval, the first comprehensive benchmark for image-based microstructure evolution prediction. We evaluate 14 models, encompassing both domain-specific and general-purpose architectures, across four representative MicroEvo tasks with datasets specifically structured for both short- and long-term assessment. Our multi-faceted evaluation framework goes beyond numerical accuracy and computational cost, incorporating a curated set of structure-preserving metrics to assess physical fidelity. Our extensive evaluations yield several key insights. Notably, we find that modern architectures (e.g., VMamba), not only achieve superior long-term stability and physical fidelity but also operate with an order-of-magnitude greater computational efficiency. The results highlight the necessity of holistic evaluation and identify these modern architectures as a highly promising direction for developing efficient and reliable surrogate models in data-driven materials science.
Related papers
- Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Prediction [0.5437050212139087]
Traditional simulation methods are expensive due to the need to solve complex partial differential equations at fine resolutions.<n>We propose a deep learning framework that governs microstructural evolution predictions while maintaining high accuracy.<n>Compared to recurrent neural architectures, our model state-of-the-art predictive performance with significantly reduced computational cost in both training and inference.
arXiv Detail & Related papers (2026-02-23T14:55:28Z) - SiMiC: Context-Aware Silicon Microstructure Characterization Using Attention-Based Convolutional Neural Networks for Field-Emission Tip Analysis [1.4613896920385958]
We propose SiMiC: Context-Aware Silicon Microstructure characterization Using Attention-Based Convolutional Neural Networks for Field-Emission Tip Analysis.<n>By leveraging deep learning, our approach efficiently extracts morphological features-such as size, shape, and apex curvature-from SEM images.<n>A specialized dataset of silicon-based field-emitter tips was developed, and a customized CNN architecture incorporating attention mechanisms was trained for multi-class microstructure classification and dimensional prediction.
arXiv Detail & Related papers (2026-01-21T04:36:42Z) - Rethinking Evaluation of Infrared Small Target Detection [105.59753496831739]
This paper introduces a hybrid-level metric incorporating pixel- and target-level performance, proposing a systematic error analysis method, and emphasizing the importance of cross-dataset evaluation.<n>An open-source toolkit has be released to facilitate standardized benchmarking.
arXiv Detail & Related papers (2025-09-21T02:45:07Z) - Computational, Data-Driven, and Physics-Informed Machine Learning Approaches for Microstructure Modeling in Metal Additive Manufacturing [0.0]
Metal additive manufacturing enables unprecedented design freedom and the production of customized, complex components.<n>The rapid melting and solidification dynamics inherent to metal AM processes generate heterogeneous, non-equilibrium microstructures.<n>Predicting microstructure and its evolution across spatial and temporal scales remains a central challenge for process optimization and defect mitigation.
arXiv Detail & Related papers (2025-05-02T17:59:54Z) - Benchmarks as Microscopes: A Call for Model Metrology [76.64402390208576]
Modern language models (LMs) pose a new challenge in capability assessment.
To be confident in our metrics, we need a new discipline of model metrology.
arXiv Detail & Related papers (2024-07-22T17:52:12Z) - GenBench: A Benchmarking Suite for Systematic Evaluation of Genomic Foundation Models [56.63218531256961]
We introduce GenBench, a benchmarking suite specifically tailored for evaluating the efficacy of Genomic Foundation Models.
GenBench offers a modular and expandable framework that encapsulates a variety of state-of-the-art methodologies.
We provide a nuanced analysis of the interplay between model architecture and dataset characteristics on task-specific performance.
arXiv Detail & Related papers (2024-06-01T08:01:05Z) - Rethinking model prototyping through the MedMNIST+ dataset collection [0.11999555634662634]
This work introduces a comprehensive benchmark for the MedMNIST+ dataset collection.<n>We reassess commonly used Convolutional Neural Networks (CNNs) and Vision Transformer (ViT) architectures across distinct medical datasets.<n>Our findings suggest that computationally efficient training schemes and modern foundation models offer viable alternatives to costly end-to-end training.
arXiv Detail & Related papers (2024-04-24T10:19:25Z) - DA-VEGAN: Differentiably Augmenting VAE-GAN for microstructure
reconstruction from extremely small data sets [110.60233593474796]
DA-VEGAN is a model with two central innovations.
A $beta$-variational autoencoder is incorporated into a hybrid GAN architecture.
A custom differentiable data augmentation scheme is developed specifically for this architecture.
arXiv Detail & Related papers (2023-02-17T08:49:09Z) - Computer Vision Methods for the Microstructural Analysis of Materials:
The State-of-the-art and Future Perspectives [0.4595477728342621]
This review paper focuses on the state-of-the-art CNN-based techniques that have been applied to various multi-scale microstructural image analysis tasks.
We identify the main challenges with regard to the application of these methods to materials science research.
arXiv Detail & Related papers (2022-07-29T15:27:47Z) - Leveraging the structure of dynamical systems for data-driven modeling [111.45324708884813]
We consider the impact of the training set and its structure on the quality of the long-term prediction.
We show how an informed design of the training set, based on invariants of the system and the structure of the underlying attractor, significantly improves the resulting models.
arXiv Detail & Related papers (2021-12-15T20:09:20Z) - Towards an Automatic Analysis of CHO-K1 Suspension Growth in
Microfluidic Single-cell Cultivation [63.94623495501023]
We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data.
Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
arXiv Detail & Related papers (2020-10-20T08:36:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.