Physically-Constrained Autoencoder-Assisted Bayesian Optimization for Refinement of High-Dimensional Defect-Sensitive Single Crystalline Structure
- URL: http://arxiv.org/abs/2601.00855v1
- Date: Mon, 29 Dec 2025 23:38:55 GMT
- Title: Physically-Constrained Autoencoder-Assisted Bayesian Optimization for Refinement of High-Dimensional Defect-Sensitive Single Crystalline Structure
- Authors: Joseph Oche Agada, Andrew McAninch, Haley Day, Yasemin Tanyu, Ewan McCombs, Seyed M. Koohpayeh, Brian H. Toby, Yishu Wang, Arpan Biswas,
- Abstract summary: To establish a structure-property relationship, not only the crystallographic symmetry but also quantitative knowledge about defects are required.<n>We present a hybrid Machine Learning framework that integrates a physicallyconstrained variational-autoencoder (pcVAE) with different Bayesian Optimization (BO) methods.
- Score: 0.45146010343938703
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Physical properties and functionalities of materials are dictated by global crystal structures as well as local defects. To establish a structure-property relationship, not only the crystallographic symmetry but also quantitative knowledge about defects are required. Here we present a hybrid Machine Learning framework that integrates a physically-constrained variational-autoencoder (pcVAE) with different Bayesian Optimization (BO) methods to systematically accelerate and improve crystal structure refinement with resolution of defects. We chose the pyrochlore structured Ho2Ti2O7 as a model system and employed the GSAS2 package for benchmarking crystallographic parameters from Rietveld refinement. However, the function space of these material systems is highly nonlinear, which limits optimizers like traditional Rietveld refinement, into trapping at local minima. Also, these naive methods don't provide an extensive learning about the overall function space, which is essential for large space, large time consuming explorations to identify various potential regions of interest. Thus, we present the approach of exploring the high Dimensional structure parameters of defect sensitive systems via pretrained pcVAE assisted BO and Sparse Axis Aligned BO. The pcVAE projects high-Dimensional diffraction data consisting of thousands of independently measured diffraction orders into a lowD latent space while enforcing scaling invariance and physical relevance. Then via BO methods, we aim to minimize the L2 norm based chisq errors in the real and latent spaces separately between experimental and simulated diffraction patterns, thereby steering the refinement towards potential optimum crystal structure parameters. We investigated and compared the results among different pcVAE assisted BO, non pcVAE assisted BO, and Rietveld refinement.
Related papers
- Function-Space Decoupled Diffusion for Forward and Inverse Modeling in Carbon Capture and Storage [65.51149575007149]
We present Fun-DDPS, a generative framework that combines function-space diffusion models with differentiable neural operator surrogates for both forward and inverse modeling.<n>Fun-DDPS produces physically consistent realizations free from the high-frequency artifacts observed in joint-state baselines.
arXiv Detail & Related papers (2026-02-12T18:58:12Z) - Generative Modeling of Aerosol State Representations [5.772617906251992]
Aerosol-cloud-radiation interactions remain among the most uncertain components of the Earth's climate system.<n>We present a framework for learning deep variational autoencoder models of speciated mass and number concentration distributions.<n>By compressing hundreds of original dimensions into ten latent variables, the approach enables efficient storage and processing.
arXiv Detail & Related papers (2025-10-11T22:38:30Z) - Polymorphism Crystal Structure Prediction with Adaptive Space Group Diversity Control [2.981139602986498]
Crystalline materials can form different structural arrangements (i.e. polymorphs) with the same chemical composition.<n>We propose a multi-objective genetic algorithm for polymorphism CSP that incorporates an adaptive space group diversity control technique.<n>ParetoCSP2 achieves excellent performance in polymorphism prediction, including a nearly perfect space group.
arXiv Detail & Related papers (2025-06-12T22:08:35Z) - Weight Spectra Induced Efficient Model Adaptation [54.8615621415845]
Fine-tuning large-scale foundation models incurs prohibitive computational costs.<n>We show that fine-tuning predominantly amplifies the top singular values while leaving the remainder largely intact.<n>We propose a novel method that leverages learnable rescaling of top singular directions.
arXiv Detail & Related papers (2025-05-29T05:03:29Z) - Modeling All Response Surfaces in One for Conditional Search Spaces [69.90317997694218]
This paper proposes a novel approach to model the response surfaces of all subspaces in one.<n>We introduce an attention-based deep feature extractor, capable of projecting configurations with different structures from various subspaces into a unified feature space.
arXiv Detail & Related papers (2025-01-08T03:56:06Z) - Efficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks [52.13486402193811]
New solid-state materials require rapidly exploring the vast space of crystal structures and locating stable regions.
Existing methods struggle to explore large material spaces and generate diverse samples with desired properties and requirements.
We propose a novel generative model employing a hierarchical exploration strategy to efficiently exploit the symmetry of the materials space to generate crystal structures given desired properties.
arXiv Detail & Related papers (2024-11-06T23:53:34Z) - Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning [78.39310274926535]
Adapting pre-trained foundation models for various downstream tasks has been prevalent in artificial intelligence.<n>To mitigate this, several fine-tuning techniques have been developed to update the pre-trained model weights in a more resource-efficient manner.<n>This paper introduces a generalized parameter-efficient fine-tuning framework, designed for various dimensional parameter space.
arXiv Detail & Related papers (2024-05-23T16:04:42Z) - Adaptive search space decomposition method for pre- and post- buckling
analyses of space truss structures [0.7537475180985098]
The paper proposes a novel adaptive search space decomposition method and a gradient-free optimization-based formulation for the pre- and post-buckling analyses.
We tackle three benchmark problems and evaluate a medium-sized test representing a real structural problem in this paper.
The accuracy and robustness of the adopted methodology show a high potential of gradient-free algorithms in analyzing space truss structures.
arXiv Detail & Related papers (2022-11-14T16:47:25Z) - Deep learning extraction of band structure parameters from density of
states: a case study on trilayer graphene [45.61296767255256]
Key requirement for a comprehensive quantitative theory is the accurate determination of materials' band structure parameters.
We introduce a general framework to derive band structure parameters from experimental data using deep neural networks.
arXiv Detail & Related papers (2022-10-12T15:24:42Z) - NeuralSI: Structural Parameter Identification in Nonlinear Dynamical
Systems [9.77270939559057]
This paper explores a new framework, dubbed NeuralSI, for structural identification.
Our approach seeks to estimate nonlinear parameters from governing equations.
The trained model can also be extrapolated under both standard and extreme conditions.
arXiv Detail & Related papers (2022-08-26T16:32:51Z) - Parametric Generative Schemes with Geometric Constraints for Encoding
and Synthesizing Airfoils [25.546237636065182]
Two deep learning-based generative schemes are proposed to capture the complexity of the design space while satisfying specific constraints.
The soft-constrained scheme generates airfoils with slight deviations from the expected geometric constraints, yet still converge to the reference airfoil.
The hard-constrained scheme produces airfoils with a wider range of geometric diversity while strictly adhering to the geometric constraints.
arXiv Detail & Related papers (2022-05-05T05:58:08Z) - Tracking perovskite crystallization via deep learning-based feature
detection on 2D X-ray scattering data [137.47124933818066]
We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture.
We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
arXiv Detail & Related papers (2022-02-22T15:39:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.