Rapid Design of Top-Performing Metal-Organic Frameworks with Qualitative
Representations of Building Blocks
- URL: http://arxiv.org/abs/2302.09184v1
- Date: Fri, 17 Feb 2023 23:24:44 GMT
- Title: Rapid Design of Top-Performing Metal-Organic Frameworks with Qualitative
Representations of Building Blocks
- Abstract summary: Metalorganic frameworks (MOFs) are an example of such material systems.
representation of MOFs through different building blocks makes it a challenge for designers to incorporate qualitative information into design optimization.
In this work, we integrated Latent Variable Gaussian Process (LVGP) and Multi-Objective Batch-Bayesian Optimization (MOBBO) to identify top-performing MOFs adaptively, autonomously, and efficiently without any human intervention.
- Score: 6.739378766136524
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Data-driven materials design often encounters challenges where systems
require or possess qualitative (categorical) information. Metal-organic
frameworks (MOFs) are an example of such material systems. The representation
of MOFs through different building blocks makes it a challenge for designers to
incorporate qualitative information into design optimization. Furthermore, the
large number of potential building blocks leads to a combinatorial challenge,
with millions of possible MOFs that could be explored through time consuming
physics-based approaches. In this work, we integrated Latent Variable Gaussian
Process (LVGP) and Multi-Objective Batch-Bayesian Optimization (MOBBO) to
identify top-performing MOFs adaptively, autonomously, and efficiently without
any human intervention. Our approach provides three main advantages: (i) no
specific physical descriptors are required and only building blocks that
construct the MOFs are used in global optimization through qualitative
representations, (ii) the method is application and property independent, and
(iii) the latent variable approach provides an interpretable model of
qualitative building blocks with physical justification. To demonstrate the
effectiveness of our method, we considered a design space with more than 47,000
MOF candidates. By searching only ~1% of the design space, LVGP-MOBBO was able
to identify all MOFs on the Pareto front and more than 97% of the 50
top-performing designs for the CO$_2$ working capacity and CO$_2$/N$_2$
selectivity properties. Finally, we compared our approach with the Random
Forest algorithm and demonstrated its efficiency, interpretability, and
robustness.
Related papers
- LEGO-MOF: Equivariant Latent Manipulation for Editable, Generative, and Optimizable MOF Design [11.084397378671682]
Metal-organic frameworks (MOFs) are highly promising for carbon capture, yet navigating their vast design space remains challenging.<n>Recent deep generative models enable de novo MOF design but primarily act as feed-forward structure generators.<n>Here, we propose a target-driven generative framework focused on continuous structural manipulation.
arXiv Detail & Related papers (2026-04-15T06:06:11Z) - HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents [71.09493646932046]
We introduce HY-Embodied-0.5, a family of foundation models specifically designed for real-world embodied agents.<n>The HY-Embodied-0.5 suite comprises two primary variants: an efficient model with 2B activated parameters designed for edge deployment, and a powerful model with 32B activated parameters targeted for complex reasoning.<n>Our MoT-2B model outperforms similarly sized state-of-the-art models on 16 benchmarks, while the 32B variant achieves performance comparable to frontier models such as Gemini 3.0 Pro.
arXiv Detail & Related papers (2026-04-08T17:59:48Z) - Generative Multi-Objective Bayesian Optimization with Scalable Batch Evaluations for Sample-Efficient De Novo Molecular Design [1.8517039579627974]
This work introduces an alternative, modular "generate-then-optimize" framework for de novo molecular design/discovery.<n>We benchmark the framework against state-of-the-art latent-space and discrete molecular optimization methods.<n>Specifically, in a case study related to sustainable energy storage, we show that our approach quickly uncovers novel, diverse, and high-performing organic (quinone-based) cathode materials.
arXiv Detail & Related papers (2025-12-19T14:59:27Z) - Efficient Training of Diffusion Mixture-of-Experts Models: A Practical Recipe [51.26601054313749]
Recent efforts on Diffusion MoE models have primarily focused on developing more sophisticated routing mechanisms.<n>Inspired by the MoE design paradigms established in large language models (LLMs), we identify a set of crucial architectural factors for building effective Diffusion MoE models.<n>We present novel architectures that can be efficiently applied to both latent and pixel-space diffusion frameworks.
arXiv Detail & Related papers (2025-12-01T03:52:31Z) - EGMOF: Efficient Generation of Metal-Organic Frameworks Using a Hybrid Diffusion-Transformer Architecture [2.5970961110910884]
EGMOF (Efficient Generation of MOFs) is a hybrid diffusion-transformer framework that overcomes limitations through a modular, descriptor-mediated workflow.<n>On a hydrogen uptake dataset, EGMOF achieved over 95% validity and 84% hit rate, representing significant improvements of up to 57% in validity and 14% in hit rate compared to existing methods.
arXiv Detail & Related papers (2025-11-05T02:14:13Z) - Reward driven discovery of the optimal microstructure representations with invariant variational autoencoders [0.015295722752489374]
Variational Autoencoders (VAEs) provide a powerful means of constructing such low-dimensional representations.<n>VAEs are often optimized through trial-and-error and empirical analysis.<n>We investigated reward-based strategies for evaluating latent space representations.
arXiv Detail & Related papers (2025-09-30T20:15:42Z) - Towards a Comprehensive Scaling Law of Mixture-of-Experts [54.117786590884776]
We propose a comprehensive and precise joint MoE scaling law that considers all essential factors.<n>Our results demonstrate that the optimal settings for $G$ and $S$ are independent of both the model architecture and data size.<n>Our proposed MoE scaling law could function as an accurate and insightful guidance to facilitate future MoE model design and training.
arXiv Detail & Related papers (2025-09-28T06:35:34Z) - LLM4CMO: Large Language Model-aided Algorithm Design for Constrained Multiobjective Optimization [54.35609820607923]
Large language models (LLMs) offer new opportunities for assisting with algorithm design.<n>We propose LLM4CMO, a novel CMOEA based on a dual-population, two-stage framework.<n>LLMs can serve as efficient co-designers in the development of complex evolutionary optimization algorithms.
arXiv Detail & Related papers (2025-08-16T02:00:57Z) - Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution [88.20464308588889]
We propose a Structural Similarity-Inspired Unfolding (SSIU) method for efficient image SR.<n>This method is designed through unfolding an SR optimization function constrained by structural similarity.<n>Our model outperforms current state-of-the-art models, boasting lower parameter counts and reduced memory consumption.
arXiv Detail & Related papers (2025-06-13T14:29:40Z) - MOFGPT: Generative Design of Metal-Organic Frameworks using Language Models [5.417632175667162]
Metal-Organic Frameworks (MOFs) with application-specific properties remain a central challenge in materials chemistry.<n>We present a reinforcement learning-enhanced, transformer-based framework for the de novo design of MOFs.<n>By integrating property feedback into sequence generation, our method drives the model toward synthesizable, topologically valid MOFs.
arXiv Detail & Related papers (2025-05-30T20:09:11Z) - Elucidating the Design Space of Multimodal Protein Language Models [69.3650883370033]
Multimodal protein language models (PLMs) integrate sequence and token-based structural information.
This paper systematically elucidates the design space of multimodal PLMs to overcome their limitations.
Our advancements approach finer-grained supervision, demonstrating that token-based multimodal PLMs can achieve robust structural modeling.
arXiv Detail & Related papers (2025-04-15T17:59:43Z) - Universality of Layer-Level Entropy-Weighted Quantization Beyond Model Architecture and Size [0.0]
We present a novel approach to selective model quantization using Entropy-Weighted Quantization (EWQ)
EWQ determines which blocks can be safely quantized without causing significant performance degradation, independent of model architecture or size.
Our method outperforms uniform quantization approaches, maintaining Massive Multitask Language Understanding (MMLU) accuracy scores within 0.5% of unquantized models.
arXiv Detail & Related papers (2025-03-06T18:54:32Z) - Multi-Objective Bayesian Optimization for Networked Black-Box Systems: A Path to Greener Profits and Smarter Designs [0.0]
MOBONS is a novel Bayesian optimization-inspired algorithm that can efficiently optimize general function networks.
We demonstrate the effectiveness of MOBONS through two case studies, including one related to sustainable process design.
arXiv Detail & Related papers (2025-02-19T21:49:05Z) - Quantum Computing Based Design of Multivariate Porous Materials [1.0923877073891446]
We propose a Hamiltonian model for quantum computing that integrates compositional, structural, and balance constraints directly into the Hamiltonian.
Our framework leads to exponentially efficient exploration of a vast search space of the linkers to identify optimal configurations.
Simulations on experimentally known MTV porous materials successfully reproduced their ground-state configurations.
arXiv Detail & Related papers (2025-02-10T10:40:22Z) - PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model [30.620582168350698]
Mixture-of-Experts (MoE) has emerged as a powerful approach for scaling transformers with improved resource utilization.
Inspired by recent works on -Efficient Fine-Tuning (PEFT), we present a unified framework for integrating PEFT modules directly into the MoE mechanism.
arXiv Detail & Related papers (2024-11-12T22:03:37Z) - Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging [111.8456671452411]
Multi-task learning (MTL) leverages a shared model to accomplish multiple tasks and facilitate knowledge transfer.
We propose a Weight-Ensembling Mixture of Experts (WEMoE) method for multi-task model merging.
We show that WEMoE and E-WEMoE outperform state-of-the-art (SOTA) model merging methods in terms of MTL performance, generalization, and robustness.
arXiv Detail & Related papers (2024-10-29T07:16:31Z) - Inverse Design of Metal-Organic Frameworks Using Quantum Natural Language Processing [0.0]
We explore the potential of using quantum natural language processing (QNLP) to inverse design metal frameworks (MOFs) with targeted properties.
By analyzing 150 hypothetical MOF structures, we categorize these into four distinct classes for pore volume and $H_2$ uptake values.
We develop multi-class classification models tailored to the probabilistic nature of quantum circuits.
arXiv Detail & Related papers (2024-05-20T05:02:12Z) - Large Language Model Agent as a Mechanical Designer [7.136205674624813]
We propose a framework that leverages a pretrained Large Language Model (LLM) in conjunction with an FEM module to autonomously generate, evaluate, and refine structural designs.
LLM operates without domain-specific fine-tuning, using general reasoning to propose design candidates, interpret FEM-derived performance metrics, and apply structurally sound modifications.
Compared to Non- Sorting Genetic Algorithm II (NSGA-II), our method achieves faster convergence and fewer FEM evaluations.
arXiv Detail & Related papers (2024-04-26T16:41:24Z) - Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning [50.73666458313015]
Large Language Models (LLMs) have demonstrated significant potential in performing multiple tasks in multimedia applications.
MoE has been emerged as a promising solution with its sparse architecture for effective task decoupling.
Intuition-MoR1E achieves superior efficiency and 2.15% overall accuracy improvement across 14 public datasets.
arXiv Detail & Related papers (2024-04-13T12:14:58Z) - Diffusion Model for Data-Driven Black-Box Optimization [54.25693582870226]
We focus on diffusion models, a powerful generative AI technology, and investigate their potential for black-box optimization.
We study two practical types of labels: 1) noisy measurements of a real-valued reward function and 2) human preference based on pairwise comparisons.
Our proposed method reformulates the design optimization problem into a conditional sampling problem, which allows us to leverage the power of diffusion models.
arXiv Detail & Related papers (2024-03-20T00:41:12Z) - Noise-powered Multi-modal Knowledge Graph Representation Framework [52.95468915728721]
The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph representation learning framework.
We propose a novel SNAG method that utilizes a Transformer-based architecture equipped with modality-level noise masking.
Our approach achieves SOTA performance across a total of ten datasets, demonstrating its versatility.
arXiv Detail & Related papers (2024-03-11T15:48:43Z) - Compositional Generative Inverse Design [69.22782875567547]
Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem.
We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples.
In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
arXiv Detail & Related papers (2024-01-24T01:33:39Z) - BOtied: Multi-objective Bayesian optimization with tied multivariate ranks [33.414682601242006]
In this paper, we show a natural connection between non-dominated solutions and the extreme quantile of the joint cumulative distribution function.
Motivated by this link, we propose the Pareto-compliant CDF indicator and the associated acquisition function, BOtied.
Our experiments on a variety of synthetic and real-world problems demonstrate that BOtied outperforms state-of-the-art MOBO acquisition functions.
arXiv Detail & Related papers (2023-06-01T04:50:06Z) - MOFormer: Self-Supervised Transformer model for Metal-Organic Framework
Property Prediction [7.367477168940467]
Metal-Organic Frameworks (MOFs) are materials with a high degree of porosity that can be used for applications in energy storage, water desalination, gas storage, and gas separation.
Finding the optimal MOFs for specific applications requires an efficient and accurate search over an enormous number of potential candidates.
We propose a structure-agnostic deep learning method based on the Transformer model, named as MOFormer, for property predictions of MOFs.
arXiv Detail & Related papers (2022-10-25T17:29:42Z) - Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning [89.31889875864599]
We propose an efficient model-based reinforcement learning algorithm for learning in multi-agent systems.
Our main theoretical contributions are the first general regret bounds for model-based reinforcement learning for MFC.
We provide a practical parametrization of the core optimization problem.
arXiv Detail & Related papers (2021-07-08T18:01:02Z) - Offline Model-Based Optimization via Normalized Maximum Likelihood
Estimation [101.22379613810881]
We consider data-driven optimization problems where one must maximize a function given only queries at a fixed set of points.
This problem setting emerges in many domains where function evaluation is a complex and expensive process.
We propose a tractable approximation that allows us to scale our method to high-capacity neural network models.
arXiv Detail & Related papers (2021-02-16T06:04:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.