Offline Materials Optimization with CliqueFlowmer

• URL: http://arxiv.org/abs/2603.06082v1
• Date: Fri, 06 Mar 2026 09:33:00 GMT
• Title: Offline Materials Optimization with CliqueFlowmer
• Abstract summary: We offer an alternative CMD technique based on offline model-based optimization (MBO)<n>We introduce a domain-specific model, dubbed CliqueFlowmer, that incorporates recent advances of clique-based MBO into transformer and flow generation.<n>We validate CliqueFlowmer's optimization abilities and show that materials it produces strongly outperform those provided by generative baselines.
• Score: 89.10003379726857
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in deep learning inspired neural network-based approaches to computational materials discovery (CMD). A plethora of problems in this field involve finding materials that optimize a target property. Nevertheless, the increasingly popular generative modeling methods are ineffective at boldly exploring attractive regions of the materials space due to their maximum likelihood training. In this work, we offer an alternative CMD technique based on offline model-based optimization (MBO) that fuses direct optimization of a target material property into generation. To that end, we introduce a domain-specific model, dubbed CliqueFlowmer, that incorporates recent advances of clique-based MBO into transformer and flow generation. We validate CliqueFlowmer's optimization abilities and show that materials it produces strongly outperform those provided by generative baselines. To enable employment of CliqueFlowmer in specialized materials optimization problems and support interdisciplinary research, we open-source our code at https://github.com/znowu/CliqueFlowmer.

Related papers

• CrystalGym: A New Benchmark for Materials Discovery Using Reinforcement Learning [21.461755133360796]
  In silico design and optimization of new materials primarily relies on high-accuracy atomic simulators that perform density functional theory calculations.<n>To aid the adoption of direct DFT signals in the materials design loop through online reinforcement learning (RL), we propose CrystalGym.<n>We benchmark common value- and policy-based reinforcement learning algorithms for designing crystals conditioned on target properties.
  arXiv  Detail & Related papers  (2025-09-27T07:02:14Z)
• Offline Model-Based Optimization: Comprehensive Review [61.91350077539443]
  offline optimization is a fundamental challenge in science and engineering, where the goal is to optimize black-box functions using only offline datasets.<n>Recent advances in model-based optimization have harnessed the generalization capabilities of deep neural networks to develop offline-specific surrogate and generative models.<n>Despite its growing impact in accelerating scientific discovery, the field lacks a comprehensive review.
  arXiv  Detail & Related papers  (2025-03-21T16:35:02Z)
• ADO: Automatic Data Optimization for Inputs in LLM Prompts [36.850626629231705]
  This study explores a novel approach to enhance the performance of Large Language Models (LLMs) through the optimization of input data within prompts.<n>We introduce a two-pronged strategy for input data optimization: content engineering and structural reformulation.
  arXiv  Detail & Related papers  (2025-02-17T04:50:41Z)
• Accelerated AI Inference via Dynamic Execution Methods [0.562479170374811]
  We focus on Dynamic Execution techniques that optimize the computation flow based on input. The techniques discussed include early exit from deep networks, speculative sampling for language models, and adaptive steps for diffusion models. Experimental results demonstrate that these dynamic approaches can significantly improve latency and throughput without compromising quality.
  arXiv  Detail & Related papers  (2024-10-30T12:49:23Z)
• Cliqueformer: Model-Based Optimization with Structured Transformers [102.55764949282906]
  Large neural networks excel at prediction tasks, but their application to design problems, such as protein engineering or materials discovery, requires solving offline model-based optimization (MBO) problems.<n>We present Cliqueformer, a transformer-based architecture that learns the black-box function's structure through functional graphical models (FGM)<n>Across various domains, including chemical and genetic design tasks, Cliqueformer demonstrates superior performance compared to existing methods.
  arXiv  Detail & Related papers  (2024-10-17T00:35:47Z)
• Investigation of reinforcement learning for shape optimization of profile extrusion dies [1.5293427903448022]
  Reinforcement Learning (RL) is a learning-based optimization algorithm. RL is based on trial-and-error interactions of an agent with an environment. We investigate this approach by applying it to two 2D test cases.
  arXiv  Detail & Related papers  (2022-12-23T08:53:09Z)
• A Unified Framework for Alternating Offline Model Training and Policy Learning [62.19209005400561]
  In offline model-based reinforcement learning, we learn a dynamic model from historically collected data, and utilize the learned model and fixed datasets for policy learning. We develop an iterative offline MBRL framework, where we maximize a lower bound of the true expected return. With the proposed unified model-policy learning framework, we achieve competitive performance on a wide range of continuous-control offline reinforcement learning datasets.
  arXiv  Detail & Related papers  (2022-10-12T04:58:51Z)
• Surrogate-Based Black-Box Optimization Method for Costly Molecular Properties [0.0]
  We propose a surrogate-based black box optimization method to tackle jointly the optimization and machine learning problems. We show that our approach can successfully optimize a costly property of interest much faster than a purely metaheuristic approach.
  arXiv  Detail & Related papers  (2021-10-01T15:28:15Z)
• Conservative Objective Models for Effective Offline Model-Based Optimization [78.19085445065845]
  Computational design problems arise in a number of settings, from synthetic biology to computer architectures. We propose a method that learns a model of the objective function that lower bounds the actual value of the ground-truth objective on out-of-distribution inputs. COMs are simple to implement and outperform a number of existing methods on a wide range of MBO problems.
  arXiv  Detail & Related papers  (2021-07-14T17:55:28Z)
• Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization Perspective [52.497514255040514]
  This work develops a new approach that enables data-driven methods to continuously learn and optimize resource allocation strategies in a dynamic environment. We propose to build the notion of continual learning into wireless system design, so that the learning model can incrementally adapt to the new episodes. Our design is based on a novel bilevel optimization formulation which ensures certain fairness" across different data samples.
  arXiv  Detail & Related papers  (2021-05-03T07:23:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.