Autofocused oracles for model-based design
- URL: http://arxiv.org/abs/2006.08052v2
- Date: Sat, 24 Oct 2020 23:32:54 GMT
- Title: Autofocused oracles for model-based design
- Authors: Clara Fannjiang and Jennifer Listgarten
- Abstract summary: We formalize the data-driven design problem as a non-zero-sum game.
We develop a principled strategy for retraining the regression model as the design algorithm proceeds.
- Score: 8.22379888383833
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Data-driven design is making headway into a number of application areas,
including protein, small-molecule, and materials engineering. The design goal
is to construct an object with desired properties, such as a protein that binds
to a therapeutic target, or a superconducting material with a higher critical
temperature than previously observed. To that end, costly experimental
measurements are being replaced with calls to high-capacity regression models
trained on labeled data, which can be leveraged in an in silico search for
design candidates. However, the design goal necessitates moving into regions of
the design space beyond where such models were trained. Therefore, one can ask:
should the regression model be altered as the design algorithm explores the
design space, in the absence of new data? Herein, we answer this question in
the affirmative. In particular, we (i) formalize the data-driven design problem
as a non-zero-sum game, (ii) develop a principled strategy for retraining the
regression model as the design algorithm proceeds---what we refer to as
autofocusing, and (iii) demonstrate the promise of autofocusing empirically.
Related papers
- Implicitly Guided Design with PropEn: Match your Data to Follow the Gradient [52.2669490431145]
PropEn is inspired by'matching', which enables implicit guidance without training a discriminator.
We show that training with a matched dataset approximates the gradient of the property of interest while remaining within the data distribution.
arXiv Detail & Related papers (2024-05-28T11:30:19Z) - Generative Design through Quality-Diversity Data Synthesis and Language Models [5.196236145367301]
Two fundamental challenges face generative models in engineering applications: the acquisition of high-performing, diverse datasets, and the adherence to precise constraints in generated designs.
We propose a novel approach combining optimization, constraint satisfaction, and language models to tackle these challenges in architectural design.
arXiv Detail & Related papers (2024-05-16T11:30:08Z) - Diffusion Model for Data-Driven Black-Box Optimization [54.25693582870226]
We focus on diffusion models, a powerful generative AI technology, and investigate their potential for black-box optimization.
We study two practical types of labels: 1) noisy measurements of a real-valued reward function and 2) human preference based on pairwise comparisons.
Our proposed method reformulates the design optimization problem into a conditional sampling problem, which allows us to leverage the power of diffusion models.
arXiv Detail & Related papers (2024-03-20T00:41:12Z) - Compositional Generative Inverse Design [69.22782875567547]
Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem.
We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples.
In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
arXiv Detail & Related papers (2024-01-24T01:33:39Z) - Generative Inverse Design of Metamaterials with Functional Responses by Interpretable Learning [3.931881794708454]
We propose a Random-forest-based Interpretable Generative Inverse Design (RIGID) method to achieve the fast generation of metamaterial designs with on-demand functional behaviors.
Based on the likelihood of target satisfaction derived from the trained forward model, one can sample design solutions using Markov chain Monte Carlo methods.
arXiv Detail & Related papers (2023-12-08T04:24:03Z) - Progressive reduced order modeling: empowering data-driven modeling with
selective knowledge transfer [0.0]
We propose a progressive reduced order modeling framework that minimizes data cravings and enhances data-driven modeling's practicality.
Our approach selectively transfers knowledge from previously trained models through gates, similar to how humans selectively use valuable knowledge while ignoring unuseful information.
We have tested our framework in several cases, including transport in porous media, gravity-driven flow, and finite deformation in hyperelastic materials.
arXiv Detail & Related papers (2023-10-04T23:50:14Z) - Weighted Unsupervised Domain Adaptation Considering Geometry Features
and Engineering Performance of 3D Design Data [2.306144660547256]
We propose a bi-weighted unsupervised domain adaptation approach that considers the geometry features and engineering performance of 3D design data.
The proposed model is tested on a wheel impact analysis problem to predict the magnitude of the maximum von Mises stress and the corresponding location of 3D road wheels.
arXiv Detail & Related papers (2023-09-08T00:26:44Z) - Towards Efficient Task-Driven Model Reprogramming with Foundation Models [52.411508216448716]
Vision foundation models exhibit impressive power, benefiting from the extremely large model capacity and broad training data.
However, in practice, downstream scenarios may only support a small model due to the limited computational resources or efficiency considerations.
This brings a critical challenge for the real-world application of foundation models: one has to transfer the knowledge of a foundation model to the downstream task.
arXiv Detail & Related papers (2023-04-05T07:28:33Z) - Design Space Exploration and Explanation via Conditional Variational
Autoencoders in Meta-model-based Conceptual Design of Pedestrian Bridges [52.77024349608834]
This paper provides a performance-driven design exploration framework to augment the human designer through a Conditional Variational Autoencoder (CVAE)
The CVAE is trained on 18'000 synthetically generated instances of a pedestrian bridge in Switzerland.
arXiv Detail & Related papers (2022-11-29T17:28:31Z) - Conservative Objective Models for Effective Offline Model-Based
Optimization [78.19085445065845]
Computational design problems arise in a number of settings, from synthetic biology to computer architectures.
We propose a method that learns a model of the objective function that lower bounds the actual value of the ground-truth objective on out-of-distribution inputs.
COMs are simple to implement and outperform a number of existing methods on a wide range of MBO problems.
arXiv Detail & Related papers (2021-07-14T17:55:28Z) - Range-GAN: Range-Constrained Generative Adversarial Network for
Conditioned Design Synthesis [10.50166876879424]
We propose a conditional deep generative model, Range-GAN, to achieve automatic design subject to range constraints.
We show that the label-aware self-augmentation leads to an average improvement of 14% on the constraint satisfaction for generated 3D shapes.
We also propose a new uniformity loss to ensure generated designs evenly cover the given requirement range.
arXiv Detail & Related papers (2021-03-10T18:02:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.