Autofocused oracles for model-based design

• URL: http://arxiv.org/abs/2006.08052v2
• Date: Sat, 24 Oct 2020 23:32:54 GMT
• Title: Autofocused oracles for model-based design
• Authors: Clara Fannjiang and Jennifer Listgarten
• Abstract summary: We formalize the data-driven design problem as a non-zero-sum game. We develop a principled strategy for retraining the regression model as the design algorithm proceeds.
• Score: 8.22379888383833
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Data-driven design is making headway into a number of application areas, including protein, small-molecule, and materials engineering. The design goal is to construct an object with desired properties, such as a protein that binds to a therapeutic target, or a superconducting material with a higher critical temperature than previously observed. To that end, costly experimental measurements are being replaced with calls to high-capacity regression models trained on labeled data, which can be leveraged in an in silico search for design candidates. However, the design goal necessitates moving into regions of the design space beyond where such models were trained. Therefore, one can ask: should the regression model be altered as the design algorithm explores the design space, in the absence of new data? Herein, we answer this question in the affirmative. In particular, we (i) formalize the data-driven design problem as a non-zero-sum game, (ii) develop a principled strategy for retraining the regression model as the design algorithm proceeds---what we refer to as autofocusing, and (iii) demonstrate the promise of autofocusing empirically.

Related papers

• Cliqueformer: Model-Based Optimization with Structured Transformers [102.55764949282906]
  We develop a model that learns the structure of an MBO task and empirically leads to improved designs. We evaluate Cliqueformer on various tasks, ranging from high-dimensional black-box functions to real-world tasks of chemical and genetic design.
  arXiv  Detail & Related papers  (2024-10-17T00:35:47Z)
• Implicitly Guided Design with PropEn: Match your Data to Follow the Gradient [52.2669490431145]
  PropEn is inspired by'matching', which enables implicit guidance without training a discriminator. We show that training with a matched dataset approximates the gradient of the property of interest while remaining within the data distribution.
  arXiv  Detail & Related papers  (2024-05-28T11:30:19Z)
• Generative Design through Quality-Diversity Data Synthesis and Language Models [5.196236145367301]
  Two fundamental challenges face generative models in engineering applications: the acquisition of high-performing, diverse datasets, and the adherence to precise constraints in generated designs. We propose a novel approach combining optimization, constraint satisfaction, and language models to tackle these challenges in architectural design.
  arXiv  Detail & Related papers  (2024-05-16T11:30:08Z)
• Diffusion Model for Data-Driven Black-Box Optimization [54.25693582870226]
  We focus on diffusion models, a powerful generative AI technology, and investigate their potential for black-box optimization. We study two practical types of labels: 1) noisy measurements of a real-valued reward function and 2) human preference based on pairwise comparisons. Our proposed method reformulates the design optimization problem into a conditional sampling problem, which allows us to leverage the power of diffusion models.
  arXiv  Detail & Related papers  (2024-03-20T00:41:12Z)
• Compositional Generative Inverse Design [69.22782875567547]
  Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem. We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples. In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
  arXiv  Detail & Related papers  (2024-01-24T01:33:39Z)
• A Data-driven Recommendation Framework for Optimal Walker Designs [0.0]
  This paper focuses on leveraging statistical modeling and machine learning to optimize a medical walker. To achieve the desirable qualities of a walker, we train a predictive machine-learning model to identify trade-offs between performance objectives. This paper presents potential walker designs that demonstrate up to a 30% mass reduction while increasing structural stability and integrity.
  arXiv  Detail & Related papers  (2023-10-28T18:04:38Z)
• Progressive reduced order modeling: empowering data-driven modeling with selective knowledge transfer [0.0]
  We propose a progressive reduced order modeling framework that minimizes data cravings and enhances data-driven modeling's practicality. Our approach selectively transfers knowledge from previously trained models through gates, similar to how humans selectively use valuable knowledge while ignoring unuseful information. We have tested our framework in several cases, including transport in porous media, gravity-driven flow, and finite deformation in hyperelastic materials.
  arXiv  Detail & Related papers  (2023-10-04T23:50:14Z)
• Weighted Unsupervised Domain Adaptation Considering Geometry Features and Engineering Performance of 3D Design Data [2.306144660547256]
  We propose a bi-weighted unsupervised domain adaptation approach that considers the geometry features and engineering performance of 3D design data. The proposed model is tested on a wheel impact analysis problem to predict the magnitude of the maximum von Mises stress and the corresponding location of 3D road wheels.
  arXiv  Detail & Related papers  (2023-09-08T00:26:44Z)
• Geometric Deep Learning for Structure-Based Drug Design: A Survey [83.87489798671155]
  Structure-based drug design (SBDD) leverages the three-dimensional geometry of proteins to identify potential drug candidates. Recent advancements in geometric deep learning, which effectively integrate and process 3D geometric data, have significantly propelled the field forward.
  arXiv  Detail & Related papers  (2023-06-20T14:21:58Z)
• Conservative Objective Models for Effective Offline Model-Based Optimization [78.19085445065845]
  Computational design problems arise in a number of settings, from synthetic biology to computer architectures. We propose a method that learns a model of the objective function that lower bounds the actual value of the ground-truth objective on out-of-distribution inputs. COMs are simple to implement and outperform a number of existing methods on a wide range of MBO problems.
  arXiv  Detail & Related papers  (2021-07-14T17:55:28Z)
• Range-GAN: Range-Constrained Generative Adversarial Network for Conditioned Design Synthesis [10.50166876879424]
  We propose a conditional deep generative model, Range-GAN, to achieve automatic design subject to range constraints. We show that the label-aware self-augmentation leads to an average improvement of 14% on the constraint satisfaction for generated 3D shapes. We also propose a new uniformity loss to ensure generated designs evenly cover the given requirement range.
  arXiv  Detail & Related papers  (2021-03-10T18:02:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.