Stylish and Functional: Guided Interpolation Subject to Physical Constraints

• URL: http://arxiv.org/abs/2412.15507v1
• Date: Fri, 20 Dec 2024 02:41:15 GMT
• Title: Stylish and Functional: Guided Interpolation Subject to Physical Constraints
• Abstract summary: One example of design manipulation involves taking two reference design images and using them as prompts to generate a design image that combines aspects of both.<n>We consider the problem of generating a design inspired by two input designs, and propose a zero-shot framework toward enforcing physical, functional requirements over the generation process.
• Score: 4.730817749718241
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative AI is revolutionizing engineering design practices by enabling rapid prototyping and manipulation of designs. One example of design manipulation involves taking two reference design images and using them as prompts to generate a design image that combines aspects of both. Real engineering designs have physical constraints and functional requirements in addition to aesthetic design considerations. Internet-scale foundation models commonly used for image generation, however, are unable to take these physical constraints and functional requirements into consideration as part of the generation process. We consider the problem of generating a design inspired by two input designs, and propose a zero-shot framework toward enforcing physical, functional requirements over the generation process by leveraging a pretrained diffusion model as the backbone. As a case study, we consider the example of rotational symmetry in generation of wheel designs. Automotive wheels are required to be rotationally symmetric for physical stability. We formulate the requirement of rotational symmetry by the use of a symmetrizer, and we use this symmetrizer to guide the diffusion process towards symmetric wheel generations. Our experimental results find that the proposed approach makes generated interpolations with higher realism than methods in related work, as evaluated by Fr\'echet inception distance (FID). We also find that our approach generates designs that more closely satisfy physical and functional requirements than generating without the symmetry guidance.

Related papers

• Planar Symmetric Pattern Generation [40.32465897894085]
  We propose a symmetrization framework for arbitrary planar groups.<n>Our method transforms any 2D continuous representation into a symmetric one while preserving continuity.
  arXiv  Detail & Related papers  (2026-06-01T11:01:48Z)
• A Unified Low-Dimensional Design Embedding for Joint Optimization of Shape, Material, and Actuation in Soft Robots [4.829343342713712]
  We introduce a smooth, low-dimensional design embedding for soft robots that unifies shape morphing, multi-material distribution, and actuation.<n>In experiments, we show that design increases with the number of basis functions, unlike comparable neural network encodings.<n>We further show that joint co-optimization of shape, material, and actuation using our unified embedding consistently outperforms sequential strategies.
  arXiv  Detail & Related papers  (2026-03-06T17:33:32Z)
• Generalized Linear Mode Connectivity for Transformers [87.32299363530996]
  A striking phenomenon is linear mode connectivity (LMC), where independently trained models can be connected by low- or zero-loss paths.<n>Prior work has predominantly focused on neuron re-ordering through permutations, but such approaches are limited in scope.<n>We introduce a unified framework that captures four symmetry classes: permutations, semi-permutations, transformations, and general invertible maps.<n>This generalization enables, for the first time, the discovery of low- and zero-barrier linear paths between independently trained Vision Transformers and GPT-2 models.
  arXiv  Detail & Related papers  (2025-06-28T01:46:36Z)
• Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling [6.34618828355523]
  AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. This work introduces a self-supervised geometric representation learning method designed to capture fine-scale geometric features from non-parametric 3D models.
  arXiv  Detail & Related papers  (2025-04-27T17:10:13Z)
• Efficient Design of Compliant Mechanisms Using Multi-Objective Optimization [50.24983453990065]
  We address the synthesis of a compliant cross-hinge mechanism capable of large angular strokes. We formulate a multi-objective optimization problem based on kinetostatic performance measures.
  arXiv  Detail & Related papers  (2025-04-23T06:29:10Z)
• Physics-Informed Geometric Operators to Support Surrogate, Dimension Reduction and Generative Models for Engineering Design [38.00713966087315]
  We propose a set of physics-informed geometric operators (GOs) to enrich the geometric data provided for training surrogate/discriminative models. GOs exploit the differential and integral properties of shapes to infuse high-level intrinsic geometric information and physics into the feature vector used for training.
  arXiv  Detail & Related papers  (2024-07-10T12:50:43Z)
• Compositional Generative Inverse Design [69.22782875567547]
  Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem. We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples. In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
  arXiv  Detail & Related papers  (2024-01-24T01:33:39Z)
• FAENet: Frame Averaging Equivariant GNN for Materials Modeling [123.19473575281357]
  We introduce a flexible framework relying on frameaveraging (SFA) to make any model E(3)-equivariant or invariant through data transformations. We prove the validity of our method theoretically and empirically demonstrate its superior accuracy and computational scalability in materials modeling.
  arXiv  Detail & Related papers  (2023-04-28T21:48:31Z)
• Design Space Exploration and Explanation via Conditional Variational Autoencoders in Meta-model-based Conceptual Design of Pedestrian Bridges [52.77024349608834]
  This paper provides a performance-driven design exploration framework to augment the human designer through a Conditional Variational Autoencoder (CVAE) The CVAE is trained on 18'000 synthetically generated instances of a pedestrian bridge in Switzerland.
  arXiv  Detail & Related papers  (2022-11-29T17:28:31Z)
• Physical Design using Differentiable Learned Simulators [9.380022457753938]
  In inverse design, learned forward simulators are combined with gradient-based design optimization. This framework produces high-quality designs by propagating through trajectories of hundreds of steps. Our results suggest that despite some remaining challenges, machine learning-based simulators are maturing to the point where they can support general-purpose design optimization.
  arXiv  Detail & Related papers  (2022-02-01T19:56:39Z)
• Inverse design of photonic devices with strict foundry fabrication constraints [55.41644538483948]
  We introduce a new method for inverse design of nanophotonic devices which guarantees that designs satisfy strict length scale constraints. We demonstrate the performance and reliability of our method by designing several common integrated photonic components.
  arXiv  Detail & Related papers  (2022-01-31T02:27:25Z)
• Vitruvion: A Generative Model of Parametric CAD Sketches [22.65229769427499]
  We present an approach to generative modeling of parametric CAD sketches. Our model, trained on real-world designs from the SketchGraphs dataset, autoregressively synthesizes sketches as sequences of primitives. We condition the model on various contexts, including partial sketches (primers) and images of hand-drawn sketches.
  arXiv  Detail & Related papers  (2021-09-29T01:02:30Z)
• Machine Learning Framework for Quantum Sampling of Highly-Constrained, Continuous Optimization Problems [101.18253437732933]
  We develop a generic, machine learning-based framework for mapping continuous-space inverse design problems into surrogate unconstrained binary optimization problems. We showcase the framework's performance on two inverse design problems by optimizing thermal emitter topologies for thermophotovoltaic applications and (ii) diffractive meta-gratings for highly efficient beam steering.
  arXiv  Detail & Related papers  (2021-05-06T02:22:23Z)
• Generative Design by Reinforcement Learning: Enhancing the Diversity of Topology Optimization Designs [5.8010446129208155]
  This study proposes a reinforcement learning based generative design process, with reward functions maximizing the diversity of topology designs. We show that RL-based generative design produces a large number of diverse designs within a short inference time by exploiting GPU in a fully automated manner.
  arXiv  Detail & Related papers  (2020-08-17T06:50:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.