Optimizing CAD Models with Latent Space Manipulation
- URL: http://arxiv.org/abs/2303.12739v1
- Date: Thu, 9 Mar 2023 08:25:09 GMT
- Title: Optimizing CAD Models with Latent Space Manipulation
- Authors: Jannes Elstner and Raoul G. C. Sch\"onhof and Steffen Tauber and Marco
F Huber
- Abstract summary: We extend StyleCLIP to work with CAD models in the form of voxel models.
We demonstrate the ability of our system for the optimiziation of automation-related features by optimizing the grabability of various CAD models.
- Score: 4.180840853105103
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: When it comes to the optimization of CAD models in the automation domain,
neural networks currently play only a minor role. Optimizing abstract features
such as automation capability is challenging, since they can be very difficult
to simulate, are too complex for rule-based systems, and also have little to no
data available for machine-learning methods. On the other hand, image
manipulation methods that can manipulate abstract features in images such as
StyleCLIP have seen much success. They rely on the latent space of pretrained
generative adversarial networks, and could therefore also make use of the vast
amount of unlabeled CAD data. In this paper, we show that such an approach is
also suitable for optimizing abstract automation-related features of CAD parts.
We achieved this by extending StyleCLIP to work with CAD models in the form of
voxel models, which includes using a 3D StyleGAN and a custom classifier.
Finally, we demonstrate the ability of our system for the optimiziation of
automation-related features by optimizing the grabability of various CAD
models. This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer review under the
responsibility of the scientific committee of the 33rd CIRP Design Conference.
Related papers
- Computer Vision Model Compression Techniques for Embedded Systems: A Survey [75.38606213726906]
This paper covers the main model compression techniques applied for computer vision tasks.
We present the characteristics of compression subareas, compare different approaches, and discuss how to choose the best technique.
We also share codes to assist researchers and new practitioners in overcoming initial implementation challenges.
arXiv Detail & Related papers (2024-08-15T16:41:55Z) - Self-supervised Graph Neural Network for Mechanical CAD Retrieval [29.321027284348272]
GC-CAD is a self-supervised contrastive graph neural network-based method for mechanical CAD retrieval.
The proposed method achieves significant accuracy improvements and up to 100 times efficiency improvement over the baseline methods.
arXiv Detail & Related papers (2024-06-13T06:56:49Z) - Cross-Modal Self-Training: Aligning Images and Pointclouds to Learn Classification without Labels [69.55622471172941]
Large-scale vision 2D vision language models, such as CLIP can be aligned with a 3D encoder to learn generalizable (open-vocabulary) 3D vision models.
We propose an optimization framework: Cross-MoST: Cross-Modal Self-Training, to improve the label-free classification performance of a zero-shot 3D vision model.
arXiv Detail & Related papers (2024-04-15T21:30:50Z) - Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability [118.26563926533517]
Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space.
We extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation by improving auto-regressive models at capacity and scalability simultaneously.
arXiv Detail & Related papers (2024-02-19T15:33:09Z) - Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds [26.10631058349939]
We propose a hybrid analytic-neural reconstruction scheme that bridges the gap between segmented point clouds and structured CAD models.
We also propose a novel implicit neural representation of freeform surfaces, driving up the performance of our overall CAD reconstruction scheme.
arXiv Detail & Related papers (2023-12-07T08:23:44Z) - Learning Versatile 3D Shape Generation with Improved AR Models [91.87115744375052]
Auto-regressive (AR) models have achieved impressive results in 2D image generation by modeling joint distributions in the grid space.
We propose the Improved Auto-regressive Model (ImAM) for 3D shape generation, which applies discrete representation learning based on a latent vector instead of volumetric grids.
arXiv Detail & Related papers (2023-03-26T12:03:18Z) - AutoCAD: Automatically Generating Counterfactuals for Mitigating
Shortcut Learning [70.70393006697383]
We present AutoCAD, a fully automatic and task-agnostic CAD generation framework.
In this paper, we present AutoCAD, a fully automatic and task-agnostic CAD generation framework.
arXiv Detail & Related papers (2022-11-29T13:39:53Z) - How Does Counterfactually Augmented Data Impact Models for Social
Computing Constructs? [35.29235215101502]
We investigate the benefits of counterfactually augmented data (CAD) for social NLP models by focusing on three social computing constructs -- sentiment, sexism, and hate speech.
We find that while models trained on CAD show lower in-domain performance, they generalize better out-of-domain.
arXiv Detail & Related papers (2021-09-14T23:46:39Z) - AutoFIS: Automatic Feature Interaction Selection in Factorization Models
for Click-Through Rate Prediction [75.16836697734995]
We propose a two-stage algorithm called Automatic Feature Interaction Selection (AutoFIS)
AutoFIS can automatically identify important feature interactions for factorization models with computational cost just equivalent to training the target model to convergence.
AutoFIS has been deployed onto the training platform of Huawei App Store recommendation service.
arXiv Detail & Related papers (2020-03-25T06:53:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.