Towards a Foundation-Model Paradigm for Aerodynamic Prediction in Three-dimensional Design

• URL: http://arxiv.org/abs/2604.18062v1
• Date: Mon, 20 Apr 2026 10:33:14 GMT
• Title: Towards a Foundation-Model Paradigm for Aerodynamic Prediction in Three-dimensional Design
• Abstract summary: This work introduces a methodology for constructing accurate surrogate models for aerodynamic design purposes.<n>A Transformer-based architecture, AeroTransformer, is developed and tailored for large-scale training to learn aerodynamics.<n>The proposed methodology achieves 0.36% error on surface-flow prediction, reducing 84.2% compared to training from scratch.
• Score: 19.79086277218628
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate machine-learning models for aerodynamic prediction are essential for accelerating shape optimization, yet remain challenging to develop for complex three-dimensional configurations due to the high cost of generating training data. This work introduces a methodology for efficiently constructing accurate surrogate models for design purposes by first pre-training a large-scale model on diverse geometries and then fine-tuning it with a few more detailed task-specific samples. A Transformer-based architecture, AeroTransformer, is developed and tailored for large-scale training to learn aerodynamics. The methodology is evaluated on transonic wings, where the model is pre-trained on SuperWing, a dataset of nearly 30000 samples with broad geometric diversity, and subsequently fine-tuned to handle specific wing shapes perturbed from the Common Research Model. Results show that, with 450 task-specific samples, the proposed methodology achieves 0.36% error on surface-flow prediction, reducing 84.2% compared to training from scratch. The influence of model configurations and training strategies is also systematically studied to provide guidance on effectively training and deploying such models under limited data and computational budgets. To facilitate reuse, we release the datasets and the pre-trained models at https://github.com/tum-pbs/AeroTransformer. An interactive design tool is also built on the pre-trained model and is available online at https://webwing.pbs.cit.tum.de.

Related papers

• Approximating Language Model Training Data from Weights [70.08614275061689]
  We formalize the problem of data approximation from model weights and propose several baselines and metrics.<n>We develop a gradient-based approach that selects the highest-matching data from a large public text corpus.<n>Even when none of the true training data is known, our method is able to locate a small subset of public Web documents.
  arXiv  Detail & Related papers  (2025-06-18T15:26:43Z)
• Optimizing ML Training with Metagradient Descent [69.89631748402377]
  We introduce an algorithm for efficiently calculating metagradients -- gradients through model training -- at scale.<n>We then introduce a "smooth model training" framework that enables effective optimization using metagradients.
  arXiv  Detail & Related papers  (2025-03-17T22:18:24Z)
• Transfer learning in Scalable Graph Neural Network for Improved Physical Simulation [37.1565271299621]
  We introduce a pre-training and transfer learning paradigm for graph network simulators.<n>We show that our proposed transfer learning methods allow the model to perform even better when fine-tuned with small amounts of training data.
  arXiv  Detail & Related papers  (2025-02-07T08:18:23Z)
• Open-Source High-Speed Flight Surrogate Modeling Framework [0.0]
  High-speed flight vehicles, which travel much faster than the speed of sound, are crucial for national defense and space exploration. accurately predicting their behavior under numerous, varied flight conditions is a challenge and often expensive. The proposed approach involves creating smarter, more efficient machine learning models.
  arXiv  Detail & Related papers  (2024-11-06T01:34:06Z)
• Flying Quadrotors in Tight Formations using Learning-based Model Predictive Control [30.715469693232492]
  In this work, we propose a framework that combines the benefits of first-principles modeling and data-driven approaches. We show that incorporating the model into a novel learning-based predictive model control framework results in substantial performance improvements. Our framework also achieves exceptional sample efficiency, using only a total of 46 seconds of flight data for training.
  arXiv  Detail & Related papers  (2024-10-13T05:03:16Z)
• Exploring the design space of deep-learning-based weather forecasting systems [56.129148006412855]
  This paper systematically analyzes the impact of different design choices on deep-learning-based weather forecasting systems. We study fixed-grid architectures such as UNet, fully convolutional architectures, and transformer-based models. We propose a hybrid system that combines the strong performance of fixed-grid models with the flexibility of grid-invariant architectures.
  arXiv  Detail & Related papers  (2024-10-09T22:25:50Z)
• Rapid aerodynamic prediction of swept wings via physics-embedded transfer learning [10.191783697332227]
  Machine learning models provide a promising way to rapidly acquire transonic swept wing flow fields. We propose a physics-embedded transfer learning framework to efficiently train the model. When reducing the dataset size, less than half of the wing training samples are need to reach the same error level as the nontransfer framework.
  arXiv  Detail & Related papers  (2024-09-19T12:35:59Z)
• Compositional Generative Inverse Design [69.22782875567547]
  Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem. We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples. In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
  arXiv  Detail & Related papers  (2024-01-24T01:33:39Z)
• Towards A Foundation Model For Trajectory Intelligence [0.0]
  We present the results of training a large trajectory model using real-world user check-in data. Our approach follows a pre-train and fine-tune paradigm, where a base model is pre-trained via masked trajectory modeling. Our empirical analysis utilizes a comprehensive dataset of over 2 billion check-ins generated by more than 6 million users.
  arXiv  Detail & Related papers  (2023-11-30T00:34:09Z)
• Reusing Pretrained Models by Multi-linear Operators for Efficient Training [65.64075958382034]
  Training large models from scratch usually costs a substantial amount of resources. Recent studies such as bert2BERT and LiGO have reused small pretrained models to initialize a large model. We propose a method that linearly correlates each weight of the target model to all the weights of the pretrained model.
  arXiv  Detail & Related papers  (2023-10-16T06:16:47Z)
• SO(2)-Equivariant Downwash Models for Close Proximity Flight [6.297269227845377]
  We present a novel learning-based approach for modelling the downwash forces that exploits the latent geometries (i.e. symmetries) present in the problem. We demonstrate that when trained with only 5 minutes of real-world flight data, our geometry-aware model outperforms state-of-the-art baseline models trained with more than 15 minutes of data.
  arXiv  Detail & Related papers  (2023-05-30T12:27:47Z)
• Automatic Parameterization for Aerodynamic Shape Optimization via Deep Geometric Learning [60.69217130006758]
  We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization. Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric patterns. We perform shape optimization experiments on 2D airfoils and discuss the applicable scenarios for the two models.
  arXiv  Detail & Related papers  (2023-05-03T13:45:40Z)
• Towards Efficient Task-Driven Model Reprogramming with Foundation Models [52.411508216448716]
  Vision foundation models exhibit impressive power, benefiting from the extremely large model capacity and broad training data. However, in practice, downstream scenarios may only support a small model due to the limited computational resources or efficiency considerations. This brings a critical challenge for the real-world application of foundation models: one has to transfer the knowledge of a foundation model to the downstream task.
  arXiv  Detail & Related papers  (2023-04-05T07:28:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.