Transfer Learning Across Fast- and Full-Simulation Domains in High-Energy Physics

• URL: http://arxiv.org/abs/2605.07471v1
• Date: Fri, 08 May 2026 09:18:34 GMT
• Title: Transfer Learning Across Fast- and Full-Simulation Domains in High-Energy Physics
• Abstract summary: We systematically study transfer learning between fast-simulated and fully simulated datasets in a realistic environment.<n>We consider three representative tasks, signal-background classification, quark-gluon jet tagging, and missing transverse energy reconstruction.<n>Models are pretrained on ATLAS-like fast simulation and adapted to CMS-like fast simulation and to fully simulated ATLAS Open Data.
• Score: 10.078675569996992
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine-learning models in high-energy physics are often trained on simulated data, where fully simulated samples are computationally expensive while fast simulation provides large statistics at reduced realism. In this work, we systematically study transfer learning between fast-simulated and fully simulated datasets in a realistic LHC environment. We consider three representative tasks, signal-background classification, quark-gluon jet tagging, and missing transverse energy reconstruction, using dense neural networks, graph neural networks, and transformer-based architectures. Models are pretrained on ATLAS-like fast simulation and adapted to CMS-like fast simulation and to fully simulated ATLAS Open Data. Across all tasks, pretrained models consistently outperform independently trained baselines and require significantly less target-domain training data, typically reducing the needed statistics by about a factor of two. These results demonstrate that fast simulation can be used to learn robust, reusable representations and motivate publishing trained models as reusable scientific assets beyond large foundation models.

Related papers

• Few-Shot Neural Differentiable Simulator: Real-to-Sim Rigid-Contact Modeling [9.084754731100311]
  We propose a few-shot real-to-sim approach that combines analytical formulations with the representational capacity of graph neural network (GNN)-based models.<n>Using only a small amount of real-world data, our method calibrates analytical simulators to generate large-scale synthetic datasets that capture diverse contact interactions.<n> Experimental results demonstrate that our approach enables learning-based simulators to outperform differentiable baselines in replicating real-world trajectories.
  arXiv  Detail & Related papers  (2026-03-06T12:32:56Z)
• Data assimilation and discrepancy modeling with shallow recurrent decoders [2.47593085771929]
  We propose a machine learning framework for Data Assimilation with a SHallow REcurrent Decoder (DA-SHRED)<n>Our algorithm incorporates a sparse identification of nonlinear dynamics based regression model in the latent space to identify functionals corresponding to missing dynamics in the simulation model.<n>We demonstrate that DA-SHRED successfully closes the SIM2REAL gap and additionally recovers missing dynamics in highly complex systems.
  arXiv  Detail & Related papers  (2025-12-01T01:01:48Z)
• Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning [20.72669976554826]
  Learned Graph Network Simulators (GNSs) offer a promising alternative to traditional mesh-based physics simulators.<n>Their speed and inherent differentiability make them well suited for applications that require fast and accurate simulations, such as robotic manipulation or manufacturing optimization.<n>We utilize movement primitives to directly predict fast, stable and accurate simulations from a single model call.
  arXiv  Detail & Related papers  (2025-11-07T13:34:02Z)
• Simulation Priors for Data-Efficient Deep Learning [56.525770511247934]
  SimPEL is a method that efficiently combines first-principles models with data-driven learning.<n>We evaluate SimPEL on diverse systems, including biological, agricultural, and robotic domains.<n>For decision-making, we demonstrate that SimPEL bridges the sim-to-real gap in model-based reinforcement learning.
  arXiv  Detail & Related papers  (2025-09-06T14:36:41Z)
• Physics-Informed Diffusion Models for SAR Ship Wake Generation from Text Prompts [4.4173427917548524]
  We develop a diffusion model trained on data generated by a physics-based simulator.<n>The model generates realistic Kelvin wake patterns and significantly achieves faster inference than the physics-based simulator.<n>These results highlight the potential of diffusion models for fast and controllable wake image generation.
  arXiv  Detail & Related papers  (2025-04-28T20:21:05Z)
• AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformers [20.363139473435048]
  We introduce AB-UPT as a novel modeling scheme for building neural surrogates for CFD simulations.<n>We show that AB-UPT yields state-of-the-art predictive accuracy of surface and volume fields on automotive CFD simulations ranging from 33 thousand up to 150 million mesh cells.<n> Notably, the proposed models can be trained on a single GPU in less than a day and predict industry-standard surface and volume fields within seconds.
  arXiv  Detail & Related papers  (2025-02-13T17:58:07Z)
• GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects [55.02281855589641]
  GausSim is a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels.<n>We leverage continuum mechanics and treat each kernel as a Center of Mass System (CMS) that represents continuous piece of matter.<n>In addition, GausSim incorporates explicit physics constraints, such as mass and momentum conservation, ensuring interpretable results and robust, physically plausible simulations.
  arXiv  Detail & Related papers  (2024-12-23T18:58:17Z)
• Bridging the Sim-to-Real Gap with Bayesian Inference [53.61496586090384]
  We present SIM-FSVGD for learning robot dynamics from data. We use low-fidelity physical priors to regularize the training of neural network models. We demonstrate the effectiveness of SIM-FSVGD in bridging the sim-to-real gap on a high-performance RC racecar system.
  arXiv  Detail & Related papers  (2024-03-25T11:29:32Z)
• SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learning [61.419914155985886]
  We propose SimVPv2, a streamlined model that eliminates the need for Unet architectures for spatial and temporal modeling.<n>SimVPv2 not only simplifies the model architecture but also improves both performance and computational efficiency.<n>On the standard Moving MNIST benchmark, SimVPv2 achieves superior performance compared to SimVP, with fewer FLOPs, about half the training time and 60% faster inference efficiency.
  arXiv  Detail & Related papers  (2022-11-22T08:01:33Z)
• Continual learning autoencoder training for a particle-in-cell simulation via streaming [52.77024349608834]
  upcoming exascale era will provide a new generation of physics simulations with high resolution. These simulations will have a high resolution, which will impact the training of machine learning models since storing a high amount of simulation data on disk is nearly impossible. This work presents an approach that trains a neural network concurrently to a running simulation without data on a disk.
  arXiv  Detail & Related papers  (2022-11-09T09:55:14Z)
• Deep Bayesian Active Learning for Accelerating Stochastic Simulation [74.58219903138301]
  Interactive Neural Process (INP) is a deep active learning framework for simulations and with active learning approaches. For active learning, we propose a novel acquisition function, Latent Information Gain (LIG), calculated in the latent space of NP based models. The results demonstrate STNP outperforms the baselines in the learning setting and LIG achieves the state-of-the-art for active learning.
  arXiv  Detail & Related papers  (2021-06-05T01:31:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.