Learning the Physics of Particle Transport via Transformers

• URL: http://arxiv.org/abs/2109.03951v1
• Date: Wed, 8 Sep 2021 22:26:03 GMT
• Title: Learning the Physics of Particle Transport via Transformers
• Authors: Oscar Pastor-Serrano, Zolt\'an Perk\'o
• Abstract summary: We present a data-driven dose calculation algorithm predicting the dose deposited by mono-energetic proton beams. Our proposed model is 33 times faster than current clinical analytic pencil beam algorithms. Our model could overcome a major obstacle that has so far prohibited real-time adaptive proton treatments.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Particle physics simulations are the cornerstone of nuclear engineering applications. Among them radiotherapy (RT) is crucial for society, with 50% of cancer patients receiving radiation treatments. For the most precise targeting of tumors, next generation RT treatments aim for real-time correction during radiation delivery, necessitating particle transport algorithms that yield precise dose distributions in sub-second times even in highly heterogeneous patient geometries. This is infeasible with currently available, purely physics based simulations. In this study, we present a data-driven dose calculation algorithm predicting the dose deposited by mono-energetic proton beams for arbitrary energies and patient geometries. Our approach frames particle transport as sequence modeling, where convolutional layers extract important spatial features into tokens and the transformer self-attention mechanism routes information between such tokens in the sequence and a beam energy token. We train our network and evaluate prediction accuracy using computationally expensive but accurate Monte Carlo (MC) simulations, considered the gold standard in particle physics. Our proposed model is 33 times faster than current clinical analytic pencil beam algorithms, improving upon their accuracy in the most heterogeneous and challenging geometries. With a relative error of 0.34% and very high gamma pass rate of 99.59% (1%, 3 mm), it also greatly outperforms the only published similar data-driven proton dose algorithm, even at a finer grid resolution. Offering MC precision 400 times faster, our model could overcome a major obstacle that has so far prohibited real-time adaptive proton treatments and significantly increase cancer treatment efficacy. Its potential to model physics interactions of other particles could also boost heavy ion treatment planning procedures limited by the speed of traditional methods.

Related papers

• Physics Enhanced Deep Surrogates for the Phonon Boltzmann Transport Equation [0.0]
  Physics-Enhanced Deep Surrogate (PEDS)<n>Network learns geometry-dependent corrections and a mixing coefficient that interpolates between macroscopic and nano-scale behavior.<n>PEDS reduces training-data requirements by up to 70% compared with purely data-driven baselines.
  arXiv  Detail & Related papers  (2025-11-25T16:25:24Z)
• Accelerating Radiative Transfer for Planetary Atmospheres by Orders of Magnitude with a Transformer-Based Machine Learning Model [0.0044302156879028705]
  Emulating radiative transfer with machine learning opens up the possibility for faster and more accurate routines within planetary atmospheric models.<n>We developed a radiative transfer emulator using an encoder-only transformer neural network architecture, trained on 1D profiles representative of solar-composition hot Jupiter atmospheres.
  arXiv  Detail & Related papers  (2025-10-30T23:38:53Z)
• Foundation Models for Discovery and Exploration in Chemical Space [57.97784111110166]
  MIST is a family of molecular foundation models trained on large unlabeled datasets.<n>We demonstrate the ability of these models to solve real-world problems across chemical space.
  arXiv  Detail & Related papers  (2025-10-20T17:56:01Z)
• Machine Learning-Integrated Hybrid Fluid-Kinetic Framework for Quantum Electrodynamic Laser Plasma Simulations [0.0]
  The research introduces a machine learning-based three-dimensional hybrid fluid-particle-in-cell (PIC) system.<n>The technique employs fluid approximations for stable areas but activates the PIC solver when SwitchNet directs it to unstable sections.<n>The model produces precise predictions with coefficient of determination (R2) values above 0.95 and mean squared errors below 10-4 for all field components.
  arXiv  Detail & Related papers  (2025-10-13T09:07:59Z)
• Accelerating Long-Term Molecular Dynamics with Physics-Informed Time-Series Forecasting [7.705860755153007]
  Molecular dynamics (MD) simulation is vital for understanding atomic-scale processes in materials science and biophysics.<n>Traditional density functional theory (DFT) methods are computationally expensive, which limits the feasibility of long-term simulations.<n>We propose a novel approach that formulates MD simulation as a time-series forecasting problem.
  arXiv  Detail & Related papers  (2025-09-16T02:00:52Z)
• Fast simulations of X-ray absorption spectroscopy for battery materials on a quantum computer [36.21999915593711]
  This work proposes a highly-optimized implementation of the time-domain algorithm for X-ray absorption.<n>The low cost of our algorithm makes it attractive to use on fault-tolerant quantum devices to accelerate the development and commercialization of high-capacity battery cathodes.
  arXiv  Detail & Related papers  (2025-06-18T18:00:29Z)
• Neurons for Neutrons: A Transformer Model for Computation Load Estimation on Domain-Decomposed Neutron Transport Problems [48.35237609036802]
  We propose a Transformer model with a unique 3D input embedding, and input representations designed for domain-decomposed neutron transport problems.<n>We demonstrate that such a model trained on domain-decomposed Small Modular Reactor (SMR) simulations achieves 98.2% accuracy while being able to skip the small-scale simulation step entirely.
  arXiv  Detail & Related papers  (2024-11-05T18:17:51Z)
• A Multi-Grained Symmetric Differential Equation Model for Learning Protein-Ligand Binding Dynamics [73.35846234413611]
  In drug discovery, molecular dynamics (MD) simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites. We propose NeuralMD, the first machine learning (ML) surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding dynamics. We demonstrate the efficiency and effectiveness of NeuralMD, achieving over 1K$times$ speedup compared to standard numerical MD simulations.
  arXiv  Detail & Related papers  (2024-01-26T09:35:17Z)
• Gradual Optimization Learning for Conformational Energy Minimization [69.36925478047682]
  Gradual Optimization Learning Framework (GOLF) for energy minimization with neural networks significantly reduces the required additional data. Our results demonstrate that the neural network trained with GOLF performs on par with the oracle on a benchmark of diverse drug-like molecules.
  arXiv  Detail & Related papers  (2023-11-05T11:48:08Z)
• Label-free timing analysis of SiPM-based modularized detectors with physics-constrained deep learning [9.234802409391111]
  We propose a novel method based on deep learning for timing analysis of modularized detectors. We mathematically demonstrate the existence of the optimal function desired by the method, and give a systematic algorithm for training and calibration of the model.
  arXiv  Detail & Related papers  (2023-04-24T09:16:31Z)
• Improving the Timing Resolution of Positron Emission Tomography Detectors Using Boosted Learning -- A Residual Physics Approach [0.4999814847776097]
  This work presents a novel and versatile approach to detector optimization using machine learning (ML) and residual physics. We apply the concept to positron emission tomography (PET), intending to improve the coincidence time resolution (CTR) We were able to improve the CTR significantly (more than 20%) for clinically relevant detectors of 19 mm height, reaching CTRs of 185 ps (450-550 keV)
  arXiv  Detail & Related papers  (2023-02-03T12:10:24Z)
• Particle-Based Score Estimation for State Space Model Learning in Autonomous Driving [62.053071723903834]
  Multi-object state estimation is a fundamental problem for robotic applications. We consider learning maximum-likelihood parameters using particle methods. We apply our method to real data collected from autonomous vehicles.
  arXiv  Detail & Related papers  (2022-12-14T01:21:05Z)
• Transfer learning for chemically accurate interatomic neural network potentials [0.0]
  We show that pre-training the network parameters on data obtained from density functional calculations improves the sample efficiency of models trained on more accurate ab-initio data. We provide GM-NN potentials pre-trained and fine-tuned on the ANI-1x and ANI-1ccx data sets, which can easily be fine-tuned on and applied to organic molecules.
  arXiv  Detail & Related papers  (2022-12-07T19:21:01Z)
• Retrieving space-dependent polarization transformations via near-optimal quantum process tomography [55.41644538483948]
  We investigate the application of genetic and machine learning approaches to tomographic problems. We find that the neural network-based scheme provides a significant speed-up, that may be critical in applications requiring a characterization in real-time. We expect these results to lay the groundwork for the optimization of tomographic approaches in more general quantum processes.
  arXiv  Detail & Related papers  (2022-10-27T11:37:14Z)
• DriPP: Driven Point Processes to Model Stimuli Induced Patterns in M/EEG Signals [62.997667081978825]
  We develop a novel statistical point process model-called driven temporal point processes (DriPP) We derive a fast and principled expectation-maximization (EM) algorithm to estimate the parameters of this model. Results on standard MEG datasets demonstrate that our methodology reveals event-related neural responses.
  arXiv  Detail & Related papers  (2021-12-08T13:07:21Z)
• A Machine-learning Based Initialization for Joint Statistical Iterative Dual-energy CT with Application to Proton Therapy [9.887533541077193]
  A CNN-based simulation method is introduced to reduce the computational time of iterative algorithms. Our method generates denoised images with greatly improved estimation accuracy for adipose, phantom tonsils, and muscle tissue.
  arXiv  Detail & Related papers  (2021-07-30T23:49:22Z)
• Simultaneous boundary shape estimation and velocity field de-noising in Magnetic Resonance Velocimetry using Physics-informed Neural Networks [70.7321040534471]
  Magnetic resonance velocimetry (MRV) is a non-invasive technique widely used in medicine and engineering to measure the velocity field of a fluid. Previous studies have required the shape of the boundary (for example, a blood vessel) to be known a priori. We present a physics-informed neural network that instead uses the noisy MRV data alone to infer the most likely boundary shape and de-noised velocity field.
  arXiv  Detail & Related papers  (2021-07-16T12:56:09Z)
• Predicting atmospheric optical properties for radiative transfer computations using neural networks [0.0]
  We develop a machine learning-based parametrization for the gaseous optical properties by training neural networks to emulate a modern radiation parameterization (RRTMGP) Our neural network-based gas optics parametrization is up to 4 times faster than RRTMGP, depending on the size of the neural networks. We conclude that our machine learning-based parametrization can speed-up radiative transfer computations whilst retaining high accuracy.
  arXiv  Detail & Related papers  (2020-05-05T15:00:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.