Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulation

• URL: http://arxiv.org/abs/2405.06605v3
• Date: Tue, 6 Aug 2024 15:20:00 GMT
• Title: Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulation
• Abstract summary: We introduce a novel machine learning method developed for the fast simulation of calorimeter detector response, adapting vector-quantized variational autoencoder (VQ-VAE) Our model adopts a two-stage generation strategy: compressing geometry-aware calorimeter data into a discrete latent space, followed by the application of a sequence model to learn and generate the latent tokens. Remarkably, our model achieves the generation of calorimeter showers within milliseconds.
• Score: 14.42579802774594
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a novel machine learning method developed for the fast simulation of calorimeter detector response, adapting vector-quantized variational autoencoder (VQ-VAE). Our model adopts a two-stage generation strategy: initially compressing geometry-aware calorimeter data into a discrete latent space, followed by the application of a sequence model to learn and generate the latent tokens. Extensive experimentation on the Calo-challenge dataset underscores the efficiency of our approach, showcasing a remarkable improvement in the generation speed compared with conventional method by a factor of 2000. Remarkably, our model achieves the generation of calorimeter showers within milliseconds. Furthermore, comprehensive quantitative evaluations across various metrics are performed to validate physics performance of generation.

Related papers

• AI-Driven Surrogate Models for Predicting Electrode-Scale Discharge Behavior in Lithium-Ion Batteries [47.27974914502511]
  We introduce a deep learning surrogate pipeline based on the Swin3D Transformer to predict discharge dynamics directly from data.<n>The proposed method reduces the computational overhead by orders of magnitude, providing a scalable and efficient framework for high- throughput battery design and optimization.
  arXiv  Detail & Related papers  (2026-07-22T09:10:48Z)
• GPT-Based Fast Simulation of CLAS12 Detector Hits via Conditional Autoregressive Generation [0.0]
  We present an application of a GPT-style autoregressive transformer as a fast surrogate model for the calorimeter inside the CLAS12 experiment.<n>We demonstrate that the model faithfully reproduces hit multiplicity, spatial distributions, energy deposits, and the energy-momentum response of the electromagnetic calorimeter.
  arXiv  Detail & Related papers  (2026-06-14T22:08:18Z)
• Calorimeter Shower Superresolution with Conditional Normalizing Flows: Implementation and Statistical Evaluation [0.0]
  This thesis investigates whether a generative model originally designed for fast simulation can be effectively applied to calorimeter superresolution.<n>Specifically, the model proposed in arXiv:2308.11700 is re-implemented independently and trained on the CaloChallenge 2022 dataset based on the Geant4 Par04 calorimeter geometry.
  arXiv  Detail & Related papers  (2026-03-26T17:07:04Z)
• Equilibrium Matching: Generative Modeling with Implicit Energy-Based Models [52.74448905289362]
  EqM is a generative modeling framework built from an equilibrium dynamics perspective.<n>By replacing time-conditional velocities with a unified equilibrium landscape, EqM offers a tighter bridge between flow and energy-based models.
  arXiv  Detail & Related papers  (2025-10-02T17:59:06Z)
• CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attention [53.539020807256904]
  We introduce a Compact for Representations of Brain Oscillations using alternating attention (CEReBrO) Our tokenization scheme represents EEG signals at a per-channel patch. We propose an alternating attention mechanism that jointly models intra-channel temporal dynamics and inter-channel spatial correlations, achieving 2x speed improvement with 6x less memory required compared to standard self-attention.
  arXiv  Detail & Related papers  (2025-01-18T21:44:38Z)
• CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation [22.42342223406944]
  We present the results of the "Fast Calorimeter Simulation Challenge 2022" - the CaloChallenge. We study state-of-the-art generative models on four calorimeter shower datasets of increasing dimensionality.
  arXiv  Detail & Related papers  (2024-10-28T23:28:07Z)
• Bayesian Circular Regression with von Mises Quasi-Processes [57.88921637944379]
  In this work we explore a family of expressive and interpretable distributions over circle-valued random functions. For posterior inference, we introduce a new Stratonovich-like augmentation that lends itself to fast Gibbs sampling. We present experiments applying this model to the prediction of wind directions and the percentage of the running gait cycle as a function of joint angles.
  arXiv  Detail & Related papers  (2024-06-19T01:57:21Z)
• Unifying Simulation and Inference with Normalizing Flows [0.08796261172196743]
  We show that two tasks can be unified by using maximum likelihood estimation (MLE) from conditional generative models for energy regression. Using an ATLAS-like calorimeter simulation, we demonstrate this concept in the context of calorimeter energy calibration.
  arXiv  Detail & Related papers  (2024-04-29T18:00:00Z)
• A conditional latent autoregressive recurrent model for generation and forecasting of beam dynamics in particle accelerators [46.348283638884425]
  We propose a two-step unsupervised deep learning framework named as Latent Autoregressive Recurrent Model (CLARM) for learning dynamics of charged particles in accelerators. The CLARM can generate projections at various accelerator sampling modules by capturing and decoding the latent space representation. The results demonstrate that the generative and forecasting ability of the proposed approach is promising when tested against a variety of evaluation metrics.
  arXiv  Detail & Related papers  (2024-03-19T22:05:17Z)
• Predicting Ordinary Differential Equations with Transformers [65.07437364102931]
  We develop a transformer-based sequence-to-sequence model that recovers scalar ordinary differential equations (ODEs) in symbolic form from irregularly sampled and noisy observations of a single solution trajectory. Our method is efficiently scalable: after one-time pretraining on a large set of ODEs, we can infer the governing law of a new observed solution in a few forward passes of the model.
  arXiv  Detail & Related papers  (2023-07-24T08:46:12Z)
• Comparison of Point Cloud and Image-based Models for Calorimeter Fast Simulation [48.26243807950606]
  Two state-of-the-art score based models are trained on the same set of calorimeter simulation and directly compared. generative models are a new class of generative models that have been shown to accurately generate high dimensional calorimeter datasets.
  arXiv  Detail & Related papers  (2023-07-10T08:20:45Z)
• Machine Learning methods for simulating particle response in the Zero Degree Calorimeter at the ALICE experiment, CERN [8.980453507536017]
  Currently, over half of the computing power at CERN GRID is used to run High Energy Physics simulations. The recent updates at the Large Hadron Collider (LHC) create the need for developing more efficient simulation methods. We propose an alternative approach to the problem that leverages machine learning.
  arXiv  Detail & Related papers  (2023-06-23T16:45:46Z)
• Generalizing to new geometries with Geometry-Aware Autoregressive Models (GAAMs) for fast calorimeter simulation [6.099458999905677]
  Generative models can provide more rapid sample production, but currently require significant effort to optimize performance for specific detector geometries. We develop a $textitgeometry-aware$ autoregressive model, which learns how the calorimeter response varies with geometry. The geometry-aware model outperforms a baseline unaware model by over $50%$ in several metrics.
  arXiv  Detail & Related papers  (2023-05-19T08:54:49Z)
• Minimizing Trajectory Curvature of ODE-based Generative Models [45.89620603363946]
  Recent generative models, such as diffusion models, rectified flows, and flow matching, define a generative process as a time reversal of a fixed forward process. We present an efficient method of training the forward process to minimize the curvature of generative trajectories without any ODE/SDE simulation.
  arXiv  Detail & Related papers  (2023-01-27T21:52:03Z)
• Geometry-aware Autoregressive Models for Calorimeter Shower Simulations [6.01665219244256]
  We develop a geometry-aware autoregressive model on a range of calorimeter geometries. This is a key proof-of-concept step towards building a model that can generalize to new unseen calorimeter geometries. Such a model can replace the hundreds of generative models used for calorimeter simulation in a Large Hadron Collider experiment.
  arXiv  Detail & Related papers  (2022-12-16T01:45:17Z)
• Score-based Generative Models for Calorimeter Shower Simulation [2.0813318162800707]
  We introduce CaloScore, a score-based generative model for collider physics applied to calorimeter shower generation. CaloScore is the first application of a score-based generative model in collider physics and is able to produce high-fidelity calorimeter images for all datasets.
  arXiv  Detail & Related papers  (2022-06-17T18:01:02Z)
• Generative Principal Component Analysis [47.03792476688768]
  We study the problem of principal component analysis with generative modeling assumptions. Key assumption is that the underlying signal lies near the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We propose a quadratic estimator, and show that it enjoys a statistical rate of order $sqrtfracklog Lm$, where $m$ is the number of samples.
  arXiv  Detail & Related papers  (2022-03-18T01:48:16Z)
• Layer Pruning on Demand with Intermediate CTC [50.509073206630994]
  We present a training and pruning method for ASR based on the connectionist temporal classification (CTC) We show that a Transformer-CTC model can be pruned in various depth on demand, improving real-time factor from 0.005 to 0.002 on GPU.
  arXiv  Detail & Related papers  (2021-06-17T02:40:18Z)
• Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration [57.568461777747515]
  We introduce a novel calibration method, Parametrized Temperature Scaling (PTS) We demonstrate that the performance of accuracy-preserving state-of-the-art post-hoc calibrators is limited by their intrinsic expressive power. We show with extensive experiments that our novel accuracy-preserving approach consistently outperforms existing algorithms across a large number of model architectures, datasets and metrics.
  arXiv  Detail & Related papers  (2021-02-24T10:18:30Z)
• Machine learning for rapid discovery of laminar flow channel wall modifications that enhance heat transfer [56.34005280792013]
  We present a combination of accurate numerical simulations of arbitrary, flat, and non-flat channels and machine learning models predicting drag coefficient and Stanton number. We show that convolutional neural networks (CNN) can accurately predict the target properties at a fraction of the time of numerical simulations.
  arXiv  Detail & Related papers  (2021-01-19T16:14:02Z)
• Sample Complexity Bounds for 1-bit Compressive Sensing and Binary Stable Embeddings with Generative Priors [52.06292503723978]
  Motivated by advances in compressive sensing with generative models, we study the problem of 1-bit compressive sensing with generative models. We first consider noiseless 1-bit measurements, and provide sample complexity bounds for approximate recovery under i.i.d.Gaussian measurements. We demonstrate that the Binary $epsilon$-Stable Embedding property, which characterizes the robustness of the reconstruction to measurement errors and noise, also holds for 1-bit compressive sensing with Lipschitz continuous generative models.
  arXiv  Detail & Related papers  (2020-02-05T09:44:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.