B-jet Tagging Using a Hybrid Edge Convolution and Transformer Architecture

• URL: http://arxiv.org/abs/2603.21326v1
• Date: Sun, 22 Mar 2026 17:10:07 GMT
• Title: B-jet Tagging Using a Hybrid Edge Convolution and Transformer Architecture
• Abstract summary: We present a hybrid deep learning architecture that integrates edge convolutions with transformer self-attention mechanisms.<n>We demonstrate that ECT achieves 0.9333 AUC for b-jet versus combined charm and light jet discrimination.<n>The proposed architecture achieves good results in b-jet tagging, particularly excelling in charm jet rejection.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Jet flavor tagging plays an important role in precise Standard Model measurement enabling the extraction of mass dependence in jet-quark interaction and quark-gluon plasma (QGP) interactions. They also enable inferring the nature of particles produced in high-energy particle collisions that contain heavy quarks. The classification of bottom jets is vital for exploring new Physics scenarios in proton-proton collisions. In this research, we present a hybrid deep learning architecture that integrates edge convolutions with transformer self-attention mechanisms, into one single architecture called the Edge Convolution Transformer (ECT) model for bottom-quark jet tagging. ECT processes track-level features (impact parameters, momentum, and their significances) alongside jet-level observables (vertex information and kinematics) to achieve state-of-the-art performance. The study utilizes the ATLAS simulation dataset. We demonstrate that ECT achieves 0.9333 AUC for b-jet versus combined charm and light jet discrimination, surpassing ParticleNet (0.8904 AUC) and the pure transformer baseline (0.9216 AUC). The model maintains inference latency below 0.060 ms per jet on modern GPUs, meeting the stringent requirements for real-time event selection at the LHC. Our results demonstrate that hybrid architectures combining local and global features offer superior performance for challenging jet classification tasks. The proposed architecture achieves good results in b-jet tagging, particularly excelling in charm jet rejection (the most challenging task), while maintaining competitive light-jet discrimination comparable to pure transformer models.

Related papers

• DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer [86.4618122245946]
  DyG$2$T is a dynamics modeling framework that infers object motion trajectories by spatially completing and temporally discriminating Key Point representations.<n>Experiments on both synthetic and real-world datasets demonstrate that DyG$2$T achieves accurate dynamics modeling and reasoning.
  arXiv  Detail & Related papers  (2026-08-19T03:44:28Z)
• WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer [107.36949516442782]
  We present a learning-based particle simulator built on a single transformer architecture to model cloth, elastic solds, Newtonian and non-Newtonian fluids, granular materials, and molecular dynamics.
  arXiv  Detail & Related papers  (2026-05-14T18:18:12Z)
• JetFormer: A Scalable and Efficient Transformer for Jet Tagging from Offline Analysis to FPGA Triggers [41.229196563303795]
  We present JetFormer, a versatile and scalable encoder-only Transformer architecture for particle jet tagging at the Large Hadron Collider (LHC)<n>Unlike prior approaches that are often tailored to specific deployment regimes, JetFormer is designed to operate effectively across the full spectrum of jet tagging scenarios.<n>The model processes variable-length sets of particle features without relying on input of explicit pairwise interactions, yet achieves superior performance compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-01-23T22:58:25Z)
• Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Images [0.0]
  Vision Transformer (ViT) architectures are renowned for modeling global contextual information.<n>ViT-based models consistently outperform established CNN baselines in F1-score, ROC-AUC, and accuracy.<n>This work establishes the first systematic framework and robust performance baselines for applying ViT architectures to calorimeter image-based jet classification.
  arXiv  Detail & Related papers  (2025-06-17T19:32:04Z)
• HEP-JEPA: A foundation model for collider physics using joint embedding predictive architecture [0.0]
  We present a transformer architecture-based foundation model for tasks at high-energy particle colliders.<n>We train the model to classify jets using a self-supervised strategy inspired by the Joint Embedding Predictive Architecture.<n>Our model fares well with other datasets for standard classification benchmark tasks.
  arXiv  Detail & Related papers  (2025-02-06T10:16:27Z)
• Particle Multi-Axis Transformer for Jet Tagging [0.774199694856838]
  In this article, we propose an idea of a new architecture, Particle Multi-Axis transformer (ParMAT) ParMAT contains local and global spatial interactions within a single unit which improves its ability to handle various input lengths. We trained our model on JETCLASS, a publicly available large dataset that contains 100M jets of 10 different classes of particles.
  arXiv  Detail & Related papers  (2024-06-09T10:34:16Z)
• 19 Parameters Is All You Need: Tiny Neural Networks for Particle Physics [52.42485649300583]
  We present the potential of one recent Lorentz- and permutation-symmetric architecture, PELICAN, for low-latency neural network tasks. We show its instances with as few as 19 trainable parameters that outperform generic architectures with tens of thousands of parameters when compared on the binary classification task of top quark jet tagging.
  arXiv  Detail & Related papers  (2023-10-24T18:51:22Z)
• Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers [124.29621071934693]
  We present a novel neural network architecture that combines the spatial learning enabled by convolutions with the contextual learning enabled by attention. TransformerCVN simultaneously classifies each event and reconstructs every individual particle's identity. This architecture enables us to perform several interpretability studies which provide insights into the network's predictions.
  arXiv  Detail & Related papers  (2023-03-10T20:36:23Z)
• Joint Spatial-Temporal and Appearance Modeling with Transformer for Multiple Object Tracking [59.79252390626194]
  We propose a novel solution named TransSTAM, which leverages Transformer to model both the appearance features of each object and the spatial-temporal relationships among objects. The proposed method is evaluated on multiple public benchmarks including MOT16, MOT17, and MOT20, and it achieves a clear performance improvement in both IDF1 and HOTA.
  arXiv  Detail & Related papers  (2022-05-31T01:19:18Z)
• DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimation [50.08080424613603]
  Long-range correlation is essential for accurate monocular depth estimation. We propose to leverage the Transformer to model this global context with an effective attention mechanism. Our proposed model, termed DepthFormer, surpasses state-of-the-art monocular depth estimation methods with prominent margins.
  arXiv  Detail & Related papers  (2022-03-27T05:03:56Z)
• Particle Transformer for Jet Tagging [4.604003661048267]
  We present JetClass, a new comprehensive dataset for jet tagging. The dataset consists of 100 M jets, about two orders of magnitude larger than existing public datasets. We propose a new Transformer-based architecture for jet tagging, called Particle Transformer (ParT)
  arXiv  Detail & Related papers  (2022-02-08T10:36:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.