JetParticle-JEPA: An Efficient Self-Supervised Representation Learning method for Jet Tagging in High-Energy Physics

• URL: http://arxiv.org/abs/2606.14813v1
• Date: Fri, 12 Jun 2026 08:25:47 GMT
• Title: JetParticle-JEPA: An Efficient Self-Supervised Representation Learning method for Jet Tagging in High-Energy Physics
• Abstract summary: We introduce JetParticle-JEPA (JP-JEPA), a self-supervised Joint-Embedding Predictive Architecture.<n>It learns physically meaningful jet representations directly from continuous particle clouds without tokenization or reconstruction of raw inputs.<n>Built on a Particle Transformer backbone, JP-JEPA predicts latent representations of masked particles while preserving fine-grained kinematic correlations.
• Score: 4.231181719953953
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Jet tagging at the Large Hadron Collider increasingly relies on deep learning models trained on massive simulated datasets, leading to high computational costs and limited robustness to detector mismodeling. We introduce JetParticle-JEPA (JP-JEPA), a self-supervised Joint-Embedding Predictive Architecture that learns physically meaningful jet representations directly from continuous particle clouds without tokenization or reconstruction of raw inputs. Built on a Particle Transformer backbone, JP-JEPA predicts latent representations of masked particles while preserving fine-grained kinematic correlations. On the JetClass benchmark, JP-JEPA achieves performance comparable to fully supervised state-of-the-art methods on the full dataset, surpasses supervised baselines in low-label regimes, and significantly outperforms existing SSL approaches. On Top Quark and Quark-Gluon Tagging benchmarks, it remains on par with supervised methods. The learned representations also exhibit strong robustness to missing detector information and improved uncertainty behavior, highlighting JP-JEPA as a promising foundation-model framework for robust and data-efficient jet physics at the LHC.

Related papers

• SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotors [48.60897189520386]
  We introduce the JEPA-style model for real-time quadrotor control.<n>We combine a latent dynamics model with a novel physics-inspired prober that maps frozen latents to interpretable state.<n>To reduce the dependence on expensive and unsafe real-world data collection, we develop a structured pipeline for automated dataset generation.
  arXiv  Detail & Related papers  (2026-06-22T15:00:59Z)
• B-jet Tagging Using a Hybrid Edge Convolution and Transformer Architecture [0.0]
  We present a hybrid deep learning architecture that integrates edge convolutions with transformer self-attention mechanisms.<n>We demonstrate that ECT achieves 0.9333 AUC for b-jet versus combined charm and light jet discrimination.<n>The proposed architecture achieves good results in b-jet tagging, particularly excelling in charm jet rejection.
  arXiv  Detail & Related papers  (2026-03-22T17:10:07Z)
• jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation [0.008652091899164643]
  jBOT is a pre-training method based on self-distillation for jet data from the CERN Large Hadron Collider.<n>We observe that pre-training on unlabeled jets leads to emergent semantic class clustering in the representation space.
  arXiv  Detail & Related papers  (2026-01-16T19:12:13Z)
• LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics [53.247652209132376]
  Joint-Embedding Predictive Architectures (JEPAs) offer a promising blueprint, but lack of practical guidance and theory has led to ad-hoc R&D.<n>We present a comprehensive theory of JEPAs and instantiate it in bf LeJEPA, a lean, scalable, and theoretically grounded training objective.
  arXiv  Detail & Related papers  (2025-11-11T18:21:55Z)
• Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density [51.15085346971361]
  Joint Embedding Predictive Architectures (JEPAs) learn representations able to solve numerous downstream tasks out-of-the-box.<n>JEPAs combine two objectives: (i) a latent-space prediction term, i.e., the representation of a slightly perturbed sample must be predictable from the original sample's representation, and (ii) an anti-collapse term, i.e., not all samples should have the same representation.
  arXiv  Detail & Related papers  (2025-10-07T14:06:30Z)
• Learning Symmetry-Independent Jet Representations via Jet-Based Joint Embedding Predictive Architecture [10.640060102348084]
  Self-supervised learning (SSL) methods have the potential to aid in the creation of machine learning models.<n>This study introduces an approach to learning jet representations without hand-crafted augmentations.<n>We finetune the representations learned by J-JEPA for jet tagging and benchmark them against task-specific representations.
  arXiv  Detail & Related papers  (2024-12-05T19:00:14Z)
• Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generation [49.49868273653921]
  Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving. We introduce Optimal Gaussian Diffusion (OGD) and Estimated Clean Manifold (ECM) Guidance. Our methodology streamlines the generative process, enabling practical applications with reduced computational overhead.
  arXiv  Detail & Related papers  (2024-08-01T17:59:59Z)
• Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
  Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems. This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
  arXiv  Detail & Related papers  (2023-08-14T16:48:57Z)
• EPiC-GAN: Equivariant Point Cloud Generation for Particle Jets [0.0]
  We introduce EPiC-GAN - equivariant point cloud generative adversarial network - which can produce point clouds of variable multiplicity. EPiC-GAN scales well to large particle multiplicities and achieves high generation fidelity on benchmark jet generation tasks.
  arXiv  Detail & Related papers  (2023-01-17T19:00:00Z)
• BIP: Boost Invariant Polynomials for Efficient Jet Tagging [0.0]
  We present a novel, versatile and transparent framework for jet representation. It achieves high accuracy on jet tagging benchmarks while being orders of magnitudes faster to train and evaluate.
  arXiv  Detail & Related papers  (2022-07-17T19:46:42Z)
• Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms [53.38353133198842]
  Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI) This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
  arXiv  Detail & Related papers  (2020-07-23T13:32:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.