A Lorentz-Equivariant Transformer for All of the LHC

• URL: http://arxiv.org/abs/2411.00446v1
• Date: Fri, 01 Nov 2024 08:40:42 GMT
• Title: A Lorentz-Equivariant Transformer for All of the LHC
• Authors: Johann Brehmer, Víctor Bresó, Pim de Haan, Tilman Plehn, Huilin Qu, Jonas Spinner, Jesse Thaler,
• Abstract summary: We show that the Lorentz-Equivariant Geometric Algebra Transformer (L-GATr) yields state-of-the-art performance for a wide range of machine learning tasks at the Large Hadron Collider.
• Score: 5.329375781648604
• License:
• Abstract: We show that the Lorentz-Equivariant Geometric Algebra Transformer (L-GATr) yields state-of-the-art performance for a wide range of machine learning tasks at the Large Hadron Collider. L-GATr represents data in a geometric algebra over space-time and is equivariant under Lorentz transformations. The underlying architecture is a versatile and scalable transformer, which is able to break symmetries if needed. We demonstrate the power of L-GATr for amplitude regression and jet classification, and then benchmark it as the first Lorentz-equivariant generative network. For all three LHC tasks, we find significant improvements over previous architectures.

Related papers

• Geometric Algebra Planes: Convex Implicit Neural Volumes [70.12234371845445]
  We show that GA-Planes is equivalent to a sparse low-rank factor plus low-resolution matrix. We also show that GA-Planes can be adapted for many existing representations.
  arXiv  Detail & Related papers  (2024-11-20T18:21:58Z)
• Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physics [4.4970885242855845]
  Lorentz Geometric Algebra Transformer (L-GATr) is a new multi-purpose architecture for high-energy physics. L-GATr is first demonstrated on regression and classification tasks from particle physics. We then construct the first Lorentz-equivariant generative model: a continuous normalizing flow based on an L-GATr network.
  arXiv  Detail & Related papers  (2024-05-23T17:15:41Z)
• The hidden Lorentz Covariance of Quantum Mechanics [0.552480439325792]
  We show that each mass sector of the Hilbert space carries a representation of the Lorentz algebra, and the (anti) de-Sitter algebra on each mass sector contracts to the Poincare algebra. We also show that three-dimensional fuzzy space also carries a unitary representation of these algebras.
  arXiv  Detail & Related papers  (2023-12-25T15:18:57Z)
• Explainable Equivariant Neural Networks for Particle Physics: PELICAN [51.02649432050852]
  PELICAN is a novel permutation equivariant and Lorentz invariant aggregator network. We present a study of the PELICAN algorithm architecture in the context of both tagging (classification) and reconstructing (regression) Lorentz-boosted top quarks. We extend the application of PELICAN to the tasks of identifying quark-initiated vs.gluon-initiated jets, and a multi-class identification across five separate target categories of jets.
  arXiv  Detail & Related papers  (2023-07-31T09:08:40Z)
• Lorentz Equivariant Model for Knowledge-Enhanced Hyperbolic Collaborative Filtering [19.57064597050846]
  We introduce prior auxiliary information from the knowledge graph (KG) to assist the user-item graph. We propose a rigorously Lorentz group equivariant knowledge-enhanced collaborative filtering model (LECF) We show that LECF remarkably outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-02-09T10:20:23Z)
• Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers [71.32827362323205]
  We propose a new class of linear Transformers calledLearner-Transformers (Learners) They incorporate a wide range of relative positional encoding mechanisms (RPEs) These include regular RPE techniques applied for sequential data, as well as novel RPEs operating on geometric data embedded in higher-dimensional Euclidean spaces.
  arXiv  Detail & Related papers  (2023-02-03T18:57:17Z)
• PELICAN: Permutation Equivariant and Lorentz Invariant or Covariant Aggregator Network for Particle Physics [64.5726087590283]
  We present a machine learning architecture that uses a set of inputs maximally reduced with respect to the full 6-dimensional Lorentz symmetry. We show that the resulting network outperforms all existing competitors despite much lower model complexity.
  arXiv  Detail & Related papers  (2022-11-01T13:36:50Z)
• Towards Lightweight Transformer via Group-wise Transformation for Vision-and-Language Tasks [126.33843752332139]
  We introduce Group-wise Transformation towards a universal yet lightweight Transformer for vision-and-language tasks, termed as LW-Transformer. We apply LW-Transformer to a set of Transformer-based networks, and quantitatively measure them on three vision-and-language tasks and six benchmark datasets. Experimental results show that while saving a large number of parameters and computations, LW-Transformer achieves very competitive performance against the original Transformer networks for vision-and-language tasks.
  arXiv  Detail & Related papers  (2022-04-16T11:30:26Z)
• Lorentz Group Equivariant Neural Network for Particle Physics [58.56031187968692]
  We present a neural network architecture that is fully equivariant with respect to transformations under the Lorentz group. For classification tasks in particle physics, we demonstrate that such an equivariant architecture leads to drastically simpler models that have relatively few learnable parameters.
  arXiv  Detail & Related papers  (2020-06-08T17:54:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.