Quantum Attention for Vision Transformers in High Energy Physics

• URL: http://arxiv.org/abs/2411.13520v1
• Date: Wed, 20 Nov 2024 18:11:17 GMT
• Title: Quantum Attention for Vision Transformers in High Energy Physics
• Authors: Alessandro Tesi, Gopal Ramesh Dahale, Sergei Gleyzer, Kyoungchul Kong, Tom Magorsch, Konstantin T. Matchev, Katia Matcheva,
• Abstract summary: We present a novel hybrid quantum-classical vision transformer architecture incorporating quantum orthogonal neural networks (QONNs) This work highlights the potential of quantum-enhanced models to address the computational demands of next-generation particle physics experiments.
• Score: 39.38389619339798
• License:
• Abstract: We present a novel hybrid quantum-classical vision transformer architecture incorporating quantum orthogonal neural networks (QONNs) to enhance performance and computational efficiency in high-energy physics applications. Building on advancements in quantum vision transformers, our approach addresses limitations of prior models by leveraging the inherent advantages of QONNs, including stability and efficient parameterization in high-dimensional spaces. We evaluate the proposed architecture using multi-detector jet images from CMS Open Data, focusing on the task of distinguishing quark-initiated from gluon-initiated jets. The results indicate that embedding quantum orthogonal transformations within the attention mechanism can provide robust performance while offering promising scalability for machine learning challenges associated with the upcoming High Luminosity Large Hadron Collider. This work highlights the potential of quantum-enhanced models to address the computational demands of next-generation particle physics experiments.

Related papers

• On chip high-dimensional entangled photon sources [0.0]
  We review and introduce the nonlinear optical processes that facilitate on-chip high-dimensional entangled photon sources. We discuss a range of current implementations of on-chip high-dimensional entangled photon sources and demonstrated applications.
  arXiv  Detail & Related papers  (2024-09-05T03:43:10Z)
• Quantum Vision Transformers for Quark-Gluon Classification [3.350407101925898]
  We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits. We evaluate our method by applying the model to multi-detector jet images from CMS Open Data.
  arXiv  Detail & Related papers  (2024-05-16T17:45:54Z)
• End-to-End Quantum Vision Transformer: Towards Practical Quantum Speedup in Large-Scale Models [20.72342380227143]
  This paper introduces an end-to-end Quantum Vision Transformer (QViT), which incorporates an innovative quantum residual connection technique. Our thorough analysis of the QViT reveals a theoretically exponential complexity and empirically speedup, showcasing the model's efficiency and potential in quantum computing applications.
  arXiv  Detail & Related papers  (2024-02-29T08:12:02Z)
• Quantum Generative Adversarial Networks: Bridging Classical and Quantum Realms [0.6827423171182153]
  We explore the synergistic fusion of classical and quantum computing paradigms within the realm of Generative Adversarial Networks (GANs) Our objective is to seamlessly integrate quantum computational elements into the conventional GAN architecture, thereby unlocking novel pathways for enhanced training processes. This research is positioned at the forefront of quantum-enhanced machine learning, presenting a critical stride towards harnessing the computational power of quantum systems.
  arXiv  Detail & Related papers  (2023-12-15T16:51:36Z)
• Quantum data learning for quantum simulations in high-energy physics [55.41644538483948]
  We explore the applicability of quantum-data learning to practical problems in high-energy physics. We make use of ansatz based on quantum convolutional neural networks and numerically show that it is capable of recognizing quantum phases of ground states. The observation of non-trivial learning properties demonstrated in these benchmarks will motivate further exploration of the quantum-data learning architecture in high-energy physics.
  arXiv  Detail & Related papers  (2023-06-29T18:00:01Z)
• Tunable photon-mediated interactions between spin-1 systems [68.8204255655161]
  We show how to harness multi-level emitters with several optical transitions to engineer photon-mediated interactions between effective spin-1 systems. Our results expand the quantum simulation toolbox available in cavity QED and quantum nanophotonic setups.
  arXiv  Detail & Related papers  (2022-06-03T14:52:34Z)
• Quantum-tailored machine-learning characterization of a superconducting qubit [50.591267188664666]
  We develop an approach to characterize the dynamics of a quantum device and learn device parameters. This approach outperforms physics-agnostic recurrent neural networks trained on numerically generated and experimental data. This demonstration shows how leveraging domain knowledge improves the accuracy and efficiency of this characterization task.
  arXiv  Detail & Related papers  (2021-06-24T15:58:57Z)
• Design of Light-Matter Interactions for Quantum Technologies [0.0]
  We design radiation patterns capable of creating effective light-matter interactions suited to applications in quantum computing, quantum simulation and quantum sensing. On the one hand, we have used dynamical decoupling techniques to design quantum operations that are robust against errors in environmental and control fields. On the other hand, we have studied generalised models of light-matter interaction, leading to the discovery of selective multi-photon interactions in the Rabi-Stark model.
  arXiv  Detail & Related papers  (2021-01-27T21:30:36Z)
• Entanglement transfer, accumulation and retrieval via quantum-walk-based qubit-qudit dynamics [50.591267188664666]
  Generation and control of quantum correlations in high-dimensional systems is a major challenge in the present landscape of quantum technologies. We propose a protocol that is able to attain entangled states of $d$-dimensional systems through a quantum-walk-based it transfer & accumulate mechanism. In particular, we illustrate a possible photonic implementation where the information is encoded in the orbital angular momentum and polarization degrees of freedom of single photons.
  arXiv  Detail & Related papers  (2020-10-14T14:33:34Z)
• Experimental Quantum Generative Adversarial Networks for Image Generation [93.06926114985761]
  We experimentally achieve the learning and generation of real-world hand-written digit images on a superconducting quantum processor. Our work provides guidance for developing advanced quantum generative models on near-term quantum devices.
  arXiv  Detail & Related papers  (2020-10-13T06:57:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.