Entanglement as Memory: Mechanistic Interpretability of Quantum Language Models
- URL: http://arxiv.org/abs/2603.26494v1
- Date: Fri, 27 Mar 2026 14:57:55 GMT
- Title: Entanglement as Memory: Mechanistic Interpretability of Quantum Language Models
- Abstract summary: We introduce the first mechanistic interpretability study of quantum language models.<n>We find that single-qubit models are exactly simulable and converge to the same geometric strategy.<n>On real quantum hardware, only the classical geometric strategy survives device noise; the entanglement strategy degrades to chance.
- Score: 0.13537117504260623
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Quantum language models have shown competitive performance on sequential tasks, yet whether trained quantum circuits exploit genuinely quantum resources -- or merely embed classical computation in quantum hardware -- remains unknown. Prior work has evaluated these models through endpoint metrics alone, without examining the memory strategies they actually learn internally. We introduce the first mechanistic interpretability study of quantum language models, combining causal gate ablation, entanglement tracking, and density-matrix interchange interventions on a controlled long-range dependency task. We find that single-qubit models are exactly classically simulable and converge to the same geometric strategy as matched classical baselines, while two-qubit models with entangling gates learn a representationally distinct strategy that encodes context in inter-qubit entanglement -- confirmed by three independent causal tests (p < 0.0001, d = 0.89). On real quantum hardware, only the classical geometric strategy survives device noise; the entanglement strategy degrades to chance. These findings open mechanistic interpretability as a tool for the science of quantum language models and reveal a noise-expressivity tradeoff governing which learned strategies survive deployment.
Related papers
- Learnable yet not simulable: a quantum resource theory of learning models [57.695822250391906]
It remains unclear which quantum resource governs the classical learnability of quantum circuits.<n>We study the expectation-value functions of families of tunable quantum circuits.<n>These results establish a quantitative resource-theoretic framework for delineating the boundary between classical simulation and learning.
arXiv Detail & Related papers (2026-08-03T14:48:03Z) - Quantum LEGO Learning: A Modular Design Principle for Hybrid Artificial Intelligence [63.39968536637762]
We introduce Quantum LEGO Learning, a learning framework that treats classical and quantum components as reusable, composable learning blocks.<n>Within this framework, a pre-trained classical neural network serves as a frozen feature block, while a VQC acts as a trainable adaptive module.<n>We develop a block-wise generalization theory that decomposes learning error into approximation and estimation components.
arXiv Detail & Related papers (2026-01-29T14:29:21Z) - Device-independent quantum memory certification in two-point measurement experiments [0.0]
We present a device-independent approach for certifying black-box quantum memories.<n>We do so by probing quantum systems at two points in time and then confronting the observed temporal correlations against classical causal models.<n>Our method establishes temporal correlations and causal modelling as practical and powerful tool for benchmarking key ingredients of quantum technologies.
arXiv Detail & Related papers (2026-01-20T17:49:54Z) - Entanglement as a Strategic Resource in Adversarial Quantum Games [0.0]
Quantum game theory naturally extends classical strategic decision-making by leveraging quantum superposition, entanglement, and measurement-based pay offs.<n>This paper introduces a novel team-based Quantum Sabotage Game (QSG), where two competing teams, one classical and one quantum-enhanced, engage in adversarial strategies.
arXiv Detail & Related papers (2025-10-25T22:05:11Z) - Quantum-Accelerated Wireless Communications: Concepts, Connections, and Implications [59.0413662882849]
Quantum computing is poised to redefine the algorithmic foundations of communication systems.<n>This article outlines the fundamentals of quantum computing in a style familiar to the communications society.<n>We highlight a mathematical harmony between quantum and wireless systems, which makes the topic more enticing to wireless researchers.
arXiv Detail & Related papers (2025-06-25T22:25:47Z) - Efficient Learning for Linear Properties of Bounded-Gate Quantum Circuits [62.46800898243033]
Recent progress in quantum learning theory prompts a question: can linear properties of a large-qubit circuit be efficiently learned from measurement data generated by varying classical inputs?<n>We prove that the sample complexity scaling linearly in $d$ is required to achieve a small prediction error, while the corresponding computational complexity may scale exponentially in d.<n>We propose a kernel-based method leveraging classical shadows and truncated trigonometric expansions, enabling a controllable trade-off between prediction accuracy and computational overhead.
arXiv Detail & Related papers (2024-08-22T08:21:28Z) - Hybrid Quantum-Classical Machine Learning with String Diagrams [49.1574468325115]
This paper develops a formal framework for describing hybrid algorithms in terms of string diagrams.
A notable feature of our string diagrams is the use of functor boxes, which correspond to a quantum-classical interfaces.
arXiv Detail & Related papers (2024-07-04T06:37:16Z) - Classical Verification of Quantum Learning [42.362388367152256]
We develop a framework for classical verification of quantum learning.
We propose a new quantum data access model that we call "mixture-of-superpositions" quantum examples.
Our results demonstrate that the potential power of quantum data for learning tasks, while not unlimited, can be utilized by classical agents.
arXiv Detail & Related papers (2023-06-08T00:31:27Z) - The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for
Deep Quantum Machine Learning [52.77024349608834]
Building a quantum analog of classical deep neural networks represents a fundamental challenge in quantum computing.
Key issue is how to address the inherent non-linearity of classical deep learning.
We introduce the Quantum Path Kernel, a formulation of quantum machine learning capable of replicating those aspects of deep machine learning.
arXiv Detail & Related papers (2022-12-22T16:06:24Z) - Quantum variational learning for entanglement witnessing [0.0]
This work focuses on the potential implementation of quantum algorithms allowing to properly classify quantum states defined over a single register of $n$ qubits.
We exploit the notion of "entanglement witness", i.e., an operator whose expectation values allow to identify certain specific states as entangled.
We made use of Quantum Neural Networks (QNNs) in order to successfully learn how to reproduce the action of an entanglement witness.
arXiv Detail & Related papers (2022-05-20T20:14:28Z) - Quantum algorithms for quantum dynamics: A performance study on the
spin-boson model [68.8204255655161]
Quantum algorithms for quantum dynamics simulations are traditionally based on implementing a Trotter-approximation of the time-evolution operator.
variational quantum algorithms have become an indispensable alternative, enabling small-scale simulations on present-day hardware.
We show that, despite providing a clear reduction of quantum gate cost, the variational method in its current implementation is unlikely to lead to a quantum advantage.
arXiv Detail & Related papers (2021-08-09T18:00:05Z) - Variational quantum policies for reinforcement learning [0.0]
Variational quantum circuits have recently gained popularity as quantum machine learning models.
In this work, we investigate how to construct and train reinforcement learning policies based on variational quantum circuits.
arXiv Detail & Related papers (2021-03-09T17:33:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.