QTrans: A Quantum Transformer for Sentiment Classification

• URL: http://arxiv.org/abs/2609.12011v1
• Date: Thu, 10 Sep 2026 06:04:31 GMT
• Title: QTrans: A Quantum Transformer for Sentiment Classification
• Abstract summary: We propose a model named QTrans, which uses parameterized quantum circuits to construct query, key, and value features.<n> Experimental results on the MR, CR, and MPQA datasets show that QTrans achieves test accuracies of 72.13%, 69.51%, and 63.45%, respectively.
• Score: 30.090297417712502
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In small-scale binary sentiment classification scenarios, factors such as negation, contrastive shifts, and cross-word dependencies lead to the non-linear coupling of sentiment cues, making it difficult for conventional lightweight models to fully capture the contextual relationships between tokens. To address this issue, we propose a model named QTrans, which uses parameterized quantum circuits to construct query, key, and value features and derives attention coefficients from Gaussian distances between quantum measurements. By further integrating a quantum feed-forward neural network, residual connections, and layer normalization, the model establishes an end-to-end trainable quantum-classical hybrid framework for sentiment classification. Experimental results on the MR, CR, and MPQA datasets show that QTrans achieves test accuracies of 72.13\%, 69.51\%, and 63.45\%, respectively, representing improvements of 2.88, 3.17, and 3.79 percentage points over the best-performing classical baselines for each dataset. Overall, QTrans expands the application of parameterized quantum circuits in lightweight sentiment analysis and lays an experimental foundation for further research into quantum multi-head self-attention for modeling textual relationships.

Related papers

• A Correlation Aware Quantum Feature Map for Variational Quantum Classification [0.0]
  Correlation Aware Quantum Feature Map (CAQFM) integrates feature dependencies into the quantum encoding process.<n>The proposed approach utilizes Pearson, Spearman, Kendall Tau, Mutual Information, and Distance Correlation measures to identify relationships among features.<n>Results demonstrate that correlation based quantum encoding can improve classification performance compared to conventional encoding strategies.
  arXiv  Detail & Related papers  (2026-06-19T16:12:10Z)
• QMC-Net: Data-Aware Quantum Representations for Remote Sensing Image Classification [19.28428432777636]
  We introduce QMC-Net, a hybrid architecture that processes six data channels using band-specific quantum circuits.<n>Results consistently outperform strong classical baselines and monolithic hybrid quantum models.
  arXiv  Detail & Related papers  (2026-04-10T19:28:58Z)
• Quantum Implicit Neural Representations for 3D Scene Reconstruction and Novel View Synthesis [42.13843953705695]
  Implicit neural representations (INRs) have become a powerful paradigm for continuous signal modeling and 3D scene reconstruction.<n>We present Quantum Neural Radiance Fields (Q-NeRF), the first hybrid quantum-classical framework for neural radiance field rendering.
  arXiv  Detail & Related papers  (2025-12-14T13:24:11Z)
• Multi-channel convolutional neural quantum embedding [10.620759775107787]
  We introduce a classical-quantum hybrid approach for optimizing quantum embedding beyond the limitations of the standard circuit model of quantum computation.<n>We benchmark the performance of various models in our framework using the CIFAR-10 and Tiny ImageNet datasets.
  arXiv  Detail & Related papers  (2025-09-26T13:51:40Z)
• Quantum Visual Fields with Neural Amplitude Encoding [70.86293548779774]
  We introduce a new type of Quantum Implicit Neural Representation (QINR) for 2D image and 3D geometric field learning.<n>QVF encodes classical data into quantum statevectors using neural amplitude encoding grounded in a learnable energy manifold.<n>Our ansatz follows a fully entangled design of learnable parametrised quantum circuits, with quantum (unitary) operations performed in the real Hilbert space.
  arXiv  Detail & Related papers  (2025-08-14T17:59:52Z)
• VQC-MLPNet: An Unconventional Hybrid Quantum-Classical Architecture for Scalable and Robust Quantum Machine Learning [50.95799256262098]
  Variational quantum circuits (VQCs) hold promise for quantum machine learning but face challenges in expressivity, trainability, and noise resilience.<n>We propose VQC-MLPNet, a hybrid architecture where a VQC generates the first-layer weights of a classical multilayer perceptron during training, while inference is performed entirely classically.
  arXiv  Detail & Related papers  (2025-06-12T01:38:15Z)
• An Amplitude-Encoding-Based Classical-Quantum Transfer Learning framework: Outperforming Classical Methods in Image Recognition [8.971481563534537]
  This paper proposes an amplitude-encoding-based classical-quantum transfer learning (AE-CQTL) framework, accompanied by an effective learning algorithm.<n>Based on the AE-CQTL framework, we designed and implemented two CQTL neural network models: Transfer learning Quantum Neural Network (TLQNN) and Transfer Learning Quantum Convolutional Neural Network (TLQCNN)
  arXiv  Detail & Related papers  (2025-02-27T15:20:01Z)
• Learning the expressibility of quantum circuit ansatz using transformer [5.368973814856243]
  We propose using a transformer model to predict the expressibility of quantum circuit ansatze. This research can enhance the understanding of the expressibility of quantum circuit ansatze and advance quantum architecture search algorithms.
  arXiv  Detail & Related papers  (2024-05-29T07:34:07Z)
• Pre-training Tensor-Train Networks Facilitates Machine Learning with Variational Quantum Circuits [70.97518416003358]
  Variational quantum circuits (VQCs) hold promise for quantum machine learning on noisy intermediate-scale quantum (NISQ) devices. While tensor-train networks (TTNs) can enhance VQC representation and generalization, the resulting hybrid model, TTN-VQC, faces optimization challenges due to the Polyak-Lojasiewicz (PL) condition. To mitigate this challenge, we introduce Pre+TTN-VQC, a pre-trained TTN model combined with a VQC.
  arXiv  Detail & Related papers  (2023-05-18T03:08:18Z)
• When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing [75.75419308975746]
  This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets.
  arXiv  Detail & Related papers  (2022-02-17T09:55:21Z)
• Transfer Learning in Quantum Parametric Classifiers: An Information-Theoretic Generalization Analysis [42.275148861039895]
  A key step in quantum machine learning with classical inputs is the design of an embedding circuit mapping inputs to a quantum state. This paper studies a transfer learning setting in which classical-to-quantum embedding is carried out by an arbitrary parametric quantum circuit.
  arXiv  Detail & Related papers  (2022-01-17T09:28:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.