QCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing

• URL: http://arxiv.org/abs/2509.05729v1
• Date: Sat, 06 Sep 2025 14:25:09 GMT
• Title: QCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing
• Authors: Charles M. Varmantchaonala, Niclas GÖtting, Nils-Erik SchÜtte, Jean Louis E. K. Fendji, Christopher Gies,
• Abstract summary: This paper presents a pretrained quantum context-sensitive embedding model, called QCSE, that captures context-sensitive word embeddings.<n>The model introduces quantum-native context learning, enabling the utilization of quantum computers for linguistic tasks.<n>Five distinct methods are proposed and tested for computing the context matrices, incorporating techniques such as exponential decay, sinusoidal modulation, phase shifts, and hash-based transformations.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Quantum Natural Language Processing (QNLP) offers a novel approach to encoding and understanding the complexity of natural languages through the power of quantum computation. This paper presents a pretrained quantum context-sensitive embedding model, called QCSE, that captures context-sensitive word embeddings, leveraging the unique properties of quantum systems to learn contextual relationships in languages. The model introduces quantum-native context learning, enabling the utilization of quantum computers for linguistic tasks. Central to the proposed approach are innovative context matrix computation methods, designed to create unique, representations of words based on their surrounding linguistic context. Five distinct methods are proposed and tested for computing the context matrices, incorporating techniques such as exponential decay, sinusoidal modulation, phase shifts, and hash-based transformations. These methods ensure that the quantum embeddings retain context sensitivity, thereby making them suitable for downstream language tasks where the expressibility and properties of quantum systems are valuable resources. To evaluate the effectiveness of the model and the associated context matrix methods, evaluations are conducted on both a Fulani corpus, a low-resource African language, dataset of small size and an English corpus of slightly larger size. The results demonstrate that QCSE not only captures context sensitivity but also leverages the expressibility of quantum systems for representing rich, context-aware language information. The use of Fulani further highlights the potential of QNLP to mitigate the problem of lack of data for this category of languages. This work underscores the power of quantum computation in natural language processing (NLP) and opens new avenues for applying QNLP to real-world linguistic challenges across various tasks and domains.

Related papers

• Quantum-enhanced Computer Vision: Going Beyond Classical Algorithms [50.573955644831386]
  Quantum-enhanced Computer Vision (QeCV) is a new research field at the intersection of computer vision, machine learning and quantum computing.<n>It has high potential to transform how visual signals are processed and interpreted with the help of quantum computing.<n>This survey contributes to the existing literature on QeCV with a holistic review of this research field.
  arXiv  Detail & Related papers  (2025-10-08T17:59:51Z)
• Artificial intelligence for representing and characterizing quantum systems [49.29080693498154]
  Efficient characterization of large-scale quantum systems is a central challenge in quantum science.<n>Recent advances in artificial intelligence (AI) have emerged as a powerful tool to address this challenge.<n>This review discusses how each of these AI paradigms contributes to two core tasks in quantum systems characterization.
  arXiv  Detail & Related papers  (2025-09-05T08:41:24Z)
• Quantum-Accelerated Wireless Communications: Concepts, Connections, and Implications [59.0413662882849]
  Quantum computing is poised to redefine the algorithmic foundations of communication systems.<n>This article outlines the fundamentals of quantum computing in a style familiar to the communications society.<n>We highlight a mathematical harmony between quantum and wireless systems, which makes the topic more enticing to wireless researchers.
  arXiv  Detail & Related papers  (2025-06-25T22:25:47Z)
• Quantum Natural Language Processing: A Comprehensive Review of Models, Methods, and Applications [0.34284444670464664]
  It is proposed to categorise QNLP models based on quantum computing principles, architecture, and computational approaches.<n>This paper attempts to provide a survey on how quantum meets language by mapping state-of-the-art in this area.
  arXiv  Detail & Related papers  (2025-04-14T06:09:26Z)
• Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data [0.0]
  This thesis explores how quantum computational methods can enhance the compositional modeling of language. Specifically, it advances Multimodal Quantum Natural Language Processing (MQNLP) by applying the Lambeq toolkit. Results indicate that syntax-based models, particularly DisCoCat and TreeReader, excel in effectively capturing grammatical structures.
  arXiv  Detail & Related papers  (2024-10-29T19:03:43Z)
• Quantum Transfer Learning for Acceptability Judgements [5.90817406672742]
  This work shows potential advantages of quantum transfer learning algorithms trained on embedding vectors extracted from a large language model. The approach has been tested on sentences extracted from ItaCoLa, a corpus that collects Italian sentences labeled with their acceptability judgment. The evaluation phase shows results for the quantum transfer learning pipeline comparable to state-of-the-art classical transfer learning algorithms.
  arXiv  Detail & Related papers  (2024-01-15T15:40:16Z)
• A didactic approach to quantum machine learning with a single qubit [68.8204255655161]
  We focus on the case of learning with a single qubit, using data re-uploading techniques. We implement the different proposed formulations in toy and real-world datasets using the qiskit quantum computing SDK.
  arXiv  Detail & Related papers  (2022-11-23T18:25:32Z)
• Quantum Self-Attention Neural Networks for Text Classification [8.975913540662441]
  We propose a new simple network architecture, called the quantum self-attention neural network (QSANN) We introduce the self-attention mechanism into quantum neural networks and then utilize a Gaussian projected quantum self-attention serving as a sensible quantum version of self-attention. Our method exhibits robustness to low-level quantum noises and showcases resilience to quantum neural network architectures.
  arXiv  Detail & Related papers  (2022-05-11T16:50:46Z)
• Quantum Semantic Communications for Resource-Efficient Quantum Networking [52.3355619190963]
  This letter proposes a novel quantum semantic communications (QSC) framework exploiting advancements in quantum machine learning and quantum semantic representations. The proposed framework achieves approximately 50-75% reduction in quantum communication resources needed, while achieving a higher quantum semantic fidelity.
  arXiv  Detail & Related papers  (2022-05-05T03:49:19Z)
• Facial Expression Recognition on a Quantum Computer [68.8204255655161]
  We show a possible solution to facial expression recognition using a quantum machine learning approach. We define a quantum circuit that manipulates the graphs adjacency matrices encoded into the amplitudes of some appropriately defined quantum states.
  arXiv  Detail & Related papers  (2021-02-09T13:48:00Z)
• Grammar-Aware Question-Answering on Quantum Computers [0.17205106391379021]
  We perform the first implementation of an NLP task on noisy intermediate-scale quantum (NISQ) hardware. We encode word-meanings in quantum states and we explicitly account for grammatical structure. Our novel QNLP model shows concrete promise for scalability as the quality of the quantum hardware improves.
  arXiv  Detail & Related papers  (2020-12-07T14:49:34Z)
• Quantum Natural Language Processing on Near-Term Quantum Computers [0.0]
  We describe a full-stack pipeline for natural language processing on near-term quantum computers, aka QNLP. DisCoCat is a language-modelling framework that extends and complements the compositional structure of pregroup grammars. We present a method for mapping DisCoCat diagrams to quantum circuits.
  arXiv  Detail & Related papers  (2020-05-08T16:42:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.