Comparative study of the ansätze in quantum language models

• URL: http://arxiv.org/abs/2502.20744v1
• Date: Fri, 28 Feb 2025 05:49:38 GMT
• Title: Comparative study of the ansätze in quantum language models
• Authors: Jordi Del Castillo, Dan Zhao, Zongrui Pei,
• Abstract summary: Quantum natural language processing (QNLP) methods and frameworks exist for text classification and generation.<n>We evaluate the performance of quantum natural language processing models based on these ans"atze at different levels in text classification tasks.
• Score: 12.109572897953413
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Quantum language models are the alternative to classical language models, which borrow concepts and methods from quantum machine learning and computational linguistics. While several quantum natural language processing (QNLP) methods and frameworks exist for text classification and generation, there is a lack of systematic study to compare the performance across various ans\"atze, in terms of their hyperparameters and classical and quantum methods to implement them. Here, we evaluate the performance of quantum natural language processing models based on these ans\"atze at different levels in text classification tasks. We perform a comparative study and optimize the QNLP models by fine-tuning several critical hyperparameters. Our results demonstrate how the balance between simplification and expressivity affects model performance. This study provides extensive data to improve our understanding of QNLP models and opens the possibility of developing better QNLP algorithms.

Related papers

• Quantum Natural Language Processing: A Comprehensive Review of Models, Methods, and Applications [0.34284444670464664]
  It is proposed to categorise QNLP models based on quantum computing principles, architecture, and computational approaches. This paper attempts to provide a survey on how quantum meets language by mapping state-of-the-art in this area.
  arXiv  Detail & Related papers  (2025-04-14T06:09:26Z)
• Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data [0.0]
  This thesis explores how quantum computational methods can enhance the compositional modeling of language. Specifically, it advances Multimodal Quantum Natural Language Processing (MQNLP) by applying the Lambeq toolkit. Results indicate that syntax-based models, particularly DisCoCat and TreeReader, excel in effectively capturing grammatical structures.
  arXiv  Detail & Related papers  (2024-10-29T19:03:43Z)
• Traitement quantique des langues : {é}tat de l'art [0.0]
  This article presents a review of quantum computing research works for Natural Language Processing (NLP) Their goal is to improve the performance of current models, and to provide a better representation of several linguistic phenomena. Several families of approaches are presented, including symbolic diagrammatic approaches, and hybrid neural networks.
  arXiv  Detail & Related papers  (2024-04-09T08:05:15Z)
• In-Context Language Learning: Architectures and Algorithms [73.93205821154605]
  We study ICL through the lens of a new family of model problems we term in context language learning (ICLL) We evaluate a diverse set of neural sequence models on regular ICLL tasks.
  arXiv  Detail & Related papers  (2024-01-23T18:59:21Z)
• Natural Language Processing for Dialects of a Language: A Survey [56.93337350526933]
  State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets.<n>This survey delves into an important attribute of these datasets: the dialect of a language.<n>Motivated by the performance degradation of NLP models for dialectal datasets and its implications for the equity of language technologies, we survey past research in NLP for dialects in terms of datasets, and approaches.
  arXiv  Detail & Related papers  (2024-01-11T03:04:38Z)
• The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute [66.84421705029624]
  We introduce an experimental protocol that enables model comparisons based on equivalent compute, measured in accelerator hours. We pre-process an existing large, diverse, and high-quality dataset of books that surpasses existing academic benchmarks in quality, diversity, and document length. This work also provides two baseline models: a feed-forward model derived from the GPT-2 architecture and a recurrent model in the form of a novel LSTM with ten-fold throughput.
  arXiv  Detail & Related papers  (2023-09-20T10:31:17Z)
• Toward Quantum Machine Translation of Syntactically Distinct Languages [0.0]
  We explore the feasibility of language translation using quantum natural language processing algorithms on noisy intermediate-scale quantum (NISQ) devices. We employ Shannon entropy to demonstrate the significant role of some appropriate angles of rotation gates in the performance of parametrized quantum circuits.
  arXiv  Detail & Related papers  (2023-07-31T11:24:54Z)
• SQL2Circuits: Estimating Metrics for SQL Queries with a Quantum Natural Language Processing Method [1.5540058359482858]
  This work employs a quantum natural language processing (QNLP)-inspired approach for constructing a quantum machine learning model. The model consists of an encoding mechanism and a training phase, including classical and quantum subroutines. We conclude that our model reaches an accuracy equivalent to that of the QNLP model in the binary classification tasks.
  arXiv  Detail & Related papers  (2023-06-14T14:23:19Z)
• A Framework for Demonstrating Practical Quantum Advantage: Racing Quantum against Classical Generative Models [62.997667081978825]
  We build over a proposed framework for evaluating the generalization performance of generative models. We establish the first comparative race towards practical quantum advantage (PQA) between classical and quantum generative models. Our results suggest that QCBMs are more efficient in the data-limited regime than the other state-of-the-art classical generative models.
  arXiv  Detail & Related papers  (2023-03-27T22:48:28Z)
• A didactic approach to quantum machine learning with a single qubit [68.8204255655161]
  We focus on the case of learning with a single qubit, using data re-uploading techniques. We implement the different proposed formulations in toy and real-world datasets using the qiskit quantum computing SDK.
  arXiv  Detail & Related papers  (2022-11-23T18:25:32Z)
• A Quantum Kernel Learning Approach to Acoustic Modeling for Spoken Command Recognition [69.97260364850001]
  We propose a quantum kernel learning (QKL) framework to address the inherent data sparsity issues. We project acoustic features based on classical-to-quantum feature encoding.
  arXiv  Detail & Related papers  (2022-11-02T16:46:23Z)
• Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning [0.0]
  We introduce a training method for parametrized quantum circuits (PQCs) that can be used to solve RL tasks for discrete and continuous state spaces. We investigate which architectural choices for quantum Q-learning agents are most important for successfully solving certain types of environments.
  arXiv  Detail & Related papers  (2021-03-28T08:57:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.