Loss Behavior in Supervised Learning with Entangled States

• URL: http://arxiv.org/abs/2509.10141v1
• Date: Fri, 12 Sep 2025 11:09:24 GMT
• Title: Loss Behavior in Supervised Learning with Entangled States
• Authors: Alexander Mandl, Johanna Barzen, Marvin Bechtold, Frank Leymann, Lavinia Stiliadou,
• Abstract summary: entanglement with an auxiliary system was shown to increase the quality of QML models in applications such as supervised learning.<n>Recent works focus on the information that can be extracted from entangled training samples and their effect on the approximation error of the trained model.<n>Results on the trainability of QML models show that the training process itself is affected by various properties of the supervised learning task.
• Score: 36.30006416492033
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Quantum Machine Learning (QML) aims to leverage the principles of quantum mechanics to speed up the process of solving machine learning problems or improve the quality of solutions. Among these principles, entanglement with an auxiliary system was shown to increase the quality of QML models in applications such as supervised learning. Recent works focus on the information that can be extracted from entangled training samples and their effect on the approximation error of the trained model. However, results on the trainability of QML models show that the training process itself is affected by various properties of the supervised learning task. These properties include the circuit structure of the QML model, the used cost function, and noise on the quantum computer. To evaluate the applicability of entanglement in supervised learning, we augment these results by investigating the effect of highly entangled training data on the model's trainability. In this work, we show that for highly expressive models, i.e., models capable of expressing a large number of candidate solutions, the possible improvement of loss function values in constrained neighborhoods during optimization is severely limited when maximally entangled states are employed for training. Furthermore, we support this finding experimentally by simulating training with Parameterized Quantum Circuits (PQCs). Our findings show that as the expressivity of the PQC increases, it becomes more susceptible to loss concentration induced by entangled training data. Lastly, our experiments evaluate the efficacy of non-maximal entanglement in the training samples and highlight the fundamental role of entanglement entropy as a predictor for the trainability.

Related papers

• What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic Study [59.44848132298657]
  Post-training quantization (PTQ) usually comes with the cost of large accuracy drops, especially for reasoning tasks under low-bit settings.<n>In this study, we present a systematic empirical study of quantization-aware training (QAT) for reasoning models.
  arXiv  Detail & Related papers  (2026-01-21T11:22:29Z)
• Revisiting Entropy in Reinforcement Learning for Large Reasoning Models [54.96908589622163]
  We investigate the entropy dynamics of large language models trained withReinforcement learning with verifiable rewards (RLVR)<n>Our findings reveal that the number of off-policy updates, the diversity of training data, and the clipping thresholds in the optimization objective are critical factors influencing the entropy of LLMs trained with RLVR.
  arXiv  Detail & Related papers  (2025-11-08T12:50:41Z)
• Training Dynamics Impact Post-Training Quantization Robustness [31.536101256063684]
  Post-training quantization is widely adopted for efficient deployment of large language models.<n>We conduct a comprehensive analysis of quantization degradation across open-source language model training trajectories up to 32B parameters and 15T training tokens.
  arXiv  Detail & Related papers  (2025-10-07T17:59:07Z)
• From Physics to Machine Learning and Back: Part II - Learning and Observational Bias in PHM [52.64097278841485]
  Review examines how incorporating learning and observational biases through physics-informed modeling and data strategies can guide models toward physically consistent and reliable predictions.<n>Fast adaptation methods including meta-learning and few-shot learning are reviewed alongside domain generalization techniques.
  arXiv  Detail & Related papers  (2025-09-25T14:15:43Z)
• Learning Density Functionals from Noisy Quantum Data [0.0]
  noisy intermediate-scale quantum (NISQ) devices are used to generate training data for machine learning (ML) models. We show that a neural-network ML model can successfully generalize from small datasets subject to noise typical of NISQ algorithms. Our findings suggest a promising pathway for leveraging NISQ devices in practical quantum simulations.
  arXiv  Detail & Related papers  (2024-09-04T17:59:55Z)
• Physics-Informed Weakly Supervised Learning for Interatomic Potentials [17.165117198519248]
  We introduce a physics-informed, weakly supervised approach for training machine-learned interatomic potentials (MLIPs)<n>We demonstrate reduced energy and force errors -- often lower by a factor of two -- for various baseline models and benchmark data sets.<n>Our approach improves the fine-tuning of foundation models on sparse, highly accurate ab initio data.
  arXiv  Detail & Related papers  (2024-07-23T12:49:04Z)
• On the relation between trainability and dequantization of variational quantum learning models [1.7999333451993955]
  We study the relation between trainability and dequantization of variational quantum machine learning (QML)<n>We introduce recipes for building PQC-based QML models which are both trainable and nondequantizable.<n>Our work however does point toward a way forward for finding more general constructions, for which finding applications may become feasible.
  arXiv  Detail & Related papers  (2024-06-11T08:59:20Z)
• Enhancing Q-Learning with Large Language Model Heuristics [0.0]
  Large language models (LLMs) can achieve zero-shot learning for simpler tasks, but they suffer from low inference speeds and occasional hallucinations. We propose textbfLLM-guided Q-learning, a framework that leverages LLMs as hallucinations to aid in learning the Q-function for reinforcement learning.
  arXiv  Detail & Related papers  (2024-05-06T10:42:28Z)
• Large Language Models are Miscalibrated In-Context Learners [22.30783674111999]
  In this work, we deliver an in-depth analysis of the behavior across different choices of learning methods.<n>We observe that the miscalibration problem exists across all learning methods in low-resource setups.<n>We find that self-ensembling with max probability produces robust and calibrated predictions.
  arXiv  Detail & Related papers  (2023-12-21T11:55:10Z)
• Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study [90.34226812493083]
  This work aims to investigate the impact of quantization on emphemergent abilities, which are important characteristics that distinguish LLMs from small language models. Our empirical experiments show that these emergent abilities still exist in 4-bit quantization models, while 2-bit models encounter severe performance degradation. To improve the performance of low-bit models, we conduct two special experiments: (1) fine-gained impact analysis that studies which components (or substructures) are more sensitive to quantization, and (2) performance compensation through model fine-tuning.
  arXiv  Detail & Related papers  (2023-07-16T15:11:01Z)
• Robustness and Generalization Performance of Deep Learning Models on Cyber-Physical Systems: A Comparative Study [71.84852429039881]
  Investigation focuses on the models' ability to handle a range of perturbations, such as sensor faults and noise. We test the generalization and transfer learning capabilities of these models by exposing them to out-of-distribution (OOD) samples.
  arXiv  Detail & Related papers  (2023-06-13T12:43:59Z)
• Pre-training Tensor-Train Networks Facilitates Machine Learning with Variational Quantum Circuits [70.97518416003358]
  Variational quantum circuits (VQCs) hold promise for quantum machine learning on noisy intermediate-scale quantum (NISQ) devices. While tensor-train networks (TTNs) can enhance VQC representation and generalization, the resulting hybrid model, TTN-VQC, faces optimization challenges due to the Polyak-Lojasiewicz (PL) condition. To mitigate this challenge, we introduce Pre+TTN-VQC, a pre-trained TTN model combined with a VQC.
  arXiv  Detail & Related papers  (2023-05-18T03:08:18Z)
• Quantum-tailored machine-learning characterization of a superconducting qubit [50.591267188664666]
  We develop an approach to characterize the dynamics of a quantum device and learn device parameters. This approach outperforms physics-agnostic recurrent neural networks trained on numerically generated and experimental data. This demonstration shows how leveraging domain knowledge improves the accuracy and efficiency of this characterization task.
  arXiv  Detail & Related papers  (2021-06-24T15:58:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.