Relative Entropy via Distribution of Observables

• URL: http://arxiv.org/abs/2203.01964v3
• Date: Sat, 5 Aug 2023 17:32:43 GMT
• Title: Relative Entropy via Distribution of Observables
• Authors: George Androulakis, Tiju Cherian John
• Abstract summary: We obtain formulas for Petz-R'enyi and Umegaki relative entropy from the idea of distribution of a positive selfadjoint operator. All of the results presented here are valid in both finite and infinite dimensions.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We obtain formulas for Petz-R\'enyi and Umegaki relative entropy from the idea of distribution of a positive selfadjoint operator. Classical results on R\'enyi and Kullback-Leibler divergences are applied to obtain new results and new proofs for some known results about Petz-R\'enyi and Umegaki relative entropy. Most important among these, is a necessary and sufficient condition for the finiteness of the Petz-R\'enyi $\alpha$-relative entropy. All of the results presented here are valid in both finite and infinite dimensions. In particular, these results are valid for states in Fock spaces and thus are applicable to continuous variable quantum information theory.

Related papers

• A New Theoretical Perspective on Data Heterogeneity in Federated Optimization [39.75009345804017]
  In federated learning (FL), data heterogeneity is the main reason that existing theoretical analyses are pessimistic about the convergence rate. In particular, for many FL algorithms, the convergence rate grows dramatically when the number of local updates becomes large. This paper aims to bridge this gap between theoretical understanding and practical performance by providing a theoretical analysis from a new perspective.
  arXiv  Detail & Related papers  (2024-07-22T11:52:58Z)
• Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussians [27.20127082606962]
  Variational inference (VI) is a popular approach in Bayesian inference. This work aims to contribute to the theoretical study of VI in the non-Gaussian case.
  arXiv  Detail & Related papers  (2024-06-06T12:38:59Z)
• Conditional Independence of 1D Gibbs States with Applications to Efficient Learning [0.23301643766310368]
  We show that spin chains in thermal equilibrium have a correlation structure in which individual regions are strongly correlated at most with their near vicinity. We prove that these measures decay superexponentially at every positive temperature.
  arXiv  Detail & Related papers  (2024-02-28T17:28:01Z)
• Pseudo entropy and pseudo-Hermiticity in quantum field theories [0.0]
  We explore the concept of pseudo R'enyi entropy within the context of quantum field theories (QFTs) Our analysis reveals that the reality or complexity of the logarithmic term of pseudo R'enyi entropy can be explained through this pseudo-Hermitian framework. We also observe a universal divergent term in the second pseudo R'enyi entropy within 2-dimensional CFTs.
  arXiv  Detail & Related papers  (2023-11-02T07:35:04Z)
• Local Intrinsic Dimensional Entropy [29.519376857728325]
  Most entropy measures depend on the spread of the probability distribution over the sample space $mathcalX|$. In this work, we question the role of cardinality and distribution spread in defining entropy measures for continuous spaces. We find that the average value of the local intrinsic dimension of a distribution, denoted as ID-Entropy, can serve as a robust entropy measure for continuous spaces.
  arXiv  Detail & Related papers  (2023-04-05T04:36:07Z)
• Tight Exponential Analysis for Smoothing the Max-Relative Entropy and for Quantum Privacy Amplification [56.61325554836984]
  The max-relative entropy together with its smoothed version is a basic tool in quantum information theory. We derive the exact exponent for the decay of the small modification of the quantum state in smoothing the max-relative entropy based on purified distance.
  arXiv  Detail & Related papers  (2021-11-01T16:35:41Z)
• R\'enyi divergence inequalities via interpolation, with applications to generalised entropic uncertainty relations [91.3755431537592]
  We investigate quantum R'enyi entropic quantities, specifically those derived from'sandwiched' divergence. We present R'enyi mutual information decomposition rules, a new approach to the R'enyi conditional entropy tripartite chain rules and a more general bipartite comparison.
  arXiv  Detail & Related papers  (2021-06-19T04:06:23Z)
• Towards a functorial description of quantum relative entropy [0.0]
  Affine functor defines an affine functor in the special case where the relative entropy is finite. A recent non-commutative disintegration theorem provides a key ingredient in this proof.
  arXiv  Detail & Related papers  (2021-05-10T00:58:46Z)
• Optimized quantum f-divergences [6.345523830122166]
  I introduce the optimized quantum f-divergence as a related generalization of quantum relative entropy. I prove that it satisfies the data processing inequality, and the method of proof relies upon the operator Jensen inequality. One benefit of this approach is that there is now a single, unified approach for establishing the data processing inequality for the Petz--Renyi and sandwiched Renyi relative entropies.
  arXiv  Detail & Related papers  (2021-03-31T04:15:52Z)
• Long-distance entanglement of purification and reflected entropy in conformal field theory [58.84597116744021]
  We study entanglement properties of mixed states in quantum field theory via entanglement of purification and reflected entropy. We find an elementary proof that the decay of both, the entanglement of purification and reflected entropy, is enhanced with respect to the mutual information behaviour.
  arXiv  Detail & Related papers  (2021-01-29T19:00:03Z)
• Extensive R\'enyi entropies in matrix product states [0.0]
  We prove that all R'enyi entanglement entropies of spin-chains described by generic (gapped) are extensive for disconnected sub-systems. For unital quantum channels this yields a very simple lower bound on the distribution of singular values and the expansion coefficient in terms of the Kraus-rank.
  arXiv  Detail & Related papers  (2020-08-26T18:53:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.