Unified framework for continuity of sandwiched R\'enyi divergences

• URL: http://arxiv.org/abs/2308.12425v1
• Date: Wed, 23 Aug 2023 21:09:54 GMT
• Title: Unified framework for continuity of sandwiched R\'enyi divergences
• Authors: Andreas Bluhm, Angela Capel, Paul Gondolf and Tim M\"obus
• Abstract summary: We prove continuity bounds for entropic quantities related to sandwiched R'enyi divergences. In a separate contribution, we use the ALAAF method, developed by some of the authors, to study the stability of approximate quantum Markov chains.
• Score: 0.27309692684728604
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we prove uniform continuity bounds for entropic quantities related to the sandwiched R\'enyi divergences such as the sandwiched R\'enyi conditional entropy. We follow three different approaches: The first one is the axiomatic approach, which exploits the sub-/ superadditivity and joint concavity/ convexity of the exponential of the divergence. In our second approach, termed the "operator space approach", we express the entropic measures as norms and utilize their properties for establishing the bounds. These norms draw inspiration from interpolation space norms. We not only demonstrate the norm properties solely relying on matrix analysis tools but also extend their applicability to a context that holds relevance in resource theories. By this, we extend the strategies of Marwah and Dupuis as well as Beigi and Goodarzi employed in the sandwiched R\'enyi conditional entropy context. Finally, we merge the approaches into a mixed approach that has some advantageous properties and then discuss in which regimes each bound performs best. Our results improve over the previous best continuity bounds or sometimes even give the first continuity bounds available. In a separate contribution, we use the ALAAF method, developed in a previous article by some of the authors, to study the stability of approximate quantum Markov chains.

Related papers

• A Unified Theory of Stochastic Proximal Point Methods without Smoothness [52.30944052987393]
  Proximal point methods have attracted considerable interest owing to their numerical stability and robustness against imperfect tuning. This paper presents a comprehensive analysis of a broad range of variations of the proximal point method (SPPM)
  arXiv  Detail & Related papers  (2024-05-24T21:09:19Z)
• Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales [8.81121308982678]
  We investigate the conditional distributions of two Banach space valued, jointly Gaussian random variables. We show that their means and covariances are determined by a general finite dimensional approximation scheme based upon a martingale approach.
  arXiv  Detail & Related papers  (2024-04-04T13:57:44Z)
• Online Learning with Adversaries: A Differential-Inclusion Analysis [52.43460995467893]
  We introduce an observation-matrix-based framework for fully asynchronous online Federated Learning with adversaries. Our main result is that the proposed algorithm almost surely converges to the desired mean $mu.$ We derive this convergence using a novel differential-inclusion-based two-timescale analysis.
  arXiv  Detail & Related papers  (2023-04-04T04:32:29Z)
• On the Importance of Gradient Norm in PAC-Bayesian Bounds [92.82627080794491]
  We propose a new generalization bound that exploits the contractivity of the log-Sobolev inequalities. We empirically analyze the effect of this new loss-gradient norm term on different neural architectures.
  arXiv  Detail & Related papers  (2022-10-12T12:49:20Z)
• The strong converse exponent of discriminating infinite-dimensional quantum states [0.0]
  We show that the sandwiched R'enyi divergences of finite-dimensional density operators quantify their distinguishability in the strong converse domain. We also initiate the study of the sandwiched R'enyi divergences, and the related problem of the strong converse exponent.
  arXiv  Detail & Related papers  (2021-07-16T17:57:28Z)
• Lifting the Convex Conjugate in Lagrangian Relaxations: A Tractable Approach for Continuous Markov Random Fields [53.31927549039624]
  We show that a piecewise discretization preserves better contrast from existing discretization problems. We apply this theory to the problem of matching two images.
  arXiv  Detail & Related papers  (2021-07-13T12:31:06Z)
• R\'enyi divergence inequalities via interpolation, with applications to generalised entropic uncertainty relations [91.3755431537592]
  We investigate quantum R'enyi entropic quantities, specifically those derived from'sandwiched' divergence. We present R'enyi mutual information decomposition rules, a new approach to the R'enyi conditional entropy tripartite chain rules and a more general bipartite comparison.
  arXiv  Detail & Related papers  (2021-06-19T04:06:23Z)
• Uniqueness and Optimality of Dynamical Extensions of Divergences [9.13755431537592]
  We introduce an axiomatic approach for channel divergences and channel relative entropies. We show that these axioms are sufficient to give enough structure also in the channel domain. We also introduce the maximal channel extension of a given classical state divergence.
  arXiv  Detail & Related papers  (2020-06-23T21:23:08Z)
• The Convergence Indicator: Improved and completely characterized parameter bounds for actual convergence of Particle Swarm Optimization [68.8204255655161]
  We introduce a new convergence indicator that can be used to calculate whether the particles will finally converge to a single point or diverge. Using this convergence indicator we provide the actual bounds completely characterizing parameter regions that lead to a converging swarm.
  arXiv  Detail & Related papers  (2020-06-06T19:08:05Z)
• Sequences of lower bounds for entropic uncertainty relations from bistochastic maps [0.0]
  We show a strategy to derive sequences of lower bounds based on alternating sequences of measurements onto A and B. The strategy can allow for an advantage both in the pure state and in the mixed state scenario.
  arXiv  Detail & Related papers  (2019-12-30T16:35:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.