Phase space distributions in information theory
- URL: http://arxiv.org/abs/2410.16338v1
- Date: Mon, 21 Oct 2024 06:43:23 GMT
- Title: Phase space distributions in information theory
- Abstract summary: We investigate Shannon, Wehrl and Renyi entropies, its divergences, mutual information and other correlation measures.
The entropies associated with the Wigner distribution are observed to be lower than those of the Husimi distribution.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We use phase space distributions specifically, the Wigner distribution (WD) and Husimi distribution (HD) to investigate certain information-theoretic measures as descriptors for a given system. We extensively investigate and analyze Shannon, Wehrl and Renyi entropies, its divergences, mutual information and other correlation measures within the context of these phase space distributions. The analysis is illustrated with an anharmonic oscillator and is studied with respect to perturbation parameter ($\lambda$) and states ($n$). The entropies associated with the Wigner distribution are observed to be lower than those of the Husimi distribution, which aligns with the findings regarding the marginals. Moreover, the real components of the entropies associated with the Wigner distribution tend to approach the entropic uncertainty bound more closely compared to those of the corresponding Husimi distribution. Moreover, we quantify the precise amount of information lost when opting for the Husimi distribution over the Wigner distribution for characterizing the specified system. Since it is not always positive definite, the entropies cannot always be defined.
Related papers
- Probing information theoretic measures of nonlinear ultracold quantum gases using phase-space distributions [0.0]
We study harmonically trapped Bose--Einstein condensate described by the Gross Pitaevskii equation.<n>From the mean field ground state wavefunction we construct both distributions and their position and momentum space marginals.<n>We find that stronger repulsive interactions drive increased phase space delocalization.
arXiv Detail & Related papers (2026-06-01T05:21:19Z) - On the Entanglement Entropy Distribution of a Hybrid Quantum Circuit [3.584852326415375]
We investigate the distribution of entanglement entropy in hybrid quantum circuits consisting of random unitary gates and local measurements applied at a finite rate.<n>We demonstrate that higher moments of the entanglement entropy distribution, such as a ratio between the variance and the mean and skewness, capture nontrivial features of the measurement-induced dynamics.
arXiv Detail & Related papers (2026-03-31T06:45:38Z) - Consecutive-gap ratio distribution for crossover ensembles [0.0]
We describe the crossover between the Gaussian ensemble (GOE) and Poisson statistics.<n>This crossover is observed in the isotropic Heisenberg spin-$1/2$ chain with disordered local field.<n>We study the continuous-state Markov process that governs the probability of finding the system close to this fixed point.
arXiv Detail & Related papers (2025-12-17T12:41:13Z) - Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplers [49.97755400231656]
We present the first performance guarantee with explicit dimensional general score-mismatched diffusion samplers.
We show that score mismatches result in an distributional bias between the target and sampling distributions, proportional to the accumulated mismatch between the target and training distributions.
This result can be directly applied to zero-shot conditional samplers for any conditional model, irrespective of measurement noise.
arXiv Detail & Related papers (2024-10-17T16:42:12Z) - Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysis [56.442307356162864]
We study the theoretical aspects of score-based discrete diffusion models under the Continuous Time Markov Chain (CTMC) framework.
We introduce a discrete-time sampling algorithm in the general state space $[S]d$ that utilizes score estimators at predefined time points.
Our convergence analysis employs a Girsanov-based method and establishes key properties of the discrete score function.
arXiv Detail & Related papers (2024-10-03T09:07:13Z) - Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective [18.331374727331077]
We provide a theoretical understanding of the Lipschitz continuity and second momentum properties of the diffusion process.
Our results provide deeper theoretical insights into the dynamics of the diffusion process under common data distributions.
arXiv Detail & Related papers (2024-05-26T03:32:27Z) - Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian
Mixture Models [59.331993845831946]
Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties.
This paper provides the first theoretical study towards understanding the influence of guidance on diffusion models in the context of Gaussian mixture models.
arXiv Detail & Related papers (2024-03-03T23:15:48Z) - Entropy of the Canonical Occupancy (Macro) State in the Quantum
Measurement Theory [0.0]
The paper analyzes the probability distribution of the occupancy numbers and the entropy of a system at the equilibrium composed by an arbitrary number of non-interacting bosons.
arXiv Detail & Related papers (2023-08-08T10:26:11Z) - Adaptive Annealed Importance Sampling with Constant Rate Progress [68.8204255655161]
Annealed Importance Sampling (AIS) synthesizes weighted samples from an intractable distribution.
We propose the Constant Rate AIS algorithm and its efficient implementation for $alpha$-divergences.
arXiv Detail & Related papers (2023-06-27T08:15:28Z) - Full counting statistics as probe of measurement-induced transitions in
the quantum Ising chain [62.997667081978825]
We show that local projective measurements induce a modification of the out-of-equilibrium probability distribution function of the local magnetization.
In particular we describe how the probability distribution of the former shows different behaviour in the area-law and volume-law regimes.
arXiv Detail & Related papers (2022-12-19T12:34:37Z) - Non-Gaussian work statistics at finite-time driving [0.0]
We study properties of the work distribution of a many-body system driven through a quantum phase transition in finite time.
We focus on the non-Gaussianity of the distribution, which we characterize through two quantitative metrics: skewness and negentropy.
arXiv Detail & Related papers (2022-08-12T10:08:27Z) - Ground-state energy distribution of disordered many-body quantum systems [0.0]
We focus on the ground-state energy distribution of disordered many-body quantum systems.
We derive an analytical expression that reproduces with high accuracy the ground-state energy distribution of the systems that we consider.
arXiv Detail & Related papers (2022-05-19T18:00:03Z) - AI Giving Back to Statistics? Discovery of the Coordinate System of
Univariate Distributions by Beta Variational Autoencoder [0.0]
The article discusses experiences of training neural networks to classify univariate empirical distributions and to represent them on the two-dimensional latent space forcing disentanglement based on the inputs of cumulative distribution functions (CDF)
The representation on the latent two-dimensional coordinate system can be seen as an additional metadata of the real-world data that disentangles important distribution characteristics, such as shape of the CDF, classification probabilities of underlying theoretical distributions and their parameters, information entropy, and skewness.
arXiv Detail & Related papers (2020-04-06T14:11:13Z) - Profile Entropy: A Fundamental Measure for the Learnability and
Compressibility of Discrete Distributions [63.60499266361255]
We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression.
Specifically, profile entropy a) determines the speed of estimating the distribution relative to the best natural estimator; b) characterizes the rate of inferring all symmetric properties compared with the best estimator over any label-invariant distribution collection; c) serves as the limit of profile compression.
arXiv Detail & Related papers (2020-02-26T17:49:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.