On the Algorithmic Information Between Probabilities
- URL: http://arxiv.org/abs/2303.07296v2
- Date: Wed, 11 Sep 2024 17:26:13 GMT
- Title: On the Algorithmic Information Between Probabilities
- Authors: Samuel Epstein,
- Abstract summary: We extend algorithmic conservation inequalities to probability measures.
The amount of self information of a probability measure cannot increase when submitted to randomized processing.
We show that given a quantum measurement, for an overwhelming majority of pure states, no meaningful information is produced.
- Score: 6.5268245109828005
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We extend algorithmic conservation inequalities to probability measures. The amount of self information of a probability measure cannot increase when submitted to randomized processing. This includes (potentially non-computable) measures over finite sequences, infinite sequences, and $T_0$, second countable topologies. One example is the convolution of signals over real numbers with probability kernels. Thus the smoothing of any signal due We show that given a quantum measurement, for an overwhelming majority of pure states, no meaningful information is produced.
Related papers
- Efficient inference of quantum system parameters by Approximate Bayesian Computation [0.0]
We propose the Approximate Bayesian Computation (ABC) algorithm, which evades likelihood by sampling from a library of measurement data.
We apply ABC to interpret photodetection click-patterns arising when probing in real time a two-level atom and an optomechanical system.
Our work demonstrates that fast parameter inference may be possible no matter the complexity of a quantum device and the measurement scheme involved.
arXiv Detail & Related papers (2024-06-30T15:10:05Z) - Real-Valued Somewhat-Pseudorandom Unitaries [5.294604210205507]
We show that even though real-valued unitaries cannot be completely pseudorandom, we can still obtain some pseudorandom properties without giving up on a real-valued unitary.
Our analysis shows that an even simpler construction: applying a random (binary) phase followed by a random computational-basis permutation, would suffice.
arXiv Detail & Related papers (2024-03-25T12:37:50Z) - Unambiguous discrimination of sequences of quantum states [14.37149160708975]
We consider the problem of determining the state of an unknown quantum sequence without error.
We calculate the optimum probability by solving the optimality conditions of a semidefinite program.
arXiv Detail & Related papers (2024-02-09T12:18:15Z) - The signaling dimension in generalized probabilistic theories [48.99818550820575]
The signaling dimension of a given physical system quantifies the minimum dimension of a classical system required to reproduce all input/output correlations of the given system.
We show that it suffices to consider extremal measurements with rayextremal effects, and we bound the number of elements of any such measurement in terms of the linear dimension.
For systems with a finite number of extremal effects, we recast the problem of characterizing the extremal measurements with ray-extremal effects.
arXiv Detail & Related papers (2023-11-22T02:09:16Z) - A Non-monotonic Self-terminating Language Model [62.93465126911921]
In this paper, we focus on the problem of non-terminating sequences resulting from an incomplete decoding algorithm.
We first define an incomplete probable decoding algorithm which includes greedy search, top-$k$ sampling, and nucleus sampling.
We then propose a non-monotonic self-terminating language model, which relaxes the constraint of monotonically increasing termination probability.
arXiv Detail & Related papers (2022-10-03T00:28:44Z) - Exact results on Quantum search algorithm [0.34376560669160383]
We give exact analytic expressions for the success probability after arbitrary number of iteration of the generalized Grover operator.
We quantify success probability of the algorithm with decrease in coherence of the initial quantum state against modest noise.
arXiv Detail & Related papers (2022-07-20T09:05:32Z) - Eliminating Intermediate Measurements using Pseudorandom Generators [1.218340575383456]
We show that quantum algorithms of time $T$ and space $Sge log T$ can be simulated by quantum algorithms of time $T cdot mathrmpoly (S)$ and space $ O(Scdot log T)$ with unitary operations and without intermediate measurements.
arXiv Detail & Related papers (2021-06-22T15:47:20Z) - Shannon Entropy Rate of Hidden Markov Processes [77.34726150561087]
We show how to calculate entropy rates for hidden Markov chains.
We also show how this method gives the minimal set of infinite predictive features.
A sequel addresses the challenge's second part on structure.
arXiv Detail & Related papers (2020-08-29T00:48:17Z) - Stochastic Saddle-Point Optimization for Wasserstein Barycenters [69.68068088508505]
We consider the populationimation barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data.
We employ the structure of the problem and obtain a convex-concave saddle-point reformulation of this problem.
In the setting when the distribution of random probability measures is discrete, we propose an optimization algorithm and estimate its complexity.
arXiv Detail & Related papers (2020-06-11T19:40:38Z) - Generalized Sliced Distances for Probability Distributions [47.543990188697734]
We introduce a broad family of probability metrics, coined as Generalized Sliced Probability Metrics (GSPMs)
GSPMs are rooted in the generalized Radon transform and come with a unique geometric interpretation.
We consider GSPM-based gradient flows for generative modeling applications and show that under mild assumptions, the gradient flow converges to the global optimum.
arXiv Detail & Related papers (2020-02-28T04:18:00Z) - Distributed, partially collapsed MCMC for Bayesian Nonparametrics [68.5279360794418]
We exploit the fact that completely random measures, which commonly used models like the Dirichlet process and the beta-Bernoulli process can be expressed as, are decomposable into independent sub-measures.
We use this decomposition to partition the latent measure into a finite measure containing only instantiated components, and an infinite measure containing all other components.
The resulting hybrid algorithm can be applied to allow scalable inference without sacrificing convergence guarantees.
arXiv Detail & Related papers (2020-01-15T23:10:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.