The world as a neural network

• URL: http://arxiv.org/abs/2008.01540v1
• Date: Tue, 4 Aug 2020 17:10:46 GMT
• Title: The world as a neural network
• Authors: Vitaly Vanchurin
• Abstract summary: We discuss a possibility that the universe on its most fundamental level is a neural network. We identify two different types of dynamical degrees of freedom: "trainable" variables and "hidden" variables. We argue that the entropy production in such a system is a local function of the symmetries of the Onsager-Hilbert term.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We discuss a possibility that the entire universe on its most fundamental level is a neural network. We identify two different types of dynamical degrees of freedom: "trainable" variables (e.g. bias vector or weight matrix) and "hidden" variables (e.g. state vector of neurons). We first consider stochastic evolution of the trainable variables to argue that near equilibrium their dynamics is well approximated by Madelung equations (with free energy representing the phase) and further away from the equilibrium by Hamilton-Jacobi equations (with free energy representing the Hamilton's principal function). This shows that the trainable variables can indeed exhibit classical and quantum behaviors with the state vector of neurons representing the hidden variables. We then study stochastic evolution of the hidden variables by considering $D$ non-interacting subsystems with average state vectors, $\bar{\bf x}^{1}$, ..., $\bar{\bf x}^{D}$ and an overall average state vector $\bar{\bf x}^{0}$. In the limit when the weight matrix is a permutation matrix, the dynamics of $\bar{\bf x}^{\mu}$ can be described in terms of relativistic strings in an emergent $D+1$ dimensional Minkowski space-time. If the subsystems are minimally interacting, with interactions described by a metric tensor, then the emergent space-time becomes curved. We argue that the entropy production in such a system is a local function of the metric tensor which should be determined by the symmetries of the Onsager tensor. It turns out that a very simple and highly symmetric Onsager tensor leads to the entropy production described by the Einstein-Hilbert term. This shows that the learning dynamics of a neural network can indeed exhibit approximate behaviors described by both quantum mechanics and general relativity. We also discuss a possibility that the two descriptions are holographic duals of each other.

Related papers

• Symmetries, correlation functions, and entanglement of general quantum Motzkin spin-chains [0.029541734875307393]
  Motzkin spin-chains, which include 'colorless' (integer spin $s=1$) and 'colorful' ($s geq 2$) variants, are one-dimensional (1D) local integer spin models. We analytically discover several unique properties of these models, potentially suggesting a new correlations class for lowenergy physics.
  arXiv  Detail & Related papers  (2024-08-28T18:10:16Z)
• Symmetry shapes thermodynamics of macroscopic quantum systems [0.0]
  We show that the entropy of a system can be described in terms of group-theoretical quantities. We apply our technique to generic $N$ identical interacting $d$-level quantum systems.
  arXiv  Detail & Related papers  (2024-02-06T18:13:18Z)
• Classical stochastic representation of quantum mechanics [0.0]
  We show that the dynamics of a quantum system can be represented by the dynamics of an underlying classical systems obeying the Hamilton equations of motion. The probabilistic character of quantum mechanics is devised by treating the wave function as a variable.
  arXiv  Detail & Related papers  (2023-07-31T21:02:43Z)
• Position as an independent variable and the emergence of the $1/2$-time fractional derivative in quantum mechanics [0.0]
  We derive the function $cal P(pm)$, which generates the space evolution under the potential $cal V(q)$ and Hamiltonian $cal H$. Using Dirac's procedure, separation of variables is possible, and while the coupled position-independent Dirac equations depend on the $1/2$-fractional derivative, the coupled time-independent Dirac equations (TIDE) lead to positive and negative shifts in the potential.
  arXiv  Detail & Related papers  (2023-07-25T19:57:23Z)
• Injectivity of ReLU networks: perspectives from statistical physics [22.357927193774803]
  We consider a single layer, $x mapsto mathrmReLU(Wx)$, with a random Gaussian $m times n$ matrix $W$, in a high-dimensional setting where $n, m to infty$. Recent work connects this problem to spherical integral geometry giving rise to a conjectured sharp injectivity threshold for $alpha = fracmn$ by studying the expected Euler characteristic of a certain random set. We show that injectivity is equivalent to a property of the ground state of the spherical
  arXiv  Detail & Related papers  (2023-02-27T19:51:42Z)
• Correspondence between open bosonic systems and stochastic differential equations [77.34726150561087]
  We show that there can also be an exact correspondence at finite $n$ when the bosonic system is generalized to include interactions with the environment. A particular system with the form of a discrete nonlinear Schr"odinger equation is analyzed in more detail.
  arXiv  Detail & Related papers  (2023-02-03T19:17:37Z)
• Sublinear quantum algorithms for estimating von Neumann entropy [18.30551855632791]
  We study the problem of obtaining estimates to within a multiplicative factor $gamma>1$ of the Shannon entropy of probability distributions and the von Neumann entropy of mixed quantum states. We work with the quantum purified query access model, which can handle both classical probability distributions and mixed quantum states, and is the most general input model considered in the literature.
  arXiv  Detail & Related papers  (2021-11-22T12:00:45Z)
• Towards a theory of quantum gravity from neural networks [0.0]
  We show that the non-equilibrium dynamics of trainable variables can be described by the Madelung equations. We argue that the Lorentz symmetries and curved space-time can emerge from the interplay between entropy production and entropy destruction due to learning.
  arXiv  Detail & Related papers  (2021-10-28T12:39:01Z)
• Symmetric distinguishability as a quantum resource [21.071072991369824]
  We develop a resource theory of symmetric distinguishability, the fundamental objects of which are elementary quantum information sources. We study the resource theory for two different classes of free operations: $(i)$ $rmCPTP_A$, which consists of quantum channels acting only on $A$, and $(ii)$ conditional doubly (CDS) maps acting on $XA$.
  arXiv  Detail & Related papers  (2021-02-24T19:05:02Z)
• Perelman's Ricci Flow in Topological Quantum Gravity [62.997667081978825]
  In our quantum gravity, Perelman's $tau$ turns out to play the role of a dilaton for anisotropic scale transformations. We show how Perelman's $cal F$ and $cal W$ entropy functionals are related to our superpotential.
  arXiv  Detail & Related papers  (2020-11-24T06:29:35Z)
• Sub-bosonic (deformed) ladder operators [62.997667081978825]
  We present a class of deformed creation and annihilation operators that originates from a rigorous notion of fuzziness. This leads to deformed, sub-bosonic commutation relations inducing a simple algebraic structure with modified eigenenergies and Fock states. In addition, we investigate possible consequences of the introduced formalism in quantum field theories, as for instance, deviations from linearity in the dispersion relation for free quasibosons.
  arXiv  Detail & Related papers  (2020-09-10T20:53:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.