The Mathematical Structure of Integrated Information Theory
- URL: http://arxiv.org/abs/2002.07655v1
- Date: Tue, 18 Feb 2020 15:44:02 GMT
- Title: The Mathematical Structure of Integrated Information Theory
- Authors: Johannes Kleiner and Sean Tull
- Abstract summary: Integrated Information Theory is one of the leading models of consciousness.
It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Integrated Information Theory is one of the leading models of consciousness.
It aims to describe both the quality and quantity of the conscious experience
of a physical system, such as the brain, in a particular state. In this
contribution, we propound the mathematical structure of the theory, separating
the essentials from auxiliary formal tools. We provide a definition of a
generalized IIT which has IIT 3.0 of Tononi et. al., as well as the Quantum IIT
introduced by Zanardi et. al. as special cases. This provides an axiomatic
definition of the theory which may serve as the starting point for future
formal investigations and as an introduction suitable for researchers with a
formal background.
Related papers
- Learning Discrete Concepts in Latent Hierarchical Models [73.01229236386148]
Learning concepts from natural high-dimensional data holds potential in building human-aligned and interpretable machine learning models.
We formalize concepts as discrete latent causal variables that are related via a hierarchical causal model.
We substantiate our theoretical claims with synthetic data experiments.
arXiv Detail & Related papers (2024-06-01T18:01:03Z) - Provable Compositional Generalization for Object-Centric Learning [55.658215686626484]
Learning representations that generalize to novel compositions of known concepts is crucial for bridging the gap between human and machine perception.
We show that autoencoders that satisfy structural assumptions on the decoder and enforce encoder-decoder consistency will learn object-centric representations that provably generalize compositionally.
arXiv Detail & Related papers (2023-10-09T01:18:07Z) - A Category-theoretical Meta-analysis of Definitions of Disentanglement [97.34033555407403]
Disentangling the factors of variation in data is a fundamental concept in machine learning.
This paper presents a meta-analysis of existing definitions of disentanglement.
arXiv Detail & Related papers (2023-05-11T15:24:20Z) - Categorical Foundations of Explainable AI: A Unifying Theory [8.637435154170916]
This paper presents the first mathematically rigorous definitions of key XAI notions and processes, using the well-funded formalism of Category theory.
We show that our categorical framework allows to: (i) model existing learning schemes and architectures, (ii) formally define the term "explanation", (iii) establish a theoretical basis for XAI, and (iv) analyze commonly overlooked aspects of explaining methods.
arXiv Detail & Related papers (2023-04-27T11:10:16Z) - Measuring the integrated information of a quantum mechanism [0.0]
Integrated information theory was originally conceived as a theory of consciousness.
It remains to be determined whether IIT as a theory of consciousness is compatible with quantum mechanics as a theory of microphysics.
arXiv Detail & Related papers (2023-01-04T22:27:36Z) - Investigating the Role of Centering Theory in the Context of Neural
Coreference Resolution Systems [71.57556446474486]
We investigate the connection between centering theory and modern coreference resolution systems.
We show that high-quality neural coreference resolvers may not benefit much from explicitly modeling centering ideas.
We formulate a version of CT that also models recency and show that it captures coreference information better compared to vanilla CT.
arXiv Detail & Related papers (2022-10-26T12:55:26Z) - Unification and Extension of Classic Information Principles [2.210780502414563]
The sextuple model of the objective information theory (OIT) is a sufficient and necessary condition for discussing information with four basic postulations.
The OIT is a novel information theory that can unify a variety of classical information principles and even accurately reveal the quantitative relationship between information, matter and energy.
arXiv Detail & Related papers (2022-06-11T14:31:31Z) - Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization [49.00409552570441]
We study the role of conceptualization in commonsense reasoning, and formulate a framework to replicate human conceptual induction.
We apply the framework to ATOMIC, a large-scale human-annotated CKG, aided by the taxonomy Probase.
arXiv Detail & Related papers (2022-06-03T12:24:49Z) - Brain Principles Programming [0.3867363075280543]
Brain Principles Programming, BPP, is the formalization of universal mechanisms (principles) of the brain's work with information.
The paper uses mathematical models and algorithms of the following theories.
arXiv Detail & Related papers (2022-02-13T13:41:44Z) - Formalising Concepts as Grounded Abstractions [68.24080871981869]
This report shows how representation learning can be used to induce concepts from raw data.
The main technical goal of this report is to show how techniques from representation learning can be married with a lattice-theoretic formulation of conceptual spaces.
arXiv Detail & Related papers (2021-01-13T15:22:01Z) - Integrated Information in Process Theories [0.0]
We show how the key notions of Tononi et al.'s Integrated Information Theory can be studied within the simple graphical language of process theories.
This allows IIT to be generalised to a broad range of physical theories, including as a special case the Quantum IIT of Zanardi, Tomka and Venuti.
arXiv Detail & Related papers (2020-02-18T15:44:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.