The Mathematical Structure of Integrated Information Theory
- URL: http://arxiv.org/abs/2002.07655v1
- Date: Tue, 18 Feb 2020 15:44:02 GMT
- Title: The Mathematical Structure of Integrated Information Theory
- Abstract summary: Integrated Information Theory is one of the leading models of consciousness.
It aims to describe both the quality and quantity of the conscious experience of a physical system, such as the brain, in a particular state.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Integrated Information Theory is one of the leading models of consciousness.
It aims to describe both the quality and quantity of the conscious experience
of a physical system, such as the brain, in a particular state. In this
contribution, we propound the mathematical structure of the theory, separating
the essentials from auxiliary formal tools. We provide a definition of a
generalized IIT which has IIT 3.0 of Tononi et. al., as well as the Quantum IIT
introduced by Zanardi et. al. as special cases. This provides an axiomatic
definition of the theory which may serve as the starting point for future
formal investigations and as an introduction suitable for researchers with a
formal background.
Related papers
- From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery [60.11725132433485]
We argue that scientific discovery is fundamentally a problem of knowledge organisation.<n>We introduce Mechanistic World Models, a new design paradigm that places reusable mechanisms at the centre of representation, computation and learning.
arXiv Detail & Related papers (2026-07-14T08:03:27Z) - Towards an Inferentialist Account of Information Through Proof-theoretic Semantics [0.0]
We take a first step towards developing an inferentialist semantic theory of information.<n>We replace truth with inferability, and trace the consequences of this replacement.<n>Using P-tS, we develop the first steps towards a mathematical-logical theory of an inferentialist primitive unit of information, the 'inferon'
arXiv Detail & Related papers (2026-05-06T18:49:02Z) - Information as Maximum-Caliber Deviation: A bridge between Integrated Information Theory and the Free Energy Principle [51.56484100374058]
This work proposes that information can be defined as the deviation $$ of realized dynamics from a constrained maximum-caliber (MaxCal) path ensemble over a finite time horizon.<n>Under this definition, each of the cause/effect repertoires central to IIT 3.0 emerge directly from MaxCal variational principles.<n>Information $$ is shown to be equivalent to prediction error under accompanying predictive coding models.
arXiv Detail & Related papers (2026-05-03T07:22:55Z) - There Will Be a Scientific Theory of Deep Learning [62.690977616250954]
We make the case that a scientific theory of deep learning is emerging.<n>We identify five growing bodies of work that point toward such a theory.<n>We argue that the emerging theory is best thought of as a mechanics of the learning process.
arXiv Detail & Related papers (2026-04-23T13:58:12Z) - Newton to Einstein: Axiom-Based Discovery via Game Design [55.30047000068118]
We propose a game design framework in which scientific inquiry is recast as a rule-evolving system.<n>Unlike conventional ML approaches that operate within fixed assumptions, our method enables the discovery of new theoretical structures.
arXiv Detail & Related papers (2025-09-05T18:59:18Z) - Learning Discrete Concepts in Latent Hierarchical Models [73.01229236386148]
Learning concepts from natural high-dimensional data holds potential in building human-aligned and interpretable machine learning models.
We formalize concepts as discrete latent causal variables that are related via a hierarchical causal model.
We substantiate our theoretical claims with synthetic data experiments.
arXiv Detail & Related papers (2024-06-01T18:01:03Z) - Provable Compositional Generalization for Object-Centric Learning [55.658215686626484]
Learning representations that generalize to novel compositions of known concepts is crucial for bridging the gap between human and machine perception.
We show that autoencoders that satisfy structural assumptions on the decoder and enforce encoder-decoder consistency will learn object-centric representations that provably generalize compositionally.
arXiv Detail & Related papers (2023-10-09T01:18:07Z) - A Category-theoretical Meta-analysis of Definitions of Disentanglement [97.34033555407403]
Disentangling the factors of variation in data is a fundamental concept in machine learning.
This paper presents a meta-analysis of existing definitions of disentanglement.
arXiv Detail & Related papers (2023-05-11T15:24:20Z) - Categorical Foundations of Explainable AI: A Unifying Theory [8.637435154170916]
This paper presents the first mathematically rigorous definitions of key XAI notions and processes, using the well-funded formalism of Category theory.
We show that our categorical framework allows to: (i) model existing learning schemes and architectures, (ii) formally define the term "explanation", (iii) establish a theoretical basis for XAI, and (iv) analyze commonly overlooked aspects of explaining methods.
arXiv Detail & Related papers (2023-04-27T11:10:16Z) - Measuring the integrated information of a quantum mechanism [0.0]
Integrated information theory was originally conceived as a theory of consciousness.
It remains to be determined whether IIT as a theory of consciousness is compatible with quantum mechanics as a theory of microphysics.
arXiv Detail & Related papers (2023-01-04T22:27:36Z) - Investigating the Role of Centering Theory in the Context of Neural
Coreference Resolution Systems [71.57556446474486]
We investigate the connection between centering theory and modern coreference resolution systems.
We show that high-quality neural coreference resolvers may not benefit much from explicitly modeling centering ideas.
We formulate a version of CT that also models recency and show that it captures coreference information better compared to vanilla CT.
arXiv Detail & Related papers (2022-10-26T12:55:26Z) - Unification and Extension of Classic Information Principles [2.210780502414563]
The sextuple model of the objective information theory (OIT) is a sufficient and necessary condition for discussing information with four basic postulations.
The OIT is a novel information theory that can unify a variety of classical information principles and even accurately reveal the quantitative relationship between information, matter and energy.
arXiv Detail & Related papers (2022-06-11T14:31:31Z) - Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization [49.00409552570441]
We study the role of conceptualization in commonsense reasoning, and formulate a framework to replicate human conceptual induction.
We apply the framework to ATOMIC, a large-scale human-annotated CKG, aided by the taxonomy Probase.
arXiv Detail & Related papers (2022-06-03T12:24:49Z) - Brain Principles Programming [0.3867363075280543]
Brain Principles Programming, BPP, is the formalization of universal mechanisms (principles) of the brain's work with information.
The paper uses mathematical models and algorithms of the following theories.
arXiv Detail & Related papers (2022-02-13T13:41:44Z) - Formalising Concepts as Grounded Abstractions [68.24080871981869]
This report shows how representation learning can be used to induce concepts from raw data.
The main technical goal of this report is to show how techniques from representation learning can be married with a lattice-theoretic formulation of conceptual spaces.
arXiv Detail & Related papers (2021-01-13T15:22:01Z) - Integrated Information in Process Theories [0.0]
We show how the key notions of Tononi et al.'s Integrated Information Theory can be studied within the simple graphical language of process theories.
This allows IIT to be generalised to a broad range of physical theories, including as a special case the Quantum IIT of Zanardi, Tomka and Venuti.
arXiv Detail & Related papers (2020-02-18T15:44:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.