Towards a Semantic Information Theory (Introducing Quantum Corollas)

• URL: http://arxiv.org/abs/2201.05478v1
• Date: Fri, 14 Jan 2022 14:33:13 GMT
• Title: Towards a Semantic Information Theory (Introducing Quantum Corollas)
• Authors: Philip Tetlow, Dinesh Garg, Leigh Chase, Mark Mattingley-Scott, Nicholas Bronn, Kugendran Naidoo, Emil Reinert
• Abstract summary: We propose an extension to Quantum Information Theory that applies quantum entanglement and information entropy as linguistic tools. This extension integrates Denotational Semantics with Information Theory via a model based on distributional representation and partial data triples known as Corolla.
• Score: 3.1482441999786954
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The field of Information Theory is founded on Claude Shannon's seminal ideas relating to entropy. Nevertheless, his well-known avoidance of meaning (Shannon, 1948) still persists to this day, so that Information Theory remains poorly connected to many fields with clear informational content and a dependence on semantics. Herein we propose an extension to Quantum Information Theory which, subject to constraints, applies quantum entanglement and information entropy as linguistic tools that model semantics through measures of both difference and equivalence. This extension integrates Denotational Semantics with Information Theory via a model based on distributional representation and partial data triples known as Corolla.

Related papers

• Relational dynamics and Page-Wootters formalism in group field theory [0.0]
  Group field theory posits that spacetime is emergent and is hence defined without any background notion of space or time. There is no obvious notion of coordinate transformations or constraints, and established quantisation methods cannot be directly applied. We use a parametrised version of group field theory, in which all (geometry and matter) degrees of freedom evolve in a fiducial parameter. Using the "trinity of relational dynamics", we show that the resulting "clock-neutral" theory is entirely equivalent to a deparametrised canonical group field theory.
  arXiv  Detail & Related papers  (2024-07-03T18:18:36Z)
• Learning Discrete Concepts in Latent Hierarchical Models [73.01229236386148]
  Learning concepts from natural high-dimensional data holds potential in building human-aligned and interpretable machine learning models. We formalize concepts as discrete latent causal variables that are related via a hierarchical causal model. We substantiate our theoretical claims with synthetic data experiments.
  arXiv  Detail & Related papers  (2024-06-01T18:01:03Z)
• Relaxation of first-class constraints and the quantization of gauge theories: from "matter without matter" to the reappearance of time in quantum gravity [72.27323884094953]
  We make a conceptual overview of an approach to the initial-value problem in canonical gauge theories. We stress how the first-class phase-space constraints may be relaxed if we interpret them as fixing the values of new degrees of freedom.
  arXiv  Detail & Related papers  (2024-02-19T19:00:02Z)
• On the Joint Interaction of Models, Data, and Features [82.60073661644435]
  We introduce a new tool, the interaction tensor, for empirically analyzing the interaction between data and model through features. Based on these observations, we propose a conceptual framework for feature learning. Under this framework, the expected accuracy for a single hypothesis and agreement for a pair of hypotheses can both be derived in closed-form.
  arXiv  Detail & Related papers  (2023-06-07T21:35:26Z)
• Semantic Communications: Principles and Challenges [59.13318519076149]
  This article provides an overview on semantic communications. After a brief review on Shannon information theory, we discuss semantic communications with theory, frameworks, and system design enabled by deep learning.
  arXiv  Detail & Related papers  (2021-12-30T16:32:00Z)
• Shannon theory beyond quantum: information content of a source [68.8204255655161]
  We extend the definition of information content to operational probabilistic theories. We prove relevant properties as the subadditivity, and the relation between purity and information content of a state.
  arXiv  Detail & Related papers  (2021-12-23T16:36:06Z)
• Holographic tensor network models and quantum error correction: A topical review [78.28647825246472]
  Recent progress in studies of holographic dualities has led to a confluence with concepts and techniques from quantum information theory. A particularly successful approach has involved capturing holographic properties by means of tensor networks.
  arXiv  Detail & Related papers  (2021-02-04T14:09:21Z)
• On L\'{e}on van Hove's 1952 article on the foundations of Quantum Field Theory [0.0]
  In 1952, L'eon van Hove published an article, in French, with the title Les difficult'es de divergences pour um modele particulier de champ quantifi'e''
  arXiv  Detail & Related papers  (2020-10-05T17:59:06Z)
• Plausible Reasoning about EL-Ontologies using Concept Interpolation [27.314325986689752]
  We propose an inductive mechanism which is based on a clear model-theoretic semantics, and can thus be tightly integrated with standard deductive reasoning. We focus on inference, a powerful commonsense reasoning mechanism which is closely related to cognitive models of category-based induction.
  arXiv  Detail & Related papers  (2020-06-25T14:19:41Z)
• Quantifying daseinisation using Shannon entropy [0.0]
  Topos formalism for quantum mechanics is interpreted in a broader, information retrieval perspective. Daseinisation, defined in purely logical terms, is reformulated in terms of two relations: exclusion and preclusion of queries.
  arXiv  Detail & Related papers  (2020-02-26T10:00:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.