Towards a Measure Theory of Semantic Information

• URL: http://arxiv.org/abs/2508.00525v1
• Date: Fri, 01 Aug 2025 11:03:39 GMT
• Title: Towards a Measure Theory of Semantic Information
• Authors: George M. Coghill,
• Abstract summary: I critique Floridi's theory of strongly semantic information on its own terms.<n>I present a new approach based on the unit circle.<n>While contradictions and tautologies have zero informativeness, it is found that messages which are contradictory to each other are equally informative.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A classic account of the quantification of semantic information is that of Bar-Hiller and Carnap. Their account proposes an inverse relation between the informativeness of a statement and its probability. However, their approach assigns the maximum informativeness to a contradiction: which Floridi refers to as the Bar-Hillel-Carnap paradox. He developed a novel theory founded on a distance metric and parabolic relation, designed to remove this paradox. Unfortunately is approach does not succeed in that aim. In this paper I critique Floridi's theory of strongly semantic information on its own terms and show where it succeeds and fails. I then present a new approach based on the unit circle (a relation that has been the basis of theories from basic trigonometry to quantum theory). This is used, by analogy with von Neumann's quantum probability to construct a measure space for informativeness that meets all the requirements stipulated by Floridi and removes the paradox. In addition, while contradictions and tautologies have zero informativeness, it is found that messages which are contradictory to each other are equally informative. The utility of this is explained by means of an example.

Related papers

• Any theory that admits a Wigner's Friend type multi-agent paradox is logically contextual [0.0]
  We prove a link between Wigner's Friend type multi-agent paradoxes and contextuality in general theories.<n>We identify structural properties of such paradoxes in general theories and specific to quantum theory.
  arXiv  Detail & Related papers  (2025-02-06T08:43:36Z)
• Machine learning and information theory concepts towards an AI Mathematician [77.63761356203105]
  The current state-of-the-art in artificial intelligence is impressive, especially in terms of mastery of language, but not so much in terms of mathematical reasoning. This essay builds on the idea that current deep learning mostly succeeds at system 1 abilities. It takes an information-theoretical posture to ask questions about what constitutes an interesting mathematical statement.
  arXiv  Detail & Related papers  (2024-03-07T15:12:06Z)
• Logic meets Wigner's Friend (and their Friends) [49.1574468325115]
  We take a fresh look at Wigner's Friend thought-experiment and some of its more recent variants and extensions. We discuss various solutions proposed in the literature, focusing on a few questions.
  arXiv  Detail & Related papers  (2023-07-04T13:31:56Z)
• Connecting classical finite exchangeability to quantum theory [45.76759085727843]
  Exchangeability is a fundamental concept in probability theory and statistics.<n>It allows to model situations where the order of observations does not matter.<n>It is well known that both theorems do not hold for finitely exchangeable sequences.
  arXiv  Detail & Related papers  (2023-06-06T17:15:19Z)
• Connes implies Tsirelson: a simple proof [91.3755431537592]
  We show that the Connes embedding problem implies the synchronous Tsirelson conjecture. We also give a different construction of Connes' algebra $mathcalRomega$ appearing in the Connes embedding problem.
  arXiv  Detail & Related papers  (2022-09-16T13:59:42Z)
• A theory of quantum (statistical) measurement [0.0]
  We propose a theory of quantum (statistical) measurement which is close, in spirit, to Hepp's theory. We make a three-fold assumption: the measurement is not instantaneous, it lasts a finite amount of time and is, up to arbitrary accuracy, performed in a finite region of space. The fact that no irreversibility is attached to the process of measurement is shown to follow from the author's theory of irreversibility.
  arXiv  Detail & Related papers  (2022-05-25T16:56:37Z)
• Logical Satisfiability of Counterfactuals for Faithful Explanations in NLI [60.142926537264714]
  We introduce the methodology of Faithfulness-through-Counterfactuals. It generates a counterfactual hypothesis based on the logical predicates expressed in the explanation. It then evaluates if the model's prediction on the counterfactual is consistent with that expressed logic.
  arXiv  Detail & Related papers  (2022-05-25T03:40:59Z)
• Towards a Semantic Information Theory (Introducing Quantum Corollas) [3.1482441999786954]
  We propose an extension to Quantum Information Theory that applies quantum entanglement and information entropy as linguistic tools. This extension integrates Denotational Semantics with Information Theory via a model based on distributional representation and partial data triples known as Corolla.
  arXiv  Detail & Related papers  (2022-01-14T14:33:13Z)
• Causal Expectation-Maximisation [70.45873402967297]
  We show that causal inference is NP-hard even in models characterised by polytree-shaped graphs. We introduce the causal EM algorithm to reconstruct the uncertainty about the latent variables from data about categorical manifest variables. We argue that there appears to be an unnoticed limitation to the trending idea that counterfactual bounds can often be computed without knowledge of the structural equations.
  arXiv  Detail & Related papers  (2020-11-04T10:25:13Z)
• A Weaker Faithfulness Assumption based on Triple Interactions [89.59955143854556]
  We propose a weaker assumption that we call $2$-adjacency faithfulness. We propose a sound orientation rule for causal discovery that applies under weaker assumptions.
  arXiv  Detail & Related papers  (2020-10-27T13:04:08Z)
• Quantum Theory Needs No 'Interpretation' But 'Theoretical Formal-Conceptual Unity' (Or: Escaping Adan Cabello's "Map of Madness" With the Help of David Deutsch's Explanations) [0.0]
  We argue that there are reasons to believe that the creation of 'interpretations' for the theory of quanta has functioned as a trap designed by anti-realists. We will argue that the key to escape the anti-realist trap of interpretation is to recognize that --as Einstein told Heisenberg almost one century ago-- it is only the theory which can tell you what can be observed.
  arXiv  Detail & Related papers  (2020-08-01T19:10:06Z)
• Unitary-Only Quantum Theory Cannot Consistently Describe the Use of Itself: On the Frauchiger-Renner Paradox [0.0]
  The Frauchiger-Renner Paradox is an extension of paradoxes based on the 'Problem of Measurement,' such as Schrodinger's Cat and Wigner's Friend. This paper discusses a basic inconsistency arising in the FR scenario at a much earlier point than the derived contradiction.
  arXiv  Detail & Related papers  (2020-02-04T18:34:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.