Quantum Cognitively Motivated Decision Fusion for Video Sentiment Analysis

• URL: http://arxiv.org/abs/2101.04406v1
• Date: Tue, 12 Jan 2021 11:06:04 GMT
• Title: Quantum Cognitively Motivated Decision Fusion for Video Sentiment Analysis
• Authors: Dimitris Gkoumas, Qiuchi Li, Shahram Dehdashti, Massimo Melucci, Yijun Yu, Dawei Song
• Abstract summary: We show that the sentiment judgment from one modality could be incompatible with the judgment from another. We propose a fundamentally new, quantum cognitively motivated fusion strategy for predicting sentiment judgments.
• Score: 22.701975963984378
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Video sentiment analysis as a decision-making process is inherently complex, involving the fusion of decisions from multiple modalities and the so-caused cognitive biases. Inspired by recent advances in quantum cognition, we show that the sentiment judgment from one modality could be incompatible with the judgment from another, i.e., the order matters and they cannot be jointly measured to produce a final decision. Thus the cognitive process exhibits "quantum-like" biases that cannot be captured by classical probability theories. Accordingly, we propose a fundamentally new, quantum cognitively motivated fusion strategy for predicting sentiment judgments. In particular, we formulate utterances as quantum superposition states of positive and negative sentiment judgments, and uni-modal classifiers as mutually incompatible observables, on a complex-valued Hilbert space with positive-operator valued measures. Experiments on two benchmarking datasets illustrate that our model significantly outperforms various existing decision level and a range of state-of-the-art content-level fusion approaches. The results also show that the concept of incompatibility allows effective handling of all combination patterns, including those extreme cases that are wrongly predicted by all uni-modal classifiers.

Related papers

• MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs [55.20845457594977]
  Large language models (LLMs) have shown increasing capability in problem-solving and decision-making. We present a process-based benchmark MR-Ben that demands a meta-reasoning skill. Our meta-reasoning paradigm is especially suited for system-2 slow thinking.
  arXiv  Detail & Related papers  (2024-06-20T03:50:23Z)
• Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution [110.99891169486366]
  We propose a method that integrates efficient and precise uncertainty quantification into a deep learning-based surrogate model. Our method endows deep learning-based surrogate models with robust and efficient uncertainty quantification capabilities for both forward and inverse problems. Our method excels at propagating uncertainty over extended auto-regressive rollouts, making it suitable for scenarios involving long-term predictions.
  arXiv  Detail & Related papers  (2024-02-13T11:22:59Z)
• Unveiling quantum steering by quantum-classical uncertainty complementarity [0.0]
  We introduce a novel complementarity relation between system's quantum and classical uncertainties. We demonstrate a superior steering detection efficiency compared to an entropic uncertainty relation.
  arXiv  Detail & Related papers  (2023-12-02T07:49:20Z)
• A Semantic Approach to Decidability in Epistemic Planning (Extended Version) [72.77805489645604]
  We use a novel semantic approach to achieve decidability. Specifically, we augment the logic of knowledge S5$_n$ and with an interaction axiom called (knowledge) commutativity. We prove that our framework admits a finitary non-fixpoint characterization of common knowledge, which is of independent interest.
  arXiv  Detail & Related papers  (2023-07-28T11:26:26Z)
• Asymmetric quantum decision-making [0.48757691171453793]
  Quantum processes can realize conflict-free joint among two agents using entanglement of photons or quantum interference of angular momentum (OAM) This study theoretically investigates asymmetric collective decision-making using quantum interference of photons carrying OAM or entangled photons.
  arXiv  Detail & Related papers  (2023-05-03T13:46:03Z)
• Decision-Making Under Uncertainty: Beyond Probabilities [5.358161704743754]
  A classical assumption is that probabilities can sufficiently capture all uncertainty in a system. In this paper, the focus is on the uncertainty that goes beyond this classical interpretation. We show several solution techniques for both discrete and continuous models.
  arXiv  Detail & Related papers  (2023-03-10T10:53:33Z)
• Multi-Target Decision Making under Conditions of Severe Uncertainty [0.0]
  We show how incomplete preferential and probabilistic information can be exploited to compare decisions among different targets. We discuss some interesting properties of the proposed orders between decision options and show how they can be concretely computed by linear optimization. We conclude the paper by demonstrating our framework in the context of comparing algorithms under different performance measures.
  arXiv  Detail & Related papers  (2022-12-13T11:47:02Z)
• On the Complexity of Adversarial Decision Making [101.14158787665252]
  We show that the Decision-Estimation Coefficient is necessary and sufficient to obtain low regret for adversarial decision making. We provide new structural results that connect the Decision-Estimation Coefficient to variants of other well-known complexity measures.
  arXiv  Detail & Related papers  (2022-06-27T06:20:37Z)
• Experimental violations of Leggett-Garg's inequalities on a quantum computer [77.34726150561087]
  We experimentally observe the violations of Leggett-Garg-Bell's inequalities on single and multi-qubit systems. Our analysis highlights the limits of nowadays quantum platforms, showing that the above-mentioned correlation functions deviate from theoretical prediction as the number of qubits and the depth of the circuit grow.
  arXiv  Detail & Related papers  (2021-09-06T14:35:15Z)
• Inverse Active Sensing: Modeling and Understanding Timely Decision-Making [111.07204912245841]
  We develop a framework for the general setting of evidence-based decision-making under endogenous, context-dependent time pressure. We demonstrate how it enables modeling intuitive notions of surprise, suspense, and optimality in decision strategies.
  arXiv  Detail & Related papers  (2020-06-25T02:30:45Z)
• QuLBIT: Quantum-Like Bayesian Inference Technologies for Cognition and Decision [0.11470070927586014]
  This paper provides the foundations of a unified cognitive decision-making framework (QulBIT) which is derived from quantum theory. We detail the main modules of the unified framework, the explanatory analysis method, and illustrate their application in situations violating the Sure Thing Principle.
  arXiv  Detail & Related papers  (2020-05-30T09:02:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.