Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection

• URL: http://arxiv.org/abs/2603.25203v1
• Date: Thu, 26 Mar 2026 09:08:31 GMT
• Title: Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection
• Abstract summary: We present Probabilistic Concept Graph Reasoning (PCGR), an interpretable and evolvable framework that reframes multimodal misinformation detection as structured and concept-based reasoning.<n>PCGR achieves state-of-the-art MMD accuracy and robustness to emerging manipulation types, outperforming prior methods in both coarse detection and fine-grained manipulation recognition.
• Score: 50.08054676999716
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multimodal misinformation poses an escalating challenge that often evades traditional detectors, which are opaque black boxes and fragile against new manipulation tactics. We present Probabilistic Concept Graph Reasoning (PCGR), an interpretable and evolvable framework that reframes multimodal misinformation detection (MMD) as structured and concept-based reasoning. PCGR follows a build-then-infer paradigm, which first constructs a graph of human-understandable concept nodes, including novel high-level concepts automatically discovered and validated by multimodal large language models (MLLMs), and then applies hierarchical attention over this concept graph to infer claim veracity. This design produces interpretable reasoning chains linking evidence to conclusions. Experiments demonstrate that PCGR achieves state-of-the-art MMD accuracy and robustness to emerging manipulation types, outperforming prior methods in both coarse detection and fine-grained manipulation recognition.

Related papers

• ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection [4.1722537413195395]
  ThinkDeception is a novel and interpretable multimodal deception detection framework.<n>It transforms deception detection from a traditional binary classification task into an explicit cognitive reasoning process.<n>This work successfully drives the field of deception detection toward interpretable, multimodal cognitive reasoning.
  arXiv  Detail & Related papers  (2026-06-17T12:08:20Z)
• Enhancing Multimodal In-Context Learning via Inductive-Deductive Reasoning [65.15766304205657]
  In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile.<n>Our analysis reveals that the fundamental limitation lies in an inductive gap, models often produce correct answers from flawed reasoning.<n>We introduce a framework that restructures multimodal ICL as a principled inductive-deductive process.
  arXiv  Detail & Related papers  (2026-05-04T09:18:19Z)
• Walk the Talk: Bridging the Reasoning-Action Gap for Thinking with Images via Multimodal Agentic Policy Optimization [89.68681087743876]
  Multimodal Large Language Models (MLLMs) have incentivized models to think with images'' by actively invoking visual tools during multi-turn reasoning.<n>The common Reinforcement Learning practice of relying on outcome-based rewards ignores the fact that textual plausibility often masks executive failure.<n>We introduce Multimodal Agentic Policy Optimization (MAPO), bridging the gap between textual reasoning and visual actions generated by models within their Multimodal Chain-of-Thought.
  arXiv  Detail & Related papers  (2026-04-08T07:48:07Z)
• Towards Faithful Multimodal Concept Bottleneck Models [0.07329200485567826]
  Concept Bottleneck Models (CBMs) are interpretable models that route predictions through a layer of human-interpretable concepts.<n>We introduce f-CBM, a multimodal CBM framework built on a vision-language backbone that jointly targets concept detection and leakage mitigation.<n>Experiments demonstrate that f-CBM achieves the best trade-off between task accuracy, concept detection, and leakage reduction.
  arXiv  Detail & Related papers  (2026-03-13T16:56:08Z)
• Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts [74.47786985522762]
  We identify a critical failure mode termed textual inertia, where models tend to blindly adhere to the erroneous text while neglecting conflicting visual evidence.<n>We propose the LogicGraph Perturbation Protocol that structurally injects perturbations into the reasoning chains of diverse LMMs.<n>Results reveal that models successfully self-correct in less than 10% of cases and predominantly succumb to blind textual error propagation.
  arXiv  Detail & Related papers  (2026-01-07T16:39:34Z)
• Beyond the Black Box: Identifiable Interpretation and Control in Generative Models via Causal Minimality [52.57416398859353]
  We show that causal minimality can endow latent representations of diffusion vision and autoregressive language models with clear causal interpretation and robust, component-wise identifiable control.<n>We introduce a novel theoretical framework for hierarchical selection models, where higher-level concepts emerge from the constrained composition of lower-level variables.<n>These causally grounded concepts serve as levers for fine-grained model steering, paving the way for transparent, reliable systems.
  arXiv  Detail & Related papers  (2025-12-11T14:59:14Z)
• Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI [10.687381287384524]
  Part-prototypical concept mining network (PCMNet) is proposed to learn interpretable prototypes from meaningful regions.<n>PCMNet clusters prototypes into concept groups, creating semantically grounded explanations without requiring additional annotations.<n>Our experiments show that PCMNet can provide a high level of interpretability, stability, and robustness under clean and occluded scenarios.
  arXiv  Detail & Related papers  (2025-04-16T15:48:21Z)
• Extracting Interpretable Logic Rules from Graph Neural Networks [7.262955921646328]
  Graph neural networks (GNNs) operate over both input feature spaces and graph structures.<n>We propose a novel framework, LOGI CXGNN, for extracting interpretable logic rules from GNNs.<n> LOGI CXGNN is model-agnostic, efficient, and data-driven, eliminating the need for predefined concepts.
  arXiv  Detail & Related papers  (2025-03-25T09:09:46Z)
• Contrastive Token-level Explanations for Graph-based Rumour Detection [4.626073646852022]
  Social media has facilitated the spread of harmful rumours, which can disrupt economies, influence political outcomes, and exacerbate public health crises.<n>Graph Neural Network (GNN)-based approaches have shown significant promise in automated rumour detection.<n>Existing graph explainability techniques fall short in addressing the unique challenges posed by the dependencies among feature dimensions in high-dimensional text embeddings.
  arXiv  Detail & Related papers  (2025-02-05T07:14:11Z)
• Cantor: Inspiring Multimodal Chain-of-Thought of MLLM [83.6663322930814]
  We argue that converging visual context acquisition and logical reasoning is pivotal for tackling visual reasoning tasks. We propose an innovative multimodal CoT framework, termed Cantor, characterized by a perception-decision architecture. Our experiments demonstrate the efficacy of the proposed framework, showing significant improvements in multimodal CoT performance.
  arXiv  Detail & Related papers  (2024-04-24T17:59:48Z)
• Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval [139.21955930418815]
  Cross-modal Retrieval methods build similarity relations between vision and language modalities by jointly learning a common representation space. However, the predictions are often unreliable due to the Aleatoric uncertainty, which is induced by low-quality data, e.g., corrupt images, fast-paced videos, and non-detailed texts. We propose a novel Prototype-based Aleatoric Uncertainty Quantification (PAU) framework to provide trustworthy predictions by quantifying the uncertainty arisen from the inherent data ambiguity.
  arXiv  Detail & Related papers  (2023-09-29T09:41:19Z)
• Understanding Masked Autoencoders via Hierarchical Latent Variable Models [109.35382136147349]
  Masked autoencoder (MAE) has recently achieved prominent success in a variety of vision tasks. Despite the emergence of intriguing empirical observations on MAE, a theoretically principled understanding is still lacking.
  arXiv  Detail & Related papers  (2023-06-08T03:00:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.