SEER: Semantic Enhancement and Emotional Reasoning Network for Multimodal Fake News Detection

• URL: http://arxiv.org/abs/2507.13415v1
• Date: Thu, 17 Jul 2025 12:33:45 GMT
• Title: SEER: Semantic Enhancement and Emotional Reasoning Network for Multimodal Fake News Detection
• Authors: Peican Zhu, Yubo Jing, Le Cheng, Bin Chen, Xiaodong Cui, Lianwei Wu, Keke Tang,
• Abstract summary: We propose a novel Semantic Enhancement and Emotional Reasoning (SEER) Network for multimodal fake news detection.<n>We generate summarized captions for image semantic understanding and utilize the products of large multimodal models for semantic enhancement.<n>Inspired by the perceived relationship between news authenticity and emotional tendencies, we propose an expert emotional reasoning module.
• Score: 16.736471802440374
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Previous studies on multimodal fake news detection mainly focus on the alignment and integration of cross-modal features, as well as the application of text-image consistency. However, they overlook the semantic enhancement effects of large multimodal models and pay little attention to the emotional features of news. In addition, people find that fake news is more inclined to contain negative emotions than real ones. Therefore, we propose a novel Semantic Enhancement and Emotional Reasoning (SEER) Network for multimodal fake news detection. We generate summarized captions for image semantic understanding and utilize the products of large multimodal models for semantic enhancement. Inspired by the perceived relationship between news authenticity and emotional tendencies, we propose an expert emotional reasoning module that simulates real-life scenarios to optimize emotional features and infer the authenticity of news. Extensive experiments on two real-world datasets demonstrate the superiority of our SEER over state-of-the-art baselines.

Related papers

• KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection [1.8603865942709585]
  We propose a novel Knowledge Augmentation and Emotion Guidance Network (KEN)<n>On the one hand, we effectively leverage LVLM's powerful semantic understanding and extensive world knowledge.<n>On the other hand, we consider inter-class differences between different emotional types of news through balanced learning, achieving fine-grained modeling of the relationship between emotional types and authenticity.
  arXiv  Detail & Related papers  (2025-07-13T14:28:20Z)
• External Reliable Information-enhanced Multimodal Contrastive Learning for Fake News Detection [10.575512607941839]
  ERIC-FND is an external reliable information-enhanced multimodal contrastive learning framework for fake news detection.<n>Experiments are done on two commonly used datasets in different languages, X (Twitter) and Weibo.
  arXiv  Detail & Related papers  (2025-03-05T02:07:38Z)
• When Words Smile: Generating Diverse Emotional Facial Expressions from Text [72.19705878257204]
  We introduce an end-to-end text-to-expression model that explicitly focuses on emotional dynamics.<n>Our model learns expressive facial variations in a continuous latent space and generates expressions that are diverse, fluid, and emotionally coherent.
  arXiv  Detail & Related papers  (2024-12-03T15:39:05Z)
• Dynamic Analysis and Adaptive Discriminator for Fake News Detection [59.41431561403343]
  We propose a Dynamic Analysis and Adaptive Discriminator (DAAD) approach for fake news detection.<n>For knowledge-based methods, we introduce the Monte Carlo Tree Search algorithm to leverage the self-reflective capabilities of large language models.<n>For semantic-based methods, we define four typical deceit patterns to reveal the mechanisms behind fake news creation.
  arXiv  Detail & Related papers  (2024-08-20T14:13:54Z)
• MSynFD: Multi-hop Syntax aware Fake News Detection [27.046529059563863]
  Social media platforms have fueled the rapid dissemination of fake news, posing threats to our real-life society. Existing methods use multimodal data or contextual information to enhance the detection of fake news. We propose a novel multi-hop syntax aware fake news detection (MSynFD) method, which incorporates complementary syntax information to deal with subtle twists in fake news.
  arXiv  Detail & Related papers  (2024-02-18T05:40:33Z)
• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Nothing Stands Alone: Relational Fake News Detection with Hypergraph Neural Networks [49.29141811578359]
  We propose to leverage a hypergraph to represent group-wise interaction among news, while focusing on important news relations with its dual-level attention mechanism. Our approach yields remarkable performance and maintains the high performance even with a small subset of labeled news data.
  arXiv  Detail & Related papers  (2022-12-24T00:19:32Z)
• Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
  Multiverse is a new feature based on multilingual evidence that can be used for fake news detection. The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
  arXiv  Detail & Related papers  (2022-11-25T18:24:17Z)
• An Emotion-Aware Multi-Task Approach to Fake News and Rumour Detection using Transfer Learning [13.448658162594603]
  We show the correlation between the legitimacy of a text with its intrinsic emotion for fake news and rumour detection. We propose a multi-task framework for fake news and rumour detection, predicting both the emotion and legitimacy of the text.
  arXiv  Detail & Related papers  (2022-11-22T16:15:25Z)
• Multimodal Fake News Detection with Adaptive Unimodal Representation Aggregation [28.564442206829625]
  AURA is a multimodal fake news detection network with adaptive unimodal representation aggregation. We perform coarse-level fake news detection and cross-modal cosistency learning according to the unimodal and multimodal representations. Experiments on Weibo and Gossipcop prove that AURA can successfully beat several state-of-the-art FND schemes.
  arXiv  Detail & Related papers  (2022-06-12T14:06:55Z)
• Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models [53.31917090073727]
  We propose a neural network-based emotion recognition framework that uses a late fusion of transfer-learned and fine-tuned models from speech and text modalities. We evaluate the effectiveness of our proposed multimodal approach on the interactive emotional dyadic motion capture dataset.
  arXiv  Detail & Related papers  (2022-02-16T00:23:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.