A Survey on Multimodal Disinformation Detection

• URL: http://arxiv.org/abs/2103.12541v1
• Date: Sat, 13 Mar 2021 18:04:17 GMT
• Title: A Survey on Multimodal Disinformation Detection
• Authors: Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, Preslav Nakov
• Abstract summary: We explore the state-of-the-art on multimodal disinformation detection covering various combinations of modalities. We argue for the need to tackle disinformation detection by taking into account multiple modalities as well as both factuality and harmfulness.
• Score: 33.89798158570927
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent years have witnessed the proliferation of fake news, propaganda, misinformation, and disinformation online. While initially this was mostly about textual content, over time images and videos gained popularity, as they are much easier to consume, attract much more attention, and spread further than simple text. As a result, researchers started targeting different modalities and combinations thereof. As different modalities are studied in different research communities, with insufficient interaction, here we offer a survey that explores the state-of-the-art on multimodal disinformation detection covering various combinations of modalities: text, images, audio, video, network structure, and temporal information. Moreover, while some studies focused on factuality, others investigated how harmful the content is. While these two components in the definition of disinformation -- (i) factuality and (ii) harmfulness, are equally important, they are typically studied in isolation. Thus, we argue for the need to tackle disinformation detection by taking into account multiple modalities as well as both factuality and harmfulness, in the same framework. Finally, we discuss current challenges and future research directions.

Related papers

• Detecting Misinformation in Multimedia Content through Cross-Modal Entity Consistency: A Dual Learning Approach [10.376378437321437]
  We propose a Multimedia Misinformation Detection framework for detecting misinformation from video content by leveraging cross-modal entity consistency. Our results demonstrate that MultiMD outperforms state-of-the-art baseline models.
  arXiv  Detail & Related papers  (2024-08-16T16:14:36Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [76.47138162283714]
  Forgetting refers to the loss or deterioration of previously acquired information or knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning. Survey argues that forgetting is a double-edged sword and can be beneficial and desirable in certain cases.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection [53.48346699224921]
  A novel Knowledge-guided Dualconsistency Network is proposed to detect rumors with multimedia contents. It uses two consistency detectionworks to capture the inconsistency at the cross-modal level and the content-knowledge level simultaneously. It also enables robust multi-modal representation learning under different missing visual modality conditions.
  arXiv  Detail & Related papers  (2023-06-03T15:32:20Z)
• Multimodal Automated Fact-Checking: A Survey [20.533353006768497]
  Multimodal misinformation is perceived as more credible by humans, and spreads faster than its text-only counterparts. We conceptualise a framework for automated fact-checking (AFC) including subtasks unique to multimodal misinformation. We focus on four modalities prevalent in real-world fact-checking: text, image, audio, and video.
  arXiv  Detail & Related papers  (2023-05-22T21:52:24Z)
• Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues [24.428582199602822]
  The rise of various social media platforms also enables the proliferation of online misinformation. Health misinformation in social media has become an emerging research direction that attracts increasing attention from researchers of different disciplines.
  arXiv  Detail & Related papers  (2022-11-10T01:52:12Z)
• Vision+X: A Survey on Multimodal Learning in the Light of Data [64.03266872103835]
  multimodal machine learning that incorporates data from various sources has become an increasingly popular research area. We analyze the commonness and uniqueness of each data format mainly ranging from vision, audio, text, and motions. We investigate the existing literature on multimodal learning from both the representation learning and downstream application levels.
  arXiv  Detail & Related papers  (2022-10-05T13:14:57Z)
• Rumor Detection with Self-supervised Learning on Texts and Social Graph [101.94546286960642]
  We propose contrastive self-supervised learning on heterogeneous information sources, so as to reveal their relations and characterize rumors better. We term this framework as Self-supervised Rumor Detection (SRD) Extensive experiments on three real-world datasets validate the effectiveness of SRD for automatic rumor detection on social media.
  arXiv  Detail & Related papers  (2022-04-19T12:10:03Z)
• Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities [5.4482836906033585]
  Social media platforms are evolving from text-based forums into multi-modal environments. Misinformation spreaders have recently targeted contextual connections between the modalities e.g., text and image. We analyze, categorize and identify existing approaches in addition to challenges and shortcomings they face in order to unearth new research opportunities in the field of multi-modal misinformation detection.
  arXiv  Detail & Related papers  (2022-03-25T19:45:33Z)
• A Review of Web Infodemic Analysis and Detection Trends across Multi-modalities using Deep Neural Networks [3.42658286826597]
  Fake news detection is one of the most analyzed and prominent areas of research. Facebook, Reddit, WhatsApp, YouTube, and other social applications are gradually gaining attention in this emerging field. This review primarily deals with multi-modal fake news detection techniques that include images, videos, and their combinations with text.
  arXiv  Detail & Related papers  (2021-11-23T16:02:28Z)
• Mining Disinformation and Fake News: Concepts, Methods, and Recent Advancements [55.33496599723126]
  disinformation including fake news has become a global phenomenon due to its explosive growth. Despite the recent progress in detecting disinformation and fake news, it is still non-trivial due to its complexity, diversity, multi-modality, and costs of fact-checking or annotation.
  arXiv  Detail & Related papers  (2020-01-02T21:01:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.