From a Tiny Slip to a Giant Leap: An LLM-Based Simulation for Fake News Evolution

• URL: http://arxiv.org/abs/2410.19064v1
• Date: Thu, 24 Oct 2024 18:17:16 GMT
• Title: From a Tiny Slip to a Giant Leap: An LLM-Based Simulation for Fake News Evolution
• Authors: Yuhan Liu, Zirui Song, Xiaoqing Zhang, Xiuying Chen, Rui Yan,
• Abstract summary: We propose a Fake News evolUtion Simulation framEwork based on large language models (LLMs) We define four types of agents commonly observed in daily interactions: spreaders, who propagate information; commentators, who provide opinions and interpretations; verifiers, who check the accuracy of information and bystanders, who passively observe without engaging. Given the lack of prior work in this area, we developed a FUSE-EVAL evaluation framework to measure the deviation from true news during the fake news evolution process.
• Score: 35.82418316346851
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: With the growing spread of misinformation online, research has increasingly focused on detecting and tracking fake news. However, an overlooked issue is that fake news does not naturally exist in social networks -- it often originates from distorted facts or deliberate fabrication by malicious actors. Understanding how true news gradually evolves into fake news is critical for early detection and prevention, reducing its spread and impact. Hence, in this paper, we take the first step toward simulating and revealing this evolution, proposing a Fake News evolUtion Simulation framEwork (FUSE) based on large language models (LLMs). Specifically, we employ LLM as agents to represent individuals in a simulated social network. We define four types of agents commonly observed in daily interactions: spreaders, who propagate information; commentators, who provide opinions and interpretations; verifiers, who check the accuracy of information; and bystanders, who passively observe without engaging. For simulated environments, we model various social network structures, such as high-clustering networks and scale-free networks, to mirror real-world network dynamics. Each day, the agents engage in belief exchanges, reflect on their thought processes, and reintroduce the news accordingly. Given the lack of prior work in this area, we developed a FUSE-EVAL evaluation framework to measure the deviation from true news during the fake news evolution process. The results show that FUSE successfully captures the underlying patterns of how true news transforms into fake news and accurately reproduces previously discovered instances of fake news, aligning closely with human evaluations. Moreover, our work provides insights into the fact that combating fake news should not be delayed until it has fully evolved; instead, prevention in advance is key to achieving better outcomes.

Related papers

• Fake News Detection and Manipulation Reasoning via Large Vision-Language Models [38.457805116130004]
  This paper introduces a benchmark for fake news detection and manipulation reasoning, referred to as Human-centric and Fact-related Fake News (HFFN) The benchmark highlights the centrality of human and the high factual relevance, with detailed manual annotations. A Multi-modal news Detection and Reasoning langUage Model (M-DRUM) is presented not only to judge on the authenticity of multi-modal news, but also raise analytical reasoning about potential manipulations.
  arXiv  Detail & Related papers  (2024-07-02T08:16:43Z)
• Exploring the Deceptive Power of LLM-Generated Fake News: A Study of Real-World Detection Challenges [21.425647152424585]
  We propose a strong fake news attack method called conditional Variational-autoencoder-Like Prompt (VLPrompt) Unlike current methods, VLPrompt eliminates the need for additional data collection while maintaining contextual coherence. Our experiments, including various detection methods and novel human study metrics, were conducted to assess their performance on our dataset.
  arXiv  Detail & Related papers  (2024-03-27T04:39:18Z)
• From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News [38.990330255607276]
  We introduce a Fake news propagation simulation framework based on large language models (LLMs) Our simulation results uncover patterns in fake news propagation related to topic relevance, and individual traits, aligning with real-world observations.
  arXiv  Detail & Related papers  (2024-03-14T15:40:13Z)
• Adapting Fake News Detection to the Era of Large Language Models [48.5847914481222]
  We study the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa.
  arXiv  Detail & Related papers  (2023-11-02T08:39:45Z)
• Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection [50.07850264495737]
  "Prompt-and-Align" (P&A) is a novel prompt-based paradigm for few-shot fake news detection. We show that P&A sets new states-of-the-art for few-shot fake news detection performance by significant margins.
  arXiv  Detail & Related papers  (2023-09-28T13:19:43Z)
• Multiverse: Multilingual Evidence for Fake News Detection [71.51905606492376]
  Multiverse is a new feature based on multilingual evidence that can be used for fake news detection. The hypothesis of the usage of cross-lingual evidence as a feature for fake news detection is confirmed.
  arXiv  Detail & Related papers  (2022-11-25T18:24:17Z)
• A Multi-Policy Framework for Deep Learning-Based Fake News Detection [0.31498833540989407]
  This work introduces Multi-Policy Statement Checker (MPSC), a framework that automates fake news detection. MPSC uses deep learning techniques to analyze a statement itself and its related news articles, predicting whether it is seemingly credible or suspicious.
  arXiv  Detail & Related papers  (2022-06-01T21:25:21Z)
• SOK: Fake News Outbreak 2021: Can We Stop the Viral Spread? [5.64512235559998]
  Social Networks' omnipresence and ease of use has revolutionized the generation and distribution of information in today's world. Unlike traditional media channels, social networks facilitate faster and wider spread of disinformation and misinformation. Viral spread of false information has serious implications on the behaviors, attitudes and beliefs of the public.
  arXiv  Detail & Related papers  (2021-05-22T09:26:13Z)
• Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media [1.7616042687330642]
  We propose a model for detecting fake news using stance as one of the features along with the content of the article. Our work interprets the content with automatic feature extraction and the relevance of the text pieces. The experiment conducted on the real-world dataset indicates that our model outperforms the previous work and enables fake news detection with an accuracy of 95.32%.
  arXiv  Detail & Related papers  (2021-05-21T10:46:43Z)
• How does Truth Evolve into Fake News? An Empirical Study of Fake News Evolution [55.27685924751459]
  We present the Fake News Evolution dataset: a new dataset tracking the fake news evolution process. Our dataset is composed of 950 paired data, each of which consists of articles representing the truth, the fake news, and the evolved fake news. We observe the features during the evolution and they are the disinformation techniques, text similarity, top 10 keywords, classification accuracy, parts of speech, and sentiment properties.
  arXiv  Detail & Related papers  (2021-03-10T09:01:34Z)
• Causal Understanding of Fake News Dissemination on Social Media [50.4854427067898]
  We argue that it is critical to understand what user attributes potentially cause users to share fake news. In fake news dissemination, confounders can be characterized by fake news sharing behavior that inherently relates to user attributes and online activities. We propose a principled approach to alleviating selection bias in fake news dissemination.
  arXiv  Detail & Related papers  (2020-10-20T19:37:04Z)
• Modeling the spread of fake news on Twitter [2.7910505923792637]
  We propose a point process model of the spread of fake news on Twitter. We show that the proposed model is superior to the current state-of-the-art methods in accurately predicting the evolution of the spread of a fake news item. The proposed model contributes to understanding the dynamics of the spread of fake news on social media.
  arXiv  Detail & Related papers  (2020-07-28T08:28:16Z)
• Machine Learning Explanations to Prevent Overtrust in Fake News Detection [64.46876057393703]
  This research investigates the effects of an Explainable AI assistant embedded in news review platforms for combating the propagation of fake news. We design a news reviewing and sharing interface, create a dataset of news stories, and train four interpretable fake news detection algorithms. For a deeper understanding of Explainable AI systems, we discuss interactions between user engagement, mental model, trust, and performance measures in the process of explaining.
  arXiv  Detail & Related papers  (2020-07-24T05:42:29Z)
• Leveraging Multi-Source Weak Social Supervision for Early Detection of Fake News [67.53424807783414]
  Social media has greatly enabled people to participate in online activities at an unprecedented rate. This unrestricted access also exacerbates the spread of misinformation and fake news online which might cause confusion and chaos unless being detected early for its mitigation. We jointly leverage the limited amount of clean data along with weak signals from social engagements to train deep neural networks in a meta-learning framework to estimate the quality of different weak instances. Experiments on realworld datasets demonstrate that the proposed framework outperforms state-of-the-art baselines for early detection of fake news without using any user engagements at prediction time.
  arXiv  Detail & Related papers  (2020-04-03T18:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.