The Deepfake Detection Dilemma: A Multistakeholder Exploration of Adversarial Dynamics in Synthetic Media

• URL: http://arxiv.org/abs/2102.06109v1
• Date: Thu, 11 Feb 2021 16:44:09 GMT
• Title: The Deepfake Detection Dilemma: A Multistakeholder Exploration of Adversarial Dynamics in Synthetic Media
• Authors: Claire Leibowicz, Sean McGregor, Aviv Ovadya
• Abstract summary: Synthetic media detection technologies label media as either synthetic or non-synthetic. As detection practices become more accessible, they become more easily circumvented. This work concludes that there is no "best" approach to navigating the detector dilemma.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Synthetic media detection technologies label media as either synthetic or non-synthetic and are increasingly used by journalists, web platforms, and the general public to identify misinformation and other forms of problematic content. As both well-resourced organizations and the non-technical general public generate more sophisticated synthetic media, the capacity for purveyors of problematic content to adapt induces a \newterm{detection dilemma}: as detection practices become more accessible, they become more easily circumvented. This paper describes how a multistakeholder cohort from academia, technology platforms, media entities, and civil society organizations active in synthetic media detection and its socio-technical implications evaluates the detection dilemma. Specifically, we offer an assessment of detection contexts and adversary capacities sourced from the broader, global AI and media integrity community concerned with mitigating the spread of harmful synthetic media. A collection of personas illustrates the intersection between unsophisticated and highly-resourced sponsors of misinformation in the context of their technical capacities. This work concludes that there is no "best" approach to navigating the detector dilemma, but derives a set of implications from multistakeholder input to better inform detection process decisions and policies, in practice.

Related papers

• Survey on AI-Generated Media Detection: From Non-MLLM to MLLM [51.91311158085973]
  Methods for detecting AI-generated media have evolved rapidly. General-purpose detectors based on MLLMs integrate authenticity verification, explainability, and localization capabilities. Ethical and security considerations have emerged as critical global concerns.
  arXiv  Detail & Related papers  (2025-02-07T12:18:20Z)
• Regulating Reality: Exploring Synthetic Media Through Multistakeholder AI Governance [1.450405446885067]
  This paper analyzes 23 in-depth, semi-structured interviews with stakeholders governing synthetic media from across sectors. It reveals key themes affecting synthetic media governance, including how temporal perspectives-spanning past, present, and future. It also reveals the critical role of trust, both among stakeholders and between audiences and interventions.
  arXiv  Detail & Related papers  (2025-02-06T21:56:16Z)
• Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights [49.81915942821647]
  Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. This paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity.
  arXiv  Detail & Related papers  (2024-11-12T09:02:11Z)
• The Cat and Mouse Game: The Ongoing Arms Race Between Diffusion Models and Detection Methods [0.0]
  Diffusion models have transformed synthetic media generation, offering unmatched realism and control over content creation. They can facilitate deepfakes, misinformation, and unauthorized reproduction of copyrighted material. In response, the need for effective detection mechanisms has become increasingly urgent.
  arXiv  Detail & Related papers  (2024-10-24T15:51:04Z)
• A Survey of Stance Detection on Social Media: New Directions and Perspectives [50.27382951812502]
  stance detection has emerged as a crucial subfield within affective computing. Recent years have seen a surge of research interest in developing effective stance detection methods. This paper provides a comprehensive survey of stance detection techniques on social media.
  arXiv  Detail & Related papers  (2024-09-24T03:06:25Z)
• Deepfake Media Forensics: State of the Art and Challenges Ahead [51.33414186878676]
  AI-generated synthetic media, also called Deepfakes, have influenced so many domains, from entertainment to cybersecurity. Deepfake detection has become a vital area of research, focusing on identifying subtle inconsistencies and artifacts with machine learning techniques. This paper reviews the primary algorithms that address these challenges, examining their advantages, limitations, and future prospects.
  arXiv  Detail & Related papers  (2024-08-01T08:57:47Z)
• Detecting and Grounding Multi-Modal Media Manipulation and Beyond [93.08116982163804]
  We highlight a new research problem for multi-modal fake media, namely Detecting and Grounding Multi-Modal Media Manipulation (DGM4) DGM4 aims to not only detect the authenticity of multi-modal media, but also ground the manipulated content. We propose a novel HierArchical Multi-modal Manipulation rEasoning tRansformer (HAMMER) to fully capture the fine-grained interaction between different modalities.
  arXiv  Detail & Related papers  (2023-09-25T15:05:46Z)
• False Information, Bots and Malicious Campaigns: Demystifying Elements of Social Media Manipulations [6.901078062583646]
  False information and persistent manipulation attacks on online social networks (OSNs) have affected the openness of OSNs. This paper synthesizes insights from various disciplines to provide a comprehensive analysis of the manipulation landscape.
  arXiv  Detail & Related papers  (2023-08-24T01:37:33Z)
• Synthetic Misinformers: Generating and Combating Multimodal Misinformation [11.696058634552147]
  multimodal misinformation detection (MMD) detects whether the combination of an image and its accompanying text could mislead or misinform. We show that our proposed CLIP-based Named Entity Swapping can lead to MMD models that surpass other OOC and NEI Misinformers in terms of multimodal accuracy.
  arXiv  Detail & Related papers  (2023-03-02T12:59:01Z)
• Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection [115.83992775004043]
  Recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing images and videos at a low cost. This paper provides a comprehensive review of the current media tampering detection approaches, and discusses the challenges and trends in this field for future research.
  arXiv  Detail & Related papers  (2022-12-12T02:54:08Z)
• Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities [5.4482836906033585]
  Social media platforms are evolving from text-based forums into multi-modal environments. Misinformation spreaders have recently targeted contextual connections between the modalities e.g., text and image. We analyze, categorize and identify existing approaches in addition to challenges and shortcomings they face in order to unearth new research opportunities in the field of multi-modal misinformation detection.
  arXiv  Detail & Related papers  (2022-03-25T19:45:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.