Toward Transdisciplinary Approaches to Audio Deepfake Discernment

• URL: http://arxiv.org/abs/2411.05969v1
• Date: Fri, 08 Nov 2024 20:59:25 GMT
• Title: Toward Transdisciplinary Approaches to Audio Deepfake Discernment
• Authors: Vandana P. Janeja, Christine Mallinson,
• Abstract summary: This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment. We see the promising potential in recent transdisciplinary work that incorporates linguistic knowledge into AI approaches.
• Score: 0.0
• License:
• Abstract: This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment through an interdisciplinary lens across Artificial Intelligence methods and linguistics. With an avalanche of tools for the generation of realistic-sounding fake speech on one side, the detection of deepfakes is lagging on the other. Particularly hindering audio deepfake detection is the fact that current AI models lack a full understanding of the inherent variability of language and the complexities and uniqueness of human speech. We see the promising potential in recent transdisciplinary work that incorporates linguistic knowledge into AI approaches to provide pathways for expert-in-the-loop and to move beyond expert agnostic AI-based methods for more robust and comprehensive deepfake detection.

Related papers

• Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights [49.81915942821647]
  Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. This paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity.
  arXiv  Detail & Related papers  (2024-11-12T09:02:11Z)
• Deep Learning Technology for Face Forgery Detection: A Survey [17.519617618071003]
  Deep learning has enabled the creation or manipulation of high-fidelity facial images and videos. This technology, also known as deepfake, has achieved dramatic progress and become increasingly popular in social media. To diminish the risks of deepfake, it is desirable to develop powerful forgery detection methods.
  arXiv  Detail & Related papers  (2024-09-22T01:42:01Z)
• Deepfake Media Forensics: State of the Art and Challenges Ahead [51.33414186878676]
  AI-generated synthetic media, also called Deepfakes, have influenced so many domains, from entertainment to cybersecurity. Deepfake detection has become a vital area of research, focusing on identifying subtle inconsistencies and artifacts with machine learning techniques. This paper reviews the primary algorithms that address these challenges, examining their advantages, limitations, and future prospects.
  arXiv  Detail & Related papers  (2024-08-01T08:57:47Z)
• Deepfake tweets automatic detection [0.0]
  This study uses advanced natural language processing (NLP) techniques to distinguish between genuine and AI-generated texts. By developing reliable methods for detecting AI-generated misinformation, this work contributes to a more trustworthy online information environment.
  arXiv  Detail & Related papers  (2024-06-24T09:55:31Z)
• What to Remember: Self-Adaptive Continual Learning for Audio Deepfake Detection [53.063161380423715]
  Existing detection models have shown remarkable success in discriminating known deepfake audio, but struggle when encountering new attack types. We propose a continual learning approach called Radian Weight Modification (RWM) for audio deepfake detection.
  arXiv  Detail & Related papers  (2023-12-15T09:52:17Z)
• Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey [97.33926242130732]
  Large Language Models (LLMs) have revolutionized the domain of natural language processing (NLP) with remarkable capabilities of generating human-like text responses. Despite these advancements, several works in the existing literature have raised serious concerns about the potential misuse of LLMs. To address these concerns, a consensus among the research community is to develop algorithmic solutions to detect AI-generated text.
  arXiv  Detail & Related papers  (2023-10-23T18:11:32Z)
• All-for-One and One-For-All: Deep learning-based feature fusion for Synthetic Speech Detection [18.429817510387473]
  Recent advances in deep learning and computer vision have made the synthesis and counterfeiting of multimedia content more accessible than ever. In this paper, we consider three different feature sets proposed in the literature for the synthetic speech detection task and present a model that fuses them. The system was tested on different scenarios and datasets to prove its robustness to anti-forensic attacks and its generalization capabilities.
  arXiv  Detail & Related papers  (2023-07-28T13:50:25Z)
• NPVForensics: Jointing Non-critical Phonemes and Visemes for Deepfake Detection [50.33525966541906]
  Existing multimodal detection methods capture audio-visual inconsistencies to expose Deepfake videos. We propose a novel Deepfake detection method to mine the correlation between Non-critical Phonemes and Visemes, termed NPVForensics. Our model can be easily adapted to the downstream Deepfake datasets with fine-tuning.
  arXiv  Detail & Related papers  (2023-06-12T06:06:05Z)
• Deepfake audio detection by speaker verification [79.99653758293277]
  We propose a new detection approach that leverages only the biometric characteristics of the speaker, with no reference to specific manipulations. The proposed approach can be implemented based on off-the-shelf speaker verification tools. We test several such solutions on three popular test sets, obtaining good performance, high generalization ability, and high robustness to audio impairment.
  arXiv  Detail & Related papers  (2022-09-28T13:46:29Z)
• Is it possible not to cheat on the Turing Test: Exploring the potential and challenges for true natural language 'understanding' by computers [0.0]
  The area of natural language understanding in artificial intelligence claims to have been making great strides. A comprehensive, interdisciplinary overview of current approaches and remaining challenges is yet to be carried out. I unite all of these perspectives to unpack the challenges involved in reaching true (human-like) language understanding.
  arXiv  Detail & Related papers  (2022-06-29T14:19:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.