Detecting Deception, Not Deepfakes: Why Media Forensics Needs Social Theories

• URL: http://arxiv.org/abs/2605.09007v1
• Date: Sat, 09 May 2026 15:46:31 GMT
• Title: Detecting Deception, Not Deepfakes: Why Media Forensics Needs Social Theories
• Abstract summary: Deepfake detection has been framed as a classification task, given an audio or video clip, decide whether it is real or synthetic.<n>We argue that better classifiers of synthetic media alone will not solve this problem, especially for interactive deepfakes such as impersonation in video and voice calls.<n>We identify five assumptions that artifact-based detection relies on and show that all five are eroding as generative models improve.
• Score: 5.5150683027141945
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: For nearly a decade, deepfake detection has been framed as a classification task: given an audio or video clip, decide whether it is real or synthetic. Top detectors often report high accuracy on standard benchmarks; however, performance drops sharply on content from newer or unseen generators. We argue that better classifiers of synthetic media alone will not solve this problem, especially for interactive deepfakes such as impersonation in video and voice calls, where the harm lies not in the artifact (manipulated media signal) but in the act of deception. Deepfake detection therefore requires a complementary analytical layer focused on communicative interaction, not just media realism. We identify five assumptions that artifact-based detection (the forensic analysis of low-level signal traces) relies on and show that all five are eroding as generative models improve, producing what we call the Generalization Illusion. To address this, we draw on three well-established frameworks from philosophy of language and social psychology, namely, Speech Act Theory, Grice's Cooperative Principle, and Cialdini's principles of influence, to examine forensic signals at three levels: the utterance, the conversation, and the listener response. The result is a unified framework that complements existing forensic methods. We close with open problems for future work. https://jesseeho.github.io/deepfake-deception/

Related papers

• Listening Deepfake Detection: A New Perspective Beyond Speaking-Centric Forgery Analysis [12.060274776566223]
  We present the task of Listening Deepfake Detection (LDD)<n>We propose MANet, a Motion-aware and Audio-guided Network that captures subtle motion inconsistencies in listener videos.<n>Our work highlights the necessity of rethinking deepfake detection beyond the traditional speaking-centric paradigm.
  arXiv  Detail & Related papers  (2026-04-14T12:20:07Z)
• ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videos [62.94038307981723]
  We introduce ActivityForensics, the first large-scale benchmark for localizing manipulated activity in videos.<n>It contains over 6K forged video segments that are seamlessly blended into the video context.<n>Based on ActivityForensics, we introduce comprehensive evaluation protocols covering intra-domain, cross-domain, and open-world settings.
  arXiv  Detail & Related papers  (2026-04-04T18:00:05Z)
• Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection [58.82268659497348]
  We argue that the root of this failure lies in a fundamental mismatch: MLLMs are asked to reason about fakes before they can truly see them.<n>We propose Forensic-Chat, a generalizable, explainable, and still-conversational assistant for fake image detection.
  arXiv  Detail & Related papers  (2025-09-29T20:59:19Z)
• SEPSIS: I Can Catch Your Lies -- A New Paradigm for Deception Detection [8.823923683853815]
  This research explores the problem of deception through the lens of psychology.<n>We propose a novel framework for deception detection leveraging NLP techniques.<n>We present a novel multi-task learning pipeline that leverages the dataless merging of fine-tuned language models.
  arXiv  Detail & Related papers  (2023-12-01T02:13:25Z)
• Audio-Visual Person-of-Interest DeepFake Detection [77.04789677645682]
  The aim of this work is to propose a deepfake detector that can cope with the wide variety of manipulation methods and scenarios encountered in the real world. We leverage a contrastive learning paradigm to learn the moving-face and audio segment embeddings that are most discriminative for each identity. Our method can detect both single-modality (audio-only, video-only) and multi-modality (audio-video) attacks, and is robust to low-quality or corrupted videos.
  arXiv  Detail & Related papers  (2022-04-06T20:51:40Z)
• Does Audio Deepfake Detection Generalize? [6.415366195115544]
  We systematize audio spoofing detection by re-implementing and uniformly evaluating architectures from related work. We publish a new dataset consisting of 37.9 hours of found audio recordings of celebrities and politicians, of which 17.2 hours are deepfakes. This may suggest that the community has tailored its solutions too closely to the prevailing ASVSpoof benchmark and that deepfakes are much harder to detect outside the lab than previously thought.
  arXiv  Detail & Related papers  (2022-03-30T12:48:22Z)
• Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motion [82.06128362686445]
  We propose a multi-modal semantic forensic approach to handle both cheapfakes and visually persuasive deepfakes. We leverage the idea of attribution to learn person-specific biometric patterns that distinguish a given speaker from others. Unlike existing person-specific approaches, our method is also effective against attacks that focus on lip manipulation.
  arXiv  Detail & Related papers  (2021-12-21T01:57:04Z)
• Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection [118.37239586697139]
  LipForensics is a detection approach capable of both generalising manipulations and withstanding various distortions. It consists in first pretraining a-temporal network to perform visual speech recognition (lipreading) A temporal network is subsequently finetuned on fixed mouth embeddings of real and forged data in order to detect fake videos based on mouth movements without over-fitting to low-level, manipulation-specific artefacts.
  arXiv  Detail & Related papers  (2020-12-14T15:53:56Z)
• "Notic My Speech" -- Blending Speech Patterns With Multimedia [65.91370924641862]
  We propose a view-temporal attention mechanism to model both the view dependence and the visemic importance in speech recognition and understanding. Our proposed method outperformed the existing work by 4.99% in terms of the viseme error rate. We show that there is a strong correlation between our model's understanding of multi-view speech and the human perception.
  arXiv  Detail & Related papers  (2020-06-12T06:51:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.