A survey of AI-generated voices and their detection

• URL: http://arxiv.org/abs/2608.15411v1
• Date: Sat, 15 Aug 2026 20:59:31 GMT
• Title: A survey of AI-generated voices and their detection
• Abstract summary: Recent incidents of voice cloning scams targeting businesses and political leaders underscore the need for robust safeguards.<n>Unlike image and video deepfakes, the detection of synthetic voices poses unique challenges due to the complexity of phonetics, prosody and auditory perception.<n>This survey offers a comprehensive overview of AI voice generation and detection methods, encompassing both the technical foundations and the latest state-of-the-art advances.
• Score: 24.68419598161603
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The ability of artificial intelligence (AI) models to generate highly realistic human voices has advanced rapidly. These technologies power accessibility tools, virtual assistants and creative applications, but they also enable harmful uses, including impersonation, fraud and disinformation. Recent incidents of voice cloning scams targeting businesses and political leaders underscore the urgent need for robust safeguards. Unlike image and video deepfakes, the detection of synthetic voices poses unique challenges due to the complexity of phonetics, prosody and auditory perception. This survey offers a comprehensive overview of AI voice generation and detection methods, encompassing both the technical foundations and the latest state-of-the-art advances. This study also identifies key open challenges, benchmark resources and future directions to make this survey useful for future researchers.

Related papers

• AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan [64.09595490689874]
  We propose the All-Type Audio Deepfake Detection (AT-ADD) Grand Challenge for ACM Multimedia 2026.<n>AT-ADD aims to accelerate the development of robust and generalizable audio forensic technologies.
  arXiv  Detail & Related papers  (2026-04-09T12:38:19Z)
• Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements [12.716872085463887]
  generative adversarial network (GAN)-based approaches have drawn considerable attention for their powerful feature-mapping capabilities and potential to produce highly realistic speech.<n>This systematic review presents a comprehensive analysis of the voice conversion landscape, highlighting key techniques, key challenges, and the transformative impact of GANs in the field.<n>Overall, this work serves as an essential resource for researchers, developers, and practitioners aiming to advance the state-of-the-art (SOTA) in voice conversion technology.
  arXiv  Detail & Related papers  (2025-04-27T11:22:21Z)
• A Practical Synthesis of Detecting AI-Generated Textual, Visual, and Audio Content [4.347187436636075]
  Advances in AI-generated content have led to wide adoption of large language models, diffusion-based visual generators, and synthetic audio tools.<n>These developments raise concerns about misinformation, copyright infringement, security threats, and the erosion of public trust.<n>This paper explores an extensive range of methods designed to detect and mitigate AI-generated textual, visual, and audio content.
  arXiv  Detail & Related papers  (2025-04-02T23:27:55Z)
• Challenges in Human-Agent Communication [55.53932430345333]
  We identify and analyze twelve key communication challenges that these systems pose.<n>These include challenges in conveying information from the agent to the user, challenges in enabling the user to convey information to the agent, and overarching challenges that need to be considered across all human-agent communication.<n>Our findings serve as an urgent call for new design patterns, principles, and guidelines to support transparency and control in these systems.
  arXiv  Detail & Related papers  (2024-11-28T01:21:26Z)
• Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights [49.81915942821647]
  Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. This paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity.
  arXiv  Detail & Related papers  (2024-11-12T09:02:11Z)
• Where are we in audio deepfake detection? A systematic analysis over generative and detection models [59.09338266364506]
  SONAR is a synthetic AI-Audio Detection Framework and Benchmark.<n>It provides a comprehensive evaluation for distinguishing cutting-edge AI-synthesized auditory content.<n>It is the first framework to uniformly benchmark AI-audio detection across both traditional and foundation model-based detection systems.
  arXiv  Detail & Related papers  (2024-10-06T01:03:42Z)
• Detecting AI-Generated Text: Factors Influencing Detectability with Current Methods [13.14749943120523]
  Knowing whether a text was produced by human or artificial intelligence (AI) is important to determining its trustworthiness.<n>State-of-the art approaches to AIGT detection include watermarking, statistical and stylistic analysis, and machine learning classification.<n>We aim to provide insight into the salient factors that combine to determine how "detectable" AIGT text is under different scenarios.
  arXiv  Detail & Related papers  (2024-06-21T18:31:49Z)
• A Survey on Speech Deepfake Detection [7.3348524333159]
  Speech Deepfakes pose a serious threat by generating realistic voices and spreading misinformation.<n>To combat this, numerous challenges have been organized to advance speech Deepfake detection techniques.<n>We systematically analyze more than 200 papers published up to March 2024.
  arXiv  Detail & Related papers  (2024-04-22T06:52:12Z)
• Artificial Intelligence for Cochlear Implants: Review of Strategies, Challenges, and Perspectives [2.608119698700597]
  This review aims to comprehensively cover advancements in CI-based ASR and speech enhancement, among other related aspects.<n>The review will delve into potential applications and suggest future directions to bridge existing research gaps in this domain.
  arXiv  Detail & Related papers  (2024-03-17T11:28:23Z)
• Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey [97.33926242130732]
  Large Language Models (LLMs) have revolutionized the domain of natural language processing (NLP) with remarkable capabilities of generating human-like text responses. Despite these advancements, several works in the existing literature have raised serious concerns about the potential misuse of LLMs. To address these concerns, a consensus among the research community is to develop algorithmic solutions to detect AI-generated text.
  arXiv  Detail & Related papers  (2023-10-23T18:11:32Z)
• Deepfake audio detection by speaker verification [79.99653758293277]
  We propose a new detection approach that leverages only the biometric characteristics of the speaker, with no reference to specific manipulations. The proposed approach can be implemented based on off-the-shelf speaker verification tools. We test several such solutions on three popular test sets, obtaining good performance, high generalization ability, and high robustness to audio impairment.
  arXiv  Detail & Related papers  (2022-09-28T13:46:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.