TrueFake: A Real World Case Dataset of Last Generation Fake Images also Shared on Social Networks

• URL: http://arxiv.org/abs/2504.20658v1
• Date: Tue, 29 Apr 2025 11:33:52 GMT
• Title: TrueFake: A Real World Case Dataset of Last Generation Fake Images also Shared on Social Networks
• Authors: Stefano Dell'Anna, Andrea Montibeller, Giulia Boato,
• Abstract summary: We introduce TrueFake, a large-scale benchmarking dataset of 600,000 images.<n>This dataset allows for rigorous evaluation of state-of-the-art fake image detectors under very realistic and challenging conditions.<n>We analyze how social media sharing impacts detection performance, and identify current most effective detection and training strategies.
• Score: 0.9870503213194768
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: AI-generated synthetic media are increasingly used in real-world scenarios, often with the purpose of spreading misinformation and propaganda through social media platforms, where compression and other processing can degrade fake detection cues. Currently, many forensic tools fail to account for these in-the-wild challenges. In this work, we introduce TrueFake, a large-scale benchmarking dataset of 600,000 images including top notch generative techniques and sharing via three different social networks. This dataset allows for rigorous evaluation of state-of-the-art fake image detectors under very realistic and challenging conditions. Through extensive experimentation, we analyze how social media sharing impacts detection performance, and identify current most effective detection and training strategies. Our findings highlight the need for evaluating forensic models in conditions that mirror real-world use.

Related papers

• FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensics [66.14786900470158]
  We propose FakeScope, an expert multimodal model (LMM) tailored for AI-generated image forensics. FakeScope identifies AI-synthetic images with high accuracy and provides rich, interpretable, and query-driven forensic insights. FakeScope achieves state-of-the-art performance in both closed-ended and open-ended forensic scenarios.
  arXiv  Detail & Related papers  (2025-03-31T16:12:48Z)
• Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanation [15.442558725312976]
  We introduce FakeVLM, a specialized large multimodal model for both general synthetic image and DeepFake detection tasks.<n>FakeVLM excels in distinguishing real from fake images and provides clear, natural language explanations for image artifacts.<n>We present FakeClue, a comprehensive dataset containing over 100,000 images across seven categories, annotated with fine-grained artifact clues in natural language.
  arXiv  Detail & Related papers  (2025-03-19T05:14:44Z)
• SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model [48.547599530927926]
  Synthetic images, when shared on social media, can mislead extensive audiences and erode trust in digital content.<n>We introduce the Social media Image Detection dataSet (SID-Set), which offers three key advantages.<n>We propose a new image deepfake detection, localization, and explanation framework, named SIDA.
  arXiv  Detail & Related papers  (2024-12-05T16:12:25Z)
• DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection [67.3143177137102]
  Deepfake detection refers to detecting artificially generated or edited faces in images or videos. We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
  arXiv  Detail & Related papers  (2023-12-07T07:19:45Z)
• Fill-Up: Balancing Long-Tailed Data with Generative Models [11.91669614267993]
  This paper proposes a new image synthesis pipeline for long-tailed situations using Textual Inversion. We show that generated images from textual-inverted text tokens effectively aligns with the real domain. We also show that real-world data imbalance scenarios can be successfully mitigated by filling up the imbalanced data with synthetic images.
  arXiv  Detail & Related papers  (2023-06-12T16:01:20Z)
• Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images [60.34381768479834]
  Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language. We pioneer a systematic study on deepfake detection generated by state-of-the-art diffusion models.
  arXiv  Detail & Related papers  (2023-04-02T10:25:09Z)
• Deep Convolutional Pooling Transformer for Deepfake Detection [54.10864860009834]
  We propose a deep convolutional Transformer to incorporate decisive image features both locally and globally. Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy. The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.
  arXiv  Detail & Related papers  (2022-09-12T15:05:41Z)
• Are GAN generated images easy to detect? A critical analysis of the state-of-the-art [22.836654317217324]
  With the increased level of photorealism, synthetic media are becoming hardly distinguishable from real ones. It is important to develop automated tools to reliably and timely detect synthetic media.
  arXiv  Detail & Related papers  (2021-04-06T15:54:26Z)
• Deep Traffic Sign Detection and Recognition Without Target Domain Real Images [52.079665469286496]
  We propose a novel database generation method that requires no real image from the target-domain, and (ii) templates of the traffic signs. The method does not aim at overcoming the training with real data, but to be a compatible alternative when the real data is not available. On large data sets, training with a fully synthetic data set almost matches the performance of training with a real one.
  arXiv  Detail & Related papers  (2020-07-30T21:06:47Z)
• Detecting CNN-Generated Facial Images in Real-World Scenarios [15.755089410308647]
  We present a framework for evaluating detection methods under real-world conditions. We also evaluate state-of-the-art detection methods using the proposed framework. Our results suggest that CNN-based detection methods are not yet robust enough to be used in real-world scenarios.
  arXiv  Detail & Related papers  (2020-05-12T09:18:28Z)
• Leveraging Multi-Source Weak Social Supervision for Early Detection of Fake News [67.53424807783414]
  Social media has greatly enabled people to participate in online activities at an unprecedented rate. This unrestricted access also exacerbates the spread of misinformation and fake news online which might cause confusion and chaos unless being detected early for its mitigation. We jointly leverage the limited amount of clean data along with weak signals from social engagements to train deep neural networks in a meta-learning framework to estimate the quality of different weak instances. Experiments on realworld datasets demonstrate that the proposed framework outperforms state-of-the-art baselines for early detection of fake news without using any user engagements at prediction time.
  arXiv  Detail & Related papers  (2020-04-03T18:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.