Explainable Artifacts for Synthetic Western Blot Source Attribution

• URL: http://arxiv.org/abs/2409.18881v2
• Date: Fri, 4 Oct 2024 10:40:11 GMT
• Title: Explainable Artifacts for Synthetic Western Blot Source Attribution
• Authors: João Phillipe Cardenuto, Sara Mandelli, Daniel Moreira, Paolo Bestagini, Edward Delp, Anderson Rocha,
• Abstract summary: Recent advancements in artificial intelligence have enabled generative models to produce synthetic scientific images that are indistinguishable from pristine ones. This study aims to identify explainable artifacts generated by state-of-the-art generative models and leverage them for open-set identification and source attribution.
• Score: 18.798003207293746
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advancements in artificial intelligence have enabled generative models to produce synthetic scientific images that are indistinguishable from pristine ones, posing a challenge even for expert scientists habituated to working with such content. When exploited by organizations known as paper mills, which systematically generate fraudulent articles, these technologies can significantly contribute to the spread of misinformation about ungrounded science, potentially undermining trust in scientific research. While previous studies have explored black-box solutions, such as Convolutional Neural Networks, for identifying synthetic content, only some have addressed the challenge of generalizing across different models and providing insight into the artifacts in synthetic images that inform the detection process. This study aims to identify explainable artifacts generated by state-of-the-art generative models (e.g., Generative Adversarial Networks and Diffusion Models) and leverage them for open-set identification and source attribution (i.e., pointing to the model that created the image).

Related papers

• Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AI [0.0]
  Synthetic photographs may be used maliciously by a broad range of threat actors. We show that visible artifacts in generated images reveal their synthetic origin to the trained eye. We categorize these artifacts, provide examples, discuss the challenges in detecting them, suggest practical applications of our work, and outline future research directions.
  arXiv  Detail & Related papers  (2024-08-12T08:58:23Z)
• Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection [86.97062579515833]
  We introduce the concept of Neighboring Pixel Relationships(NPR) as a means to capture and characterize the generalized structural artifacts stemming from up-sampling operations. A comprehensive analysis is conducted on an open-world dataset, comprising samples generated by tft28 distinct generative models. This analysis culminates in the establishment of a novel state-of-the-art performance, showcasing a remarkable tft11.6% improvement over existing methods.
  arXiv  Detail & Related papers  (2023-12-16T14:27:06Z)
• Perceptual Artifacts Localization for Image Synthesis Tasks [59.638307505334076]
  We introduce a novel dataset comprising 10,168 generated images, each annotated with per-pixel perceptual artifact labels. A segmentation model, trained on our proposed dataset, effectively localizes artifacts across a range of tasks. We propose an innovative zoom-in inpainting pipeline that seamlessly rectifies perceptual artifacts in the generated images.
  arXiv  Detail & Related papers  (2023-10-09T10:22:08Z)
• The Age of Synthetic Realities: Challenges and Opportunities [85.058932103181]
  We highlight the crucial need for the development of forensic techniques capable of identifying harmful synthetic creations and distinguishing them from reality. Our focus extends to various forms of media, such as images, videos, audio, and text, as we examine how synthetic realities are crafted and explore approaches to detecting these malicious creations. This study is of paramount importance due to the rapid progress of AI generative techniques and their impact on the fundamental principles of Forensic Science.
  arXiv  Detail & Related papers  (2023-06-09T15:55:10Z)
• Using generative AI to investigate medical imagery models and datasets [21.814095540433115]
  Explanations are needed in order to increase the trust in AI-based models. We present a method for automatic visual explanations leveraging team-based expertise. We demonstrate results on eight prediction tasks across three medical imaging modalities.
  arXiv  Detail & Related papers  (2023-06-01T17:59:55Z)
• Intriguing properties of synthetic images: from generative adversarial networks to diffusion models [19.448196464632]
  It is important to gain insight into which image features better discriminate fake images from real ones. In this paper we report on our systematic study of a large number of image generators of different families, aimed at discovering the most forensically relevant characteristics of real and generated images.
  arXiv  Detail & Related papers  (2023-04-13T11:13:19Z)
• On the detection of synthetic images generated by diffusion models [18.12766911229293]
  Methods based on diffusion models (DM) have been gaining the spotlight. DM enables the creation of text-based visual content. Malicious users can generate and distribute fake media perfectly adapted to their attacks.
  arXiv  Detail & Related papers  (2022-11-01T18:10:55Z)
• Is synthetic data from generative models ready for image recognition? [69.42645602062024]
  We study whether and how synthetic images generated from state-of-the-art text-to-image generation models can be used for image recognition tasks. We showcase the powerfulness and shortcomings of synthetic data from existing generative models, and propose strategies for better applying synthetic data for recognition tasks.
  arXiv  Detail & Related papers  (2022-10-14T06:54:24Z)
• Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data [64.65952078807086]
  Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs) Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation. We seek a proactive and sustainable solution on deepfake detection by introducing artificial fingerprints into the models.
  arXiv  Detail & Related papers  (2020-07-16T16:49:55Z)
• Reverse Engineering Configurations of Neural Text Generation Models [86.9479386959155]
  The study of artifacts that emerge in machine generated text as a result of modeling choices is a nascent research area. We conduct an extensive suite of diagnostic tests to observe whether modeling choices leave detectable artifacts in the text they generate. Our key finding, which is backed by a rigorous set of experiments, is that such artifacts are present and that different modeling choices can be inferred by observing the generated text alone.
  arXiv  Detail & Related papers  (2020-04-13T21:02:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.