Has an AI model been trained on your images?

• URL: http://arxiv.org/abs/2501.06399v1
• Date: Sat, 11 Jan 2025 01:12:23 GMT
• Title: Has an AI model been trained on your images?
• Authors: Matyas Bohacek, Hany Farid,
• Abstract summary: We describe a method that allows us to determine if a model was trained on a specific image or set of images.<n>This method is computationally efficient and assumes no explicit knowledge of the model architecture or weights.<n>We anticipate that this method will be crucial for auditing existing models and, looking ahead, ensuring the fairer development and deployment of generative AI models.
• Score: 13.106063755117399
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: From a simple text prompt, generative-AI image models can create stunningly realistic and creative images bounded, it seems, by only our imagination. These models have achieved this remarkable feat thanks, in part, to the ingestion of billions of images collected from nearly every corner of the internet. Many creators have understandably expressed concern over how their intellectual property has been ingested without their permission or a mechanism to opt out of training. As a result, questions of fair use and copyright infringement have quickly emerged. We describe a method that allows us to determine if a model was trained on a specific image or set of images. This method is computationally efficient and assumes no explicit knowledge of the model architecture or weights (so-called black-box membership inference). We anticipate that this method will be crucial for auditing existing models and, looking ahead, ensuring the fairer development and deployment of generative AI models.

Related papers

• Artificial Intelligence and Misinformation in Art: Can Vision Language Models Judge the Hand or the Machine Behind the Canvas? [40.65612212208553]
  Powerful artificial intelligence models that can generate and analyze images creates new challenges for painting attribution.<n>On the one hand, AI models can create images that mimic the style of a painter, which can be incorrectly attributed, for example, by other AI models.<n>On the other hand, AI models may not be able to correctly identify the artist for real paintings, inducing users to incorrectly attribute paintings.
  arXiv  Detail & Related papers  (2025-08-02T15:27:31Z)
• How Many Van Goghs Does It Take to Van Gogh? Finding the Imitation Threshold [50.33428591760124]
  We study the relationship between a concept's frequency in the training dataset and the ability of a model to imitate it. We propose an efficient approach that estimates the imitation threshold without incurring the colossal cost of training multiple models from scratch.
  arXiv  Detail & Related papers  (2024-10-19T06:28:14Z)
• Detecting AI-Generated Images via CLIP [0.0]
  We investigate the ability of the Contrastive Language-Image Pre-training (CLIP) architecture, pre-trained on massive internet-scale data sets, to determine if an image is AI-generated. We fine-tune CLIP on real images and AIGI from several generative models, enabling CLIP to determine if an image is AI-generated and, if so, determine what generation method was used to create it. Our method will significantly increase access to AIGI-detecting tools and reduce the negative effects of AIGI on society.
  arXiv  Detail & Related papers  (2024-04-12T19:29:10Z)
• A Dataset and Benchmark for Copyright Infringement Unlearning from Text-to-Image Diffusion Models [52.49582606341111]
  Copyright law confers creators the exclusive rights to reproduce, distribute, and monetize their creative works. Recent progress in text-to-image generation has introduced formidable challenges to copyright enforcement. We introduce a novel pipeline that harmonizes CLIP, ChatGPT, and diffusion models to curate a dataset.
  arXiv  Detail & Related papers  (2024-01-04T11:14:01Z)
• Detecting Generated Images by Real Images Only [64.12501227493765]
  Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
  arXiv  Detail & Related papers  (2023-11-02T03:09:37Z)
• CopyScope: Model-level Copyright Infringement Quantification in the Diffusion Workflow [6.6282087165087304]
  Copyright infringement quantification is the primary and challenging step towards AI-generated image copyright traceability. We propose CopyScope, a new framework to quantify the infringement of AI-generated images from the model level.
  arXiv  Detail & Related papers  (2023-10-13T13:08:09Z)
• Ablating Concepts in Text-to-Image Diffusion Models [57.9371041022838]
  Large-scale text-to-image diffusion models can generate high-fidelity images with powerful compositional ability. These models are typically trained on an enormous amount of Internet data, often containing copyrighted material, licensed images, and personal photos. We propose an efficient method of ablating concepts in the pretrained model, preventing the generation of a target concept.
  arXiv  Detail & Related papers  (2023-03-23T17:59:42Z)
• Implementing and Experimenting with Diffusion Models for Text-to-Image Generation [0.0]
  Two models, DALL-E 2 and Imagen, have demonstrated that highly photorealistic images could be generated from a simple textual description of an image. Text-to-image models require exceptionally large amounts of computational resources to train, as well as handling huge datasets collected from the internet. This thesis contributes by reviewing the different approaches and techniques used by these models, and then by proposing our own implementation of a text-to-image model.
  arXiv  Detail & Related papers  (2022-09-22T12:03:33Z)
• Weakly Supervised High-Fidelity Clothing Model Generation [67.32235668920192]
  We propose a cheap yet scalable weakly-supervised method called Deep Generative Projection (DGP) to address this specific scenario. We show that projecting the rough alignment of clothing and body onto the StyleGAN space can yield photo-realistic wearing results.
  arXiv  Detail & Related papers  (2021-12-14T07:15:15Z)
• InvGAN: Invertible GANs [88.58338626299837]
  InvGAN, short for Invertible GAN, successfully embeds real images to the latent space of a high quality generative model. This allows us to perform image inpainting, merging, and online data augmentation.
  arXiv  Detail & Related papers  (2021-12-08T21:39:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.