Coincidental Generation

• URL: http://arxiv.org/abs/2304.01108v2
• Date: Mon, 10 Apr 2023 15:16:04 GMT
• Title: Coincidental Generation
• Abstract summary: Generative A.I. models have emerged as versatile tools across diverse industries, with applications in privacy-preserving data sharing, computational art, personalization of products and services, and immersive entertainment. Here, we introduce a new privacy concern in the adoption and use of generative A.I. models, where a generative model's output is similar enough to an existing entity, beyond those represented in the dataset used to train the model, to be mistaken for it.
• Score: 0.5076419064097732
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative A.I. models have emerged as versatile tools across diverse industries, with applications in privacy-preserving data sharing, computational art, personalization of products and services, and immersive entertainment. Here, we introduce a new privacy concern in the adoption and use of generative A.I. models: that of coincidental generation, where a generative model's output is similar enough to an existing entity, beyond those represented in the dataset used to train the model, to be mistaken for it. Consider, for example, synthetic portrait generators, which are today deployed in commercial applications such as virtual modeling agencies and synthetic stock photography. Due to the low intrinsic dimensionality of human face perception, every synthetically generated face will coincidentally resemble an actual person. Such examples of coincidental generation all but guarantee the misappropriation of likeness and expose organizations that use generative A.I. to legal and regulatory risk.

Related papers

• Can Generative Models Actually Forge Realistic Identity Documents? [51.56484100374058]
  Open-source and publicly accessible generative models can produce identity document forgeries.<n>Risk of generative identity document deepfakes achieving forensic-level authenticity may be overestimated.
  arXiv  Detail & Related papers  (2025-12-25T00:56:50Z)
• GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesis [14.174192604480599]
  GaitCrafter is a diffusion-based framework for synthesizing realistic gait sequences in the silhouette domain.<n>Our approach enables the generation of temporally consistent and identity-preserving gait sequences.<n>We introduce a mechanism to generate novel identities-synthetic individuals not present in the original dataset.
  arXiv  Detail & Related papers  (2025-08-18T18:32:42Z)
• Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generation [10.402456492958457]
  This work aims to demonstrate that a semantically controllable generative network can provide enhanced control over the digital face modeling process. We introduce a novel data generation pipeline that creates a high-quality 3D face database using a pre-trained diffusion model. We introduce a comprehensive system designed for creating and editing high-quality face assets.
  arXiv  Detail & Related papers  (2025-04-21T17:38:50Z)
• Personalized Image Generation with Deep Generative Models: A Decade Survey [51.26287478042516]
  We present a review of generalized personalized image generation across various generative models. We first define a unified framework that standardizes the personalization process across different generative models. We then provide an in-depth analysis of personalization techniques within each generative model, highlighting their unique contributions and innovations.
  arXiv  Detail & Related papers  (2025-02-18T17:34:04Z)
• RealRAG: Retrieval-augmented Realistic Image Generation via Self-reflective Contrastive Learning [54.07026389388881]
  We present the first real-object-based retrieval-augmented generation framework (RealRAG)<n>RealRAG augments fine-grained and unseen novel object generation by learning and retrieving real-world images to overcome the knowledge gaps of generative models.<n>Our framework integrates fine-grained visual knowledge for the generative models, tackling the distortion problem and improving the realism for fine-grained object generation.
  arXiv  Detail & Related papers  (2025-02-02T16:41:54Z)
• Unveiling Synthetic Faces: How Synthetic Datasets Can Expose Real Identities [22.8742248559748]
  We show that in 6 state-of-the-art synthetic face recognition datasets, several samples from the original real dataset are leaked. This paper is the first work which shows the leakage from training data of generator models into the generated synthetic face recognition datasets.
  arXiv  Detail & Related papers  (2024-10-31T15:17:14Z)
• Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations [52.11801730860999]
  In recent years, the robot learning community has shown increasing interest in using deep generative models to capture the complexity of large datasets. We present the different types of models that the community has explored, such as energy-based models, diffusion models, action value maps, or generative adversarial networks. We also present the different types of applications in which deep generative models have been used, from grasp generation to trajectory generation or cost learning.
  arXiv  Detail & Related papers  (2024-08-08T11:34:31Z)
• AI-Generated Images as Data Source: The Dawn of Synthetic Era [61.879821573066216]
  generative AI has unlocked the potential to create synthetic images that closely resemble real-world photographs. This paper explores the innovative concept of harnessing these AI-generated images as new data sources. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability.
  arXiv  Detail & Related papers  (2023-10-03T06:55:19Z)
• On the Stability of Iterative Retraining of Generative Models on their own Data [56.153542044045224]
  We study the impact of training generative models on mixed datasets. We first prove the stability of iterative training under the condition that the initial generative models approximate the data distribution well enough. We empirically validate our theory on both synthetic and natural images by iteratively training normalizing flows and state-of-the-art diffusion models.
  arXiv  Detail & Related papers  (2023-09-30T16:41:04Z)
• TSGM: A Flexible Framework for Generative Modeling of Synthetic Time Series [61.436361263605114]
  Time series data are often scarce or highly sensitive, which precludes the sharing of data between researchers and industrial organizations. We introduce Time Series Generative Modeling (TSGM), an open-source framework for the generative modeling of synthetic time series.
  arXiv  Detail & Related papers  (2023-05-19T10:11:21Z)
• Is synthetic data from generative models ready for image recognition? [69.42645602062024]
  We study whether and how synthetic images generated from state-of-the-art text-to-image generation models can be used for image recognition tasks. We showcase the powerfulness and shortcomings of synthetic data from existing generative models, and propose strategies for better applying synthetic data for recognition tasks.
  arXiv  Detail & Related papers  (2022-10-14T06:54:24Z)
• 3DMM-RF: Convolutional Radiance Fields for 3D Face Modeling [111.98096975078158]
  We introduce a style-based generative network that synthesizes in one pass all and only the required rendering samples of a neural radiance field. We show that this model can accurately be fit to "in-the-wild" facial images of arbitrary pose and illumination, extract the facial characteristics, and be used to re-render the face in controllable conditions.
  arXiv  Detail & Related papers  (2022-09-15T15:28:45Z)
• Mimetic Models: Ethical Implications of AI that Acts Like You [5.843033621853535]
  An emerging theme in artificial intelligence research is the creation of models to simulate the decisions and behavior of specific people. We develop a framework for characterizing the ethical and social issues raised by their growing availability.
  arXiv  Detail & Related papers  (2022-07-19T16:41:36Z)
• Training face verification models from generated face identity data [2.557825816851682]
  We consider an approach to increase the privacy protection of data sets, as applied to face recognition. We build on the StyleGAN generative adversarial network and feed it with latent codes combining two distinct sub-codes. We find that the addition of a small amount of private data greatly improves the performance of our model.
  arXiv  Detail & Related papers  (2021-08-02T12:00:01Z)
• Composable Generative Models [5.990174495635326]
  This paper focuses on synthetic data generation models with privacy preserving applications in mind. It introduces a novel architecture, the Composable Generative Model (CGM) The CGM has been evaluated on 13 datasets and compared to 14 recent generative models.
  arXiv  Detail & Related papers  (2021-02-18T10:11:29Z)
• On Attribution of Deepfakes [25.334701225923517]
  generative adversarial networks have made it possible to efficiently synthesize and alter media at scale. Malicious individuals now rely on these machine-generated media, or deepfakes, to manipulate social discourse. We present a technique to optimize over the source of entropy of each generative model to attribute a deepfake to one of the models.
  arXiv  Detail & Related papers  (2020-08-20T20:25:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.