On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook

• URL: http://arxiv.org/abs/2307.16680v7
• Date: Thu, 06 Feb 2025 02:18:55 GMT
• Title: On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
• Authors: Mingyuan Fan, Chengyu Wang, Cen Chen, Yang Liu, Jun Huang,
• Abstract summary: Diffusion models and large language models have emerged as leading-edge generative models.<n>This paper investigates both the long-standing and emerging threats associated with these models across four fundamental dimensions: 1) privacy, 2) security, 3) fairness, and 4) responsibility.
• Score: 26.491739980732927
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Diffusion models and large language models have emerged as leading-edge generative models, revolutionizing various aspects of human life. However, the practical implementations of these models have also exposed inherent risks, bringing to the forefront their evil sides and sparking concerns regarding their trustworthiness. Despite the wealth of literature on this subject, a comprehensive survey specifically delving into the intersection of large-scale generative models and their trustworthiness remains largely absent. To bridge this gap, this paper investigates both the long-standing and emerging threats associated with these models across four fundamental dimensions: 1) privacy, 2) security, 3) fairness, and 4) responsibility. Based on the investigation results, we develop an extensive map outlining the trustworthiness of large generative models. After that, we provide practical recommendations and potential research directions for future secure applications equipped with large generative models, ultimately promoting the trustworthiness of the models and benefiting the society as a whole.

Related papers

• Reliable and Responsible Foundation Models: A Comprehensive Survey [287.21660198043145]
  This survey addresses the reliable and responsible development of foundation models.<n>We explore critical issues, including bias and fairness, security and privacy, uncertainty, explainability, and distribution shift.<n>For each area, we review the current state of the field and outline concrete future research directions.
  arXiv  Detail & Related papers  (2026-02-04T17:25:03Z)
• Holmes: Towards Effective and Harmless Model Ownership Verification to Personalized Large Vision Models via Decoupling Common Features [54.63343151319368]
  This paper proposes a harmless model ownership verification method for personalized models by decoupling similar common features.<n>In the first stage, we create shadow models that retain common features of the victim model while disrupting dataset-specific features.<n>After that, a meta-classifier is trained to identify stolen models by determining whether suspicious models contain the dataset-specific features of the victim.
  arXiv  Detail & Related papers  (2025-06-24T15:40:11Z)
• Generative Models in Decision Making: A Survey [63.68746774576147]
  generative models can be incorporated into decision-making systems by generating trajectories that guide agents toward high-reward state-action regions or intermediate sub-goals. This paper presents a comprehensive review of the application of generative models in decision-making tasks.
  arXiv  Detail & Related papers  (2025-02-24T12:31:28Z)
• Safety at Scale: A Comprehensive Survey of Large Model Safety [298.05093528230753]
  We present a comprehensive taxonomy of safety threats to large models, including adversarial attacks, data poisoning, backdoor attacks, jailbreak and prompt injection attacks, energy-latency attacks, data and model extraction attacks, and emerging agent-specific threats. We identify and discuss the open challenges in large model safety, emphasizing the need for comprehensive safety evaluations, scalable and effective defense mechanisms, and sustainable data practices.
  arXiv  Detail & Related papers  (2025-02-02T05:14:22Z)
• Synthetic Data for Portfolios: A Throw of the Dice Will Never Abolish Chance [0.0]
  This paper contributes to a deeper understanding of the limitations of generative models, particularly in portfolio and risk management. We propose a pipeline for the generation of multivariate returns that meets conventional evaluation standards on a large universe of US equities.
  arXiv  Detail & Related papers  (2025-01-07T18:50:24Z)
• New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook [54.24701201956833]
  Security and privacy issues have undermined users' confidence in pre-trained models. Current literature lacks a clear taxonomy of emerging attacks and defenses for pre-trained models. This taxonomy categorizes attacks and defenses into No-Change, Input-Change, and Model-Change approaches.
  arXiv  Detail & Related papers  (2024-11-12T10:15:33Z)
• Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models [112.48136829374741]
  In this paper, we unveil a new vulnerability: the privacy backdoor attack. When a victim fine-tunes a backdoored model, their training data will be leaked at a significantly higher rate than if they had fine-tuned a typical model. Our findings highlight a critical privacy concern within the machine learning community and call for a reevaluation of safety protocols in the use of open-source pre-trained models.
  arXiv  Detail & Related papers  (2024-04-01T16:50:54Z)
• On the Challenges and Opportunities in Generative AI [135.2754367149689]
  We argue that current large-scale generative AI models do not sufficiently address several fundamental issues that hinder their widespread adoption across domains. In this work, we aim to identify key unresolved challenges in modern generative AI paradigms that should be tackled to further enhance their capabilities, versatility, and reliability.
  arXiv  Detail & Related papers  (2024-02-28T15:19:33Z)
• The Essential Role of Causality in Foundation World Models for Embodied AI [102.75402420915965]
  Embodied AI agents will require the ability to perform new tasks in many different real-world environments. Current foundation models fail to accurately model physical interactions and are therefore insufficient for Embodied AI. The study of causality lends itself to the construction of veridical world models.
  arXiv  Detail & Related papers  (2024-02-06T17:15:33Z)
• Typology of Risks of Generative Text-to-Image Models [1.933681537640272]
  This paper investigates the direct risks and harms associated with modern text-to-image generative models, such as DALL-E and Midjourney. Our review reveals significant knowledge gaps concerning the understanding and treatment of these risks despite some already being addressed. We identify 22 distinct risk types, spanning issues from data bias to malicious use.
  arXiv  Detail & Related papers  (2023-07-08T20:33:30Z)
• Conditioning Predictive Models: Risks and Strategies [1.3124513975412255]
  We provide a definitive reference on what it would take to safely make use of generative/predictive models. We believe that large language models can be understood as such predictive models of the world. We think that conditioning approaches for predictive models represent the safest known way of eliciting human-level capabilities.
  arXiv  Detail & Related papers  (2023-02-02T00:06:36Z)
• Fairness Increases Adversarial Vulnerability [50.90773979394264]
  This paper shows the existence of a dichotomy between fairness and robustness, and analyzes when achieving fairness decreases the model robustness to adversarial samples. Experiments on non-linear models and different architectures validate the theoretical findings in multiple vision domains. The paper proposes a simple, yet effective, solution to construct models achieving good tradeoffs between fairness and robustness.
  arXiv  Detail & Related papers  (2022-11-21T19:55:35Z)
• Membership Inference Attacks Against Text-to-image Generation Models [23.39695974954703]
  This paper performs the first privacy analysis of text-to-image generation models through the lens of membership inference. We propose three key intuitions about membership information and design four attack methodologies accordingly. All of the proposed attacks can achieve significant performance, in some cases even close to an accuracy of 1, and thus the corresponding risk is much more severe than that shown by existing membership inference attacks.
  arXiv  Detail & Related papers  (2022-10-03T14:31:39Z)
• Predictability and Surprise in Large Generative Models [8.055204456718576]
  Large-scale pre-training has emerged as a technique for creating capable, general purpose, generative models. In this paper, we highlight a counterintuitive property of such models and discuss the policy implications of this property.
  arXiv  Detail & Related papers  (2022-02-15T23:21:23Z)
• On the Opportunities and Risks of Foundation Models [256.61956234436553]
  We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration.
  arXiv  Detail & Related papers  (2021-08-16T17:50:08Z)
• On Attribution of Deepfakes [25.334701225923517]
  generative adversarial networks have made it possible to efficiently synthesize and alter media at scale. Malicious individuals now rely on these machine-generated media, or deepfakes, to manipulate social discourse. We present a technique to optimize over the source of entropy of each generative model to attribute a deepfake to one of the models.
  arXiv  Detail & Related papers  (2020-08-20T20:25:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.