PFGuard: A Generative Framework with Privacy and Fairness Safeguards

• URL: http://arxiv.org/abs/2410.02246v1
• Date: Thu, 3 Oct 2024 06:37:16 GMT
• Title: PFGuard: A Generative Framework with Privacy and Fairness Safeguards
• Authors: Soyeon Kim, Yuji Roh, Geon Heo, Steven Euijong Whang,
• Abstract summary: PFGuard is a generative framework with privacy and fairness safeguards. It balances privacy-fairness conflicts between fair and private training stages. Experiments show that PFGuard successfully generates synthetic data on high-dimensional data.
• Score: 14.504462873398461
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative models must ensure both privacy and fairness for Trustworthy AI. While these goals have been pursued separately, recent studies propose to combine existing privacy and fairness techniques to achieve both goals. However, naively combining these techniques can be insufficient due to privacy-fairness conflicts, where a sample in a minority group may be amplified for fairness, only to be suppressed for privacy. We demonstrate how these conflicts lead to adverse effects, such as privacy violations and unexpected fairness-utility tradeoffs. To mitigate these risks, we propose PFGuard, a generative framework with privacy and fairness safeguards, which simultaneously addresses privacy, fairness, and utility. By using an ensemble of multiple teacher models, PFGuard balances privacy-fairness conflicts between fair and private training stages and achieves high utility based on ensemble learning. Extensive experiments show that PFGuard successfully generates synthetic data on high-dimensional data while providing both fairness convergence and strict DP guarantees - the first of its kind to our knowledge.

Related papers

• TAPFed: Threshold Secure Aggregation for Privacy-Preserving Federated Learning [16.898842295300067]
  Federated learning is a computing paradigm that enhances privacy by enabling multiple parties to collaboratively train a machine learning model without revealing personal data. Traditional federated learning platforms are unable to ensure privacy due to privacy leaks caused by the interchange of gradients. This paper proposes TAPFed, an approach for achieving privacy-preserving federated learning in the context of multiple decentralized aggregators with malicious actors.
  arXiv  Detail & Related papers  (2025-01-09T08:24:10Z)
• Activity Recognition on Avatar-Anonymized Datasets with Masked Differential Privacy [64.32494202656801]
  Privacy-preserving computer vision is an important emerging problem in machine learning and artificial intelligence. We present anonymization pipeline that replaces sensitive human subjects in video datasets with synthetic avatars within context. We also proposeMaskDP to protect non-anonymized but privacy sensitive background information.
  arXiv  Detail & Related papers  (2024-10-22T15:22:53Z)
• Bayes-Nash Generative Privacy Against Membership Inference Attacks [24.330984323956173]
  Membership inference attacks (MIAs) expose significant privacy risks by determining whether an individual's data is in a dataset. We propose a game-theoretic framework that models privacy protection from MIA as a Bayesian game between a defender and an attacker. We call the defender's data sharing policy thereby obtained Bayes-Nash Generative Privacy (BNGP)
  arXiv  Detail & Related papers  (2024-10-09T20:29:04Z)
• Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives [48.48294460952039]
  This survey offers comprehensive descriptions of the privacy, security, and fairness issues in federated learning. We contend that there exists a trade-off between privacy and fairness and between security and sharing.
  arXiv  Detail & Related papers  (2024-06-16T10:31:45Z)
• Fairness and Privacy Guarantees in Federated Contextual Bandits [8.071147275221973]
  We model the algorithm's effectiveness using fairness regret. We show that both Fed-FairX-LinUCB and Priv-FairX-LinUCB achieve near-optimal fairness regret.
  arXiv  Detail & Related papers  (2024-02-05T21:38:23Z)
• Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning [10.473137837891162]
  Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm. We propose a privacy-protection fairness FL method to protect the privacy of the client model. We conclude the relationship between privacy, fairness and utility, and there is a tradeoff between these.
  arXiv  Detail & Related papers  (2023-11-30T02:19:35Z)
• Privacy and Fairness in Federated Learning: on the Perspective of Trade-off [58.204074436129716]
  Federated learning (FL) has been a hot topic in recent years. As two crucial ethical notions, the interactions between privacy and fairness are comparatively less studied.
  arXiv  Detail & Related papers  (2023-06-25T04:38:19Z)
• Defending against Reconstruction Attacks with R\'enyi Differential Privacy [72.1188520352079]
  Reconstruction attacks allow an adversary to regenerate data samples of the training set using access to only a trained model. Differential privacy is a known solution to such attacks, but is often used with a relatively large privacy budget. We show that, for a same mechanism, we can derive privacy guarantees for reconstruction attacks that are better than the traditional ones from the literature.
  arXiv  Detail & Related papers  (2022-02-15T18:09:30Z)
• Privacy Amplification via Shuffling for Linear Contextual Bandits [51.94904361874446]
  We study the contextual linear bandit problem with differential privacy (DP) We show that it is possible to achieve a privacy/utility trade-off between JDP and LDP by leveraging the shuffle model of privacy. Our result shows that it is possible to obtain a tradeoff between JDP and LDP by leveraging the shuffle model while preserving local privacy.
  arXiv  Detail & Related papers  (2021-12-11T15:23:28Z)
• Federated $f$-Differential Privacy [19.499120576896228]
  Federated learning (FL) is a training paradigm where the clients collaboratively learn models by repeatedly sharing information. We introduce federated $f$-differential privacy, a new notion specifically tailored to the federated setting. We then propose a generic private federated learning framework PriFedSync that accommodates a large family of state-of-the-art FL algorithms.
  arXiv  Detail & Related papers  (2021-02-22T16:28:21Z)
• Private Reinforcement Learning with PAC and Regret Guarantees [69.4202374491817]
  We design privacy preserving exploration policies for episodic reinforcement learning (RL) We first provide a meaningful privacy formulation using the notion of joint differential privacy (JDP) We then develop a private optimism-based learning algorithm that simultaneously achieves strong PAC and regret bounds, and enjoys a JDP guarantee.
  arXiv  Detail & Related papers  (2020-09-18T20:18:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.