Towards Fairness in Personalized Ads Using Impression Variance Aware Reinforcement Learning

• URL: http://arxiv.org/abs/2306.03293v2
• Date: Thu, 8 Jun 2023 22:00:43 GMT
• Title: Towards Fairness in Personalized Ads Using Impression Variance Aware Reinforcement Learning
• Authors: Aditya Srinivas Timmaraju, Mehdi Mashayekhi, Mingliang Chen, Qi Zeng, Quintin Fettes, Wesley Cheung, Yihan Xiao, Manojkumar Rangasamy Kannadasan, Pushkar Tripathi, Sean Gahagan, Miranda Bogen, Rob Roudani
• Abstract summary: Variance Reduction System (VRS) for achieving more equitable outcomes in Meta's ads systems. We first define metrics to quantify fairness gaps in terms of ad impression variances. We then present the VRS for re-ranking ads in an impression variance-aware manner.
• Score: 9.246089899723744
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Variances in ad impression outcomes across demographic groups are increasingly considered to be potentially indicative of algorithmic bias in personalized ads systems. While there are many definitions of fairness that could be applicable in the context of personalized systems, we present a framework which we call the Variance Reduction System (VRS) for achieving more equitable outcomes in Meta's ads systems. VRS seeks to achieve a distribution of impressions with respect to selected protected class (PC) attributes that more closely aligns the demographics of an ad's eligible audience (a function of advertiser targeting criteria) with the audience who sees that ad, in a privacy-preserving manner. We first define metrics to quantify fairness gaps in terms of ad impression variances with respect to PC attributes including gender and estimated race. We then present the VRS for re-ranking ads in an impression variance-aware manner. We evaluate VRS via extensive simulations over different parameter choices and study the effect of the VRS on the chosen fairness metric. We finally present online A/B testing results from applying VRS to Meta's ads systems, concluding with a discussion of future work. We have deployed the VRS to all users in the US for housing ads, resulting in significant improvement in our fairness metric. VRS is the first large-scale deployed framework for pursuing fairness for multiple PC attributes in online advertising.

Related papers

• Auditing for Bias in Ad Delivery Using Inferred Demographic Attributes [50.37313459134418]
  We study the effects of inference error on auditing for bias in one prominent application: black-box audit of ad delivery using paired ads. We propose a way to mitigate the inference error when evaluating skew in ad delivery algorithms.
  arXiv  Detail & Related papers  (2024-10-30T18:57:03Z)
• Auditing for Racial Discrimination in the Delivery of Education Ads [50.37313459134418]
  We propose a new third-party auditing method that can evaluate racial bias in the delivery of ads for education opportunities. We find evidence of racial discrimination in Meta's algorithmic delivery of ads for education opportunities, posing legal and ethical concerns.
  arXiv  Detail & Related papers  (2024-06-02T02:00:55Z)
• Differentially Private Ad Conversion Measurement [44.91290951502002]
  We develop a formal framework for private ad conversion measurement using differential privacy (DP) In particular, we define the notion of an operationally valid configuration of the attribution rule. We then provide, for the set of configurations that most commonly arises in practice, a complete characterization.
  arXiv  Detail & Related papers  (2024-03-22T14:18:52Z)
• Evaluating the Fairness of Discriminative Foundation Models in Computer Vision [51.176061115977774]
  We propose a novel taxonomy for bias evaluation of discriminative foundation models, such as Contrastive Language-Pretraining (CLIP) We then systematically evaluate existing methods for mitigating bias in these models with respect to our taxonomy. Specifically, we evaluate OpenAI's CLIP and OpenCLIP models for key applications, such as zero-shot classification, image retrieval and image captioning.
  arXiv  Detail & Related papers  (2023-10-18T10:32:39Z)
• Ad-load Balancing via Off-policy Learning in a Content Marketplace [9.783697404304025]
  Ad-load balancing is a critical challenge in online advertising systems, particularly in the context of social media platforms. Traditional approaches to ad-load balancing rely on static allocation policies, which fail to adapt to changing user preferences and contextual factors. We present an approach that leverages off-policy learning and evaluation from logged bandit feedback.
  arXiv  Detail & Related papers  (2023-09-19T09:17:07Z)
• Online Ad Procurement in Non-stationary Autobidding Worlds [10.871587311621974]
  We introduce a primal-dual algorithm for online decision making with multi-dimension decision variables, bandit feedback and long-term uncertain constraints. We show that our algorithm achieves low regret in many worlds when procurement outcomes are generated through procedures that are adversarial, adversarially corrupted, periodic, and ergodic.
  arXiv  Detail & Related papers  (2023-07-10T00:41:08Z)
• Discrimination through Image Selection by Job Advertisers on Facebook [79.21648699199648]
  We propose and investigate the prevalence of a new means for discrimination in job advertising. It combines both targeting and delivery -- through the disproportionate representation or exclusion of people of certain demographics in job ad images. We use the Facebook Ad Library to demonstrate the prevalence of this practice.
  arXiv  Detail & Related papers  (2023-06-13T03:43:58Z)
• VFed-SSD: Towards Practical Vertical Federated Advertising [53.08038962443853]
  We propose a semi-supervised split distillation framework VFed-SSD to alleviate the two limitations. Specifically, we develop a self-supervised task MatchedPair Detection (MPD) to exploit the vertically partitioned unlabeled data. Our framework provides an efficient federation-enhanced solution for real-time display advertising with minimal deploying cost and significant performance lift.
  arXiv  Detail & Related papers  (2022-05-31T17:45:30Z)
• Mid-flight Forecasting for CPA Lines in Online Advertising [6.766999405722559]
  This paper investigates the forecasting problem for CPA lines in the middle of the flight. The proposed methodology generates relationships between various key performance metrics and optimization signals. The relationship between advertiser spends and effective Cost Per Action(eCPA) is also characterized.
  arXiv  Detail & Related papers  (2021-07-15T17:48:15Z)
• Auditing for Discrimination in Algorithms Delivering Job Ads [70.02478301291264]
  We develop a new methodology for black-box auditing of algorithms for discrimination in the delivery of job advertisements. Our first contribution is to identify the distinction between skew in ad delivery due to protected categories such as gender or race. Second, we develop an auditing methodology that distinguishes between skew explainable by differences in qualifications from other factors. Third, we apply our proposed methodology to two prominent targeted advertising platforms for job ads: Facebook and LinkedIn.
  arXiv  Detail & Related papers  (2021-04-09T17:38:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.