Pareto Pairwise Ranking for Fairness Enhancement of Recommender Systems
- URL: http://arxiv.org/abs/2212.10459v1
- Date: Tue, 6 Dec 2022 03:46:31 GMT
- Title: Pareto Pairwise Ranking for Fairness Enhancement of Recommender Systems
- Authors: Hao Wang
- Abstract summary: We show that our algorithm is competitive with other algorithms when evaluated on technical accuracy metrics.
What is more important, in our experiment section we demonstrate that Pareto Pairwise Ranking is the most fair algorithm in comparison with 9 other contemporary algorithms.
- Score: 4.658166900129066
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Learning to rank is an effective recommendation approach since its
introduction around 2010. Famous algorithms such as Bayesian Personalized
Ranking and Collaborative Less is More Filtering have left deep impact in both
academia and industry. However, most learning to rank approaches focus on
improving technical accuracy metrics such as AUC, MRR and NDCG. Other
evaluation metrics of recommender systems like fairness have been largely
overlooked until in recent years. In this paper, we propose a new learning to
rank algorithm named Pareto Pairwise Ranking. We are inspired by the idea of
Bayesian Personalized Ranking and power law distribution. We show that our
algorithm is competitive with other algorithms when evaluated on technical
accuracy metrics. What is more important, in our experiment section we
demonstrate that Pareto Pairwise Ranking is the most fair algorithm in
comparison with 9 other contemporary algorithms.
Related papers
- Zeroshot Listwise Learning to Rank Algorithm for Recommendation [5.694872363688119]
Learning to rank is a rare technology compared with other techniques such as deep neural networks.
We design a zeroshot listwise learning to rank algorithm for recommendation.
arXiv Detail & Related papers (2024-09-05T09:16:14Z) - Bipartite Ranking Fairness through a Model Agnostic Ordering Adjustment [54.179859639868646]
We propose a model agnostic post-processing framework xOrder for achieving fairness in bipartite ranking.
xOrder is compatible with various classification models and ranking fairness metrics, including supervised and unsupervised fairness metrics.
We evaluate our proposed algorithm on four benchmark data sets and two real-world patient electronic health record repositories.
arXiv Detail & Related papers (2023-07-27T07:42:44Z) - HARRIS: Hybrid Ranking and Regression Forests for Algorithm Selection [75.84584400866254]
We propose a new algorithm selector leveraging special forests, combining the strengths of both approaches while alleviating their weaknesses.
HARRIS' decisions are based on a forest model, whose trees are created based on optimized on a hybrid ranking and regression loss function.
arXiv Detail & Related papers (2022-10-31T14:06:11Z) - Improved Algorithms for Neural Active Learning [74.89097665112621]
We improve the theoretical and empirical performance of neural-network(NN)-based active learning algorithms for the non-parametric streaming setting.
We introduce two regret metrics by minimizing the population loss that are more suitable in active learning than the one used in state-of-the-art (SOTA) related work.
arXiv Detail & Related papers (2022-10-02T05:03:38Z) - Which Tricks Are Important for Learning to Rank? [32.38701971636441]
State-of-the-art learning-to-rank methods are based on gradient-boosted decision trees (GBDT)
In this paper, we thoroughly analyze several GBDT-based ranking algorithms in a unified setup.
As a result, we gain insights into learning-to-rank techniques and obtain a new state-of-the-art algorithm.
arXiv Detail & Related papers (2022-04-04T13:59:04Z) - GNNRank: Learning Global Rankings from Pairwise Comparisons via Directed
Graph Neural Networks [68.61934077627085]
We introduce GNNRank, a modeling framework compatible with any GNN capable of learning digraph embeddings.
We show that our methods attain competitive and often superior performance compared with existing approaches.
arXiv Detail & Related papers (2022-02-01T04:19:50Z) - Heuristic Search for Rank Aggregation with Application to Label Ranking [16.275063634853584]
We propose an effective hybrid evolutionary ranking algorithm to solve the rank aggregation problem.
The algorithm features a semantic crossover based on concordant pairs and a late acceptance local search reinforced by an efficient incremental evaluation technique.
Experiments are conducted to assess the algorithm, indicating a highly competitive performance on benchmark instances.
arXiv Detail & Related papers (2022-01-11T11:43:17Z) - Optimizing Ranking Systems Online as Bandits [2.282430531490685]
We study and propose solutions for four challenges in optimizing ranking systems online.
The effectiveness is related to how fast the algorithm learns from interactions.
Second, the deployed algorithm should be safe, which means the algorithm only displays reasonable content to user requests.
Third, as users change their preferences constantly, the algorithm should handle the nonstationarity.
arXiv Detail & Related papers (2021-10-12T08:07:46Z) - Double Coverage with Machine-Learned Advice [100.23487145400833]
We study the fundamental online $k$-server problem in a learning-augmented setting.
We show that our algorithm achieves for any k an almost optimal consistency-robustness tradeoff.
arXiv Detail & Related papers (2021-03-02T11:04:33Z) - Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking
Fairness and Algorithm Utility [54.179859639868646]
Bipartite ranking aims to learn a scoring function that ranks positive individuals higher than negative ones from labeled data.
There have been rising concerns on whether the learned scoring function can cause systematic disparity across different protected groups.
We propose a model post-processing framework for balancing them in the bipartite ranking scenario.
arXiv Detail & Related papers (2020-06-15T10:08:39Z) - Controlling Fairness and Bias in Dynamic Learning-to-Rank [31.41843594914603]
We propose a learning algorithm that ensures notions of amortized group fairness, while simultaneously learning the ranking function from implicit feedback data.
The algorithm takes the form of a controller that integrates unbiased estimators for both fairness and utility.
In addition to its rigorous theoretical foundation and convergence guarantees, we find empirically that the algorithm is highly practical and robust.
arXiv Detail & Related papers (2020-05-29T17:57:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.