A Robust Reputation-based Group Ranking System and its Resistance to
Bribery
- URL: http://arxiv.org/abs/2004.06223v2
- Date: Fri, 17 Apr 2020 14:00:45 GMT
- Title: A Robust Reputation-based Group Ranking System and its Resistance to
Bribery
- Authors: Joao Saude and Guilherme Ramos and Ludovico Boratto and Carlos Caleiro
- Abstract summary: We propose a new reputation-based ranking system, utilizing multipartite ratingworks.
We study its resistance to bribery and how to design optimal bribing strategies.
- Score: 8.300507994596416
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The spread of online reviews and opinions and its growing influence on
people's behavior and decisions, boosted the interest to extract meaningful
information from this data deluge. Hence, crowdsourced ratings of products and
services gained a critical role in business and governments. Current
state-of-the-art solutions rank the items with an average of the ratings
expressed for an item, with a consequent lack of personalization for the users,
and the exposure to attacks and spamming/spurious users. Using these ratings to
group users with similar preferences might be useful to present users with
items that reflect their preferences and overcome those vulnerabilities. In
this paper, we propose a new reputation-based ranking system, utilizing
multipartite rating subnetworks, which clusters users by their similarities
using three measures, two of them based on Kolmogorov complexity. We also study
its resistance to bribery and how to design optimal bribing strategies. Our
system is novel in that it reflects the diversity of preferences by (possibly)
assigning distinct rankings to the same item, for different groups of users. We
prove the convergence and efficiency of the system. By testing it on synthetic
and real data, we see that it copes better with spamming/spurious users, being
more robust to attacks than state-of-the-art approaches. Also, by clustering
users, the effect of bribery in the proposed multipartite ranking system is
dimmed, comparing to the bipartite case.
Related papers
- System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes [80.97898201876592]
We propose a generative model in which past content interactions impact the arrival rates of users based on a self-exciting Hawkes process.
We show analytically that given samples it is possible to disentangle System-1 and System-2 and allow content optimization based on user utility.
arXiv Detail & Related papers (2024-05-29T18:19:37Z) - Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback.
The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied.
We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
arXiv Detail & Related papers (2024-04-19T16:45:50Z) - Preference Poisoning Attacks on Reward Model Learning [49.806139447922526]
We show how an attacker can flip a small subset of preference comparisons with the goal of either promoting or demoting a target outcome.
We find that the best attacks are often highly successful, achieving in the most extreme case 100% success rate with only 0.3% of the data poisoned.
We also show that several state-of-the-art defenses against other classes of poisoning attacks exhibit, at best, limited efficacy in our setting.
arXiv Detail & Related papers (2024-02-02T21:45:24Z) - The Impact of Recommendation Systems on Opinion Dynamics: Microscopic
versus Macroscopic Effects [1.4180331276028664]
We study the impact of recommendation systems on users, both from a microscopic (i.e., at the level of individual users) and a macroscopic perspective.
Our analysis reveals that shifts in the opinions of individual users do not always align with shifts in the opinion distribution of the population.
arXiv Detail & Related papers (2023-09-16T11:44:51Z) - Graph Exploration Matters: Improving both individual-level and
system-level diversity in WeChat Feed Recommender [21.0013026365164]
Individual-level diversity and system-level diversity are both important for industrial recommender systems.
We implement and deploy the combined system in WeChat App's Top Stories used by hundreds of millions of users.
arXiv Detail & Related papers (2023-05-29T19:25:32Z) - Simpson's Paradox in Recommender Fairness: Reconciling differences
between per-user and aggregated evaluations [16.053419956606557]
We argue that two notions of fairness in ranking and recommender systems can lead to opposite conclusions.
We reconcile these notions and show that the tension is due to differences in distributions of users where items are relevant.
Based on this new understanding, practitioners might be interested in either notions, but might face challenges with the per-user metric.
arXiv Detail & Related papers (2022-10-14T12:43:32Z) - Recommendation Systems with Distribution-Free Reliability Guarantees [83.80644194980042]
We show how to return a set of items rigorously guaranteed to contain mostly good items.
Our procedure endows any ranking model with rigorous finite-sample control of the false discovery rate.
We evaluate our methods on the Yahoo! Learning to Rank and MSMarco datasets.
arXiv Detail & Related papers (2022-07-04T17:49:25Z) - Tensor-based Collaborative Filtering With Smooth Ratings Scale [0.0]
We introduce the ratings' similarity matrix which represents the dependency between different values of ratings on the population level.
It is possible to improve the quality of proposed recommendations by off-setting the effect of either shifted down or shifted up users' rates.
arXiv Detail & Related papers (2022-05-10T17:55:25Z) - Joint Multisided Exposure Fairness for Recommendation [76.75990595228666]
This paper formalizes a family of exposure fairness metrics that model the problem jointly from the perspective of both the consumers and producers.
Specifically, we consider group attributes for both types of stakeholders to identify and mitigate fairness concerns that go beyond individual users and items towards more systemic biases in recommendation.
arXiv Detail & Related papers (2022-04-29T19:13:23Z) - Causal Disentanglement with Network Information for Debiased
Recommendations [34.698181166037564]
Recent research proposes to debias by modeling a recommender system from a causal perspective.
The critical challenge in this setting is accounting for the hidden confounders.
We propose to leverage network information (i.e., user-social and user-item networks) to better approximate hidden confounders.
arXiv Detail & Related papers (2022-04-14T20:55:11Z) - Partial Bandit and Semi-Bandit: Making the Most Out of Scarce Users'
Feedback [62.997667081978825]
We present a novel approach for considering user feedback and evaluate it using three distinct strategies.
Despite a limited number of feedbacks returned by users (as low as 20% of the total), our approach obtains similar results to those of state of the art approaches.
arXiv Detail & Related papers (2020-09-16T07:32:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.