On the Design of Strategic Task Recommendations for Sustainable Crowdsourcing-Based Content Moderation

• URL: http://arxiv.org/abs/2106.02708v1
• Date: Fri, 4 Jun 2021 20:35:14 GMT
• Title: On the Design of Strategic Task Recommendations for Sustainable Crowdsourcing-Based Content Moderation
• Authors: Sainath Sanga and Venkata Sriram Siddhardh Nadendla
• Abstract summary: Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers. Current state-of-the-art recommendation systems disregard the effects on worker's mental health. We propose a novel, strategic recommendation system for the crowdsourcing platform that recommends jobs based on worker's mental status.
• Score: 1.8275108630751837
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers to review user submissions (e.g. text, images and videos) and make decisions regarding the admissibility of the posted content, along with a gamut of other tasks such as image labeling and speech-to-text conversion. In an attempt to reduce cognitive overload at the workers and improve system efficiency, these platforms offer personalized task recommendations according to the worker's preferences. However, the current state-of-the-art recommendation systems disregard the effects on worker's mental health, especially when they are repeatedly exposed to content moderation tasks with extreme content (e.g. violent images, hate-speech). In this paper, we propose a novel, strategic recommendation system for the crowdsourcing platform that recommends jobs based on worker's mental status. Specifically, this paper models interaction between the crowdsourcing platform's recommendation system (leader) and the worker (follower) as a Bayesian Stackelberg game where the type of the follower corresponds to the worker's cognitive atrophy rate and task preferences. We discuss how rewards and costs should be designed to steer the game towards desired outcomes in terms of maximizing the platform's productivity, while simultaneously improving the working conditions of crowd workers.

Related papers

• Bypassing the Popularity Bias: Repurposing Models for Better Long-Tail Recommendation [0.0]
  We aim to achieve a more equitable distribution of exposure among publishers on an online content platform. We propose a novel approach of repurposing existing components of an industrial recommender system to deliver valuable exposure to underrepresented publishers.
  arXiv  Detail & Related papers  (2024-09-17T15:40:55Z)
• Rideshare Transparency: Translating Gig Worker Insights on AI Platform Design to Policy [8.936861276568006]
  We characterize transparency-related harms, mitigation strategies, and worker needs. Our findings expose a transparency gap between existing platform designs and the information drivers need. New regulations that require platforms to publish public transparency reports may be a more effective solution to improve worker well-being.
  arXiv  Detail & Related papers  (2024-06-16T00:46:49Z)
• REBEL: A Regularization-Based Solution for Reward Overoptimization in Robotic Reinforcement Learning from Human Feedback [61.54791065013767]
  A misalignment between the reward function and user intentions, values, or social norms can be catastrophic in the real world. Current methods to mitigate this misalignment work by learning reward functions from human preferences. We propose a novel concept of reward regularization within the robotic RLHF framework.
  arXiv  Detail & Related papers  (2023-12-22T04:56:37Z)
• Incentivizing High-Quality Content in Online Recommender Systems [80.19930280144123]
  We study the game between producers and analyze the content created at equilibrium. We show that standard online learning algorithms, such as Hedge and EXP3, unfortunately incentivize producers to create low-quality content.
  arXiv  Detail & Related papers  (2023-06-13T00:55:10Z)
• Online Learning in a Creator Economy [91.55437924091844]
  We study the creator economy as a three-party game between the users, platform, and content creators. We analyze two families of contracts: return-based contracts and feature-based contracts. We show that under smoothness assumptions, the joint optimization of return-based contracts and recommendation policy provides a regret.
  arXiv  Detail & Related papers  (2023-05-19T01:58:13Z)
• Can you recommend content to creatives instead of final consumers? A RecSys based on user's preferred visual styles [69.69160476215895]
  This report is an extension of the paper "Learning Users' Preferred Visual Styles in an Image Marketplace", presented at ACM RecSys '22. We design a RecSys that learns visual styles preferences to the semantics of the projects users work on.
  arXiv  Detail & Related papers  (2022-08-23T12:11:28Z)
• Two-Stage Neural Contextual Bandits for Personalised News Recommendation [50.3750507789989]
  Existing personalised news recommendation methods focus on exploiting user interests and ignores exploration in recommendation. We build on contextual bandits recommendation strategies which naturally address the exploitation-exploration trade-off. We use deep learning representations for users and news, and generalise the neural upper confidence bound (UCB) policies to generalised additive UCB and bilinear UCB.
  arXiv  Detail & Related papers  (2022-06-26T12:07:56Z)
• Treating Crowdsourcing as Examination: How to Score Tasks and Online Workers? [7.403065976821757]
  We try to model workers as four types based on their ability: expert, normal worker, sloppy worker and spammer. We score workers' ability mainly on the medium difficult tasks, then reducing the weight of answers from sloppy workers and modifying the answers from spammers.
  arXiv  Detail & Related papers  (2022-04-26T05:15:58Z)
• Crowdsourcing with Meta-Workers: A New Way to Save the Budget [50.04836252733443]
  We introduce the concept of emphmeta-worker, a machine annotator trained by meta learning for types of tasks that are well-fit for AI. Unlike regular crowd workers, meta-workers can be reliable, stable, and more importantly, tireless and free.
  arXiv  Detail & Related papers  (2021-11-07T12:40:29Z)
• Random Walks with Erasure: Diversifying Personalized Recommendations on Social and Information Networks [4.007832851105161]
  We develop a novel recommendation framework with a goal of improving information diversity using a modified random walk exploration of the user-item graph. For recommending political content on social networks, we first propose a new model to estimate the ideological positions for both users and the content they share. Based on these estimated positions, we generate diversified personalized recommendations using our new random-walk based recommendation algorithm.
  arXiv  Detail & Related papers  (2021-02-18T21:53:32Z)
• Incentivising Exploration and Recommendations for Contextual Bandits with Payments [2.5966580648312223]
  We show how the platform can learn the inherent attributes of items and achieve a sublinear regret while maximizing cumulative social welfare. Our approach can improve various engagement metrics of users on e-commerce stores, recommendation engines and matching platforms.
  arXiv  Detail & Related papers  (2020-01-22T02:26:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.