From Zero to The Hero: A Collaborative Market Aware Recommendation System for Crowd Workers

• URL: http://arxiv.org/abs/2107.02890v1
• Date: Tue, 6 Jul 2021 21:02:36 GMT
• Title: From Zero to The Hero: A Collaborative Market Aware Recommendation System for Crowd Workers
• Authors: Hamid Shamszare, Razieh Saremi, Sanam Jena
• Abstract summary: This paper proposes a collaborative recommendation system for crowd workers. It uses five input metrics based on workers' collaboration history in the pool, workers' preferences in taking tasks in terms of monetary prize and duration, workers' specialty, and workers' proficiency. Experimental results on 260 active crowd workers demonstrate that just following the top three success probabilities of task recommendations, workers can achieve success up to 86%.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The success of software crowdsourcing depends on active and trustworthy pool of worker supply. The uncertainty of crowd workers' behaviors makes it challenging to predict workers' success and plan accordingly. In a competitive crowdsourcing marketplace, competition for success over shared tasks adds another layer of uncertainty in crowd workers' decision-making process. Preliminary analysis on software worker behaviors reveals an alarming task dropping rate of 82.9%. These factors lead to the need for an automated recommendation system for CSD workers to improve the visibility and predictability of their success in the competition. To that end, this paper proposes a collaborative recommendation system for crowd workers. The proposed recommendation system method uses five input metrics based on workers' collaboration history in the pool, workers' preferences in taking tasks in terms of monetary prize and duration, workers' specialty, and workers' proficiency. The proposed method then recommends the most suitable tasks for a worker to compete on based on workers' probability of success in the task. Experimental results on 260 active crowd workers demonstrate that just following the top three success probabilities of task recommendations, workers can achieve success up to 86%

Related papers

• Learning In Reverse Causal Strategic Environments With Ramifications on Two Sided Markets [19.183108418687226]
  We show that employers with performatively optimal hiring policies improve employer reward, labor force skill level, and in some cases labor force equity. On the other hand, we demonstrate that performative employers harm labor force utility and fail to prevent discrimination in other cases.
  arXiv  Detail & Related papers  (2024-04-20T02:42:46Z)
• Evaluating Collaborative and Autonomous Agents in Data-Stream-Supported Coordination of Mobile Crowdsourcing [0.7865191493201839]
  In mobile crowdsourcing, tasks often get assigned to crowdworkers who struggle to complete those tasks successfully. We propose different mechanisms to achieve outcome prediction and task coordination in mobile crowdsourcing.
  arXiv  Detail & Related papers  (2024-01-23T16:00:45Z)
• Optimising Human-AI Collaboration by Learning Convincing Explanations [62.81395661556852]
  We propose a method for a collaborative system that remains safe by having a human making decisions. Ardent enables efficient and effective decision-making by adapting to individual preferences for explanations.
  arXiv  Detail & Related papers  (2023-11-13T16:00:16Z)
• ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate [57.71597869337909]
  We build a multi-agent referee team called ChatEval to autonomously discuss and evaluate the quality of generated responses from different models. Our analysis shows that ChatEval transcends mere textual scoring, offering a human-mimicking evaluation process for reliable assessments.
  arXiv  Detail & Related papers  (2023-08-14T15:13:04Z)
• Provable Benefits of Policy Learning from Human Preferences in Contextual Bandit Problems [82.92678837778358]
  preference-based methods have demonstrated substantial success in empirical applications such as InstructGPT. We show how human bias and uncertainty in feedback modelings can affect the theoretical guarantees of these approaches.
  arXiv  Detail & Related papers  (2023-07-24T17:50:24Z)
• Retrospective on the 2021 BASALT Competition on Learning from Human Feedback [92.37243979045817]
  The goal of the competition was to promote research towards agents that use learning from human feedback (LfHF) techniques to solve open-world tasks. Rather than mandating the use of LfHF techniques, we described four tasks in natural language to be accomplished in the video game Minecraft. Teams developed a diverse range of LfHF algorithms across a variety of possible human feedback types.
  arXiv  Detail & Related papers  (2022-04-14T17:24:54Z)
• Crowdsourcing with Meta-Workers: A New Way to Save the Budget [50.04836252733443]
  We introduce the concept of emphmeta-worker, a machine annotator trained by meta learning for types of tasks that are well-fit for AI. Unlike regular crowd workers, meta-workers can be reliable, stable, and more importantly, tireless and free.
  arXiv  Detail & Related papers  (2021-11-07T12:40:29Z)
• On the Design of Strategic Task Recommendations for Sustainable Crowdsourcing-Based Content Moderation [1.8275108630751837]
  Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers. Current state-of-the-art recommendation systems disregard the effects on worker's mental health. We propose a novel, strategic recommendation system for the crowdsourcing platform that recommends jobs based on worker's mental status.
  arXiv  Detail & Related papers  (2021-06-04T20:35:14Z)
• An Extensive Analytical Approach on Human Resources using Random Forest Algorithm [0.0]
  Survey indicated that work life imbalances, low pay, uneven shifts and many other factors make employees think about changing their work life. This paper proposes a model with the help of a random forest algorithm by considering different employee parameters. It helps the HR department retain the employee by identifying gaps and helping the organisation to run smoothly with a good employee retention ratio.
  arXiv  Detail & Related papers  (2021-05-07T07:35:23Z)
• Study on Patterns and Effect of Task Diversity in Software Crowdsourcing [1.758684872705242]
  The objective of this study is to empirically investigate patterns and effect of task diversity in software crowdsourcing platform. The empirical study is conducted on more than one year's real-world data from TopCoder, the leading software crowdsourcing platform.
  arXiv  Detail & Related papers  (2020-05-29T02:07:33Z)
• Measuring Social Biases of Crowd Workers using Counterfactual Queries [84.10721065676913]
  Social biases based on gender, race, etc. have been shown to pollute machine learning (ML) pipeline predominantly via biased training datasets. Crowdsourcing, a popular cost-effective measure to gather labeled training datasets, is not immune to the inherent social biases of crowd workers. We propose a new method based on counterfactual fairness to quantify the degree of inherent social bias in each crowd worker.
  arXiv  Detail & Related papers  (2020-04-04T21:41:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.