Quo Vadis, HCOMP? A Review of 12 Years of Research at the Frontier of Human Computation and Crowdsourcing

• URL: http://arxiv.org/abs/2504.01352v1
• Date: Wed, 02 Apr 2025 04:51:57 GMT
• Title: Quo Vadis, HCOMP? A Review of 12 Years of Research at the Frontier of Human Computation and Crowdsourcing
• Authors: Jonas Oppenlaender, Ujwal Gadiraju, Simo Hosio,
• Abstract summary: Human computation and crowdsourcing has historically studied how tasks can be outsourced to humans.<n>Many tasks previously distributed to human crowds can today be completed by generative AI with human-level abilities.<n>Concerns about crowdworkers increasingly using language models to complete tasks are surfacing.
• Score: 16.23020356323425
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The field of human computation and crowdsourcing has historically studied how tasks can be outsourced to humans. However, many tasks previously distributed to human crowds can today be completed by generative AI with human-level abilities, and concerns about crowdworkers increasingly using language models to complete tasks are surfacing. These developments undermine core premises of the field. In this paper, we examine the evolution of the Conference on Human Computation and Crowdsourcing (HCOMP) - a representative example of the field as one of its key venues - through the lens of Kuhn's paradigm shifts. We review 12 years of research at HCOMP, mapping the evolution of HCOMP's research topics and identifying significant shifts over time. Reflecting on the findings through the lens of Kuhn's paradigm shifts, we suggest that these shifts do not constitute a paradigm shift. Ultimately, our analysis of gradual topic shifts over time, combined with data on the evident overlap with related venues, contributes a data-driven perspective to the broader discussion about the future of HCOMP and the field as a whole.

Related papers

• Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries [91.70689724416698]
  We present Quriosity, a collection of 13.5K naturally occurring questions from three diverse sources. Our analysis reveals a significant presence of causal questions (up to 42%) in the dataset.
  arXiv  Detail & Related papers  (2024-05-30T17:55:28Z)
• A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond [84.95530356322621]
  This survey presents a systematic review of the advancements in code intelligence.<n>It covers over 50 representative models and their variants, more than 20 categories of tasks, and an extensive coverage of over 680 related works.<n>Building on our examination of the developmental trajectories, we further investigate the emerging synergies between code intelligence and broader machine intelligence.
  arXiv  Detail & Related papers  (2024-03-21T08:54:56Z)
• Data Augmentation in Human-Centric Vision [54.97327269866757]
  This survey presents a comprehensive analysis of data augmentation techniques in human-centric vision tasks. It delves into a wide range of research areas including person ReID, human parsing, human pose estimation, and pedestrian detection. Our work categorizes data augmentation methods into two main types: data generation and data perturbation.
  arXiv  Detail & Related papers  (2024-03-13T16:05:18Z)
• Digitality as a "longue dur\`ee" historical phenomenon [0.0]
  Digital History traces its roots to Babbage and Lovelace's 19th-century work on "coding" This field situates Digital History within a broader historical context. The extent to which computation and Turing machines can fully understand and interpret history remains a subject of debate.
  arXiv  Detail & Related papers  (2024-03-06T17:18:37Z)
• Can AI Serve as a Substitute for Human Subjects in Software Engineering Research? [24.39463126056733]
  This vision paper proposes a novel approach to qualitative data collection in software engineering research by harnessing the capabilities of artificial intelligence (AI) We explore the potential of AI-generated synthetic text as an alternative source of qualitative data. We discuss the prospective development of new foundation models aimed at emulating human behavior in observational studies and user evaluations.
  arXiv  Detail & Related papers  (2023-11-18T14:05:52Z)
• Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling [73.14508303965683]
  We interviewed eighteen data workers from both industry and academia to learn where and how they would like to collaborate with AI. Surprisingly, though the participants showed excitement about collaborating with AI, many of them also expressed reluctance and pointed out nuanced reasons.
  arXiv  Detail & Related papers  (2023-04-17T15:30:05Z)
• Deep Learning Technique for Human Parsing: A Survey and Outlook [5.236995853909988]
  In this survey, we comprehensively review three core sub-tasks: single human parsing, multiple human parsing, and video human parsing. We put forward a transformer-based human parsing framework, providing a high-performance baseline for follow-up research. We point out a set of under-investigated open issues in this field and suggest new directions for future study.
  arXiv  Detail & Related papers  (2023-01-01T12:39:57Z)
• ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering [70.6359636116848]
  We propose a new large-scale dataset, ConvFinQA, to study the chain of numerical reasoning in conversational question answering. Our dataset poses great challenge in modeling long-range, complex numerical reasoning paths in real-world conversations.
  arXiv  Detail & Related papers  (2022-10-07T23:48:50Z)
• Coordinated Science Laboratory 70th Anniversary Symposium: The Future of Computing [80.72844751804166]
  In 2021, the Coordinated Science Laboratory CSL hosted the Future of Computing Symposium to celebrate its 70th anniversary. We summarize the major technological points, insights, and directions that speakers brought forward during the symposium. Participants discussed topics related to new computing paradigms, technologies, algorithms, behaviors, and research challenges to be expected in the future.
  arXiv  Detail & Related papers  (2022-10-04T17:32:27Z)
• Human's Role in-the-Loop [15.759742984491412]
  This blog discusses the respective roles of humans and machines in achieving cognitive tasks in matching. It aims to determine whether traditional roles of humans and machines are subject to change. Two possible modes of change, namely humans out and humans in, will be discussed.
  arXiv  Detail & Related papers  (2022-04-27T13:11:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.