CoSINT: Designing a Collaborative Capture the Flag Competition to Investigate Misinformation

• URL: http://arxiv.org/abs/2305.12357v1
• Date: Sun, 21 May 2023 05:35:48 GMT
• Title: CoSINT: Designing a Collaborative Capture the Flag Competition to Investigate Misinformation
• Authors: Sukrit Venkatagiri, Anirban Mukhopadhyay, David Hicks, Aaron Brantly, Kurt Luther
• Abstract summary: We design and evaluate a novel interaction style called collaborative capture the flag competitions (CoCTFs) We instantiated this interaction style through CoSINT, a platform that enables a trained crowd to work with professional investigators to identify and investigate social media misinformation. Our mixed-methods evaluation showed that CoSINT leverages the complementary strengths of competition and collaboration, allowing a crowd to quickly identify and debunk misinformation.
• Score: 5.231385219673095
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Crowdsourced investigations shore up democratic institutions by debunking misinformation and uncovering human rights abuses. However, current crowdsourcing approaches rely on simplistic collaborative or competitive models and lack technological support, limiting their collective impact. Prior research has shown that blending elements of competition and collaboration can lead to greater performance and creativity, but crowdsourced investigations pose unique analytical and ethical challenges. In this paper, we employed a four-month-long Research through Design process to design and evaluate a novel interaction style called collaborative capture the flag competitions (CoCTFs). We instantiated this interaction style through CoSINT, a platform that enables a trained crowd to work with professional investigators to identify and investigate social media misinformation. Our mixed-methods evaluation showed that CoSINT leverages the complementary strengths of competition and collaboration, allowing a crowd to quickly identify and debunk misinformation. We also highlight tensions between competition versus collaboration and discuss implications for the design of crowdsourced investigations.

Related papers

• NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA [49.74911193222192]
  The competition introduced a dataset of real invoice documents, along with associated questions and answers. The base model is a multi-modal generative language model, and sensitive information could be exposed through either the visual or textual input modality. Participants proposed elegant solutions to reduce communication costs while maintaining a minimum utility threshold.
  arXiv  Detail & Related papers  (2024-11-06T07:51:19Z)
• Collaborative Team Recognition: A Core Plus Extension Structure [10.842779758836219]
  This study focuses on recognizing collaborative teams and exploring inner patterns using scholarly big graph data. We propose a collaborative team recognition model with a "core + extension" team structure to recognize collaborative teams in large academic networks.
  arXiv  Detail & Related papers  (2024-06-07T07:12:35Z)
• Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Construction [10.1305370182537]
  This paper introduces a novel framework, CooperKGC, for knowledge graph construction. CooperKGC establishes a collaborative processing network, assembling a KGC collaboration team capable of concurrently addressing entity, relation, and event extraction tasks. Our experiments unequivocally demonstrate that fostering collaboration and information interaction among diverse agents within CooperKGC yields superior results compared to individual cognitive processes operating in isolation.
  arXiv  Detail & Related papers  (2023-12-05T07:27:08Z)
• Exploring Links between Conversational Agent Design Challenges and Interdisciplinary Collaboration [0.0]
  The paper focuses on the socio-technical challenges of Conversational Agents (CA) creation. It proposes a taxonomy of CA design challenges using interdisciplinary collaboration (IDC) as a lens. The paper proposes practical strategies to overcome them which complement existing design principles.
  arXiv  Detail & Related papers  (2023-11-15T10:20:49Z)
• SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data [51.42380508231581]
  The paper presents a summary of the Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data (SynFacePAD 2023) held at the 2023 International Joint Conference on Biometrics (IJCB 2023) The competition aimed to motivate and attract solutions that target detecting face presentation attacks while considering synthetic-based training data motivated by privacy, legal and ethical concerns associated with personal data. The submitted solutions presented innovations and novel approaches that led to outperforming the considered baseline in the investigated benchmarks.
  arXiv  Detail & Related papers  (2023-11-09T13:02:04Z)
• Benchmarking Robustness and Generalization in Multi-Agent Systems: A Case Study on Neural MMO [50.58083807719749]
  We present the results of the second Neural MMO challenge, hosted at IJCAI 2022, which received 1600+ submissions. This competition targets robustness and generalization in multi-agent systems. We will open-source our benchmark including the environment wrapper, baselines, a visualization tool, and selected policies for further research.
  arXiv  Detail & Related papers  (2023-08-30T07:16:11Z)
• Tackling Cooperative Incompatibility for Zero-Shot Human-AI Coordination [36.33334853998621]
  We introduce the Cooperative Open-ended LEarning (COLE) framework to solve cooperative incompatibility in learning. COLE formulates open-ended objectives in cooperative games with two players using perspectives of graph theory to evaluate and pinpoint the cooperative capacity of each strategy. We show that COLE could effectively overcome the cooperative incompatibility from theoretical and empirical analysis.
  arXiv  Detail & Related papers  (2023-06-05T16:51:38Z)
• Industry-Academia Research Collaboration in Software Engineering: The Certus Model [13.021014899410684]
  Building scalable and effective research collaborations in software engineering is known to be challenging. This paper aims to understand what are the elements of a successful industry-academia collaboration that enable the culture of participative knowledge creation.
  arXiv  Detail & Related papers  (2022-04-23T10:16:23Z)
• An Uncommon Task: Participatory Design in Legal AI [64.54460979588075]
  We examine a notable yet understudied AI design process in the legal domain that took place over a decade ago. We show how an interactive simulation methodology allowed computer scientists and lawyers to become co-designers.
  arXiv  Detail & Related papers  (2022-03-08T15:46:52Z)
• Detecting adversaries in Crowdsourcing [71.20185379303479]
  This work investigates the effects of adversaries on crowdsourced classification, under the popular Dawid and Skene model. The adversaries are allowed to deviate arbitrarily from the considered crowdsourcing model, and may potentially cooperate. We develop an approach that leverages the structure of second-order moments of annotator responses, to identify large numbers of adversaries, and mitigate their impact on the crowdsourcing task.
  arXiv  Detail & Related papers  (2021-10-07T15:07:07Z)
• On Emergent Communication in Competitive Multi-Agent Teams [116.95067289206919]
  We investigate whether competition for performance from an external, similar agent team could act as a social influence. Our results show that an external competitive influence leads to improved accuracy and generalization, as well as faster emergence of communicative languages.
  arXiv  Detail & Related papers  (2020-03-04T01:14:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.