Demystifying Misconceptions in Social Bots Research
- URL: http://arxiv.org/abs/2303.17251v2
- Date: Wed, 27 Mar 2024 14:48:48 GMT
- Title: Demystifying Misconceptions in Social Bots Research
- Authors: Stefano Cresci, Kai-Cheng Yang, Angelo Spognardi, Roberto Di Pietro, Filippo Menczer, Marinella Petrocchi,
- Abstract summary: Research on social bots aims at advancing knowledge and providing solutions to one of the most debated forms of online manipulation.
Yet, social bot research is plagued by widespread biases, hyped results, and misconceptions.
This article bolsters such effort by identifying and refuting common fallacious arguments used by both proponents and opponents of social bots research.
- Score: 8.179104445430136
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Research on social bots aims at advancing knowledge and providing solutions to one of the most debated forms of online manipulation. Yet, social bot research is plagued by widespread biases, hyped results, and misconceptions that set the stage for ambiguities, unrealistic expectations, and seemingly irreconcilable findings. Overcoming such issues is instrumental towards ensuring reliable solutions and reaffirming the validity of the scientific method. In this contribution, we review some recent results in social bots research, highlighting and revising factual errors as well as methodological and conceptual biases. More importantly, we demystify common misconceptions, addressing fundamental points on how social bots research is discussed. Our analysis surfaces the need to discuss research about online disinformation and manipulation in a rigorous, unbiased, and responsible way. This article bolsters such effort by identifying and refuting common fallacious arguments used by both proponents and opponents of social bots research, as well as providing directions toward sound methodologies for future research in the field.
Related papers
- Public Discourse Sandbox: Facilitating Human and AI Digital Communication Research [0.26249027950824505]
We introduce the Public Discourse Sandbox (PDS), which serves as a digital discourse research platform for human-AI.<n>PDS provides a safe and secure space for research experiments that are not viable on public, commercial social media platforms.
arXiv Detail & Related papers (2025-05-27T17:46:22Z) - Tinkering Against Scaling [15.060264126253212]
We propose a "tinkering" approach that is inspired by existing works.
This method involves engaging with smaller models or components that are manageable for ordinary researchers.
We argue that tinkering is both a way of making and knowing for computational social science and a way of knowing for critical studies.
arXiv Detail & Related papers (2025-04-23T09:21:39Z) - Confirmation Bias in Generative AI Chatbots: Mechanisms, Risks, Mitigation Strategies, and Future Research Directions [0.0]
The article analyzes the mechanisms by which confirmation bias may manifest in generative AI chatbots.
It assesses the ethical and practical risks associated with such bias, and proposes a range of mitigation strategies.
The article concludes by emphasizing the need for interdisciplinary collaboration and empirical evaluation to better understand and address confirmation bias in generative AI systems.
arXiv Detail & Related papers (2025-04-12T21:08:36Z) - Social Genome: Grounded Social Reasoning Abilities of Multimodal Models [61.88413918026431]
Social reasoning abilities are crucial for AI systems to interpret and respond to multimodal human communication and interaction within social contexts.<n>We introduce SOCIAL GENOME, the first benchmark for fine-grained, grounded social reasoning abilities of multimodal models.
arXiv Detail & Related papers (2025-02-21T00:05:40Z) - Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently.
Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
arXiv Detail & Related papers (2025-02-07T18:26:45Z) - Intervention strategies for misinformation sharing on social media: A bibliometric analysis [1.8020166013859684]
Inaccurate shared information causes confusion, can adversely affect mental health, and can lead to mis-informed decision-making.
This study explores the typology of intervention strategies for addressing misinformation sharing on social media.
It identifies 4 important clusters - cognition-based, automated-based, information-based, and hybrid-based.
arXiv Detail & Related papers (2024-09-26T08:38:15Z) - A Survey of Stance Detection on Social Media: New Directions and Perspectives [50.27382951812502]
stance detection has emerged as a crucial subfield within affective computing.
Recent years have seen a surge of research interest in developing effective stance detection methods.
This paper provides a comprehensive survey of stance detection techniques on social media.
arXiv Detail & Related papers (2024-09-24T03:06:25Z) - Flood of Techniques and Drought of Theories: Emotion Mining in Disasters [5.392688959066589]
Emotion mining has become a crucial tool for understanding human emotions during disasters.
This paper aims to summarize existing research on emotion mining within disaster contexts.
We aim to enhance the effectiveness and reliability of emotion mining methodologies.
arXiv Detail & Related papers (2024-07-07T00:43:05Z) - The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning [70.16523526957162]
Understanding commonsense causality helps people understand the principles of the real world better.
Despite its significance, a systematic exploration of this topic is notably lacking.
Our work aims to provide a systematic overview, update scholars on recent advancements, and provide a pragmatic guide for beginners.
arXiv Detail & Related papers (2024-06-27T16:30:50Z) - Missci: Reconstructing Fallacies in Misrepresented Science [84.32990746227385]
Health-related misinformation on social networks can lead to poor decision-making and real-world dangers.
Missci is a novel argumentation theoretical model for fallacious reasoning.
We present Missci as a dataset to test the critical reasoning abilities of large language models.
arXiv Detail & Related papers (2024-06-05T12:11:10Z) - Adversarial Botometer: Adversarial Analysis for Social Bot Detection [1.9280536006736573]
Social bots produce content that mimics human creativity.
Malicious social bots emerge to deceive people with their unrealistic content.
We evaluate the behavior of a text-based bot detector in a competitive environment.
arXiv Detail & Related papers (2024-05-03T11:28:21Z) - Virtual Harassment, Real Understanding: Using a Serious Game and
Bayesian Networks to Study Cyberbullying [0.9246281666115259]
This study explores an innovative approach, employing a serious game as a non-intrusive tool for data collection and education.
Preliminary pilot studies with the serious game show promising results, surpassing the informative capacity of traditional demographic and psychological questionnaires.
arXiv Detail & Related papers (2023-09-15T14:30:28Z) - False Information, Bots and Malicious Campaigns: Demystifying Elements
of Social Media Manipulations [6.901078062583646]
False information and persistent manipulation attacks on online social networks (OSNs) have affected the openness of OSNs.
This paper synthesizes insights from various disciplines to provide a comprehensive analysis of the manipulation landscape.
arXiv Detail & Related papers (2023-08-24T01:37:33Z) - The Age of Synthetic Realities: Challenges and Opportunities [85.058932103181]
We highlight the crucial need for the development of forensic techniques capable of identifying harmful synthetic creations and distinguishing them from reality.
Our focus extends to various forms of media, such as images, videos, audio, and text, as we examine how synthetic realities are crafted and explore approaches to detecting these malicious creations.
This study is of paramount importance due to the rapid progress of AI generative techniques and their impact on the fundamental principles of Forensic Science.
arXiv Detail & Related papers (2023-06-09T15:55:10Z) - Solving NLP Problems through Human-System Collaboration: A
Discussion-based Approach [98.13835740351932]
This research aims to create a dataset and computational framework for systems that discuss and refine their predictions through dialogue.
We show that the proposed system can have beneficial discussions with humans improving the accuracy by up to 25 points in the natural language inference task.
arXiv Detail & Related papers (2023-05-19T16:24:50Z) - Aggression and "hate speech" in communication of media users: analysis
of control capabilities [50.591267188664666]
Authors studied the possibilities of mutual influence of users in new media.
They found a high level of aggression and hate speech when discussing an urgent social problem - measures for COVID-19 fighting.
Results can be useful for developing media content in a modern digital environment.
arXiv Detail & Related papers (2022-08-25T15:53:32Z) - Empirical Estimates on Hand Manipulation are Recoverable: A Step Towards
Individualized and Explainable Robotic Support in Everyday Activities [80.37857025201036]
Key challenge for robotic systems is to figure out the behavior of another agent.
Processing correct inferences is especially challenging when (confounding) factors are not controlled experimentally.
We propose equipping robots with the necessary tools to conduct observational studies on people.
arXiv Detail & Related papers (2022-01-27T22:15:56Z) - Individual Explanations in Machine Learning Models: A Case Study on
Poverty Estimation [63.18666008322476]
Machine learning methods are being increasingly applied in sensitive societal contexts.
The present case study has two main objectives. First, to expose these challenges and how they affect the use of relevant and novel explanations methods.
And second, to present a set of strategies that mitigate such challenges, as faced when implementing explanation methods in a relevant application domain.
arXiv Detail & Related papers (2021-04-09T01:54:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.