Diverse Perspectives Can Mitigate Political Bias in Crowdsourced Content Moderation

• URL: http://arxiv.org/abs/2305.14500v1
• Date: Tue, 23 May 2023 20:10:43 GMT
• Title: Diverse Perspectives Can Mitigate Political Bias in Crowdsourced Content Moderation
• Authors: Jacob Thebault-Spieker, Sukrit Venkatagiri, Naomi Mine, Kurt Luther
• Abstract summary: Social media companies have grappled with defining and enforcing content moderation policies surrounding political content on their platforms. It is unclear how well human labelers perform at this task, or whether biases affect this process. We experimentally evaluate the feasibility and practicality of using crowd workers to identify political content.
• Score: 5.470971742987594
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In recent years, social media companies have grappled with defining and enforcing content moderation policies surrounding political content on their platforms, due in part to concerns about political bias, disinformation, and polarization. These policies have taken many forms, including disallowing political advertising, limiting the reach of political topics, fact-checking political claims, and enabling users to hide political content altogether. However, implementing these policies requires human judgement to label political content, and it is unclear how well human labelers perform at this task, or whether biases affect this process. Therefore, in this study we experimentally evaluate the feasibility and practicality of using crowd workers to identify political content, and we uncover biases that make it difficult to identify this content. Our results problematize crowds composed of seemingly interchangeable workers, and provide preliminary evidence that aggregating judgements from heterogeneous workers may help mitigate political biases. In light of these findings, we identify strategies to achieving fairer labeling outcomes, while also better supporting crowd workers at this task and potentially mitigating biases.

Related papers

• On the Use of Proxies in Political Ad Targeting [49.61009579554272]
  We show that major political advertisers circumvented mitigations by targeting proxy attributes. Our findings have crucial implications for the ongoing discussion on the regulation of political advertising.
  arXiv  Detail & Related papers  (2024-10-18T17:15:13Z)
• Measuring Political Bias in Large Language Models: What Is Said and How It Is Said [46.1845409187583]
  We propose to measure political bias in LLMs by analyzing both the content and style of their generated content regarding political issues. Our proposed measure looks at different political issues such as reproductive rights and climate change, at both the content (the substance of the generation) and the style (the lexical polarity) of such bias.
  arXiv  Detail & Related papers  (2024-03-27T18:22:48Z)
• Whose Side Are You On? Investigating the Political Stance of Large Language Models [56.883423489203786]
  We investigate the political orientation of Large Language Models (LLMs) across a spectrum of eight polarizing topics. Our investigation delves into the political alignment of LLMs across a spectrum of eight polarizing topics, spanning from abortion to LGBTQ issues. The findings suggest that users should be mindful when crafting queries, and exercise caution in selecting neutral prompt language.
  arXiv  Detail & Related papers  (2024-03-15T04:02:24Z)
• Generalizing Political Leaning Inference to Multi-Party Systems: Insights from the UK Political Landscape [10.798766768721741]
  An ability to infer the political leaning of social media users can help in gathering opinion polls. We release a dataset comprising users labelled by their political leaning as well as interactions with one another. We show that interactions in the form of retweets between users can be a very powerful feature to enable political leaning inference.
  arXiv  Detail & Related papers  (2023-12-04T09:02:17Z)
• Inducing Political Bias Allows Language Models Anticipate Partisan Reactions to Controversies [5.958974943807783]
  This study addresses the challenge of understanding political bias in digitized discourse using Large Language Models (LLMs) We present a comprehensive analytical framework, consisting of Partisan Bias Divergence Assessment and Partisan Class Tendency Prediction. Our findings reveal the model's effectiveness in capturing emotional and moral nuances, albeit with some challenges in stance detection.
  arXiv  Detail & Related papers  (2023-11-16T08:57:53Z)
• Quantitative Analysis of Forecasting Models:In the Aspect of Online Political Bias [0.0]
  We propose a approach to classify social media posts into five distinct political leaning categories. Our approach involves utilizing existing time series forecasting models on two social media datasets with different political ideologies.
  arXiv  Detail & Related papers  (2023-09-11T16:17:24Z)
• Changes in Policy Preferences in German Tweets during the COVID Pandemic [4.663960015139793]
  We present a novel data set of tweets with fine grained political preference annotations. A text classification model trained on this data is used to extract political opinions. Results indicate that in response to the COVID pandemic, expression of political opinions increased.
  arXiv  Detail & Related papers  (2023-07-31T16:07:28Z)
• Millions of Co-purchases and Reviews Reveal the Spread of Polarization and Lifestyle Politics across Online Markets [68.8204255655161]
  We study the pervasiveness of polarization and lifestyle politics over different product segments in a diverse market. We sample 234.6 million relations among 21.8 million market entities to find product categories that are politically relevant, aligned, and polarized. Cultural products are 4 times more polarized than any other segment.
  arXiv  Detail & Related papers  (2022-01-17T18:16:37Z)
• Reaching the bubble may not be enough: news media role in online political polarization [58.720142291102135]
  A way of reducing polarization would be by distributing cross-partisan news among individuals with distinct political orientations. This study investigates whether this holds in the context of nationwide elections in Brazil and Canada.
  arXiv  Detail & Related papers  (2021-09-18T11:34:04Z)
• Political Posters Identification with Appearance-Text Fusion [49.55696202606098]
  We propose a method that efficiently utilizes appearance features and text vectors to accurately classify political posters. The majority of this work focuses on political posters that are designed to serve as a promotion of a certain political event.
  arXiv  Detail & Related papers  (2020-12-19T16:14:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.