We Can Detect Your Bias: Predicting the Political Ideology of News Articles

• URL: http://arxiv.org/abs/2010.05338v1
• Date: Sun, 11 Oct 2020 20:27:55 GMT
• Title: We Can Detect Your Bias: Predicting the Political Ideology of News Articles
• Authors: Ramy Baly, Giovanni Da San Martino, James Glass and Preslav Nakov
• Abstract summary: We release a dataset of 34,737 articles that were manually annotated for political ideology. We use a challenging experimental setup where the test examples come from media that were not seen during training. Our experimental results show very sizable improvements over using state-of-the-art pre-trained Transformers.
• Score: 35.761722515882646
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We explore the task of predicting the leading political ideology or bias of news articles. First, we collect and release a large dataset of 34,737 articles that were manually annotated for political ideology -left, center, or right-, which is well-balanced across both topics and media. We further use a challenging experimental setup where the test examples come from media that were not seen during training, which prevents the model from learning to detect the source of the target news article instead of predicting its political ideology. From a modeling perspective, we propose an adversarial media adaptation, as well as a specially adapted triplet loss. We further add background information about the source, and we show that it is quite helpful for improving article-level prediction. Our experimental results show very sizable improvements over using state-of-the-art pre-trained Transformers in this challenging setup.

Related papers

• Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions [0.7249731529275342]
  We propose an extension to a recently presented news media reliability estimation method. We assess the classification performance of four reinforcement learning strategies on a large news media hyperlink graph. Our experiments, targeting two challenging bias descriptors, factual reporting and political bias, showed a significant performance improvement at the source media level.
  arXiv  Detail & Related papers  (2024-10-23T08:18:26Z)
• P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models [57.571395694391654]
  We find that existing approaches alter the political opinions and stances of news articles in more than 50% of summaries. We propose P3SUM, a diffusion model-based summarization approach controlled by political perspective classifiers. Experiments on three news summarization datasets demonstrate that P3SUM outperforms state-of-the-art summarization systems.
  arXiv  Detail & Related papers  (2023-11-16T10:14:28Z)
• Learning Unbiased News Article Representations: A Knowledge-Infused Approach [0.0]
  We propose a knowledge-infused deep learning model that learns unbiased representations of news articles using global and local contexts. We show that the proposed model mitigates algorithmic political bias and outperforms baseline methods to predict the political leaning of news articles with up to 73% accuracy.
  arXiv  Detail & Related papers  (2023-09-12T06:20:34Z)
• Towards Corpus-Scale Discovery of Selection Biases in News Coverage: Comparing What Sources Say About Entities as a Start [65.28355014154549]
  This paper investigates the challenges of building scalable NLP systems for discovering patterns of media selection biases directly from news content in massive-scale news corpora. We show the capabilities of the framework through a case study on NELA-2020, a corpus of 1.8M news articles in English from 519 news sources worldwide.
  arXiv  Detail & Related papers  (2023-04-06T23:36:45Z)
• Computational Assessment of Hyperpartisanship in News Titles [55.92100606666497]
  We first adopt a human-guided machine learning framework to develop a new dataset for hyperpartisan news title detection. Overall the Right media tends to use proportionally more hyperpartisan titles. We identify three major topics including foreign issues, political systems, and societal issues that are suggestive of hyperpartisanship in news titles.
  arXiv  Detail & Related papers  (2023-01-16T05:56:58Z)
• Unveiling the Hidden Agenda: Biases in News Reporting and Consumption [59.55900146668931]
  We build a six-year dataset on the Italian vaccine debate and adopt a Bayesian latent space model to identify narrative and selection biases. We found a nonlinear relationship between biases and engagement, with higher engagement for extreme positions. Analysis of news consumption on Twitter reveals common audiences among news outlets with similar ideological positions.
  arXiv  Detail & Related papers  (2023-01-14T18:58:42Z)
• NeuS: Neutral Multi-News Summarization for Mitigating Framing Bias [54.89737992911079]
  We propose a new task, a neutral summary generation from multiple news headlines of the varying political spectrum. One of the most interesting observations is that generation models can hallucinate not only factually inaccurate or unverifiable content, but also politically biased content.
  arXiv  Detail & Related papers  (2022-04-11T07:06:01Z)
• A Machine Learning Pipeline to Examine Political Bias with Congressional Speeches [0.3062386594262859]
  We give machine learning approaches to study political bias in two ideologically diverse social media forums: Gab and Twitter. Our proposed methods exploit the use of transcripts collected from political speeches in US congress to label the data. We also present a machine learning approach that combines features from cascades and text to forecast cascade's political bias with an accuracy of about 85%.
  arXiv  Detail & Related papers  (2021-09-18T21:15:21Z)
• Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity [35.19976910093135]
  The research presented in this paper addresses not only the automatic detection of bias but goes one step further in that it explores how political bias and unfairness are manifested linguistically. We utilize a new corpus of 6964 news articles with labels derived from adfontesmedia.com and develop a neural model for bias assessment.
  arXiv  Detail & Related papers  (2020-10-20T22:25:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.