Learning Unbiased News Article Representations: A Knowledge-Infused Approach

• URL: http://arxiv.org/abs/2309.05981v1
• Date: Tue, 12 Sep 2023 06:20:34 GMT
• Title: Learning Unbiased News Article Representations: A Knowledge-Infused Approach
• Authors: Sadia Kamal, Jimmy Hartford, Jeremy Willis, Arunkumar Bagavathi
• Abstract summary: We propose a knowledge-infused deep learning model that learns unbiased representations of news articles using global and local contexts. We show that the proposed model mitigates algorithmic political bias and outperforms baseline methods to predict the political leaning of news articles with up to 73% accuracy.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Quantification of the political leaning of online news articles can aid in understanding the dynamics of political ideology in social groups and measures to mitigating them. However, predicting the accurate political leaning of a news article with machine learning models is a challenging task. This is due to (i) the political ideology of a news article is defined by several factors, and (ii) the innate nature of existing learning models to be biased with the political bias of the news publisher during the model training. There is only a limited number of methods to study the political leaning of news articles which also do not consider the algorithmic political bias which lowers the generalization of machine learning models to predict the political leaning of news articles published by any new news publishers. In this work, we propose a knowledge-infused deep learning model that utilizes relatively reliable external data resources to learn unbiased representations of news articles using their global and local contexts. We evaluate the proposed model by setting the data in such a way that news domains or news publishers in the test set are completely unseen during the training phase. With this setup we show that the proposed model mitigates algorithmic political bias and outperforms baseline methods to predict the political leaning of news articles with up to 73% accuracy.

Related papers

• Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification [5.550237524713089]
  The study highlights the sensitivity of modern self-learning systems to unconstrained data ingestion. Applying both models to left-leaning (CNN) and right-leaning (FOX) news articles, we assess their effectiveness on data beyond the original training and test sets. We contrast the opaque architecture of a deep learning model with the transparency of a linguistically informed rule-based model.
  arXiv  Detail & Related papers  (2024-11-07T00:09:18Z)
• Biased AI can Influence Political Decision-Making [64.9461133083473]
  This paper presents two experiments investigating the effects of partisan bias in AI language models on political decision-making. We found that participants exposed to politically biased models were significantly more likely to adopt opinions and make decisions aligning with the AI's bias.
  arXiv  Detail & Related papers  (2024-10-08T22:56:00Z)
• Representation Bias in Political Sample Simulations with Large Language Models [54.48283690603358]
  This study seeks to identify and quantify biases in simulating political samples with Large Language Models. Using the GPT-3.5-Turbo model, we leverage data from the American National Election Studies, German Longitudinal Election Study, Zuobiao dataset, and China Family Panel Studies.
  arXiv  Detail & Related papers  (2024-07-16T05:52:26Z)
• Quantitative Analysis of Forecasting Models:In the Aspect of Online Political Bias [0.0]
  We propose a approach to classify social media posts into five distinct political leaning categories. Our approach involves utilizing existing time series forecasting models on two social media datasets with different political ideologies.
  arXiv  Detail & Related papers  (2023-09-11T16:17:24Z)
• Towards Corpus-Scale Discovery of Selection Biases in News Coverage: Comparing What Sources Say About Entities as a Start [65.28355014154549]
  This paper investigates the challenges of building scalable NLP systems for discovering patterns of media selection biases directly from news content in massive-scale news corpora. We show the capabilities of the framework through a case study on NELA-2020, a corpus of 1.8M news articles in English from 519 news sources worldwide.
  arXiv  Detail & Related papers  (2023-04-06T23:36:45Z)
• Unveiling the Hidden Agenda: Biases in News Reporting and Consumption [59.55900146668931]
  We build a six-year dataset on the Italian vaccine debate and adopt a Bayesian latent space model to identify narrative and selection biases. We found a nonlinear relationship between biases and engagement, with higher engagement for extreme positions. Analysis of news consumption on Twitter reveals common audiences among news outlets with similar ideological positions.
  arXiv  Detail & Related papers  (2023-01-14T18:58:42Z)
• NeuS: Neutral Multi-News Summarization for Mitigating Framing Bias [54.89737992911079]
  We propose a new task, a neutral summary generation from multiple news headlines of the varying political spectrum. One of the most interesting observations is that generation models can hallucinate not only factually inaccurate or unverifiable content, but also politically biased content.
  arXiv  Detail & Related papers  (2022-04-11T07:06:01Z)
• Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generation [105.20743048379387]
  We propose a novel framework for generating training examples informed by the known styles and strategies of human-authored propaganda. Specifically, we perform self-critical sequence training guided by natural language inference to ensure the validity of the generated articles. Our experimental results show that fake news detectors trained on PropaNews are better at detecting human-written disinformation by 3.62 - 7.69% F1 score on two public datasets.
  arXiv  Detail & Related papers  (2022-03-10T14:24:19Z)
• A Machine Learning Pipeline to Examine Political Bias with Congressional Speeches [0.3062386594262859]
  We give machine learning approaches to study political bias in two ideologically diverse social media forums: Gab and Twitter. Our proposed methods exploit the use of transcripts collected from political speeches in US congress to label the data. We also present a machine learning approach that combines features from cascades and text to forecast cascade's political bias with an accuracy of about 85%.
  arXiv  Detail & Related papers  (2021-09-18T21:15:21Z)
• Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity [35.19976910093135]
  The research presented in this paper addresses not only the automatic detection of bias but goes one step further in that it explores how political bias and unfairness are manifested linguistically. We utilize a new corpus of 6964 news articles with labels derived from adfontesmedia.com and develop a neural model for bias assessment.
  arXiv  Detail & Related papers  (2020-10-20T22:25:00Z)
• We Can Detect Your Bias: Predicting the Political Ideology of News Articles [35.761722515882646]
  We release a dataset of 34,737 articles that were manually annotated for political ideology. We use a challenging experimental setup where the test examples come from media that were not seen during training. Our experimental results show very sizable improvements over using state-of-the-art pre-trained Transformers.
  arXiv  Detail & Related papers  (2020-10-11T20:27:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.