Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper

• URL: http://arxiv.org/abs/2310.16269v1
• Date: Wed, 25 Oct 2023 01:01:28 GMT
• Title: Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspaper
• Authors: Cristina Espa\~na-Bonet
• Abstract summary: We use ratings of authentic news outlets to create a multilingual corpus of news with coarse stance annotations. We show that classifiers trained on this data are able to identify the editorial line of most unseen newspapers in English, German, Spanish and Catalan. We observe that, similarly to traditional newspapers, ChatGPT editorial line evolves with time and, being a data-driven system, the stance of the generated articles differs among languages.
• Score: 1.450405446885067
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Neutrality is difficult to achieve and, in politics, subjective. Traditional media typically adopt an editorial line that can be used by their potential readers as an indicator of the media bias. Several platforms currently rate news outlets according to their political bias. The editorial line and the ratings help readers in gathering a balanced view of news. But in the advent of instruction-following language models, tasks such as writing a newspaper article can be delegated to computers. Without imposing a biased persona, where would an AI-based news outlet lie within the bias ratings? In this work, we use the ratings of authentic news outlets to create a multilingual corpus of news with coarse stance annotations (Left and Right) along with automatically extracted topic annotations. We show that classifiers trained on this data are able to identify the editorial line of most unseen newspapers in English, German, Spanish and Catalan. We then apply the classifiers to 101 newspaper-like articles written by ChatGPT and Bard in the 4 languages at different time periods. We observe that, similarly to traditional newspapers, ChatGPT editorial line evolves with time and, being a data-driven system, the stance of the generated articles differs among languages.

Related papers

• Towards Corpus-Scale Discovery of Selection Biases in News Coverage: Comparing What Sources Say About Entities as a Start [65.28355014154549]
  This paper investigates the challenges of building scalable NLP systems for discovering patterns of media selection biases directly from news content in massive-scale news corpora. We show the capabilities of the framework through a case study on NELA-2020, a corpus of 1.8M news articles in English from 519 news sources worldwide.
  arXiv  Detail & Related papers  (2023-04-06T23:36:45Z)
• Computational Assessment of Hyperpartisanship in News Titles [55.92100606666497]
  We first adopt a human-guided machine learning framework to develop a new dataset for hyperpartisan news title detection. Overall the Right media tends to use proportionally more hyperpartisan titles. We identify three major topics including foreign issues, political systems, and societal issues that are suggestive of hyperpartisanship in news titles.
  arXiv  Detail & Related papers  (2023-01-16T05:56:58Z)
• Unveiling the Hidden Agenda: Biases in News Reporting and Consumption [59.55900146668931]
  We build a six-year dataset on the Italian vaccine debate and adopt a Bayesian latent space model to identify narrative and selection biases. We found a nonlinear relationship between biases and engagement, with higher engagement for extreme positions. Analysis of news consumption on Twitter reveals common audiences among news outlets with similar ideological positions.
  arXiv  Detail & Related papers  (2023-01-14T18:58:42Z)
• Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection [83.3580786484122]
  We find that newspapers from larger schools, located in wealthier, educated, and urban ZIP codes are more likely to be classified as high quality. We argue that privileging any corpus as high quality entails a language ideology.
  arXiv  Detail & Related papers  (2022-01-25T17:20:04Z)
• Machine-Learning media bias [0.0]
  Inferring which newspaper published a given article leads to a conditional probability distribution whose analysis lets us automatically map newspapers into a bias space. By analyzing roughly a million articles from roughly a hundred newspapers for bias in dozens of news topics, our method maps newspapers into a two-dimensional bias landscape that agrees well with previous bias classifications based on human judgement.
  arXiv  Detail & Related papers  (2021-08-31T18:06:32Z)
• Newsalyze: Enabling News Consumers to Understand Media Bias [7.652448987187803]
  Knowing a news article's slant and authenticity is of crucial importance in times of "fake news" We introduce Newsalyze, a bias-aware news reader focusing on a subtle, yet powerful form of media bias, named bias by word choice and labeling (WCL) WCL bias can alter the assessment of entities reported in the news, e.g., "freedom fighters" vs. "terrorists"
  arXiv  Detail & Related papers  (2021-05-20T11:20:37Z)
• Cross-Domain Learning for Classifying Propaganda in Online Contents [67.10699378370752]
  We present an approach to leverage cross-domain learning, based on labeled documents and sentences from news and tweets, as well as political speeches with a clear difference in their degrees of being propagandistic. Our experiments demonstrate the usefulness of this approach, and identify difficulties and limitations in various configurations of sources and targets for the transfer step.
  arXiv  Detail & Related papers  (2020-11-13T10:19:13Z)
• Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity [35.19976910093135]
  The research presented in this paper addresses not only the automatic detection of bias but goes one step further in that it explores how political bias and unfairness are manifested linguistically. We utilize a new corpus of 6964 news articles with labels derived from adfontesmedia.com and develop a neural model for bias assessment.
  arXiv  Detail & Related papers  (2020-10-20T22:25:00Z)
• Viable Threat on News Reading: Generating Biased News Using Natural Language Models [49.90665530780664]
  We show that publicly available language models can reliably generate biased news content based on an input original news. We also show that a large number of high-quality biased news articles can be generated using controllable text generation.
  arXiv  Detail & Related papers  (2020-10-05T16:55:39Z)
• Birds of a Feather Flock Together: Satirical News Detection via Language Model Differentiation [7.556286423133077]
  In satirical news, the lexical and pragmatical attributes of the context are the key factors in amusing the readers. We propose a method that differentiates the satirical news and true news.
  arXiv  Detail & Related papers  (2020-07-04T18:46:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.