Ideology Prediction of German Political Texts

• URL: http://arxiv.org/abs/2605.14352v1
• Date: Thu, 14 May 2026 04:25:56 GMT
• Title: Ideology Prediction of German Political Texts
• Abstract summary: We propose a transformer-based model capable of projecting the political orientation of a text on a continuous left-to-right spectrum.<n>This study demonstrates that transformer models can recognize political framing in German news at the level of public opinion polls.
• Score: 0.7349727826230863
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Elections represent a crucial milestone in a nation's ongoing development. To better understand the political rhetoric from various movements, ranging from left to right, we propose a transformer-based model capable of projecting the political orientation of a text on a continuous left-to-right spectrum, represented by a normalized scalar d between -1 and 1. This approach enables analysts to focus on specific segments of the political landscape, such as conservatives, while excluding liberal and far-right movements. Such a task can only be achieved with multiclass classifiers, provided that the desired orientation is incorporated within one of their predefined classes. To determine the most suitable foundation model among 13 candidate transformers for this task, we constructed four distinct corpora. One corpus comprised annotated plenary notes from the German Bundestag, while another was based on an official online decision-making tool, Wahl-O-Mat. The third corpus consisted of articles from 33 newspapers, each identified by its political orientation, and the fourth included 535,200 tweets from 597 members of the 20th and 21st German Bundestag. To mitigate overfitting, we used two distinct corpora for training and two for testing, respectively. For in-domain performance, DeBERTa-large achieved the highest F1 score F1=0.844 as well as for the X (Twitter) out-of-domain test ACC=0.864. Regarding the newspaper out-of-domain test, Gemma2-2B excelled (MAE = 0.172). This study demonstrates that transformer models can recognize political framing in German news at the level of public opinion polls. Our findings suggest that both the model architecture and the availability of domain-specific training data can be as influential as model size for estimating political bias. We discuss methodological limitations and outline directions for improving the robustness of bias measurement.

Related papers

• Right Frame, Wrong Rule: Cultural Cues Expose the Financial Knowledge Gap They Were Meant to Close [57.963463622270275]
  We study normative pluralism in Islamic finance using a four-choice taxonomy.<n>A cultural cue steers a model toward one framework, but the model selects an incorrect answer within that framework.
  arXiv  Detail & Related papers  (2026-09-01T09:46:53Z)
• Benchmarking Speech-to-Speech Translation Models [55.00303727199927]
  Speech-to-speech translation (S2ST) has advanced rapidly, but offline evaluation lacks a unified protocol.<n>We introduce a benchmarking framework integrating 46 metrics across eight dimensions.<n>We deploy it on 1,248 model-language configurations from FLEURS and CVSS.
  arXiv  Detail & Related papers  (2026-06-02T07:01:33Z)
• Large-Scale, Longitudinal Study of Large Language Models During the 2024 US Election Season [43.092041950140164]
  The 2024 US presidential election is the first major contest to occur in the US since the popularization of large language models (LLMs)<n>This moment raises urgent questions about how LLMs may shape the information ecosystem and influence political discourse.<n>We conduct a large-scale, longitudinal study of 12 models, queried using a structured survey with over 12,000 questions on a near-daily cadence from July through November 2024.
  arXiv  Detail & Related papers  (2025-09-22T22:04:19Z)
• The Enemy from Within: A Study of Political Delegitimization Discourse in Israeli Political Speech [0.21485350418225244]
  We present the first large-scale computational study of political delegitimization discourse (PDD)<n>PDD is symbolic attacks on the normative validity of political entities.<n>We use a novel Hebrew-language corpus of 10,410 sentences drawn from Knesset speeches.
  arXiv  Detail & Related papers  (2025-08-21T12:57:04Z)
• Analyzing German Parliamentary Speeches: A Machine Learning Approach for Topic and Sentiment Classification [3.3595341706248876]
  This study investigates political discourse in the German parliament, the Bundestag, by analyzing approximately 28,000 parliamentary speeches.<n>Two machine learning models for topic and sentiment classification were developed and trained on a manually labeled dataset.<n>The models showed strong classification performance, achieving an area under the receiver operating characteristic curve (AUROC) of 0.94 for topic classification.
  arXiv  Detail & Related papers  (2025-08-05T07:44:42Z)
• Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models [3.217354895187878]
  We analyze whether zero-shot persona prompting with limited information can accurately predict individual voting decisions.<n>We find that we can simulate voting behavior of Members of the European Parliament reasonably well with a weighted F1 score of approximately 0.793.
  arXiv  Detail & Related papers  (2025-06-13T14:02:21Z)
• Representation Bias in Political Sample Simulations with Large Language Models [54.48283690603358]
  This study seeks to identify and quantify biases in simulating political samples with Large Language Models. Using the GPT-3.5-Turbo model, we leverage data from the American National Election Studies, German Longitudinal Election Study, Zuobiao dataset, and China Family Panel Studies.
  arXiv  Detail & Related papers  (2024-07-16T05:52:26Z)
• Multilingual estimation of political-party positioning: From label aggregation to long-input Transformers [3.651047982634467]
  We implement and compare two approaches to automatic scaling analysis of political-party manifestos. We find that the task can be efficiently solved by state-of-the-art models, with label aggregation producing the best results.
  arXiv  Detail & Related papers  (2023-10-19T08:34:48Z)
• Computational Assessment of Hyperpartisanship in News Titles [55.92100606666497]
  We first adopt a human-guided machine learning framework to develop a new dataset for hyperpartisan news title detection. Overall the Right media tends to use proportionally more hyperpartisan titles. We identify three major topics including foreign issues, political systems, and societal issues that are suggestive of hyperpartisanship in news titles.
  arXiv  Detail & Related papers  (2023-01-16T05:56:58Z)
• Design and analysis of tweet-based election models for the 2021 Mexican legislative election [55.41644538483948]
  We use a dataset of 15 million election-related tweets in the six months preceding election day. We find that models using data with geographical attributes determine the results of the election with better precision and accuracy than conventional polling methods.
  arXiv  Detail & Related papers  (2023-01-02T12:40:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.