Examining Political Rhetoric with Epistemic Stance Detection
- URL: http://arxiv.org/abs/2212.14486v1
- Date: Thu, 29 Dec 2022 23:47:14 GMT
- Title: Examining Political Rhetoric with Epistemic Stance Detection
- Authors: Ankita Gupta, Su Lin Blodgett, Justin H Gross, Brendan O'Connor
- Abstract summary: We develop a simple RoBERTa-based model for multi-source stance predictions that outperforms more complex state-of-the-art modeling.
We demonstrate its novel application to political science by conducting a large-scale analysis of the Mass Market Manifestos corpus of U.S. political opinion books.
- Score: 13.829628375546568
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Participants in political discourse employ rhetorical strategies -- such as
hedging, attributions, or denials -- to display varying degrees of belief
commitments to claims proposed by themselves or others. Traditionally,
political scientists have studied these epistemic phenomena through
labor-intensive manual content analysis. We propose to help automate such work
through epistemic stance prediction, drawn from research in computational
semantics, to distinguish at the clausal level what is asserted, denied, or
only ambivalently suggested by the author or other mentioned entities (belief
holders). We first develop a simple RoBERTa-based model for multi-source stance
predictions that outperforms more complex state-of-the-art modeling. Then we
demonstrate its novel application to political science by conducting a
large-scale analysis of the Mass Market Manifestos corpus of U.S. political
opinion books, where we characterize trends in cited belief holders --
respected allies and opposed bogeymen -- across U.S. political ideologies.
Related papers
- High Risk of Political Bias in Black Box Emotion Inference Models [0.0]
This paper investigates the presence of political bias in machine learning models used for sentiment analysis (SA) in social science research.
We conducted a bias audit on a Polish sentiment analysis model developed in our lab.
Our findings indicate that annotations by human raters propagate political biases into the model's predictions.
arXiv Detail & Related papers (2024-07-18T20:31:07Z) - Representation Bias in Political Sample Simulations with Large Language Models [54.48283690603358]
This study seeks to identify and quantify biases in simulating political samples with Large Language Models.
Using the GPT-3.5-Turbo model, we leverage data from the American National Election Studies, German Longitudinal Election Study, Zuobiao dataset, and China Family Panel Studies.
arXiv Detail & Related papers (2024-07-16T05:52:26Z) - Whose Side Are You On? Investigating the Political Stance of Large Language Models [56.883423489203786]
We investigate the political orientation of Large Language Models (LLMs) across a spectrum of eight polarizing topics.
Our investigation delves into the political alignment of LLMs across a spectrum of eight polarizing topics, spanning from abortion to LGBTQ issues.
The findings suggest that users should be mindful when crafting queries, and exercise caution in selecting neutral prompt language.
arXiv Detail & Related papers (2024-03-15T04:02:24Z) - P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models [57.571395694391654]
We find that existing approaches alter the political opinions and stances of news articles in more than 50% of summaries.
We propose P3SUM, a diffusion model-based summarization approach controlled by political perspective classifiers.
Experiments on three news summarization datasets demonstrate that P3SUM outperforms state-of-the-art summarization systems.
arXiv Detail & Related papers (2023-11-16T10:14:28Z) - Inducing Political Bias Allows Language Models Anticipate Partisan
Reactions to Controversies [5.958974943807783]
This study addresses the challenge of understanding political bias in digitized discourse using Large Language Models (LLMs)
We present a comprehensive analytical framework, consisting of Partisan Bias Divergence Assessment and Partisan Class Tendency Prediction.
Our findings reveal the model's effectiveness in capturing emotional and moral nuances, albeit with some challenges in stance detection.
arXiv Detail & Related papers (2023-11-16T08:57:53Z) - KHAN: Knowledge-Aware Hierarchical Attention Networks for Accurate
Political Stance Prediction [37.261840137596195]
We propose a novel knowledge-aware approach to political stance prediction (KHAN)
We employ (1) hierarchical attention networks (HAN) to learn the relationships among words and sentences in three different levels and (2) knowledge encoding (KE) to incorporate external knowledge for real-world entities into the process of political stance prediction.
Through extensive evaluations on three real-world datasets, we demonstrate the superiority of DASH in terms of (1) accuracy, (2) efficiency, and (3) effectiveness.
arXiv Detail & Related papers (2023-02-23T16:09:42Z) - PAR: Political Actor Representation Learning with Social Context and
Expert Knowledge [45.215862050840116]
We propose textbfPAR, a textbfPolitical textbfActor textbfRepresentation learning framework.
We retrieve and extract factual statements about legislators to leverage social context information.
We then construct a heterogeneous information network to incorporate social context and use relational graph neural networks to learn legislator representations.
arXiv Detail & Related papers (2022-10-15T19:28:06Z) - Entity Graph Extraction from Legal Acts -- a Prototype for a Use Case in
Policy Design Analysis [52.77024349608834]
This paper presents a prototype developed to serve the quantitative study of public policy design.
Our system aims to automate the process of gathering legal documents, annotating them with Institutional Grammar, and using hypergraphs to analyse inter-relations between crucial entities.
arXiv Detail & Related papers (2022-09-02T10:57:47Z) - A Latent-Variable Model for Intrinsic Probing [93.62808331764072]
We propose a novel latent-variable formulation for constructing intrinsic probes.
We find empirical evidence that pre-trained representations develop a cross-lingually entangled notion of morphosyntax.
arXiv Detail & Related papers (2022-01-20T15:01:12Z) - Encoding Heterogeneous Social and Political Context for Entity Stance
Prediction [7.477393857078695]
We propose the novel task of entity stance prediction.
We retrieve facts from Wikipedia about social entities regarding contemporary U.S. politics.
We then annotate social entities' stances towards political ideologies with the help of domain experts.
arXiv Detail & Related papers (2021-08-09T08:59:43Z) - Political Ideology and Polarization of Policy Positions: A
Multi-dimensional Approach [19.435030285532854]
We study the ideology of the policy under discussion teasing apart the nuanced co-existence of stance and ideology.
Aligned with the theoretical accounts in political science, we treat ideology as a multi-dimensional construct.
We showcase that this framework enables quantitative analysis of polarization, a temporal, multifaceted measure of ideological distance.
arXiv Detail & Related papers (2021-06-28T04:03:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.