PolitiSky24: U.S. Political Bluesky Dataset with User Stance Labels
- URL: http://arxiv.org/abs/2506.07606v1
- Date: Mon, 09 Jun 2025 10:06:25 GMT
- Title: PolitiSky24: U.S. Political Bluesky Dataset with User Stance Labels
- Abstract summary: Stance detection identifies the viewpoint expressed in text toward a specific target, such as a political figure.<n>We present the first stance detection dataset for the 2024 U.S. presidential election, collected from Bluesky.<n>The dataset comprises 16,044 user-target stance pairs enriched with engagement metadata, interaction graphs, and user posting histories.
- Score: 4.748038457227373
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Stance detection identifies the viewpoint expressed in text toward a specific target, such as a political figure. While previous datasets have focused primarily on tweet-level stances from established platforms, user-level stance resources, especially on emerging platforms like Bluesky remain scarce. User-level stance detection provides a more holistic view by considering a user's complete posting history rather than isolated posts. We present the first stance detection dataset for the 2024 U.S. presidential election, collected from Bluesky and centered on Kamala Harris and Donald Trump. The dataset comprises 16,044 user-target stance pairs enriched with engagement metadata, interaction graphs, and user posting histories. PolitiSky24 was created using a carefully evaluated pipeline combining advanced information retrieval and large language models, which generates stance labels with supporting rationales and text spans for transparency. The labeling approach achieves 81\% accuracy with scalable LLMs. This resource addresses gaps in political stance analysis through its timeliness, open-data nature, and user-level perspective. The dataset is available at https://doi.org/10.5281/zenodo.15616911
Related papers
- TikStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversations [4.101075054019962]
We present TikStance, a multimodal and context-aware dataset comprising 161 videos and 13,876 comments from TikTok.<n>The dataset covers three major political figures in the 2024 U.S. election cycle--Donald Trump, Joe Biden, and Kamala Harris--with content collected between September 2023 and January 2025.<n>Each discussion unit links a host video and its metadata to a parent-linked comment tree, enabling stance analysis within both audiovisual and conversational context.
arXiv Detail & Related papers (2026-07-16T17:37:19Z) - DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping [49.402442592047855]
Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment.<n>We argue that resolving this limitation requires shifting from national labels to multi-dimensional demographic constraints.<n>We propose DVMap, a framework for fine-grained pluralistic value alignment.
arXiv Detail & Related papers (2026-05-14T06:06:43Z) - Learning Next Action Predictors from Human-Computer Interaction [53.41504288073184]
LongNAP is a user model that combines parametric and in-context learning to reason over long interaction histories.<n>We label over 360K actions across one month of continuous phone usage from 20 users, amounting to 1,800 hours of screen time.<n>LongNAP significantly outperforms supervised finetuning and prompted baselines on held-out data.
arXiv Detail & Related papers (2026-03-06T05:31:04Z) - Wisdom of the LLM Crowd: A Large Scale Benchmark of Multi-Label U.S. Election-Related Harmful Social Media Content [1.7020765368200692]
USE24-XD is a large-scale dataset of nearly 100k posts collected from X (formerly Twitter) during the 2024 U.S presidential election cycle.<n>We employ six large language models (LLMs) to systematically annotate posts across five categories: Conspiracy, Sensationalism, Hate Speech, Speculation, and Satire.
arXiv Detail & Related papers (2026-02-12T13:57:12Z) - Exploiting contextual information to improve stance detection in informal political discourse with LLMs [0.0]
This study investigates the use of Large Language Models (LLMs) for political stance detection in informal online discourse.<n>Using a real-world political forum dataset, we generate structured profiles that summarize users' ideological leaning, recurring topics, and linguistic patterns.<n>We show that contextual prompts significantly boost accuracy, with improvements ranging from +17.5% to +38.5%, achieving up to 74% accuracy that surpasses previous approaches.
arXiv Detail & Related papers (2026-02-04T16:49:26Z) - LASTIST: LArge-Scale Target-Independent STance dataset [16.439668986979353]
Stance detection has emerged as an area of research in the field of artificial intelligence.<n>Most research is currently centered on the target-dependent stance detection task.<n>Most benchmark datasets are based on English, making it difficult to develop models in low-resource languages such as Korean.<n>This study proposes the LArge-Scale Target-Independent STance (LASTIST) dataset to fill this research gap.
arXiv Detail & Related papers (2025-10-28T11:07:29Z) - A Decade of News Forum Interactions: Threaded Conversations, Signed Votes, and Topical Tags [3.443622476405787]
We present a large-scale, longitudinal dataset capturing user activity on the online platform of DerStandard, a major Austrian newspaper.<n>The dataset spans ten years (2013-2022) and includes over 75 million user comments, more than 400 million votes, and detailed metadata on articles and user interactions.
arXiv Detail & Related papers (2025-06-27T13:40:20Z) - Search Arena: Analyzing Search-Augmented LLMs [61.28673331156436]
We introduce Search Arena, a crowd-sourced, large-scale, human-preference dataset of over 24,000 paired multi-turn user interactions.<n>The dataset spans diverse intents and languages, and contains full system traces with around 12,000 human preference votes.<n>Our analysis reveals that user preferences are influenced by the number of citations, even when the cited content does not directly support the attributed claims.
arXiv Detail & Related papers (2025-06-05T17:59:26Z) - Whose Side Are You On? Investigating the Political Stance of Large Language Models [56.883423489203786]
We investigate the political orientation of Large Language Models (LLMs) across a spectrum of eight polarizing topics.
Our investigation delves into the political alignment of LLMs across a spectrum of eight polarizing topics, spanning from abortion to LGBTQ issues.
The findings suggest that users should be mindful when crafting queries, and exercise caution in selecting neutral prompt language.
arXiv Detail & Related papers (2024-03-15T04:02:24Z) - When is Off-Policy Evaluation (Reward Modeling) Useful in Contextual Bandits? A Data-Centric Perspective [64.73162159837956]
evaluating the value of a hypothetical target policy with only a logged dataset is important but challenging.
We propose DataCOPE, a data-centric framework for evaluating a target policy given a dataset.
Our empirical analysis of DataCOPE in the logged contextual bandit settings using healthcare datasets confirms its ability to evaluate both machine-learning and human expert policies.
arXiv Detail & Related papers (2023-11-23T17:13:37Z) - CoDet: Co-Occurrence Guided Region-Word Alignment for Open-Vocabulary
Object Detection [78.0010542552784]
CoDet is a novel approach to learn object-level vision-language representations for open-vocabulary object detection.
By grouping images that mention a shared concept in their captions, objects corresponding to the shared concept shall exhibit high co-occurrence.
CoDet has superior performances and compelling scalability in open-vocabulary detection.
arXiv Detail & Related papers (2023-10-25T14:31:02Z) - Multilingual estimation of political-party positioning: From label
aggregation to long-input Transformers [3.651047982634467]
We implement and compare two approaches to automatic scaling analysis of political-party manifestos.
We find that the task can be efficiently solved by state-of-the-art models, with label aggregation producing the best results.
arXiv Detail & Related papers (2023-10-19T08:34:48Z) - Data Selection for Language Models via Importance Resampling [90.9263039747723]
We formalize the problem of selecting a subset of a large raw unlabeled dataset to match a desired target distribution.
We extend the classic importance resampling approach used in low-dimensions for LM data selection.
We instantiate the DSIR framework with hashed n-gram features for efficiency, enabling the selection of 100M documents in 4.5 hours.
arXiv Detail & Related papers (2023-02-06T23:57:56Z) - Contextual information integration for stance detection via
cross-attention [59.662413798388485]
Stance detection deals with identifying an author's stance towards a target.
Most existing stance detection models are limited because they do not consider relevant contextual information.
We propose an approach to integrate contextual information as text.
arXiv Detail & Related papers (2022-11-03T15:04:29Z) - A Spanish dataset for Targeted Sentiment Analysis of political headlines [0.0]
This work addresses the task of Targeted Sentiment Analysis for the domain of news headlines, published by the main outlets during the 2019 Argentinean Presidential Elections.
We present a polarity dataset of 1,976 headlines mentioning candidates in the 2019 elections at the target level.
Preliminary experiments with state-of-the-art classification algorithms based on pre-trained linguistic models suggest that target information is helpful for this task.
arXiv Detail & Related papers (2022-08-30T01:30:30Z) - Tweets2Stance: Users stance detection exploiting Zero-Shot Learning
Algorithms on Tweets [0.06372261626436675]
The aim of the study is to predict the stance of a Party p in regard to each statement s exploiting what the Twitter Party account wrote on Twitter.
Results obtained from multiple experiments show that Tweets2Stance can correctly predict the stance with a general minimum MAE of 1.13, which is a great achievement considering the task complexity.
arXiv Detail & Related papers (2022-04-22T14:00:11Z) - Progressive End-to-End Object Detection in Crowded Scenes [96.92416613336096]
Previous query-based detectors suffer from two drawbacks: first, multiple predictions will be inferred for a single object, typically in crowded scenes; second, the performance saturates as the depth of the decoding stage increases.
We propose a progressive predicting method to address the above issues. Specifically, we first select accepted queries to generate true positive predictions, then refine the rest noisy queries according to the previously accepted predictions.
Experiments show that our method can significantly boost the performance of query-based detectors in crowded scenes.
arXiv Detail & Related papers (2022-03-15T06:12:00Z) - X-Stance: A Multilingual Multi-Target Dataset for Stance Detection [42.46681912294797]
We extract a large-scale stance detection dataset from comments written by candidates of elections in Switzerland.
The dataset consists of German, French and Italian text, allowing for a cross-lingual evaluation of stance detection.
arXiv Detail & Related papers (2020-03-18T17:58:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.