TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings

• URL: http://arxiv.org/abs/2310.14450v3
• Date: Thu, 8 Feb 2024 15:17:15 GMT
• Title: TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings
• Authors: Hans W. A. Hanley, Zakir Durumeric
• Abstract summary: We train topic-agnostic/TAG and topic-aware/TAW embeddings for use in downstream stance detection. We achieve state-of-the-art performance across several public stance detection datasets.
• Score: 6.0971418973431
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Stance detection is important for understanding different attitudes and beliefs on the Internet. However, given that a passage's stance toward a given topic is often highly dependent on that topic, building a stance detection model that generalizes to unseen topics is difficult. In this work, we propose using contrastive learning as well as an unlabeled dataset of news articles that cover a variety of different topics to train topic-agnostic/TAG and topic-aware/TAW embeddings for use in downstream stance detection. Combining these embeddings in our full TATA model, we achieve state-of-the-art performance across several public stance detection datasets (0.771 $F_1$-score on the Zero-shot VAST dataset). We release our code and data at https://github.com/hanshanley/tata.

Related papers

• A Challenge Dataset and Effective Models for Conversational Stance Detection [26.208989232347058]
  We introduce a new multi-turn conversation stance detection dataset (called textbfMT-CSD) We propose a global-local attention network (textbfGLAN) to address both long and short-range dependencies inherent in conversational data. Our dataset serves as a valuable resource to catalyze advancements in cross-domain stance detection.
  arXiv  Detail & Related papers  (2024-03-17T08:51:01Z)
• Assaying on the Robustness of Zero-Shot Machine-Generated Text Detectors [57.7003399760813]
  We explore advanced Large Language Models (LLMs) and their specialized variants, contributing to this field in several ways. We uncover a significant correlation between topics and detection performance. These investigations shed light on the adaptability and robustness of these detection methods across diverse topics.
  arXiv  Detail & Related papers  (2023-12-20T10:53:53Z)
• Unified Visual Relationship Detection with Vision and Language Models [89.77838890788638]
  This work focuses on training a single visual relationship detector predicting over the union of label spaces from multiple datasets. We propose UniVRD, a novel bottom-up method for Unified Visual Relationship Detection by leveraging vision and language models. Empirical results on both human-object interaction detection and scene-graph generation demonstrate the competitive performance of our model.
  arXiv  Detail & Related papers  (2023-03-16T00:06:28Z)
• Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads [12.007570049217398]
  We propose a new task called conversational stance detection. It infers the stance towards a given target (e.g., COVID-19 vaccination) when given a data instance and its corresponding conversation thread. To infer the desired stances from both data instances and conversation threads, we propose a model called Branch-BERT that incorporates contextual information in conversation threads.
  arXiv  Detail & Related papers  (2022-11-06T08:40:48Z)
• Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding [137.3719377780593]
  A new design (named Detection Hub) is dataset-aware and category-aligned. It mitigates the dataset inconsistency and provides coherent guidance for the detector to learn across multiple datasets. The categories across datasets are semantically aligned into a unified space by replacing one-hot category representations with word embedding.
  arXiv  Detail & Related papers  (2022-06-07T17:59:44Z)
• Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Study [6.047731445033151]
  Cross-topic stance detection is the task to automatically detect stances (pro, against, or neutral) on unseen topics. We reproduce state-of-the-art cross-topic stance detection work, and analyze its results. We ask: What extent is stance detection topic-independent and generalizable across topics? We conclude that investigating performance on different topics, and addressing topic-specific vocabulary and context, is a future avenue for cross-topic stance detection.
  arXiv  Detail & Related papers  (2021-10-14T20:03:36Z)
• Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding [71.2260967797055]
  We propose a weakly-supervised approach for aspect-based sentiment analysis. We learn sentiment, aspect> joint topic embeddings in the word embedding space. We then use neural models to generalize the word-level discriminative information.
  arXiv  Detail & Related papers  (2020-10-13T21:33:24Z)
• Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations [13.153001795077227]
  We present a new dataset for zero-shot stance detection that captures a wider range of topics and lexical variation than in previous datasets. We also propose a new model for stance detection that implicitly captures relationships between topics using generalized topic representations.
  arXiv  Detail & Related papers  (2020-10-07T20:27:12Z)
• ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection [101.56529337489417]
  We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of human, action, object> in images. We argue that multi-level consistencies among objects, actions and interactions are strong cues for generating semantic representations of rare or previously unseen HOIs. Our model takes visual features of candidate human-object pairs and word embeddings of HOI labels as inputs, maps them into visual-semantic joint embedding space and obtains detection results by measuring their similarities.
  arXiv  Detail & Related papers  (2020-08-14T09:11:18Z)
• Stance Detection Benchmark: How Robust Is Your Stance Detection? [65.91772010586605]
  Stance Detection (StD) aims to detect an author's stance towards a certain topic or claim. We introduce a StD benchmark that learns from ten StD datasets of various domains in a multi-dataset learning setting. Within this benchmark setup, we are able to present new state-of-the-art results on five of the datasets.
  arXiv  Detail & Related papers  (2020-01-06T13:37:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.