Making FETCH! Happen: Finding Emergent Dog Whistles Through Common Habitats

• URL: http://arxiv.org/abs/2412.12072v2
• Date: Fri, 14 Feb 2025 21:43:14 GMT
• Title: Making FETCH! Happen: Finding Emergent Dog Whistles Through Common Habitats
• Authors: Kuleen Sasse, Carlos Aguirre, Isabel Cachola, Sharon Levy, Mark Dredze,
• Abstract summary: Dog whistles are coded expressions with dual meanings. We introduce FETCH!, a task for finding novel dog whistles in social media corpora. We present EarShot, a strong baseline system that combines the strengths of vector databases and Large Language Models.
• Score: 16.78149030970864
• License:
• Abstract: WARNING: This paper contains content that maybe upsetting or offensive to some readers. Dog whistles are coded expressions with dual meanings: one intended for the general public (outgroup) and another that conveys a specific message to an intended audience (ingroup). Often, these expressions are used to convey controversial political opinions while maintaining plausible deniability and slip by content moderation filters. Identification of dog whistles relies on curated lexicons, which have trouble keeping up to date. We introduce FETCH!, a task for finding novel dog whistles in massive social media corpora. We find that state-of-the-art systems fail to achieve meaningful results across three distinct social media case studies. We present EarShot, a strong baseline system that combines the strengths of vector databases and Large Language Models (LLMs) to efficiently and effectively identify new dog whistles.

Related papers

• Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistles [47.61526125774749]
  A dog whistle is a form of coded communication that carries a secondary meaning to specific audiences and is often weaponized for racial and socioeconomic discrimination. We present an approach for word-sense disambiguation of dog whistles from standard speech using Large Language Models (LLMs) We leverage this technique to create a dataset of 16,550 high-confidence coded examples of dog whistles used in formal and informal communication.
  arXiv  Detail & Related papers  (2024-06-10T23:09:19Z)
• Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attacks [60.14025705964573]
  SheepDog is a style-robust fake news detector that prioritizes content over style in determining news veracity. SheepDog achieves this resilience through (1) LLM-empowered news reframings that inject style diversity into the training process by customizing articles to match different styles; (2) a style-agnostic training scheme that ensures consistent veracity predictions across style-diverse reframings; and (3) content-focused attributions that distill content-centric guidelines from LLMs for debunking fake news.
  arXiv  Detail & Related papers  (2023-10-16T21:05:12Z)
• Towards Lexical Analysis of Dog Vocalizations via Online Videos [19.422796780268605]
  This study presents a data-driven investigation into the semantics of dog vocalizations via correlating different sound types with consistent semantics. We first present a new dataset of Shiba Inu sounds, along with contextual information such as location and activity, collected from YouTube. Based on the analysis of conditioned probability between dog vocalizations and corresponding location and activity, we discover supporting evidence for previous research on the semantic meaning of various dog sounds.
  arXiv  Detail & Related papers  (2023-09-21T23:53:14Z)
• From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models [73.25963871034858]
  We present the first large-scale computational investigation of dogwhistles. We develop a typology of dogwhistles, curate the largest-to-date glossary of over 300 dogwhistles, and analyze their usage in historical U.S. politicians' speeches. We show that harmful content containing dogwhistles avoids toxicity detection, highlighting online risks of such coded language.
  arXiv  Detail & Related papers  (2023-05-26T18:00:57Z)
• ManiTweet: A New Benchmark for Identifying Manipulation of News on Social Media [74.93847489218008]
  We present a novel task, identifying manipulation of news on social media, which aims to detect manipulation in social media posts and identify manipulated or inserted information. To study this task, we have proposed a data collection schema and curated a dataset called ManiTweet, consisting of 3.6K pairs of tweets and corresponding articles. Our analysis demonstrates that this task is highly challenging, with large language models (LLMs) yielding unsatisfactory performance.
  arXiv  Detail & Related papers  (2023-05-23T16:40:07Z)
• Verifying the Robustness of Automatic Credibility Assessment [50.55687778699995]
  We show that meaning-preserving changes in input text can mislead the models. We also introduce BODEGA: a benchmark for testing both victim models and attack methods on misinformation detection tasks. Our experimental results show that modern large language models are often more vulnerable to attacks than previous, smaller solutions.
  arXiv  Detail & Related papers  (2023-03-14T16:11:47Z)
• LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval [68.85686621130111]
  We propose to make a dense retriever align a well-performing lexicon-aware representation model. We evaluate our model on three public benchmarks, which shows that with a comparable lexicon-aware retriever as the teacher, our proposed dense model can bring consistent and significant improvements.
  arXiv  Detail & Related papers  (2022-08-29T15:09:28Z)
• Anti-Asian Hate Speech Detection via Data Augmented Semantic Relation Inference [4.885207279350052]
  We propose a novel approach to leverage sentiment hashtags to enhance hate speech detection in a natural language inference framework. We design a novel framework SRIC that simultaneously performs two tasks: (1) semantic relation inference between online posts and sentiment hashtags, and (2) sentiment classification on these posts.
  arXiv  Detail & Related papers  (2022-04-14T15:03:35Z)
• Leveraging Transformers for Hate Speech Detection in Conversational Code-Mixed Tweets [36.29939722039909]
  This paper describes the system proposed by team MIDAS-IIITD for HASOC 2021 subtask 2. It is one of the first shared tasks focusing on detecting hate speech from Hindi-English code-mixed conversations on Twitter. Our best performing system, a hard voting ensemble of Indic-BERT, XLM-RoBERTa, and Multilingual BERT, achieved a macro F1 score of 0.7253.
  arXiv  Detail & Related papers  (2021-12-18T19:27:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.