Out of the Echo Chamber: Detecting Countering Debate Speeches
- URL: http://arxiv.org/abs/2005.01157v1
- Date: Sun, 3 May 2020 18:02:10 GMT
- Title: Out of the Echo Chamber: Detecting Countering Debate Speeches
- Authors: Matan Orbach, Yonatan Bilu, Assaf Toledo, Dan Lahav, Michal Jacovi,
Ranit Aharonov and Noam Slonim
- Abstract summary: We study the problem in the context of debate speeches.
We aim to identify, from among a set of speeches on the same topic and with an opposing stance, the ones that directly counter it.
We explore several algorithms addressing this task, and while some are successful, all fall short of expert human performance.
- Score: 18.321466611103684
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: An educated and informed consumption of media content has become a challenge
in modern times. With the shift from traditional news outlets to social media
and similar venues, a major concern is that readers are becoming encapsulated
in "echo chambers" and may fall prey to fake news and disinformation, lacking
easy access to dissenting views. We suggest a novel task aiming to alleviate
some of these concerns -- that of detecting articles that most effectively
counter the arguments -- and not just the stance -- made in a given text. We
study this problem in the context of debate speeches. Given such a speech, we
aim to identify, from among a set of speeches on the same topic and with an
opposing stance, the ones that directly counter it. We provide a large dataset
of 3,685 such speeches (in English), annotated for this relation, which
hopefully would be of general interest to the NLP community. We explore several
algorithms addressing this task, and while some are successful, all fall short
of expert human performance, suggesting room for further research. All data
collected during this work is freely available for research.
Related papers
- Tracking the Newsworthiness of Public Documents [107.12303391111014]
This work focuses on news coverage of local public policy in the San Francisco Bay Area by the San Francisco Chronicle.
First, we gather news articles, public policy documents and meeting recordings and link them using probabilistic relational modeling.
Second, we define a new task: newsworthiness prediction, to predict if a policy item will get covered.
arXiv Detail & Related papers (2023-11-16T10:05:26Z) - Crossing the Aisle: Unveiling Partisan and Counter-Partisan Events in
News Reporting [7.8192232188516115]
We study to which degree media balances news reporting and affects consumers through event inclusion or omission.
We first introduce the task of detecting both partisan and counter-partisan events.
Our findings highlight both the ways in which the news subtly shapes opinion and the need for large language models.
arXiv Detail & Related papers (2023-10-28T17:50:13Z) - NewsDialogues: Towards Proactive News Grounded Conversation [72.10055780635625]
We propose a novel task, Proactive News Grounded Conversation, in which a dialogue system can proactively lead the conversation based on some key topics of the news.
To further develop this novel task, we collect a human-to-human Chinese dialogue dataset tsNewsDialogues, which includes 1K conversations with a total of 14.6K utterances.
arXiv Detail & Related papers (2023-08-12T08:33:42Z) - ManiTweet: A New Benchmark for Identifying Manipulation of News on Social Media [74.93847489218008]
We present a novel task, identifying manipulation of news on social media, which aims to detect manipulation in social media posts and identify manipulated or inserted information.
To study this task, we have proposed a data collection schema and curated a dataset called ManiTweet, consisting of 3.6K pairs of tweets and corresponding articles.
Our analysis demonstrates that this task is highly challenging, with large language models (LLMs) yielding unsatisfactory performance.
arXiv Detail & Related papers (2023-05-23T16:40:07Z) - Unveiling the Hidden Agenda: Biases in News Reporting and Consumption [59.55900146668931]
We build a six-year dataset on the Italian vaccine debate and adopt a Bayesian latent space model to identify narrative and selection biases.
We found a nonlinear relationship between biases and engagement, with higher engagement for extreme positions.
Analysis of news consumption on Twitter reveals common audiences among news outlets with similar ideological positions.
arXiv Detail & Related papers (2023-01-14T18:58:42Z) - Assessing the impact of contextual information in hate speech detection [0.48369513656026514]
We provide a novel corpus for contextualized hate speech detection based on user responses to news posts from media outlets on Twitter.
This corpus was collected in the Rioplatense dialectal variety of Spanish and focuses on hate speech associated with the COVID-19 pandemic.
arXiv Detail & Related papers (2022-10-02T09:04:47Z) - NeuS: Neutral Multi-News Summarization for Mitigating Framing Bias [54.89737992911079]
We propose a new task, a neutral summary generation from multiple news headlines of the varying political spectrum.
One of the most interesting observations is that generation models can hallucinate not only factually inaccurate or unverifiable content, but also politically biased content.
arXiv Detail & Related papers (2022-04-11T07:06:01Z) - Detecting Anchors' Opinion in Hinghlish News Delivery [22.98110639419913]
We propose a novel task of anchors' opinion detection in debates.
We curate code-mixed news debates and develop the ODIN dataset.
A total of 2054 anchors' utterances in the dataset are marked as opinionated or non-opinionated.
arXiv Detail & Related papers (2022-04-05T12:26:46Z) - A Study of Fake News Reading and Annotating in Social Media Context [1.0499611180329804]
We present an eye-tracking study, in which we let 44 lay participants to casually read through a social media feed containing posts with news articles, some of which were fake.
In a second run, we asked the participants to decide on the truthfulness of these articles.
We also describe a follow-up qualitative study with a similar scenario but this time with 7 expert fake news annotators.
arXiv Detail & Related papers (2021-09-26T08:11:17Z) - Hate Speech Detection in Clubhouse [6.942237543984334]
We analyze the collected instances from statistical point of view using the Google Perspective Scores.
Our experiments show that, the Perspective Scores can outperform Bag of Words and Word2Vec as high level text features.
arXiv Detail & Related papers (2021-06-24T11:00:19Z) - Detecting Cross-Modal Inconsistency to Defend Against Neural Fake News [57.9843300852526]
We introduce the more realistic and challenging task of defending against machine-generated news that also includes images and captions.
To identify the possible weaknesses that adversaries can exploit, we create a NeuralNews dataset composed of 4 different types of generated articles.
In addition to the valuable insights gleaned from our user study experiments, we provide a relatively effective approach based on detecting visual-semantic inconsistencies.
arXiv Detail & Related papers (2020-09-16T14:13:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.