Misinformation Detection on YouTube Using Video Captions

• URL: http://arxiv.org/abs/2107.00941v1
• Date: Fri, 2 Jul 2021 10:02:36 GMT
• Title: Misinformation Detection on YouTube Using Video Captions
• Authors: Raj Jagtap, Abhinav Kumar, Rahul Goel, Shakshi Sharma, Rajesh Sharma, Clint P. George
• Abstract summary: This work proposes an approach that uses state-of-the-art NLP techniques to extract features from video captions (subtitles) To evaluate our approach, we utilize a publicly accessible and labeled dataset for classifying videos as misinformation or not.
• Score: 6.503828590815483
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Millions of people use platforms such as YouTube, Facebook, Twitter, and other mass media. Due to the accessibility of these platforms, they are often used to establish a narrative, conduct propaganda, and disseminate misinformation. This work proposes an approach that uses state-of-the-art NLP techniques to extract features from video captions (subtitles). To evaluate our approach, we utilize a publicly accessible and labeled dataset for classifying videos as misinformation or not. The motivation behind exploring video captions stems from our analysis of videos metadata. Attributes such as the number of views, likes, dislikes, and comments are ineffective as videos are hard to differentiate using this information. Using caption dataset, the proposed models can classify videos among three classes (Misinformation, Debunking Misinformation, and Neutral) with 0.85 to 0.90 F1-score. To emphasize the relevance of the misinformation class, we re-formulate our classification problem as a two-class classification - Misinformation vs. others (Debunking Misinformation and Neutral). In our experiments, the proposed models can classify videos with 0.92 to 0.95 F1-score and 0.78 to 0.90 AUC ROC.

Related papers

• A Novel BERT-based Classifier to Detect Political Leaning of YouTube Videos based on their Titles [1.6647208383676708]
  A quarter of US adults regularly get their news from YouTube. We propose a novel classifier to classify YouTube videos based on their titles into six categories, namely: Far Left, Left, Center, Anti-Woke, Right, and Far Right. For the vast majority of cases, the predicted political leaning matches that of the news agency.
  arXiv  Detail & Related papers  (2024-02-16T14:44:30Z)
• Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Data [102.0069667710562]
  This paper presents Open-VCLIP++, a framework that adapts CLIP to a strong zero-shot video classifier. We demonstrate that training Open-VCLIP++ is tantamount to continual learning with zero historical data. Our approach is evaluated on three widely used action recognition datasets.
  arXiv  Detail & Related papers  (2023-10-08T04:46:43Z)
• Text-to-feature diffusion for audio-visual few-shot learning [59.45164042078649]
  Few-shot learning from video data is a challenging and underexplored, yet much cheaper, setup. We introduce a unified audio-visual few-shot video classification benchmark on three datasets. We show that AV-DIFF obtains state-of-the-art performance on our proposed benchmark for audio-visual few-shot learning.
  arXiv  Detail & Related papers  (2023-09-07T17:30:36Z)
• Identifying Misinformation on YouTube through Transcript Contextual Analysis with Transformer Models [1.749935196721634]
  We introduce a novel methodology for video classification, focusing on the veracity of the content. We employ advanced machine learning techniques like transfer learning to solve the classification challenge. We apply the trained models to three datasets: (a) YouTube Vaccine-misinformation related videos, (b) YouTube Pseudoscience videos, and (c) Fake-News dataset.
  arXiv  Detail & Related papers  (2023-07-22T19:59:16Z)
• Automatic Generation of Labeled Data for Video-Based Human Pose Analysis via NLP applied to YouTube Subtitles [2.039924457892648]
  We propose a method that makes use of the abundance of fitness videos available online. We utilize the advantage that videos often not only show the exercises, but also provide language as an additional source of information.
  arXiv  Detail & Related papers  (2023-03-23T15:55:33Z)
• Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles [0.5898451150401338]
  We present results of an auditing study performed over YouTube aimed at investigating how fast a user can get into a misinformation filter bubble. We employ a sock puppet audit methodology, in which pre-programmed agents (acting as YouTube users) delve into misinformation filter bubbles by watching misinformation promoting content. Then they try to burst the bubbles and reach more balanced recommendations by watching misinformation debunking content.
  arXiv  Detail & Related papers  (2022-10-18T18:27:47Z)
• Boosting Video Representation Learning with Multi-Faceted Integration [112.66127428372089]
  Video content is multifaceted, consisting of objects, scenes, interactions or actions. Existing datasets mostly label only one of the facets for model training, resulting in the video representation that biases to only one facet depending on the training dataset. We propose a new learning framework, MUlti-Faceted Integration (MUFI), to aggregate facets from different datasets for learning a representation that could reflect the full spectrum of video content.
  arXiv  Detail & Related papers  (2022-01-11T16:14:23Z)
• Few-Shot Learning for Video Object Detection in a Transfer-Learning Scheme [70.45901040613015]
  We study the new problem of few-shot learning for video object detection. We employ a transfer-learning framework to effectively train the video object detector on a large number of base-class objects and a few video clips of novel-class objects.
  arXiv  Detail & Related papers  (2021-03-26T20:37:55Z)
• Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling [98.41300980759577]
  A canonical approach to video-and-language learning dictates a neural model to learn from offline-extracted dense video features. We propose a generic framework ClipBERT that enables affordable end-to-end learning for video-and-language tasks. Experiments on text-to-video retrieval and video question answering on six datasets demonstrate that ClipBERT outperforms existing methods.
  arXiv  Detail & Related papers  (2021-02-11T18:50:16Z)
• Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework [43.002621928500425]
  We propose a self-supervised method to learn feature representations from videos. Because video representation is important, we extend negative samples by introducing intra-negative samples. We conduct experiments on video retrieval and video recognition tasks using the learned video representation.
  arXiv  Detail & Related papers  (2020-08-06T09:08:14Z)
• Generalized Few-Shot Video Classification with Video Retrieval and Feature Generation [132.82884193921535]
  We argue that previous methods underestimate the importance of video feature learning and propose a two-stage approach. We show that this simple baseline approach outperforms prior few-shot video classification methods by over 20 points on existing benchmarks. We present two novel approaches that yield further improvement.
  arXiv  Detail & Related papers  (2020-07-09T13:05:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.