Zero-shot stance detection based on cross-domain feature enhancement by contrastive learning

• URL: http://arxiv.org/abs/2210.03380v1
• Date: Fri, 7 Oct 2022 07:45:40 GMT
• Title: Zero-shot stance detection based on cross-domain feature enhancement by contrastive learning
• Authors: Xuechen Zhao, Jiaying Zou, Zhong Zhang, Feng Xie, Bin Zhou, Lei Tian
• Abstract summary: We propose a stance detection approach that can efficiently adapt to unseen targets. We first augment the data by masking the topic words of sentences. We then feed the augmented data to an unsupervised contrastive learning module to capture transferable features.
• Score: 9.719309795292773
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection. In this work, we propose a stance detection approach that can efficiently adapt to unseen targets, the core of which is to capture target-invariant syntactic expression patterns as transferable knowledge. Specifically, we first augment the data by masking the topic words of sentences, and then feed the augmented data to an unsupervised contrastive learning module to capture transferable features. Then, to fit a specific target, we encode the raw texts as target-specific features. Finally, we adopt an attention mechanism, which combines syntactic expression patterns with target-specific features to obtain enhanced features for predicting previously unseen targets. Experiments demonstrate that our model outperforms competitive baselines on four benchmark datasets.

Related papers

• Stanceformer: Target-Aware Transformer for Stance Detection [59.69858080492586]
  Stance Detection involves discerning the stance expressed in a text towards a specific subject or target. Prior works have relied on existing transformer models that lack the capability to prioritize targets effectively. We introduce Stanceformer, a target-aware transformer model that incorporates enhanced attention towards the targets during both training and inference.
  arXiv  Detail & Related papers  (2024-10-09T17:24:28Z)
• Guiding Computational Stance Detection with Expanded Stance Triangle Framework [25.2980607215715]
  Stance detection determines whether the author of a piece of text is in favor of, against, or neutral towards a specified target. We decompose the stance detection task from a linguistic perspective, and investigate key components and inference paths in this task.
  arXiv  Detail & Related papers  (2023-05-31T13:33:29Z)
• Object-fabrication Targeted Attack for Object Detection [54.10697546734503]
  adversarial attack for object detection contains targeted attack and untargeted attack. New object-fabrication targeted attack mode can mislead detectors tofabricate extra false objects with specific target labels.
  arXiv  Detail & Related papers  (2022-12-13T08:42:39Z)
• AcroFOD: An Adaptive Method for Cross-domain Few-shot Object Detection [59.10314662986463]
  Cross-domain few-shot object detection aims to adapt object detectors in the target domain with a few annotated target data. The proposed method achieves state-of-the-art performance on multiple benchmarks.
  arXiv  Detail & Related papers  (2022-09-22T10:23:40Z)
• Robust Region Feature Synthesizer for Zero-Shot Object Detection [87.79902339984142]
  We build a novel zero-shot object detection framework that contains an Intra-class Semantic Diverging component and an Inter-class Structure Preserving component. It is the first study to carry out zero-shot object detection in remote sensing imagery.
  arXiv  Detail & Related papers  (2022-01-01T03:09:15Z)
• Real-World Semantic Grasping Detection [0.34410212782758054]
  We propose an end-to-end semantic grasping detection model, which can accomplish both semantic recognition and grasping detection. We also design a target feature filtering mechanism, which only maintains the features of a single object according to the semantic information for grasping detection. Experimental results show that the proposed method can achieve 98.38% accuracy in Cornell grasping dataset.
  arXiv  Detail & Related papers  (2021-11-20T05:57:22Z)
• ZSD-YOLO: Zero-Shot YOLO Detection using Vision-Language KnowledgeDistillation [5.424015823818208]
  A dataset such as COCO is extensively annotated across many images but with a sparse number of categories and annotating all object classes across a diverse domain is expensive and challenging. We develop a Vision-Language distillation method that aligns both image and text embeddings from a zero-shot pre-trained model such as CLIP to a modified semantic prediction head from a one-stage detector like YOLOv5. During inference, our model can be adapted to detect any number of object classes without additional training.
  arXiv  Detail & Related papers  (2021-09-24T16:46:36Z)
• Detection of Adversarial Supports in Few-shot Classifiers Using Feature Preserving Autoencoders and Self-Similarity [89.26308254637702]
  We propose a detection strategy to highlight adversarial support sets. We make use of feature preserving autoencoder filtering and also the concept of self-similarity of a support set to perform this detection. Our method is attack-agnostic and also the first to explore detection for few-shot classifiers to the best of our knowledge.
  arXiv  Detail & Related papers  (2020-12-09T14:13:41Z)
• Synthesizing the Unseen for Zero-shot Object Detection [72.38031440014463]
  We propose to synthesize visual features for unseen classes, so that the model learns both seen and unseen objects in the visual domain. We use a novel generative model that uses class-semantics to not only generate the features but also to discriminatively separate them.
  arXiv  Detail & Related papers  (2020-10-19T12:36:11Z)
• Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations [13.153001795077227]
  We present a new dataset for zero-shot stance detection that captures a wider range of topics and lexical variation than in previous datasets. We also propose a new model for stance detection that implicitly captures relationships between topics using generalized topic representations.
  arXiv  Detail & Related papers  (2020-10-07T20:27:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.