Nearest neighbour approaches for Emotion Detection in Tweets

• URL: http://arxiv.org/abs/2107.05394v1
• Date: Thu, 8 Jul 2021 13:00:06 GMT
• Title: Nearest neighbour approaches for Emotion Detection in Tweets
• Authors: Olha Kaminska, Chris Cornelis, Veronique Hoste
• Abstract summary: We propose an approach using weighted $k$ Nearest Neighbours (kNN), a simple, easy to implement, and explainable machine learning model. In particular, we apply the weighted kNN model to the shared emotion detection task in tweets from SemEval-2018.
• Score: 1.7581155313656314
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Emotion detection is an important task that can be applied to social media data to discover new knowledge. While the use of deep learning methods for this task has been prevalent, they are black-box models, making their decisions hard to interpret for a human operator. Therefore, in this paper, we propose an approach using weighted $k$ Nearest Neighbours (kNN), a simple, easy to implement, and explainable machine learning model. These qualities can help to enhance results' reliability and guide error analysis. In particular, we apply the weighted kNN model to the shared emotion detection task in tweets from SemEval-2018. Tweets are represented using different text embedding methods and emotion lexicon vocabulary scores, and classification is done by an ensemble of weighted kNN models. Our best approaches obtain results competitive with state-of-the-art solutions and open up a promising alternative path to neural network methods.

Related papers

• Unsupervised Sentiment Analysis of Plastic Surgery Social Media Posts [91.3755431537592]
  The massive collection of user posts across social media platforms is primarily untapped for artificial intelligence (AI) use cases. Natural language processing (NLP) is a subfield of AI that leverages bodies of documents, known as corpora, to train computers in human-like language understanding. This study demonstrates that the applied results of unsupervised analysis allow a computer to predict either negative, positive, or neutral user sentiment towards plastic surgery.
  arXiv  Detail & Related papers  (2023-07-05T20:16:20Z)
• Adversarial Attacks on the Interpretation of Neuron Activation Maximization [70.5472799454224]
  Activation-maximization approaches are used to interpret and analyze trained deep-learning models. In this work, we consider the concept of an adversary manipulating a model for the purpose of deceiving the interpretation.
  arXiv  Detail & Related papers  (2023-06-12T19:54:33Z)
• Towards Better Explanations for Object Detection [0.0]
  This paper proposes a method to explain the decision for any object detection model called D-CLOSE. We performed tests on the MS-COCO dataset with the YOLOX model, which shows that our method outperforms D-RISE.
  arXiv  Detail & Related papers  (2023-06-05T09:52:05Z)
• On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting [51.41426141283203]
  User-defined keyword spotting is a task to detect new spoken terms defined by users. Previous works try to incorporate self-supervised learning models or apply meta-learning algorithms. Our result shows that HuBERT combined with Matching network achieves the best result.
  arXiv  Detail & Related papers  (2022-04-01T10:59:39Z)
• Text analysis and deep learning: A network approach [0.0]
  We propose a novel method that combines transformer models with network analysis to form a self-referential representation of language use within a corpus of interest. Our approach produces linguistic relations strongly consistent with the underlying model as well as mathematically well-defined operations on them. It represents, to the best of our knowledge, the first unsupervised method to extract semantic networks directly from deep language models.
  arXiv  Detail & Related papers  (2021-10-08T14:18:36Z)
• Fuzzy-Rough Nearest Neighbour Approaches for Emotion Detection in Tweets [1.7581155313656314]
  Social media are an essential source of meaningful data that can be used in different tasks such as sentiment analysis and emotion recognition. We develop an approach for the SemEval-2018 emotion detection task, based on the fuzzy rough nearest neighbour (FRNN) Our results are competitive with the best SemEval solutions based on more complicated deep learning methods.
  arXiv  Detail & Related papers  (2021-07-08T12:52:47Z)
• Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference [150.07326223077405]
  Few-shot learning is attracting much attention to mitigate data scarcity. We present a discriminative nearest neighbor classification with deep self-attention. We propose to boost the discriminative ability by transferring a natural language inference (NLI) model.
  arXiv  Detail & Related papers  (2020-10-25T00:39:32Z)
• Explaining and Improving Model Behavior with k Nearest Neighbor Representations [107.24850861390196]
  We propose using k nearest neighbor representations to identify training examples responsible for a model's predictions. We show that kNN representations are effective at uncovering learned spurious associations. Our results indicate that the kNN approach makes the finetuned model more robust to adversarial inputs.
  arXiv  Detail & Related papers  (2020-10-18T16:55:25Z)
• Boosting Deep Neural Networks with Geometrical Prior Knowledge: A Survey [77.99182201815763]
  Deep Neural Networks (DNNs) achieve state-of-the-art results in many different problem settings. DNNs are often treated as black box systems, which complicates their evaluation and validation. One promising field, inspired by the success of convolutional neural networks (CNNs) in computer vision tasks, is to incorporate knowledge about symmetric geometrical transformations.
  arXiv  Detail & Related papers  (2020-06-30T14:56:05Z)
• Combining word embeddings and convolutional neural networks to detect duplicated questions [0.0]
  We propose a simple approach to identifying semantically similar questions by combining the strengths of word embeddings and Convolutional Neural Networks. Our network is trained on the Quora dataset, which contains over 400k question pairs.
  arXiv  Detail & Related papers  (2020-06-08T12:30:25Z)
• An Adversarial Approach for Explaining the Predictions of Deep Neural Networks [9.645196221785694]
  We present a novel algorithm for explaining the predictions of a deep neural network (DNN) using adversarial machine learning. Our approach identifies the relative importance of input features in relation to the predictions based on the behavior of an adversarial attack on the DNN. Our analysis enables us to produce consistent and efficient explanations.
  arXiv  Detail & Related papers  (2020-05-20T18:06:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.