Emoji Prediction: Extensions and Benchmarking

• URL: http://arxiv.org/abs/2007.07389v1
• Date: Tue, 14 Jul 2020 22:41:20 GMT
• Title: Emoji Prediction: Extensions and Benchmarking
• Authors: Weicheng Ma, Ruibo Liu, Lili Wang, Soroush Vosoughi
• Abstract summary: The emoji prediction task aims at predicting the proper set of emojis associated with a piece of text. We extend the existing setting of the emoji prediction task to include a richer set of emojis and to allow multi-label classification. We propose novel models for multi-class and multi-label emoji prediction based on Transformer networks.
• Score: 30.642840676899734
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Emojis are a succinct form of language which can express concrete meanings, emotions, and intentions. Emojis also carry signals that can be used to better understand communicative intent. They have become a ubiquitous part of our daily lives, making them an important part of understanding user-generated content. The emoji prediction task aims at predicting the proper set of emojis associated with a piece of text. Through emoji prediction, models can learn rich representations of the communicative intent of the written text. While existing research on the emoji prediction task focus on a small subset of emoji types closely related to certain emotions, this setting oversimplifies the task and wastes the expressive power of emojis. In this paper, we extend the existing setting of the emoji prediction task to include a richer set of emojis and to allow multi-label classification on the task. We propose novel models for multi-class and multi-label emoji prediction based on Transformer networks. We also construct multiple emoji prediction datasets from Twitter using heuristics. The BERT models achieve state-of-the-art performances on all our datasets under all the settings, with relative improvements of 27.21% to 236.36% in accuracy, 2.01% to 88.28% in top-5 accuracy and 65.19% to 346.79% in F-1 score, compared to the prior state-of-the-art. Our results demonstrate the efficacy of deep Transformer-based models on the emoji prediction task. We also release our datasets at https://github.com/hikari-NYU/Emoji_Prediction_Datasets_MMS for future researchers.

Related papers

• On-Device Emoji Classifier Trained with GPT-based Data Augmentation for a Mobile Keyboard [2.6624014064407717]
  This paper proposes an on-device emoji classifier based on MobileBert for SwiftKey. To account for the data imbalance, we utilize the widely used GPT to generate one or more tags for each emoji class. For each emoji and corresponding tags, we merge the original set with GPT-generated sentences and label them with this emoji. At inference time, we interpolate the emoji output with the user history for better emoji classifications.
  arXiv  Detail & Related papers  (2024-11-06T09:52:29Z)
• Semantics Preserving Emoji Recommendation with Large Language Models [47.94761630160614]
  Existing emoji recommendation methods are primarily evaluated based on their ability to match the exact emoji a user chooses in the original text. We propose a new semantics preserving evaluation framework for emoji recommendation, which measures a model's ability to recommend emojis that maintain the semantic consistency with the user's text.
  arXiv  Detail & Related papers  (2024-09-16T22:27:46Z)
• EmojiLM: Modeling the New Emoji Language [44.23076273155259]
  We develop a text-emoji parallel corpus, Text2Emoji, from a large language model. Based on the parallel corpus, we distill a sequence-to-sequence model, EmojiLM, which is specialized in the text-emoji bidirectional translation. Our proposed model outperforms strong baselines and the parallel corpus benefits emoji-related downstream tasks.
  arXiv  Detail & Related papers  (2023-11-03T07:06:51Z)
• Emoji Prediction in Tweets using BERT [0.0]
  We propose a transformer-based approach for emoji prediction using BERT, a widely-used pre-trained language model. We fine-tuned BERT on a large corpus of text (tweets) containing both text and emojis to predict the most appropriate emoji for a given text. Our experimental results demonstrate that our approach outperforms several state-of-the-art models in predicting emojis with an accuracy of over 75 percent.
  arXiv  Detail & Related papers  (2023-07-05T06:38:52Z)
• Emojich -- zero-shot emoji generation using Russian language: a technical report [52.77024349608834]
  "Emojich" is a text-to-image neural network that generates emojis using captions in Russian language as a condition. We aim to keep the generalization ability of a pretrained big model ruDALL-E Malevich (XL) 1.3B parameters at the fine-tuning stage.
  arXiv  Detail & Related papers  (2021-12-04T23:37:32Z)
• Emoji-aware Co-attention Network with EmoGraph2vec Model for Sentiment Anaylsis [9.447106020795292]
  We propose a method to learn emoji representations called EmoGraph2vec and design an emoji-aware co-attention network. Our model designs a co-attention mechanism to incorporate the text and emojis, and integrates a squeeze-and-excitation block into a convolutional neural network. Experimental results show that the proposed model can outperform several baselines for sentiment analysis on benchmark datasets.
  arXiv  Detail & Related papers  (2021-10-27T08:01:10Z)
• Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-2018 [66.28665205489845]
  We offer the first longitudinal study of how emoji semantics changes over time, applying techniques from computational linguistics to six years of Twitter data. We identify five patterns in emoji semantic development and find evidence that the less abstract an emoji is, the more likely it is to undergo semantic change. To aid future work on emoji and semantics, we make our data publicly available along with a web-based interface that anyone can use to explore semantic change in emoji.
  arXiv  Detail & Related papers  (2021-05-03T13:35:10Z)
• A `Sourceful' Twist: Emoji Prediction Based on Sentiment, Hashtags and Application Source [1.6818451361240172]
  We showcase the importance of using Twitter features to help the model understand the sentiment involved and hence to predict the most suitable emoji for the text. Our data analysis and neural network model performance evaluations depict that using hashtags and application sources as features allows to encode different information and is effective in emoji prediction.
  arXiv  Detail & Related papers  (2021-03-14T03:05:04Z)
• Are Emojis Emotional? A Study to Understand the Association between Emojis and Emotions [37.86739837901986]
  We seek to explore the connection between emojis and emotions by means of a new dataset consisting of human-solicited association ratings. We additionally conduct experiments to assess to what extent such associations can be inferred from existing data, such as similar associations can be predicted for a larger set of emojis.
  arXiv  Detail & Related papers  (2020-05-02T04:04:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.