RIGHT: Retrieval-augmented Generation for Mainstream Hashtag Recommendation

• URL: http://arxiv.org/abs/2312.10466v1
• Date: Sat, 16 Dec 2023 14:47:03 GMT
• Title: RIGHT: Retrieval-augmented Generation for Mainstream Hashtag Recommendation
• Authors: Run-Ze Fan, Yixing Fan, Jiangui Chen, Jiafeng Guo, Ruqing Zhang, Xueqi Cheng
• Abstract summary: We propose RetrIeval-augmented Generative Mainstream HashTag Recommender (RIGHT) RIGHT consists of three components: 1) a retriever seeks relevant hashtags from the entire tweet-hashtags set; 2) a selector enhances mainstream identification by introducing global signals; and 3) a generator incorporates input tweets and selected hashtags to directly generate the desired hashtags. Our method achieves significant improvements over state-of-the-art baselines. Moreover, RIGHT can be easily integrated into large language models, improving the performance of ChatGPT by more than 10%.
• Score: 76.24205422163169
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automatic mainstream hashtag recommendation aims to accurately provide users with concise and popular topical hashtags before publication. Generally, mainstream hashtag recommendation faces challenges in the comprehensive difficulty of newly posted tweets in response to new topics, and the accurate identification of mainstream hashtags beyond semantic correctness. However, previous retrieval-based methods based on a fixed predefined mainstream hashtag list excel in producing mainstream hashtags, but fail to understand the constant flow of up-to-date information. Conversely, generation-based methods demonstrate a superior ability to comprehend newly posted tweets, but their capacity is constrained to identifying mainstream hashtags without additional features. Inspired by the recent success of the retrieval-augmented technique, in this work, we attempt to adopt this framework to combine the advantages of both approaches. Meantime, with the help of the generator component, we could rethink how to further improve the quality of the retriever component at a low cost. Therefore, we propose RetrIeval-augmented Generative Mainstream HashTag Recommender (RIGHT), which consists of three components: 1) a retriever seeks relevant hashtags from the entire tweet-hashtags set; 2) a selector enhances mainstream identification by introducing global signals; and 3) a generator incorporates input tweets and selected hashtags to directly generate the desired hashtags. The experimental results show that our method achieves significant improvements over state-of-the-art baselines. Moreover, RIGHT can be easily integrated into large language models, improving the performance of ChatGPT by more than 10%.

Related papers

• ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery [128.30514851911218]
  ConceptHash is a novel method that achieves sub-code level interpretability. In ConceptHash, each sub-code corresponds to a human-understandable concept, such as an object part. We incorporate language guidance to ensure that the learned hash codes are distinguishable within fine-grained object classes.
  arXiv  Detail & Related papers  (2024-06-12T17:49:26Z)
• #REVAL: a semantic evaluation framework for hashtag recommendation [6.746400031322727]
  We propose a novel semantic evaluation framework for hashtag recommendation, called #REval. #REval includes an internal module referred to as BERTag, which automatically learns the hashtag embeddings. Our experiments on three large datasets show that #REval gave more meaningful hashtag synonyms for hashtag recommendation evaluation.
  arXiv  Detail & Related papers  (2023-05-24T07:10:56Z)
• Hashtag-Guided Low-Resource Tweet Classification [31.810562621519804]
  We propose a novel Hashtag-guided Tweet Classification model (HashTation) HashTation automatically generates meaningful hashtags for the input tweet to provide useful auxiliary signals for tweet classification. Experiments show that HashTation achieves significant improvements on seven low-resource tweet classification tasks.
  arXiv  Detail & Related papers  (2023-02-20T18:21:02Z)
• Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training [66.64843711515341]
  Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. We call attention to a new setting named multilingual keyphrase generation. We propose a retrieval-augmented method for multilingual keyphrase generation to mitigate the data shortage problem in non-English languages.
  arXiv  Detail & Related papers  (2022-05-21T00:45:21Z)
• Attend and Select: A Segment Attention based Selection Mechanism for Microblog Hashtag Generation [69.73215951112452]
  A hashtag is formed by tokens or phrases that may originate from various fragmentary segments of the original text. We propose an end-to-end Transformer-based generation model which consists of three phases: encoding, segments-selection, and decoding. We introduce two large-scale hashtag generation datasets, which are newly collected from Chinese Weibo and English Twitter.
  arXiv  Detail & Related papers  (2021-06-06T15:13:58Z)
• News Meets Microblog: Hashtag Annotation via Retriever-Generator [15.558878116343585]
  We propose to leverage news articles published before the microblog post to generate hashtags following a Retriever-Generator framework. Experiments on English Twitter datasets demonstrate superior performance and significant advantages of leveraging news articles to generate hashtags.
  arXiv  Detail & Related papers  (2021-04-18T05:28:13Z)
• Hit ratio: An Evaluation Metric for Hashtag Recommendation [6.746400031322727]
  We propose a new metric which we call hit ratio for hashtag recommendation. Most of the research in the area of hashtag recommendation have used classical metrics such as hit rate, precision, recall, and F1-score. A comparison of hit ratio with the classical evaluation metrics reveals their limitations.
  arXiv  Detail & Related papers  (2020-10-03T02:07:41Z)
• Deep Reinforcement Learning with Label Embedding Reward for Supervised Image Hashing [85.84690941656528]
  We introduce a novel decision-making approach for deep supervised hashing. We learn a deep Q-network with a novel label embedding reward defined by Bose-Chaudhuri-Hocquenghem codes. Our approach outperforms state-of-the-art supervised hashing methods under various code lengths.
  arXiv  Detail & Related papers  (2020-08-10T09:17:20Z)
• On Identifying Hashtags in Disaster Twitter Data [55.17975121160699]
  We construct a unique dataset of disaster-related tweets annotated with hashtags useful for filtering actionable information. Using this dataset, we investigate Long Short Term Memory-based models within a Multi-Task Learning framework. The best performing model achieves an F1-score as high as 92.22%.
  arXiv  Detail & Related papers  (2020-01-05T22:37:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.