Sentiment and Hashtag-aware Attentive Deep Neural Network for Multimodal Post Popularity Prediction

• URL: http://arxiv.org/abs/2412.10737v1
• Date: Sat, 14 Dec 2024 08:18:23 GMT
• Title: Sentiment and Hashtag-aware Attentive Deep Neural Network for Multimodal Post Popularity Prediction
• Authors: Shubhi Bansal, Mohit Kumar, Chandravardhan Singh Raghaw, Nagendra Kumar,
• Abstract summary: Social media users articulate their opinions on a broad spectrum of subjects and share their experiences through posts on social media platforms. We propose a seNtiment and hAshtag-aware attentive deep neuRal netwoRk for multiAl posT pOpularity pRediction.
• Score: 1.3845503845316387
• License:
• Abstract: Social media users articulate their opinions on a broad spectrum of subjects and share their experiences through posts comprising multiple modes of expression, leading to a notable surge in such multimodal content on social media platforms. Nonetheless, accurately forecasting the popularity of these posts presents a considerable challenge. Prevailing methodologies primarily center on the content itself, thereby overlooking the wealth of information encapsulated within alternative modalities such as visual demographics, sentiments conveyed through hashtags and adequately modeling the intricate relationships among hashtags, texts, and accompanying images. This oversight limits the ability to capture emotional connection and audience relevance, significantly influencing post popularity. To address these limitations, we propose a seNtiment and hAshtag-aware attentive deep neuRal netwoRk for multimodAl posT pOpularity pRediction, herein referred to as NARRATOR that extracts visual demographics from faces appearing in images and discerns sentiment from hashtag usage, providing a more comprehensive understanding of the factors influencing post popularity Moreover, we introduce a hashtag-guided attention mechanism that leverages hashtags as navigational cues, guiding the models focus toward the most pertinent features of textual and visual modalities, thus aligning with target audience interests and broader social media context. Experimental results demonstrate that NARRATOR outperforms existing methods by a significant margin on two real-world datasets. Furthermore, ablation studies underscore the efficacy of integrating visual demographics, sentiment analysis of hashtags, and hashtag-guided attention mechanisms in enhancing the performance of post popularity prediction, thereby facilitating increased audience relevance, emotional engagement, and aesthetic appeal.

Related papers

• TriMod Fusion for Multimodal Named Entity Recognition in Social Media [0.0]
  We propose a novel approach that integrates textual, visual, and hashtag features (TriMod) for effective modality fusion. We demonstrate the superiority of our approach over existing state-of-the-art methods, achieving significant improvements in precision, recall, and F1 score.
  arXiv  Detail & Related papers  (2025-01-14T17:29:41Z)
• Contrastive Learning for Implicit Social Factors in Social Media Popularity Prediction [12.798988947331596]
  We study factors introduced by social platforms that impact post popularity. These factors include content relevance, user influence similarity, and user identity. We propose three implicit social factors related to popularity, including content relevance, user influence similarity, and user identity.
  arXiv  Detail & Related papers  (2024-10-12T03:25:11Z)
• Social Convos: Capturing Agendas and Emotions on Social Media [1.6385815610837167]
  We present a novel approach to extract influence indicators from messages circulating among groups of users discussing particular topics. We focus on two influence indicators: the (control of) agenda and the use of emotional language.
  arXiv  Detail & Related papers  (2024-02-23T19:14:09Z)
• RIGHT: Retrieval-augmented Generation for Mainstream Hashtag Recommendation [76.24205422163169]
  We propose RetrIeval-augmented Generative Mainstream HashTag Recommender (RIGHT) RIGHT consists of three components: 1) a retriever seeks relevant hashtags from the entire tweet-hashtags set; 2) a selector enhances mainstream identification by introducing global signals; and 3) a generator incorporates input tweets and selected hashtags to directly generate the desired hashtags. Our method achieves significant improvements over state-of-the-art baselines. Moreover, RIGHT can be easily integrated into large language models, improving the performance of ChatGPT by more than 10%.
  arXiv  Detail & Related papers  (2023-12-16T14:47:03Z)
• Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting [74.68371461260946]
  SocialSense is a framework that induces a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics. Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings.
  arXiv  Detail & Related papers  (2023-10-20T06:17:02Z)
• Predicting Tweet Engagement with Graph Neural Networks [0.0]
  We propose TweetGage, a Graph Neural Network solution to predict the user engagement based on a novel graph-based model. To validate our proposal, we focus on the Twitter platform and perform a thorough experimental campaign.
  arXiv  Detail & Related papers  (2023-05-17T10:09:40Z)
• Effects of Algorithmic Trend Promotion: Evidence from Coordinated Campaigns in Twitter's Trending Topics [5.524750830120598]
  We study the effects of a hashtag appearing on the trending topics page on the number of tweets produced with that hashtag. We find there is a statistically significant, but modest, return to a hashtag being featured on trending topics.
  arXiv  Detail & Related papers  (2023-04-08T15:22:36Z)
• Perceptual Score: What Data Modalities Does Your Model Perceive? [73.75255606437808]
  We introduce the perceptual score, a metric that assesses the degree to which a model relies on the different subsets of the input features. We find that recent, more accurate multi-modal models for visual question-answering tend to perceive the visual data less than their predecessors. Using the perceptual score also helps to analyze model biases by decomposing the score into data subset contributions.
  arXiv  Detail & Related papers  (2021-10-27T12:19:56Z)
• Exploring Visual Engagement Signals for Representation Learning [56.962033268934015]
  We present VisE, a weakly supervised learning approach, which maps social images to pseudo labels derived by clustered engagement signals. We then study how models trained in this way benefit subjective downstream computer vision tasks such as emotion recognition or political bias detection.
  arXiv  Detail & Related papers  (2021-04-15T20:50:40Z)
• Cross-Media Keyphrase Prediction: A Unified Framework with Multi-Modality Multi-Head Attention and Image Wordings [63.79979145520512]
  We explore the joint effects of texts and images in predicting the keyphrases for a multimedia post. We propose a novel Multi-Modality Multi-Head Attention (M3H-Att) to capture the intricate cross-media interactions. Our model significantly outperforms the previous state of the art based on traditional attention networks.
  arXiv  Detail & Related papers  (2020-11-03T08:44:18Z)
• Improving Image Captioning with Better Use of Captions [65.39641077768488]
  We present a novel image captioning architecture to better explore semantics available in captions and leverage that to enhance both image representation and caption generation. Our models first construct caption-guided visual relationship graphs that introduce beneficial inductive bias using weakly supervised multi-instance learning. During generation, the model further incorporates visual relationships using multi-task learning for jointly predicting word and object/predicate tag sequences.
  arXiv  Detail & Related papers  (2020-06-21T14:10:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.