The Battle of Information Representations: Comparing Sentiment and Semantic Features for Forecasting Market Trends

• URL: http://arxiv.org/abs/2303.14221v1
• Date: Fri, 24 Mar 2023 18:30:15 GMT
• Title: The Battle of Information Representations: Comparing Sentiment and Semantic Features for Forecasting Market Trends
• Authors: Andrei Zaichenko, Aleksei Kazakov, Elizaveta Kovtun, and Semen Budennyy
• Abstract summary: We study whether semantic features in the form of contextual embeddings are more valuable than sentiment attributes for forecasting market trends. We consider the corpus of Twitter posts related to the largest companies by capitalization from NASDAQ and their close prices. Our results show that in the substantially prevailing number of cases, the use of sentiment features leads to higher metrics.
• Score: 0.5249805590164902
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The study of the stock market with the attraction of machine learning approaches is a major direction for revealing hidden market regularities. This knowledge contributes to a profound understanding of financial market dynamics and getting behavioural insights, which could hardly be discovered with traditional analytical methods. Stock prices are inherently interrelated with world events and social perception. Thus, in constructing the model for stock price prediction, the critical stage is to incorporate such information on the outside world, reflected through news and social media posts. To accommodate this, researchers leverage the implicit or explicit knowledge representations: (1) sentiments extracted from the texts or (2) raw text embeddings. However, there is too little research attention to the direct comparison of these approaches in terms of the influence on the predictive power of financial models. In this paper, we aim to close this gap and figure out whether the semantic features in the form of contextual embeddings are more valuable than sentiment attributes for forecasting market trends. We consider the corpus of Twitter posts related to the largest companies by capitalization from NASDAQ and their close prices. To start, we demonstrate the connection of tweet sentiments with the volatility of companies' stock prices. Convinced of the existing relationship, we train Temporal Fusion Transformer models for price prediction supplemented with either tweet sentiments or tweet embeddings. Our results show that in the substantially prevailing number of cases, the use of sentiment features leads to higher metrics. Noteworthy, the conclusions are justifiable within the considered scenario involving Twitter posts and stocks of the biggest tech companies.

Related papers

• Effect of Leaders Voice on Financial Market: An Empirical Deep Learning Expedition on NASDAQ, NSE, and Beyond [1.6622844933418388]
  Deep learning based models are proposed to predict the trend of financial market based on NLP analysis of the twitter handles of leaders of different fields. The Indian and USA financial markets are explored in the present work where as other markets can be taken in future.
  arXiv  Detail & Related papers  (2024-03-18T18:19:08Z)
• Tweet Influence on Market Trends: Analyzing the Impact of Social Media Sentiment on Biotech Stocks [0.0]
  This study investigates the relationship between tweet sentiment across diverse categories: news, company opinions, CEO opinions, competitor opinions, and stock market behavior in the biotechnology sector. We analyzed historical stock market data for ten of the largest and most influential pharmaceutical companies alongside Twitter data related to COVID-19, vaccines, the companies, and their respective CEOs.
  arXiv  Detail & Related papers  (2024-01-26T15:43:27Z)
• Stock Movement and Volatility Prediction from Tweets, Macroeconomic Factors and Historical Prices [20.574163667057476]
  Prior research using tweet data for stock market prediction faces three challenges. ECON has an adept tweets filter that efficiently extracts and decodes the vast array of tweet data. It discerns multi-level relationships among stocks, sectors, and macroeconomic factors through a self-aware mechanism in semantic space.
  arXiv  Detail & Related papers  (2023-12-04T22:27:43Z)
• Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting [74.68371461260946]
  SocialSense is a framework that induces a belief-centered graph on top of an existent social network, along with graph-based propagation to capture social dynamics. Our method surpasses existing state-of-the-art in experimental evaluations for both zero-shot and supervised settings.
  arXiv  Detail & Related papers  (2023-10-20T06:17:02Z)
• Predicting Financial Market Trends using Time Series Analysis and Natural Language Processing [0.0]
  This study was to assess the viability of Twitter sentiments as a tool for predicting stock prices of major corporations such as Tesla, Apple. Our findings indicate that positivity, negativity, and subjectivity are the primary determinants of fluctuations in stock prices.
  arXiv  Detail & Related papers  (2023-08-31T21:20:58Z)
• ManiTweet: A New Benchmark for Identifying Manipulation of News on Social Media [74.93847489218008]
  We present a novel task, identifying manipulation of news on social media, which aims to detect manipulation in social media posts and identify manipulated or inserted information. To study this task, we have proposed a data collection schema and curated a dataset called ManiTweet, consisting of 3.6K pairs of tweets and corresponding articles. Our analysis demonstrates that this task is highly challenging, with large language models (LLMs) yielding unsatisfactory performance.
  arXiv  Detail & Related papers  (2023-05-23T16:40:07Z)
• Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models [51.3422222472898]
  We document the capability of large language models (LLMs) like ChatGPT to predict stock price movements using news headlines. We develop a theoretical model incorporating information capacity constraints, underreaction, limits-to-arbitrage, and LLMs.
  arXiv  Detail & Related papers  (2023-04-15T19:22:37Z)
• Taureau: A Stock Market Movement Inference Framework Based on Twitter Sentiment Analysis [0.0]
  We propose Taureau, a framework that leverages Twitter sentiment analysis for predicting stock market movement. We first utilize Tweepy and getOldTweets to obtain historical tweets indicating public opinions for a set of top companies. We correlate the temporal dimensions of the obtained sentiment scores with monthly stock price movement data.
  arXiv  Detail & Related papers  (2023-03-30T19:12:08Z)
• A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Prediction [100.9772316028191]
  In this paper, we experiment with a variety of adversarial attack configurations to fool three stock prediction victim models. Our results show that the proposed attack method can achieve consistent success rates and cause significant monetary loss in trading simulation.
  arXiv  Detail & Related papers  (2022-05-01T05:12:22Z)
• REST: Relational Event-driven Stock Trend Forecasting [76.08435590771357]
  We propose a relational event-driven stock trend forecasting (REST) framework, which can address the shortcoming of existing methods. To remedy the first shortcoming, we propose to model the stock context and learn the effect of event information on the stocks under different contexts. To address the second shortcoming, we construct a stock graph and design a new propagation layer to propagate the effect of event information from related stocks.
  arXiv  Detail & Related papers  (2021-02-15T07:22:09Z)
• A Sentiment Analysis Approach to the Prediction of Market Volatility [62.997667081978825]
  We have explored the relationship between sentiment extracted from financial news and tweets and FTSE100 movements. The sentiment captured from news headlines could be used as a signal to predict market returns; the same does not apply for volatility. We developed an accurate classifier for the prediction of market volatility in response to the arrival of new information.
  arXiv  Detail & Related papers  (2020-12-10T01:15:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.