Predicting Stock Prices with FinBERT-LSTM: Integrating News Sentiment Analysis

• URL: http://arxiv.org/abs/2407.16150v1
• Date: Tue, 23 Jul 2024 03:26:07 GMT
• Title: Predicting Stock Prices with FinBERT-LSTM: Integrating News Sentiment Analysis
• Authors: Wenjun Gu, Yihao Zhong, Shizun Li, Changsong Wei, Liting Dong, Zhuoyue Wang, Chao Yan,
• Abstract summary: We use deep learning networks, based on the history of stock prices and articles of financial, business, technical news that introduce market information to predict stock prices. We developed a pre-trained NLP model known as FinBERT, designed to discern the sentiments within financial texts. This model utilizes news categories related to the stock market structure hierarchy, namely market, industry, and stock related news categories, combined with the stock market's stock price situation in the previous week for prediction.
• Score: 2.7921137693344384
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The stock market's ascent typically mirrors the flourishing state of the economy, whereas its decline is often an indicator of an economic downturn. Therefore, for a long time, significant correlation elements for predicting trends in financial stock markets have been widely discussed, and people are becoming increasingly interested in the task of financial text mining. The inherent instability of stock prices makes them acutely responsive to fluctuations within the financial markets. In this article, we use deep learning networks, based on the history of stock prices and articles of financial, business, technical news that introduce market information to predict stock prices. We illustrate the enhancement of predictive precision by integrating weighted news categories into the forecasting model. We developed a pre-trained NLP model known as FinBERT, designed to discern the sentiments within financial texts. Subsequently, we advanced this model by incorporating the sophisticated Long Short Term Memory (LSTM) architecture, thus constructing the innovative FinBERT-LSTM model. This model utilizes news categories related to the stock market structure hierarchy, namely market, industry, and stock related news categories, combined with the stock market's stock price situation in the previous week for prediction. We selected NASDAQ-100 index stock data and trained the model on Benzinga news articles, and utilized Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and Accuracy as the key metrics for the assessment and comparative analysis of the model's performance. The results indicate that FinBERT-LSTM performs the best, followed by LSTM, and DNN model ranks third in terms of effectiveness.

Related papers

• Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approach [6.112119533910774]
  This paper introduces an advanced approach by employing Large Language Models (LLMs) instruction fine-tuned with a novel combination of instruction-based techniques and quantized low-rank adaptation (QLoRA) compression. Our methodology integrates 'base factors', such as financial metric growth and earnings transcripts, with 'external factors', including recent market indices performances and analyst grades, to create a rich, supervised dataset. This study not only demonstrates the power of integrating cutting-edge AI with fine-tuned financial data but also paves the way for future research in enhancing AI-driven financial analysis tools.
  arXiv  Detail & Related papers  (2024-08-13T04:53:31Z)
• Exploring Sectoral Profitability in the Indian Stock Market Using Deep Learning [0.0]
  The study builds upon existing literature on stock price prediction methods, emphasizing the shift toward machine learning and deep learning approaches. Using historical stock prices of 180 stocks across 18 sectors listed on the NSE, India, the LSTM model predicts future prices. Results demonstrate the efficacy of the LSTM model in accurately predicting stock prices and informing investment decisions.
  arXiv  Detail & Related papers  (2024-05-28T17:55:54Z)
• AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Framework [48.3060010653088]
  We release AlphaFin datasets, combining traditional research datasets, real-time financial data, and handwritten chain-of-thought (CoT) data. We then use AlphaFin datasets to benchmark a state-of-the-art method, called Stock-Chain, for effectively tackling the financial analysis task.
  arXiv  Detail & Related papers  (2024-03-19T09:45:33Z)
• Enhancing Financial Data Visualization for Investment Decision-Making [0.04096453902709291]
  This paper delves into the potential of Long Short-Term Memory (LSTM) networks for predicting stock dynamics. The study incorporates multiple features to enhance LSTM's capacity in capturing complex patterns. The meticulously crafted LSTM incorporates crucial price and volume attributes over a 25-day time step.
  arXiv  Detail & Related papers  (2023-12-09T07:53:25Z)
• Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction [54.21695754082441]
  Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility. Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions. We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction. Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
  arXiv  Detail & Related papers  (2023-08-18T16:21:15Z)
• Stock Market Price Prediction: A Hybrid LSTM and Sequential Self-Attention based Approach [3.8154633976469086]
  We propose a new model named Long Short-Term Memory (LSTM) with Sequential Self-Attention Mechanism (LSTM-SSAM) We conduct extensive experiments on the three stock datasets: SBIN,BANK, and BANKBARODA. The experimental results prove the effectiveness and feasibility of the proposed model compared to existing models.
  arXiv  Detail & Related papers  (2023-08-07T14:21:05Z)
• Joint Latent Topic Discovery and Expectation Modeling for Financial Markets [45.758436505779386]
  We present a groundbreaking framework for financial market analysis. This approach is the first to jointly model investor expectations and automatically mine latent stock relationships. Our model consistently achieves an annual return exceeding 10%.
  arXiv  Detail & Related papers  (2023-06-01T01:36:51Z)
• Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models [51.3422222472898]
  We document the capability of large language models (LLMs) like ChatGPT to predict stock price movements using news headlines. We develop a theoretical model incorporating information capacity constraints, underreaction, limits-to-arbitrage, and LLMs.
  arXiv  Detail & Related papers  (2023-04-15T19:22:37Z)
• FinBERT-LSTM: Deep Learning based stock price prediction using News Sentiment Analysis [0.0]
  Being able to predict short term movements in the market enables investors to reap greater returns on their investments. We use Deep Learning networks to predict stock prices, assimilating financial, business and technology news articles.
  arXiv  Detail & Related papers  (2022-11-11T15:13:16Z)
• Bayesian Bilinear Neural Network for Predicting the Mid-price Dynamics in Limit-Order Book Markets [84.90242084523565]
  Traditional time-series econometric methods often appear incapable of capturing the true complexity of the multi-level interactions driving the price dynamics. By adopting a state-of-the-art second-order optimization algorithm, we train a Bayesian bilinear neural network with temporal attention. By addressing the use of predictive distributions to analyze errors and uncertainties associated with the estimated parameters and model forecasts, we thoroughly compare our Bayesian model with traditional ML alternatives.
  arXiv  Detail & Related papers  (2022-03-07T18:59:54Z)
• Stock Price Prediction Under Anomalous Circumstances [81.37657557441649]
  This paper aims to capture the movement pattern of stock prices under anomalous circumstances. We train ARIMA and LSTM models at the single-stock level, industry level, and general market level. Based on 100 companies' stock prices in the period of 2016 to 2020, the models achieve an average prediction accuracy of 98%.
  arXiv  Detail & Related papers  (2021-09-14T18:50:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.