CrudeBERT: Applying Economic Theory towards fine-tuning Transformer-based Sentiment Analysis Models to the Crude Oil Market

• URL: http://arxiv.org/abs/2305.06140v1
• Date: Wed, 10 May 2023 13:42:56 GMT
• Title: CrudeBERT: Applying Economic Theory towards fine-tuning Transformer-based Sentiment Analysis Models to the Crude Oil Market
• Authors: Himmet Kaplan, Ralf-Peter Mundani, Heiko R\"olke, Albert Weichselbraun
• Abstract summary: CrudeBERT is a new sentiment analysis model that draws upon these events to contextualize and fine-tune FinBERT. An extensive evaluation demonstrates that CrudeBERT outperforms proprietary and open-source solutions in the domain of crude oil.
• Score: 0.15293427903448023
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Predicting market movements based on the sentiment of news media has a long tradition in data analysis. With advances in natural language processing, transformer architectures have emerged that enable contextually aware sentiment classification. Nevertheless, current methods built for the general financial market such as FinBERT cannot distinguish asset-specific value-driving factors. This paper addresses this shortcoming by presenting a method that identifies and classifies events that impact supply and demand in the crude oil markets within a large corpus of relevant news headlines. We then introduce CrudeBERT, a new sentiment analysis model that draws upon these events to contextualize and fine-tune FinBERT, thereby yielding improved sentiment classifications for headlines related to the crude oil futures market. An extensive evaluation demonstrates that CrudeBERT outperforms proprietary and open-source solutions in the domain of crude oil.

Related papers

• Unifying Economic and Language Models for Enhanced Sentiment Analysis of the Oil Market [0.0699049312989311]
  Crude oil, a critical component of the global economy, has its prices influenced by various factors such as economic trends, political events, and natural disasters. Recent advancements in natural language processing bring new possibilities for event-based analysis. We introduce CrudeBERT, a fine-tuned LM specifically for the crude oil market.
  arXiv  Detail & Related papers  (2024-10-16T11:41:24Z)
• Predicting Stock Prices with FinBERT-LSTM: Integrating News Sentiment Analysis [2.7921137693344384]
  We use deep learning networks, based on the history of stock prices and articles of financial, business, technical news that introduce market information to predict stock prices. We developed a pre-trained NLP model known as FinBERT, designed to discern the sentiments within financial texts. This model utilizes news categories related to the stock market structure hierarchy, namely market, industry, and stock related news categories, combined with the stock market's stock price situation in the previous week for prediction.
  arXiv  Detail & Related papers  (2024-07-23T03:26:07Z)
• Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction [54.21695754082441]
  Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility. Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions. We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction. Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
  arXiv  Detail & Related papers  (2023-08-18T16:21:15Z)
• Joint Latent Topic Discovery and Expectation Modeling for Financial Markets [45.758436505779386]
  We present a groundbreaking framework for financial market analysis. This approach is the first to jointly model investor expectations and automatically mine latent stock relationships. Our model consistently achieves an annual return exceeding 10%.
  arXiv  Detail & Related papers  (2023-06-01T01:36:51Z)
• Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models [51.3422222472898]
  We document the capability of large language models (LLMs) like ChatGPT to predict stock price movements using news headlines. We develop a theoretical model incorporating information capacity constraints, underreaction, limits-to-arbitrage, and LLMs.
  arXiv  Detail & Related papers  (2023-04-15T19:22:37Z)
• Stock Broad-Index Trend Patterns Learning via Domain Knowledge Informed Generative Network [2.1163070161951865]
  We propose IndexGAN, which includes deliberate designs for the inherent characteristics of the stock market. We also utilize the critic to approximate the Wasserstein distance between actual and predicted sequences.
  arXiv  Detail & Related papers  (2023-02-27T21:56:56Z)
• Research on the correlation between text emotion mining and stock market based on deep learning [6.000327333763521]
  This paper will use the Bert model to train the financial corpus and predict the Shenzhen stock index. It is found that the emotional characteristics obtained by applying the BERT model to the financial corpus can be reflected in the fluctuation of the stock market.
  arXiv  Detail & Related papers  (2022-05-09T12:51:16Z)
• Bayesian Bilinear Neural Network for Predicting the Mid-price Dynamics in Limit-Order Book Markets [84.90242084523565]
  Traditional time-series econometric methods often appear incapable of capturing the true complexity of the multi-level interactions driving the price dynamics. By adopting a state-of-the-art second-order optimization algorithm, we train a Bayesian bilinear neural network with temporal attention. By addressing the use of predictive distributions to analyze errors and uncertainties associated with the estimated parameters and model forecasts, we thoroughly compare our Bayesian model with traditional ML alternatives.
  arXiv  Detail & Related papers  (2022-03-07T18:59:54Z)
• Forecasting Crude Oil Price Using Event Extraction [2.132096006921048]
  A novel crude oil price forecasting framework, AGESL, is proposed to deal with this problem. In our approach, an open domain event extraction algorithm is utilized to extract underlying related events. Then a deep neural network integrating the news event features, sentimental features, and historical price features is built to predict future crude oil prices.
  arXiv  Detail & Related papers  (2021-11-14T08:48:43Z)
• A Sentiment Analysis Approach to the Prediction of Market Volatility [62.997667081978825]
  We have explored the relationship between sentiment extracted from financial news and tweets and FTSE100 movements. The sentiment captured from news headlines could be used as a signal to predict market returns; the same does not apply for volatility. We developed an accurate classifier for the prediction of market volatility in response to the arrival of new information.
  arXiv  Detail & Related papers  (2020-12-10T01:15:48Z)
• A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding [69.37299910149981]
  A key component for the successful renewable energy sources integration is the usage of energy storage. We propose a novel modelling framework for the strategic participation of energy storage in the European continuous intraday market. An distributed version of the fitted Q algorithm is chosen for solving this problem due to its sample efficiency. Results indicate that the agent converges to a policy that achieves in average higher total revenues than the benchmark strategy.
  arXiv  Detail & Related papers  (2020-04-13T13:50:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.