Absolute Value Constraint: The Reason for Invalid Performance Evaluation Results of Neural Network Models for Stock Price Prediction

• URL: http://arxiv.org/abs/2101.10942v2
• Date: Fri, 19 Mar 2021 03:56:09 GMT
• Title: Absolute Value Constraint: The Reason for Invalid Performance Evaluation Results of Neural Network Models for Stock Price Prediction
• Authors: Yi Wei
• Abstract summary: We implement six shallow and deep neural networks to predict stock prices and use four prediction error measures for evaluation. The results show that the prediction error value only partially reflects the model accuracy of the stock price prediction, and cannot reflect the change in the direction of the model predicted stock price.
• Score: 5.212847826445359
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Neural networks for stock price prediction(NNSPP) have been popular for decades. However, most of its study results remain in the research paper and cannot truly play a role in the securities market. One of the main reasons leading to this situation is that the prediction error(PE) based evaluation results have statistical flaws. Its prediction results cannot represent the most critical financial direction attributes. So it cannot provide investors with convincing, interpretable, and consistent model performance evaluation results for practical applications in the securities market. To illustrate, we have used data selected from 20 stock datasets over six years from the Shanghai and Shenzhen stock market in China, and 20 stock datasets from NASDAQ and NYSE in the USA. We implement six shallow and deep neural networks to predict stock prices and use four prediction error measures for evaluation. The results show that the prediction error value only partially reflects the model accuracy of the stock price prediction, and cannot reflect the change in the direction of the model predicted stock price. This characteristic determines that PE is not suitable as an evaluation indicator of NNSPP. Otherwise, it will bring huge potential risks to investors. Therefore, this paper establishes an experiment platform to confirm that the PE method is not suitable for the NNSPP evaluation, and provides a theoretical basis for the necessity of creating a new NNSPP evaluation method in the future.

Related papers

• A Study on Stock Forecasting Using Deep Learning and Statistical Models [3.437407981636465]
  This paper will review many deep learning algorithms for stock price forecasting. We use a record of s&p 500 index data for training and testing. It will discuss various models, including the Auto regression integration moving average model, the Recurrent neural network model, the long short-term model, the convolutional neural network model, and the full convolutional neural network model.
  arXiv  Detail & Related papers  (2024-02-08T16:45:01Z)
• Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction [54.21695754082441]
  Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility. Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions. We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction. Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
  arXiv  Detail & Related papers  (2023-08-18T16:21:15Z)
• Stock Market Price Prediction: A Hybrid LSTM and Sequential Self-Attention based Approach [3.8154633976469086]
  We propose a new model named Long Short-Term Memory (LSTM) with Sequential Self-Attention Mechanism (LSTM-SSAM) We conduct extensive experiments on the three stock datasets: SBIN,BANK, and BANKBARODA. The experimental results prove the effectiveness and feasibility of the proposed model compared to existing models.
  arXiv  Detail & Related papers  (2023-08-07T14:21:05Z)
• HireVAE: An Online and Adaptive Factor Model Based on Hierarchical and Regime-Switch VAE [113.47287249524008]
  It is still an open question to build a factor model that can conduct stock prediction in an online and adaptive setting. We propose the first deep learning based online and adaptive factor model, HireVAE, at the core of which is a hierarchical latent space that embeds the relationship between the market situation and stock-wise latent factors. Across four commonly used real stock market benchmarks, the proposed HireVAE demonstrate superior performance in terms of active returns over previous methods.
  arXiv  Detail & Related papers  (2023-06-05T12:58:13Z)
• Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Models [57.70351255180495]
  We use ChatGPT to assess whether each headline is good, bad, or neutral for firms' stock prices. We find that ChatGPT outperforms traditional sentiment analysis methods. Long-short strategies based on ChatGPT-4 deliver the highest Sharpe ratio.
  arXiv  Detail & Related papers  (2023-04-15T19:22:37Z)
• Uncertainty estimation of pedestrian future trajectory using Bayesian approximation [137.00426219455116]
  Under dynamic traffic scenarios, planning based on deterministic predictions is not trustworthy. The authors propose to quantify uncertainty during forecasting using approximation which deterministic approaches fail to capture. The effect of dropout weights and long-term prediction on future state uncertainty has been studied.
  arXiv  Detail & Related papers  (2022-05-04T04:23:38Z)
• Machine Learning for Stock Prediction Based on Fundamental Analysis [13.920569652186714]
  We investigate three machine learning algorithms: Feed-forward Neural Network (FNN), Random Forest (RF) and Adaptive Neural Fuzzy Inference System (ANFIS) RF model achieves the best prediction results, and feature selection is able to improve test performance of FNN and ANFIS. Our findings demonstrate that machine learning models could be used to aid fundamental analysts with decision-making regarding stock investment.
  arXiv  Detail & Related papers  (2022-01-26T18:48:51Z)
• Learning to Predict Trustworthiness with Steep Slope Loss [69.40817968905495]
  We study the problem of predicting trustworthiness on real-world large-scale datasets. We observe that the trustworthiness predictors trained with prior-art loss functions are prone to view both correct predictions and incorrect predictions to be trustworthy. We propose a novel steep slope loss to separate the features w.r.t. correct predictions from the ones w.r.t. incorrect predictions by two slide-like curves that oppose each other.
  arXiv  Detail & Related papers  (2021-09-30T19:19:09Z)
• Stock Price Prediction Under Anomalous Circumstances [81.37657557441649]
  This paper aims to capture the movement pattern of stock prices under anomalous circumstances. We train ARIMA and LSTM models at the single-stock level, industry level, and general market level. Based on 100 companies' stock prices in the period of 2016 to 2020, the models achieve an average prediction accuracy of 98%.
  arXiv  Detail & Related papers  (2021-09-14T18:50:38Z)
• Profitability Analysis in Stock Investment Using an LSTM-Based Deep Learning Model [1.2891210250935146]
  We present a deep learning-based regression model built on a long-and-short-term memory network (LSTM) network. It extracts historical stock prices based on a stock's ticker name for a specified pair of start and end dates, and forecasts the future stock prices. We deploy the model on 75 significant stocks chosen from 15 critical sectors of the Indian stock market.
  arXiv  Detail & Related papers  (2021-04-06T11:09:51Z)
• Stock Price Prediction Using CNN and LSTM-Based Deep Learning Models [0.0]
  This paper presents a suite of deep learning based models for stock price prediction. We use the historical records of the NIFTY 50 index listed in the National Stock Exchange of India. Our proposition includes two regression models built on convolutional neural networks and three long and short term memory network based predictive models.
  arXiv  Detail & Related papers  (2020-10-22T03:09:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.