Classification Modeling with RNN-Based, Random Forest, and XGBoost for Imbalanced Data: A Case of Early Crash Detection in ASEAN-5 Stock Markets

• URL: http://arxiv.org/abs/2406.07888v2
• Date: Sun, 29 Sep 2024 12:35:19 GMT
• Title: Classification Modeling with RNN-Based, Random Forest, and XGBoost for Imbalanced Data: A Case of Early Crash Detection in ASEAN-5 Stock Markets
• Abstract summary: The study is examined using imbalanced data, which is common due to the rarity of market crashes. The study analyzes daily data from 2010 to 2023 across the major stock markets of the ASEAN-5 countries. Among the various RNN architectures, Simple RNN stands out as the most superior.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This research aims to evaluate the performance of several Recurrent Neural Network (RNN) architectures including Simple RNN, Gated Recurrent Units (GRU), and Long Short-Term Memory (LSTM), compared to classic algorithms such as Random Forest and XGBoost in building classification models for early crash detection in ASEAN-5 stock markets. The study is examined using imbalanced data, which is common due to the rarity of market crashes. The study analyzes daily data from 2010 to 2023 across the major stock markets of the ASEAN-5 countries, including Indonesia, Malaysia, Singapore, Thailand, and Philippines. Market crash is identified as the target variable when the major stock price indices fall below the Value at Risk (VaR) thresholds of 5%, 2.5% and 1%. predictors involving technical indicators of major local and global markets as well as commodity markets. This study includes 213 predictors with their respective lags (5, 10, 15, 22, 50, 200) and uses a time step of 7, expanding the total number of predictors to 1491. The challenge of data imbalance is addressed with SMOTE-ENN. The results show that all RNN-Based architectures outperform Random Forest and XGBoost. Among the various RNN architectures, Simple RNN stands out as the most superior, mainly due to the data characteristics that are not overly complex and focus more on short-term information. This study enhances and extends the range of phenomena observed in previous studies by incorporating variables like different geographical zones and time periods, as well as methodological adjustments.

Related papers

• Tabular Deep Learning for Algorithmic Trading: Cross-Regime Bayesian Optimisation for Equity Signal Generation [0.0]
  Five model classes are trained on daily observations from approximately 300 large-cap US equities over eleven years.<n>No individual deep learning architecture outperforms gradient-boosted trees, but combining XGBoost and TabNet using rank aggregation produces a Hybrid ensemble with an annualised return of 51.26%.<n>A near-zero beta indicates this outperformance is driven by stock selection, not market exposure.
  arXiv  Detail & Related papers  (2026-08-27T13:01:32Z)
• RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting [83.06074370551887]
  A fixed context window is mismatched to the time-varying optimal look-back of non-stationary price processes.<n>We propose a Mixture-of-Experts framework designed to adaptively determine the temporal context for each input sample.<n> Experiments on cumulative log-return prediction (HS300, S&P500) and fund sales forecasting demonstrate that RAVEN achieves SOTA performances, improves Pearson correlation by 9.2% on HS300 and 20.2% on S&P500, and reduces MSE by 18.2% on fund sales forecasting.
  arXiv  Detail & Related papers  (2026-06-23T02:11:04Z)
• Graph-Augmented Retrieval for Cross-Entity Financial Sentiment Analysis: A Comparative Study [0.0]
  This paper presents a novel two-hop Graph-RAG architecture versus a standard vector-only baseline for cross-entity financial sentiment analysis.<n>Our system constructs a sentiment-weighted knowledge graph of 59 equity entities from 255 news articles covering major technology stocks, then augments dense retrieval with intensity-filtered graph over INFLUENCES edges.
  arXiv  Detail & Related papers  (2026-05-19T18:55:15Z)
• Explainable Graph Neural Networks for Interbank Contagion Surveillance: A Regulatory-Aligned Framework for the U.S. Banking Sector [0.40611352512781873]
  The ST-GAT framework was created to serve as an explainable GNN-based solution for detecting bank distress early warning signs.<n>It models 8,103 FDIC insured institutions across 58 quarterly snapshots (2010Q1-2024Q2)<n>The framework achieves the highest AUPRC among all GNN architectures.
  arXiv  Detail & Related papers  (2026-04-14T19:07:28Z)
• Stock Market Prediction Using Node Transformer Architecture Integrated with BERT Sentiment Analysis [1.2362187555287152]
  This paper presents an integrated framework combining a node transformer architecture with BERT-based sentiment analysis for stock price forecasting.<n>The proposed model represents the stock market as a graph structure where individual stocks form nodes and edges capture relationships.<n> Experiments on 20 S&P 500 stocks spanning January 1982 to March 2025 demonstrate that the integrated model achieves a mean absolute percentage error (MAPE) of 0.80% for one-day-ahead predictions.
  arXiv  Detail & Related papers  (2026-03-06T05:15:22Z)
• Systemic Risk Radar: A Multi-Layer Graph Framework for Early Market Crash Warning [0.0]
  We present Systemic Risk Radar (SRR), a framework that models financial markets as multi-layer graphs to detect early signs of fragility and crash-regime transitions.<n>We evaluate SRR across three major crises: the Dot-com crash, the Global Financial Crisis, and the COVID-19 shock.<n>Results show that structural network information provides useful early-warning signals compared to feature-based models alone.
  arXiv  Detail & Related papers  (2025-12-19T03:00:09Z)
• Adaptive Weighted Genetic Algorithm-Optimized SVR for Robust Long-Term Forecasting of Global Stock Indices for investment decisions [0.5076419064097734]
  The proposed improved genetic algorithm-optimized support vector regression (IGA-SVR) model is specifically designed for long-term price prediction of global indices.<n>Extensive testing was conducted on the five global indices, namely Nifty, Dow Jones Industrial Average (DJI), DAX Performance Index (DAX), Nikkei 225 (N225) and Shanghai Stock Exchange Composite Index (SSE)
  arXiv  Detail & Related papers  (2025-12-17T06:08:45Z)
• Extending the application of dynamic Bayesian networks in calculating market risk: Standard and stressed expected shortfall [0.0]
  We extend the application of dynamic Bayesian networks (DBNs) to the estimation of 10-day 97.5% ES and stressed ES.<n>Backtesting shows that all models fail to produce statistically accurate ES and SES forecasts at the 2.5% level.<n>DBNs perform comparably to the historical simulation model, but their contribution to tail prediction is limited by the small weight assigned to their one-day-ahead forecasts.
  arXiv  Detail & Related papers  (2025-12-13T13:55:28Z)
• A Study of Dynamic Stock Relationship Modeling and S&P500 Price Forecasting Based on Differential Graph Transformer [4.6028394466086535]
  We propose a Differential Graph Transformer framework for dynamic relationship modeling and price prediction.<n>Our DGT integrates sequential graph structure changes into multi-head self-attention.<n>Clausal temporal attention captures global/local dependencies in price sequences.
  arXiv  Detail & Related papers  (2025-06-23T14:53:31Z)
• Predicting Stock Market Crash with Bayesian Generalised Pareto Regression [0.0]
  Extreme negative returns, though rare, can cause significant financial disruption.<n>This paper develops a Bayesian Generalised Pareto Regression model to forecast extreme losses in Indian equity markets.
  arXiv  Detail & Related papers  (2025-06-21T02:36:05Z)
• A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challenges [75.37448213291668]
  This paper systematically reviews existing Graph Neural Networks (GNNs) We first highlight the four key challenges faced by existing GNNs, paving the way for our exploration of real-world GNN models.
  arXiv  Detail & Related papers  (2024-03-07T13:10:37Z)
• ResNLS: An Improved Model for Stock Price Forecasting [1.2039469573641217]
  We introduce a hybrid model that improves stock price prediction by emphasizing the dependencies between adjacent stock prices. In predicting the SSE Composite Index, our experiment reveals that when the closing price data for the previous 5 consecutive trading days is used as the input, the performance of the model (ResNLS-5) is optimal. It also demonstrates at least a 20% improvement over the current state-of-the-art baselines.
  arXiv  Detail & Related papers  (2023-12-02T03:55:37Z)
• GAIA: Delving into Gradient-based Attribution Abnormality for Out-of-distribution Detection [40.07502368794068]
  We offer an innovative perspective on quantifying the disparities between in-distribution (ID) and out-of-distribution (OOD) data. We introduce two forms of abnormalities for OOD detection: the zero-deflation abnormality and the channel-wise average abnormality. The effectiveness of GAIA is validated on both commonly utilized (CIFAR) and large-scale (ImageNet-1k) benchmarks.
  arXiv  Detail & Related papers  (2023-11-16T07:05:12Z)
• Support for Stock Trend Prediction Using Transformers and Sentiment Analysis [3.147603836269998]
  We develop a Transformer based model that uses technical stock data and sentiment analysis to conduct accurate stock trend prediction over long time windows. This paper also introduces a novel dataset containing daily technical stock data and top news headline data spanning almost three years.
  arXiv  Detail & Related papers  (2023-05-18T03:26:39Z)
• Stock Broad-Index Trend Patterns Learning via Domain Knowledge Informed Generative Network [2.1163070161951865]
  We propose IndexGAN, which includes deliberate designs for the inherent characteristics of the stock market. We also utilize the critic to approximate the Wasserstein distance between actual and predicted sequences.
  arXiv  Detail & Related papers  (2023-02-27T21:56:56Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• Machine Learning Models in Stock Market Prediction [0.0]
  The paper focuses on predicting the Nifty 50 Index by using 8 Supervised Machine Learning Models. Experiments are based on historical data of Nifty 50 Index of Indian Stock Market from 22nd April, 1996 to 16th April, 2021.
  arXiv  Detail & Related papers  (2022-02-06T10:33:42Z)
• Generalizing Graph Neural Networks on Out-Of-Distribution Graphs [51.33152272781324]
  Graph Neural Networks (GNNs) are proposed without considering the distribution shifts between training and testing graphs. In such a setting, GNNs tend to exploit subtle statistical correlations existing in the training set for predictions, even though it is a spurious correlation. We propose a general causal representation framework, called StableGNN, to eliminate the impact of spurious correlations.
  arXiv  Detail & Related papers  (2021-11-20T18:57:18Z)
• Forecasting Financial Market Structure from Network Features using Machine Learning [0.6999740786886535]
  We propose a model that forecasts market correlation structure from link- and node-based financial network features using machine learning. We provide empirical evidence using three different network filtering methods to estimate market structure, namely Dynamic Asset Graph (DAG), Dynamic Minimal Spanning Tree (DMST) and Dynamic Threshold Networks (DTN) Experimental results show that the proposed model can forecast market structure with high predictive performance with up to $40%$ improvement over a time-invariant correlation-based benchmark.
  arXiv  Detail & Related papers  (2021-10-22T12:51:32Z)
• Stock Price Prediction Under Anomalous Circumstances [81.37657557441649]
  This paper aims to capture the movement pattern of stock prices under anomalous circumstances. We train ARIMA and LSTM models at the single-stock level, industry level, and general market level. Based on 100 companies' stock prices in the period of 2016 to 2020, the models achieve an average prediction accuracy of 98%.
  arXiv  Detail & Related papers  (2021-09-14T18:50:38Z)
• Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training data [52.771780951404565]
  Shift-Robust GNN (SR-GNN) is designed to account for distributional differences between biased training data and the graph's true inference distribution. We show that SR-GNN outperforms other GNN baselines by accuracy, eliminating at least (40%) of the negative effects introduced by biased training data.
  arXiv  Detail & Related papers  (2021-08-02T18:00:38Z)
• Volatility Modeling of Stocks from Selected Sectors of the Indian Economy Using GARCH [1.2891210250935146]
  We present several volatility models based on generalized autoregressive conditional heteroscedasticity (GARCH) framework for modeling the volatility of ten stocks listed in the national stock exchange (NSE) of India. The historical stock price records from Jan 1, 2010, to Apr 30, 2021, are scraped from the Yahoo Finance website using the DataReader API of the Pandas module in the Python programming language. The analysis of the results shows that asymmetric GARCH models yield more accurate forecasts on the future volatility of stocks.
  arXiv  Detail & Related papers  (2021-05-28T14:59:40Z)
• A Biased Graph Neural Network Sampler with Near-Optimal Regret [57.70126763759996]
  Graph neural networks (GNN) have emerged as a vehicle for applying deep network architectures to graph and relational data. In this paper, we build upon existing work and treat GNN neighbor sampling as a multi-armed bandit problem. We introduce a newly-designed reward function that introduces some degree of bias designed to reduce variance and avoid unstable, possibly-unbounded payouts.
  arXiv  Detail & Related papers  (2021-03-01T15:55:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.