Mitigating Distribution Shift in Stock Price Data via Return-Volatility Normalization for Accurate Prediction
- URL: http://arxiv.org/abs/2508.20108v2
- Date: Fri, 29 Aug 2025 06:51:17 GMT
- Title: Mitigating Distribution Shift in Stock Price Data via Return-Volatility Normalization for Accurate Prediction
- Abstract summary: We propose ReVol, a robust method for stock price prediction that explicitly addresses the distribution shift problem.<n>ReVol leverages three key strategies to mitigate these shifts.<n>We show that ReVol enhances the performance of the state-of-the-art backbone models in most cases.
- Score: 18.422228047849305
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: How can we address distribution shifts in stock price data to improve stock price prediction accuracy? Stock price prediction has attracted attention from both academia and industry, driven by its potential to uncover complex market patterns and enhance decisionmaking. However, existing methods often fail to handle distribution shifts effectively, focusing on scaling or representation adaptation without fully addressing distributional discrepancies and shape misalignments between training and test data. We propose ReVol (Return-Volatility Normalization for Mitigating Distribution Shift in Stock Price Data), a robust method for stock price prediction that explicitly addresses the distribution shift problem. ReVol leverages three key strategies to mitigate these shifts: (1) normalizing price features to remove sample-specific characteristics, including return, volatility, and price scale, (2) employing an attention-based module to estimate these characteristics accurately, thereby reducing the influence of market anomalies, and (3) reintegrating the sample characteristics into the predictive process, restoring the traits lost during normalization. Additionally, ReVol combines geometric Brownian motion for long-term trend modeling with neural networks for short-term pattern recognition, unifying their complementary strengths. Extensive experiments on real-world datasets demonstrate that ReVol enhances the performance of the state-of-the-art backbone models in most cases, achieving an average improvement of more than 0.03 in IC and over 0.7 in SR across various settings.
Related papers
- Optimizing Visual Generative Models via Distribution-wise Rewards [57.46109819595665]
We present a novel framework that finetunes generative models using distribution-wise rewards, ensuring better alignment with real-world data distributions.<n>Our approach significantly improves FID-50K across various base models, from 5.77 for SiT and from 3.74 to 3.52 for EDM2.
arXiv Detail & Related papers (2026-07-02T15:08:56Z) - Addressing Market Regime Changes and Heavy-Tailed Returns in Portfolio Optimization via Bayesian VAR and Elliptical Black-Litterman [5.64741634621447]
We present a new deep reinforcement learning algorithm for portfolio optimization that accounts for fat-tailed returns.<n>The algorithm significantly outperforms state-of-the-art methods, achieving Sharpe and Sortino ratios of 1.72 and 2.70, respectively, and total returns of 57.26%.
arXiv Detail & Related papers (2026-06-08T06:58:11Z) - From Index to Equity: Pre-Training Transformers for Stock Return Prediction [2.814741750783267]
This research aims to leverage machine learning to improve stock price prediction and support informed investment decisions.<n>It investigates transformer-based models for stock prediction and examines the impact of pre-training strategies on forecasting performance.
arXiv Detail & Related papers (2026-05-12T13:18:48Z) - An Adaptive Volatility-based Learning Rate Scheduler [0.0]
VolSched is a novel LR scheduler inspired by the concept of volatility in processes like Geometric Brownian Motion.<n>By calculating the ratio between long-term and short-term accuracy volatility, VolSched increases the LR to escape plateaus and decreases it to stabilize training.
arXiv Detail & Related papers (2025-07-11T05:45:53Z) - Why Regression? Binary Encoding Classification Brings Confidence to Stock Market Index Price Prediction [13.19419686734908]
We propose a novel end-to-end framework that explicitly models the adaptive fusion of constituent stocks for index price prediction.<n>Cubic consistently outperforms state-of-the-art baselines in stock index prediction tasks.
arXiv Detail & Related papers (2025-05-18T15:45:41Z) - Assessing Uncertainty in Stock Returns: A Gaussian Mixture Distribution-Based Method [19.332951287688108]
We introduce a novel deep learning model to capture the complex, time-varying nature of asset return distributions in the Chinese stock market.<n>Our approach effectively characterizes short-term fluctuations and non-traditional features of stock returns, such as skewness and heavy tails.<n>It provides more accurate volatility forecasts and offers unique risk insights for different assets, thereby deepening the understanding of return uncertainty.
arXiv Detail & Related papers (2025-03-10T05:20:56Z) - Rejection via Learning Density Ratios [50.91522897152437]
Classification with rejection emerges as a learning paradigm which allows models to abstain from making predictions.<n>We propose a different distributional perspective, where we seek to find an idealized data distribution which maximizes a pretrained model's performance.<n>Our framework is tested empirically over clean and noisy datasets.
arXiv Detail & Related papers (2024-05-29T01:32:17Z) - Diffusion Variational Autoencoder for Tackling Stochasticity in
Multi-Step Regression Stock Price Prediction [54.21695754082441]
Multi-step stock price prediction over a long-term horizon is crucial for forecasting its volatility.
Current solutions to multi-step stock price prediction are mostly designed for single-step, classification-based predictions.
We combine a deep hierarchical variational-autoencoder (VAE) and diffusion probabilistic techniques to do seq2seq stock prediction.
Our model is shown to outperform state-of-the-art solutions in terms of its prediction accuracy and variance.
arXiv Detail & Related papers (2023-08-18T16:21:15Z) - DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend Forecasting [23.64541466875515]
We propose an end-to-end framework with two adapters, which can effectively adapt the data and the model to mitigate the effects of distribution shifts.
Our key insight is to automatically learn how to adapt stock data into a locally stationary distribution in favor of profitable updates.
Experiments on real-world stock datasets demonstrate that DoubleAdapt achieves state-of-the-art predictive performance and shows considerable efficiency.
arXiv Detail & Related papers (2023-06-16T14:18:32Z) - Distributional Reinforcement Learning with Dual Expectile-Quantile Regression [51.87411935256015]
quantile regression approach to distributional RL provides flexible and effective way of learning arbitrary return distributions.<n>We show that distributional estimation guarantees vanish, and we empirically observe that the estimated distribution rapidly collapses to its mean.<n>Motivated by the efficiency of $L$-based learning, we propose to jointly learn expectiles and quantiles of the return distribution in a way that allows efficient learning.
arXiv Detail & Related papers (2023-05-26T12:30:05Z) - An Empirical Study on Distribution Shift Robustness From the Perspective
of Pre-Training and Data Augmentation [91.62129090006745]
This paper studies the distribution shift problem from the perspective of pre-training and data augmentation.
We provide the first comprehensive empirical study focusing on pre-training and data augmentation.
arXiv Detail & Related papers (2022-05-25T13:04:53Z) - Regularizing Variational Autoencoder with Diversity and Uncertainty
Awareness [61.827054365139645]
Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference.
We propose an alternative model, DU-VAE, for learning a more Diverse and less Uncertain latent space.
arXiv Detail & Related papers (2021-10-24T07:58:13Z) - Evaluating Prediction-Time Batch Normalization for Robustness under
Covariate Shift [81.74795324629712]
We call prediction-time batch normalization, which significantly improves model accuracy and calibration under covariate shift.
We show that prediction-time batch normalization provides complementary benefits to existing state-of-the-art approaches for improving robustness.
The method has mixed results when used alongside pre-training, and does not seem to perform as well under more natural types of dataset shift.
arXiv Detail & Related papers (2020-06-19T05:08:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.