Deep Reinforcement Learning Framework for Diversified Portfolio Management Across Global Equity Markets
- URL: http://arxiv.org/abs/2605.17307v1
- Date: Sun, 17 May 2026 07:50:37 GMT
- Title: Deep Reinforcement Learning Framework for Diversified Portfolio Management Across Global Equity Markets
- Abstract summary: This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets.<n>Five model configurations are compared, varying in reward formulation, policy structure, portfolio constraints, and temporal encoder.<n>Results show that RL strategies achieve competitive risk-adjusted performance primarily in the Euro Stoxx 50, where statistically significant abnormal returns are observed.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision Process, incorporating transaction costs, turnover penalties, and diversification constraints into the reward function. Five model configurations are compared, varying in reward formulation, policy structure (flat versus hierarchical Dirichlet), portfolio constraints, and temporal encoder (LSTM versus Transformer), and evaluated via walk-forward optimization across sixteen out-of-sample folds spanning 2003-2026 on the Nasdaq-100, Nikkei 225, and Euro Stoxx 50. Results show that RL strategies achieve competitive risk-adjusted performance primarily in the Euro Stoxx 50, where statistically significant abnormal returns are observed, but the central hypothesis is only partially confirmed: no strategy achieves statistically significant excess returns relative to Buy and Hold under HAC-robust inference across all markets. Regime analysis reveals that RL adds the most value during periods of elevated uncertainty, while ensemble aggregation across markets improves risk-adjusted performance and confirms the benefits of geographic diversification.
Related papers
- Deep Reinforcement Learning for Reliability Based Bi-Objective Portfolio Optimization [5.11777500105171]
We propose a deep reinforcement learning framework for reliability based portfolio optimization (MORP-DRL)<n>We jointly optimize expected return and downside risk using three complementary risk measures: variance, Conditional Value-at-Risk (CVaR), and Entropic Value-at-Risk (EVaR)<n>Experiments on ten global equity indices demonstrate that MORP-DRL achieves competitive risk-return performance, reduced downside risk during periods of market stress, and scalability to high-dimensional portfolio settings.
arXiv Detail & Related papers (2026-07-07T06:24:32Z) - Dynamic Multi-Pair Trading Strategy in Cryptocurrency Markets with Deep Reinforcement Learning [0.0]
This thesis contributes to the quantitative finance literature by introducing a hybrid architecture that combines statistical arbitrage with DRL execution policies.<n>It delivers a novel framework for safe reinforcement learning via deterministic shielding, proving that anchoring a neural policy to statistically robust boundaries successfully mitigates severe divergence risks.
arXiv Detail & Related papers (2026-06-03T08:10:33Z) - Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards [73.44333771806282]
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective paradigm for improving the reasoning capabilities of large language models.<n>We propose Correction-Oriented Policy Optimization (CIPO), a simple and effective extension to RLVR that converts on-policy failed trajectories into correction-oriented supervision.<n>CIPO improves learning effectiveness while explicitly enhancing the model's ability to correct its own errors.
arXiv Detail & Related papers (2026-05-14T08:22:21Z) - Experience Sharing in Mutual Reinforcement Learning for Heterogeneous Language Models [48.79781352398832]
We introduce Mutual Reinforcement Learning, a framework for concurrent RL post-training.<n>The framework combines a Shared Experience Exchange (SEE), Multi-Worker Resource Allocation (MWRA), and a Tokenizer Heterogeneity Layer (THL)<n>We instantiate three controlled probes on top of GRPO: data-level rollout sharing via Peer Rollout Pooling (PRP), value-level advantage sharing via Cross-Policy GRPO Advantage Sharing (XGRPO), and outcome-level success transfer via Success-Gated Transfer (SGT)
arXiv Detail & Related papers (2026-05-08T05:01:40Z) - Taming the Black Swan: A Momentum-Gated Hierarchical Optimisation Framework for Asymmetric Alpha Generation [0.0]
This study presents the Adaptive Equity Generation and Immunisation System (AEGIS), a novel framework that reengineers the trade-off between growth and stability.<n>It uses a volatility-adjusted momentum filter to identify trend strength and employing a minimax correlation algorithm to enforce structural diversification.<n> Empirical validation via a comprehensive 20-year walk-forward backtest (2006-2025), which covers significant stress events like the 2008 Global Financial Crisis, confirms that the framework produces substantial excess alpha relative to the standard S&P 500 benchmark.
arXiv Detail & Related papers (2026-04-10T07:39:27Z) - DVPO: Distributional Value Modeling-based Policy Optimization for LLM Post-Training [45.777138699734024]
We introduce DVPO, a new RL framework that combines conditional risk theory with distributional value modeling to better balance robustness and generalization.<n> DVPO consistently outperforms PPO, GRPO, and robust Bellman-based PPO under noisy supervision.
arXiv Detail & Related papers (2025-12-03T14:48:38Z) - Statistical Arbitrage in Polish Equities Market Using Deep Learning Techniques [0.0]
We study a systematic approach to a popular Statistical Arbitrage technique: Pairs Trading.<n>We replace the second asset with a replication of the first using risk factor representations.<n>We adapt the framework of Avellaneda and Lee (2008) to the Polish market.
arXiv Detail & Related papers (2025-11-20T21:09:34Z) - Cryptocurrency Portfolio Management with Reinforcement Learning: Soft Actor--Critic and Deep Deterministic Policy Gradient Algorithms [0.0]
This paper proposes a reinforcement learning--based framework for cryptocurrency portfolio management.<n>We use the Soft Actor--Critic (SAC) and Deep Deterministic Policy Gradient (DDPG) algorithms.
arXiv Detail & Related papers (2025-11-16T03:43:24Z) - Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets [57.179679246370114]
In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices.<n>During deployment, these agents trade in live markets where their own transactions can shift asset prices, a phenomenon known as market impact.<n>Traditional robust RL approaches address this model misspecification by optimizing the worst-case performance over a set of uncertainties.<n>We develop a novel class of elliptic uncertainty sets, enabling efficient and tractable robust policy evaluation.
arXiv Detail & Related papers (2025-10-22T18:22:25Z) - Building crypto portfolios with agentic AI [46.348283638884425]
The rapid growth of crypto markets has opened new opportunities for investors, but at the same time exposed them to high volatility.<n>This paper presents a practical application of a multi-agent system designed to autonomously construct and evaluate crypto-asset allocations.
arXiv Detail & Related papers (2025-07-11T18:03:51Z) - Deep Learning Enhanced Multi-Day Turnover Quantitative Trading Algorithm for Chinese A-Share Market [0.0]
Algorithm is trained on comprehensive A-share data from 2010-2020 and rigorously backtested on 2021-2024 data.<n>It achieves remarkable performance with 15.2% annualized returns, maximum drawdown constrained below 5%, and a Sharpe ratio of 1.87.
arXiv Detail & Related papers (2025-06-03T01:59:55Z) - MTS: A Deep Reinforcement Learning Portfolio Management Framework with Time-Awareness and Short-Selling [0.8642326601683299]
This paper introduces a Deep Reinforcement Learning Portfolio Management Framework with Time-Awareness and Short-Selling.<n>It addresses limitations in dynamic risk management, exploitation of temporal markets, and incorporation of complex trading strategies such as short-selling.<n>It consistently achieves higher cumulative returns, Sharpe, Omega, and Sortino ratios, underscoring its effectiveness in balancing risk and return.
arXiv Detail & Related papers (2025-03-06T06:41:17Z) - Deep Reinforcement Learning and Mean-Variance Strategies for Responsible Portfolio Optimization [49.396692286192206]
We study the use of deep reinforcement learning for responsible portfolio optimization by incorporating ESG states and objectives.
Our results show that deep reinforcement learning policies can provide competitive performance against mean-variance approaches for responsible portfolio allocation.
arXiv Detail & Related papers (2024-03-25T12:04:03Z) - Reinforcement-Learning based Portfolio Management with Augmented Asset
Movement Prediction States [71.54651874063865]
Portfolio management (PM) aims to achieve investment goals such as maximal profits or minimal risks.
In this paper, we propose SARL, a novel State-Augmented RL framework for PM.
Our framework aims to address two unique challenges in financial PM: (1) data Heterogeneous data -- the collected information for each asset is usually diverse, noisy and imbalanced (e.g., news articles); and (2) environment uncertainty -- the financial market is versatile and non-stationary.
arXiv Detail & Related papers (2020-02-09T08:10:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.