Deep Reinforcement Learning for Reliability Based Bi-Objective Portfolio Optimization

• URL: http://arxiv.org/abs/2607.06610v1
• Date: Tue, 07 Jul 2026 06:24:32 GMT
• Title: Deep Reinforcement Learning for Reliability Based Bi-Objective Portfolio Optimization
• Abstract summary: We propose a deep reinforcement learning framework for reliability based portfolio optimization (MORP-DRL)<n>We jointly optimize expected return and downside risk using three complementary risk measures: variance, Conditional Value-at-Risk (CVaR), and Entropic Value-at-Risk (EVaR)<n>Experiments on ten global equity indices demonstrate that MORP-DRL achieves competitive risk-return performance, reduced downside risk during periods of market stress, and scalability to high-dimensional portfolio settings.
• Score: 5.11777500105171
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Portfolio optimization under uncertainty is inherently a multi-objective decision problem involving complex interactions among return, risk, market dynamics, and practical investment constraints. Existing reliability based portfolio optimization approaches primarily rely on static optimization frameworks and often fail to capture sequential decision making, tail risk, and market frictions such as transaction costs. To address these limitations, we propose a deep reinforcement learning framework for multi-objective reliability based portfolio optimization (MORP-DRL). The proposed framework jointly optimizes expected return and downside risk using three complementary risk measures: variance, Conditional Value-at-Risk (CVaR), and Entropic Value-at-Risk (EVaR). To model uncertainty and heavy-tailed market behavior, asset returns are represented using GARCH(1,1), Extreme Value Theory, and a t-copula dependence structure, while realistic scenarios are generated through quasi-Monte Carlo simulation. A Proximal Policy Optimization (PPO) based strategy is developed under practical constraints including transaction costs and portfolio bounds, and is benchmarked against NSGA-II. Experiments on ten global equity indices across pre-COVID, COVID, and post-COVID market regimes demonstrate that MORP-DRL achieves competitive risk-return performance, reduced downside risk during periods of market stress, and scalability to high-dimensional portfolio settings.

Related papers

• Ratio-Variance Regularized Policy Optimization [64.95520246570446]
  We show that explicitly constraining the policy ratio variance provides a principled local approximation to trust-region constraints.<n>We introduce $bf R2bf VPO$ (Ratio-Variance Regularized Policy Optimization), which implements this constraint via a primal-dual optimization framework.
  arXiv  Detail & Related papers  (2026-05-26T09:53:42Z)
• Enhancing a Risk Model by Adding Transient Statistical Factors [90.40844650665713]
  Estimating asset returns is a key component of financial portfolio construction and evaluation.<n>We propose a systematic method based on maximum likelihood estimation to enhance an existing factor model.<n>We show that the proposed extension captures structure in the returns that is missed by the original model.
  arXiv  Detail & Related papers  (2026-05-13T04:15:24Z)
• Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets [57.179679246370114]
  In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices.<n>During deployment, these agents trade in live markets where their own transactions can shift asset prices, a phenomenon known as market impact.<n>Traditional robust RL approaches address this model misspecification by optimizing the worst-case performance over a set of uncertainties.<n>We develop a novel class of elliptic uncertainty sets, enabling efficient and tractable robust policy evaluation.
  arXiv  Detail & Related papers  (2025-10-22T18:22:25Z)
• Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios [4.042562775811427]
  We propose an innovative framework, termed Diffusion-Augmented Reinforcement Learning (DARL), which integrates Denoising Diffusion Probabilistic Models (DDPMs) with Deep Reinforcement Learning (DRL) for portfolio management.<n>By leveraging DDPMs to generate synthetic market crash scenarios conditioned on varying stress intensities, our approach significantly enhances the robustness of training data.<n> Empirical evaluations demonstrate that DARL outperforms traditional baselines, delivering superior risk-adjusted returns and resilience against unforeseen crises.
  arXiv  Detail & Related papers  (2025-10-08T14:56:50Z)
• Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimization [82.03139922490796]
  Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data.<n>Traditional RL approaches often produce policies that merely memorize the optimal yet impractical buying and selling behaviors within the fixed dataset.<n>Our approach frames portfolio optimization as a new type of partial-offline RL problem and makes two technical contributions.
  arXiv  Detail & Related papers  (2025-05-19T06:37:25Z)
• MILLION: A General Multi-Objective Framework with Controllable Risk for Portfolio Management [16.797109778036862]
  We propose a general Multi-objectIve framework with controLLableIsk for pOrtfolio maMILLION.<n>In the risk control phase, we propose two methods, i.e., portfolio adaption and portfolio improvement.<n>The results demonstrate the effectiveness and efficiency of the proposed framework.
  arXiv  Detail & Related papers  (2024-12-04T05:19:34Z)
• Deep Reinforcement Learning and Mean-Variance Strategies for Responsible Portfolio Optimization [49.396692286192206]
  We study the use of deep reinforcement learning for responsible portfolio optimization by incorporating ESG states and objectives. Our results show that deep reinforcement learning policies can provide competitive performance against mean-variance approaches for responsible portfolio allocation.
  arXiv  Detail & Related papers  (2024-03-25T12:04:03Z)
• Uniform Pessimistic Risk and its Optimal Portfolio [0.6445605125467574]
  We propose an integral of $alpha$-risk called the textituniform pessimistic risk and a computational algorithm to obtain an optimal portfolio based on the risk. Real data analysis of three stock datasets (S&P500, CSI500, KOSPI200) demonstrates the usefulness of the proposed risk and portfolio model.
  arXiv  Detail & Related papers  (2023-03-02T09:41:15Z)
• Efficient Risk-Averse Reinforcement Learning [79.61412643761034]
  In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. We prove that under certain conditions this inevitably leads to a local-optimum barrier, and propose a soft risk mechanism to bypass it. We demonstrate improved risk aversion in maze navigation, autonomous driving, and resource allocation benchmarks.
  arXiv  Detail & Related papers  (2022-05-10T19:40:52Z)
• Deep Reinforcement Learning for Long-Short Portfolio Optimization [7.131902599861306]
  This paper constructs a Deep Reinforcement Learning (DRL) portfolio management framework with short-selling mechanisms conforming to actual trading rules.<n>Key innovations include development of a comprehensive short-selling mechanism in continuous trading that accounts for dynamic evolution of transactions across time periods.<n>Compared to traditional approaches, this model delivers superior risk-adjusted returns while reducing maximum drawdown.
  arXiv  Detail & Related papers  (2020-12-26T16:25:20Z)
• Learning Risk Preferences from Investment Portfolios Using Inverse Optimization [25.19470942583387]
  This paper presents a novel approach of measuring risk preference from existing portfolios using inverse optimization. We demonstrate our methods on real market data that consists of 20 years of asset pricing and 10 years of mutual fund portfolio holdings.
  arXiv  Detail & Related papers  (2020-10-04T21:29:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.