A Meta Reinforcement Learning Approach to Goals-Based Wealth Management
- URL: http://arxiv.org/abs/2605.02300v1
- Date: Mon, 04 May 2026 07:48:02 GMT
- Title: A Meta Reinforcement Learning Approach to Goals-Based Wealth Management
- Abstract summary: We develop a meta reinforcement learning approach (denoted MetaRL) that is pre-trained on thousands of goals-based wealth management problems.<n>By eliminating separate training and optimization for each new investor problem, the MetaRL model in inference mode produces near-optimal dynamic investment portfolio.<n>Results are remarkably robust to capital market regime changes, even when training uses only one capital market regime.
- Score: 0.9133451183797617
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Applying concepts related to zero-shot meta-learning and pre-training of foundation models, we develop a meta reinforcement learning approach (denoted MetaRL) that is pre-trained on thousands of goals-based wealth management (GBWM) problems. Each GBWM problem involves a multiple year scenario over which the investor looks to optimally choose an investment portfolio each year and choose to fulfill all, some, or none of the different financial goals that arise each year. These choices seek to maximize the expected total investor utility obtained from the fulfilled financial goals. By eliminating separate training and optimization for each new investor problem, the MetaRL model in inference mode produces near-optimal dynamic investment portfolio and goal-fulfilling strategies for a new GBWM problem within a few hundredths of a second. This delivers expected utilities that are, on average, 97.8% of the optimal expected utilities (determined via Dynamic Programming). These results are remarkably robust to capital market regime changes, even when training uses only one capital market regime. Further, the MetaRL approach can enable solving problems with larger state spaces where Dynamic Programming becomes computationally infeasible.
Related papers
- LLM-based Personalized Portfolio Recommender: Integrating Large Language Models and Reinforcement Learning for Intelligent Investment Strategy Optimization [0.08496348835248901]
This paper introduces the LLM-based Personalized Portfolio Recommender.<n>The framework combines Large Language Models, reinforcement learning, and individualized risk preference modeling to support intelligent investment decision-making.
arXiv Detail & Related papers (2025-12-15T02:12:53Z) - Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons [0.0]
This research proposes an enhancement to the innovative portfolio optimization approach using the G-Learning algorithm.<n>The goal is to maximize portfolio value by a target date while minimizing the investor's periodic contributions.
arXiv Detail & Related papers (2025-11-22T14:21:06Z) - FinXplore: An Adaptive Deep Reinforcement Learning Framework for Balancing and Discovering Investment Opportunities [4.042562775811427]
This study introduces an investment landscape that integrates exploiting existing assets with exploring new investment opportunities.<n>One agent allocates assets within the existing universe, while another assists in exploring new opportunities in the extended universe.<n>Experiments demonstrate the superiority of the suggested approach against the state-of-the-art portfolio strategies and baseline methods.
arXiv Detail & Related papers (2025-09-05T10:20:32Z) - Building crypto portfolios with agentic AI [46.348283638884425]
The rapid growth of crypto markets has opened new opportunities for investors, but at the same time exposed them to high volatility.<n>This paper presents a practical application of a multi-agent system designed to autonomously construct and evaluate crypto-asset allocations.
arXiv Detail & Related papers (2025-07-11T18:03:51Z) - Demystifying Domain-adaptive Post-training for Financial LLMs [87.28855088465197]
FINDAP is a systematic and fine-grained investigation into domain-adaptive post-training of large language models.<n>Our approach consists of four key components: FinCap, FinRec, FinTrain and FinEval.<n>The resulting model, Llama-Fin, achieves, state-of-the-art performance across a wide range of financial tasks.
arXiv Detail & Related papers (2025-01-09T04:26:15Z) - Deep Reinforcement Learning and Mean-Variance Strategies for Responsible Portfolio Optimization [49.396692286192206]
We study the use of deep reinforcement learning for responsible portfolio optimization by incorporating ESG states and objectives.
Our results show that deep reinforcement learning policies can provide competitive performance against mean-variance approaches for responsible portfolio allocation.
arXiv Detail & Related papers (2024-03-25T12:04:03Z) - Deep Reinforcement Learning for Robust Goal-Based Wealth Management [0.0]
Goal-based investing is an approach to wealth management that prioritizes achieving specific financial goals.
reinforcement learning is a machine learning technique appropriate for sequential decision-making.
In this paper, a novel approach for robust goal-based wealth management based on deep reinforcement learning is proposed.
arXiv Detail & Related papers (2023-07-25T13:51:12Z) - Meta-Learning with Neural Tangent Kernels [58.06951624702086]
We propose the first meta-learning paradigm in the Reproducing Kernel Hilbert Space (RKHS) induced by the meta-model's Neural Tangent Kernel (NTK)
Within this paradigm, we introduce two meta-learning algorithms, which no longer need a sub-optimal iterative inner-loop adaptation as in the MAML framework.
We achieve this goal by 1) replacing the adaptation with a fast-adaptive regularizer in the RKHS; and 2) solving the adaptation analytically based on the NTK theory.
arXiv Detail & Related papers (2021-02-07T20:53:23Z) - Decentralized Reinforcement Learning: Global Decision-Making via Local
Economic Transactions [80.49176924360499]
We establish a framework for directing a society of simple, specialized, self-interested agents to solve sequential decision problems.
We derive a class of decentralized reinforcement learning algorithms.
We demonstrate the potential advantages of a society's inherent modular structure for more efficient transfer learning.
arXiv Detail & Related papers (2020-07-05T16:41:09Z) - Reinforcement-Learning based Portfolio Management with Augmented Asset
Movement Prediction States [71.54651874063865]
Portfolio management (PM) aims to achieve investment goals such as maximal profits or minimal risks.
In this paper, we propose SARL, a novel State-Augmented RL framework for PM.
Our framework aims to address two unique challenges in financial PM: (1) data Heterogeneous data -- the collected information for each asset is usually diverse, noisy and imbalanced (e.g., news articles); and (2) environment uncertainty -- the financial market is versatile and non-stationary.
arXiv Detail & Related papers (2020-02-09T08:10:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.