Deep reinforcement learning for portfolio management based on the empirical study of chinese stock market

• URL: http://arxiv.org/abs/2012.13773v4
• Date: Mon, 19 Apr 2021 16:25:09 GMT
• Title: Deep reinforcement learning for portfolio management based on the empirical study of chinese stock market
• Authors: Gang Huang, Xiaohua Zhou, Qingyang Song
• Abstract summary: This paper is to verify that current cutting-edge technology, deep reinforcement learning, can be applied to portfolio management. In experiments, we use our model in several randomly selected portfolios which include CSI300 that represents the market's rate of return and the randomly selected constituents of CSI500.
• Score: 3.5952664589125916
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: According to documents, there has not been a completely artificial intelligence framework with shorting mechanism in continuous action space for portfolio optimization. The objective of this paper is to verify that current cutting-edge technology, deep reinforcement learning, can be applied to portfolio management, and help us get artificial intelligence. We improve on the existing Deep Reinforcement Learning Portfolio model and make many innovations. Unlike many previous studies on discrete trading signals, we make the agent to short in a continuous action space for portfolio optimization. In addition, we design an arbitrage mechanism based on Arbitrage Pricing Theory, and redesign the activation function for acquiring action vectors. Furthermore, we redesign neural networks for reinforcement learning with reference to deep neural networks that process image data. In experiments, we use our model in several randomly selected portfolios which include CSI300 that represents the market's rate of return and the randomly selected constituents of CSI500. The experimental results show that no matter what stocks we select in our portfolios, we can always get a higher return than the market itself, namely we can get artificial intelligence through deep reinforcement learning to defeat market.

Related papers

• Cryptocurrency Portfolio Optimization by Neural Networks [81.20955733184398]
  This paper proposes an effective algorithm based on neural networks to take advantage of these investment products. A deep neural network, which outputs the allocation weight of each asset at a time interval, is trained to maximize the Sharpe ratio. A novel loss term is proposed to regulate the network's bias towards a specific asset, thus enforcing the network to learn an allocation strategy that is close to a minimum variance strategy.
  arXiv  Detail & Related papers  (2023-10-02T12:33:28Z)
• Gated Deeper Models are Effective Factor Learners [0.9137554315375922]
  We present a 5-layer deep neural network that generates more meaningful factors in a 2048-dimensional space. We evaluate our model over 2,000 stocks from the China market with their recent three years records.
  arXiv  Detail & Related papers  (2023-05-18T04:07:47Z)
• Mastering the Unsupervised Reinforcement Learning Benchmark from Pixels [112.63440666617494]
  Reinforcement learning algorithms can succeed but require large amounts of interactions between the agent and the environment. We propose a new method to solve it, using unsupervised model-based RL, for pre-training the agent. We show robust performance on the Real-Word RL benchmark, hinting at resiliency to environment perturbations during adaptation.
  arXiv  Detail & Related papers  (2022-09-24T14:22:29Z)
• An intelligent algorithmic trading based on a risk-return reinforcement learning algorithm [0.0]
  This scientific paper propose a novel portfolio optimization model using an improved deep reinforcement learning algorithm. The proposed algorithm is based on actor-critic architecture, in which the main task of critical network is to learn the distribution of portfolio cumulative return. A multi-process method is used, called Ape-x, to accelerate the speed of deep reinforcement learning training.
  arXiv  Detail & Related papers  (2022-08-23T03:20:06Z)
• Auto-Transfer: Learning to Route Transferrable Representations [77.30427535329571]
  We propose a novel adversarial multi-armed bandit approach which automatically learns to route source representations to appropriate target representations. We see upwards of 5% accuracy improvements compared with the state-of-the-art knowledge transfer methods.
  arXiv  Detail & Related papers  (2022-02-02T13:09:27Z)
• Factor Representation and Decision Making in Stock Markets Using Deep Reinforcement Learning [1.242591017155152]
  We build a portfolio management system using direct deep reinforcement learning to make optimal portfolio choice periodically among S&P500 underlying stocks. The result shows that an effective learning of market conditions and optimal portfolio allocations can significantly outperform the average market.
  arXiv  Detail & Related papers  (2021-08-03T21:31:46Z)
• Federated Learning with Unreliable Clients: Performance Analysis and Mechanism Design [76.29738151117583]
  Federated Learning (FL) has become a promising tool for training effective machine learning models among distributed clients. However, low quality models could be uploaded to the aggregator server by unreliable clients, leading to a degradation or even a collapse of training. We model these unreliable behaviors of clients and propose a defensive mechanism to mitigate such a security risk.
  arXiv  Detail & Related papers  (2021-05-10T08:02:27Z)
• A Design Space Study for LISTA and Beyond [79.76740811464597]
  In recent years, great success has been witnessed in building problem-specific deep networks from unrolling iterative algorithms. This paper revisits the role of unrolling as a design approach for deep networks, to what extent its resulting special architecture is superior, and can we find better? Using LISTA for sparse recovery as a representative example, we conduct the first thorough design space study for the unrolled models.
  arXiv  Detail & Related papers  (2021-04-08T23:01:52Z)
• MAPS: Multi-agent Reinforcement Learning-based Portfolio Management System [23.657021288146158]
  We propose the Multi-Agent reinforcement learning-based Portfolio management System (MAPS) MAPS is a cooperative system in which each agent is an independent "investor" creating its own portfolio. Experiment results with 12 years of US market data show that MAPS outperforms most of the baselines in terms of Sharpe ratio.
  arXiv  Detail & Related papers  (2020-07-10T14:08:12Z)
• Incentive Mechanism Design for Resource Sharing in Collaborative Edge Learning [106.51930957941433]
  In 5G and Beyond networks, Artificial Intelligence applications are expected to be increasingly ubiquitous. This necessitates a paradigm shift from the current cloud-centric model training approach to the Edge Computing based collaborative learning scheme known as edge learning.
  arXiv  Detail & Related papers  (2020-05-31T12:45:06Z)
• Application of Deep Q-Network in Portfolio Management [7.525667739427784]
  This paper introduces a strategy based on the classic Deep Reinforcement Learning algorithm, Deep Q-Network, for portfolio management in stock market. It is a type of deep neural network which is optimized by Q Learning. The profit of DQN algorithm is 30% more than the profit of other strategies.
  arXiv  Detail & Related papers  (2020-03-13T16:20:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.