Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2210.03469v1
• Date: Fri, 7 Oct 2022 11:42:31 GMT
• Title: Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning
• Authors: Naseh Majidi, Mahdi Shamsi, Farokh Marvasti
• Abstract summary: This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm.
• Score: 11.516147824168732
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Price movement prediction has always been one of the traders' concerns in financial market trading. In order to increase their profit, they can analyze the historical data and predict the price movement. The large size of the data and complex relations between them lead us to use algorithmic trading and artificial intelligence. This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Unlike previous studies using a discrete action space reinforcement learning algorithm, the TD3 is continuous, offering both position and the number of trading shares. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm. The achieved strategy using the TD3 is compared with some algorithms using technical analysis, reinforcement learning, stochastic, and deterministic strategies through two standard metrics, Return and Sharpe ratio. The results indicate that employing both position and the number of trading shares can improve the performance of a trading system based on the mentioned metrics.

Related papers

• Predicting Bitcoin Market Trends with Enhanced Technical Indicator Integration and Classification Models [6.39158540499473]
  This study presents a machine learning model based on classification to forecast the direction of the cryptocurrency market. It is trained using historical data and important technical indicators such as the Moving Average Convergence Divergence, the Relative Strength Index, and Bollinger Bands. The results show a buy/sell signal accuracy of over 92%.
  arXiv  Detail & Related papers  (2024-10-09T14:29:50Z)
• Reinforcement Learning Pair Trading: A Dynamic Scaling approach [3.4698840925433774]
  Trading crypto-currency is difficult due to the inherent volatility of the crypto-market. In this work, we combine Reinforcement Learning (RL) with pair trading. Our results show that RL can significantly outperform manual and traditional pair trading techniques when applied to volatile markets such as cryptocurrencies.
  arXiv  Detail & Related papers  (2024-07-23T00:16:27Z)
• When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environments [55.19252983108372]
  We have developed a multi-agent AI system called StockAgent, driven by LLMs. The StockAgent allows users to evaluate the impact of different external factors on investor trading. It avoids the test set leakage issue present in existing trading simulation systems based on AI Agents.
  arXiv  Detail & Related papers  (2024-07-15T06:49:30Z)
• Data Cross-Segmentation for Improved Generalization in Reinforcement Learning Based Algorithmic Trading [5.75899596101548]
  We propose a Reinforcement Learning (RL) algorithm that trades based on signals from a learned predictive model. We test our algorithm on 20+ years of equity data from Bursa Malaysia.
  arXiv  Detail & Related papers  (2023-07-18T16:00:02Z)
• Online Search with Predictions: Pareto-optimal Algorithm and its Applications in Energy Markets [32.50099216716867]
  This paper develops learning-augmented algorithms for energy trading in volatile electricity markets. We incorporate machine-learned predictions to design competitive algorithms for online search problems.
  arXiv  Detail & Related papers  (2022-11-12T04:12:10Z)
• DeepScalper: A Risk-Aware Reinforcement Learning Framework to Capture Fleeting Intraday Trading Opportunities [33.28409845878758]
  We propose DeepScalper, a deep reinforcement learning framework for intraday trading. We show that DeepScalper significantly outperforms many state-of-the-art baselines in terms of four financial criteria.
  arXiv  Detail & Related papers  (2021-12-15T15:24:02Z)
• MCTG:Multi-frequency continuous-share trading algorithm with GARCH based on deep reinforcement learning [5.1727003187913665]
  We propose an algorithm called the Multi-frequency Continuous-share Trading algorithm with GARCH (MCTG) to solve the problems above. The latter with a continuous action space of the reinforcement learning algorithm is used to solve the problem of trading stock shares. Experiments in different industries of Chinese stock market show our method achieves more extra profit comparing with basic DRL methods and bench model.
  arXiv  Detail & Related papers  (2021-05-08T08:00:56Z)
• A comparative study of Different Machine Learning Regressors For Stock Market Prediction [2.1485350418225244]
  We intensively studied NASDAQ stock market and targeted to choose the portfolio of ten different companies. The objective is to compute opening price of next day stock using historical data. To fulfill this task nine different Machine Learning regressor applied on this data and evaluated using MSE and R2 as performance metric.
  arXiv  Detail & Related papers  (2021-04-14T15:37:33Z)
• REST: Relational Event-driven Stock Trend Forecasting [76.08435590771357]
  We propose a relational event-driven stock trend forecasting (REST) framework, which can address the shortcoming of existing methods. To remedy the first shortcoming, we propose to model the stock context and learn the effect of event information on the stocks under different contexts. To address the second shortcoming, we construct a stock graph and design a new propagation layer to propagate the effect of event information from related stocks.
  arXiv  Detail & Related papers  (2021-02-15T07:22:09Z)
• Taking Over the Stock Market: Adversarial Perturbations Against Algorithmic Traders [47.32228513808444]
  We present a realistic scenario in which an attacker influences algorithmic trading systems by using adversarial learning techniques. We show that when added to the input stream, our perturbation can fool the trading algorithms at future unseen data points.
  arXiv  Detail & Related papers  (2020-10-19T06:28:05Z)
• A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding [69.37299910149981]
  A key component for the successful renewable energy sources integration is the usage of energy storage. We propose a novel modelling framework for the strategic participation of energy storage in the European continuous intraday market. An distributed version of the fitted Q algorithm is chosen for solving this problem due to its sample efficiency. Results indicate that the agent converges to a policy that achieves in average higher total revenues than the benchmark strategy.
  arXiv  Detail & Related papers  (2020-04-13T13:50:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.