Reinforcement Learning Pair Trading: A Dynamic Scaling approach

• URL: http://arxiv.org/abs/2407.16103v1
• Date: Tue, 23 Jul 2024 00:16:27 GMT
• Title: Reinforcement Learning Pair Trading: A Dynamic Scaling approach
• Authors: Hongshen Yang, Avinash Malik,
• Abstract summary: Trading crypto-currency is difficult due to the inherent volatility of the crypto-market. In this work, we combine Reinforcement Learning (RL) with pair trading. Our results show that RL can significantly outperform manual and traditional pair trading techniques when applied to volatile markets such as cryptocurrencies.
• Score: 3.4698840925433774
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cryptocurrency is a cryptography-based digital asset with extremely volatile prices. Around $70 billion worth of crypto-currency is traded daily on exchanges. Trading crypto-currency is difficult due to the inherent volatility of the crypto-market. In this work, we want to test the hypothesis: "Can techniques from artificial intelligence help with algorithmically trading cryptocurrencies?". In order to address this question, we combine Reinforcement Learning (RL) with pair trading. Pair trading is a statistical arbitrage trading technique which exploits the price difference between statistically correlated assets. We train reinforcement learners to determine when and how to trade pairs of cryptocurrencies. We develop new reward shaping and observation/action spaces for reinforcement learning. We performed experiments with the developed reinforcement learner on pairs of BTC-GBP and BTC-EUR data separated by 1-minute intervals (n = 263,520). The traditional non-RL pair trading technique achieved an annualised profit of 8.33%, while the proposed RL-based pair trading technique achieved annualised profits from 9.94% - 31.53%, depending upon the RL learner. Our results show that RL can significantly outperform manual and traditional pair trading techniques when applied to volatile markets such as cryptocurrencies.

Related papers

• Practical Forecasting of Cryptocoins Timeseries using Correlation Patterns [1.6229760224067287]
  We shed some light on the trend correlations across a large variety of cryptocoins, by investigating their coin/price correlation trends over the past two years. We study the causality between the trends, and exploit the derived correlations to understand the accuracy of state-of-the-art forecasting techniques.
  arXiv  Detail & Related papers  (2024-09-05T16:27:16Z)
• IT Strategic alignment in the decentralized finance (DeFi): CBDC and digital currencies [49.1574468325115]
  Decentralized finance (DeFi) is a disruptive-based financial infrastructure. This paper seeks to answer two main questions 1) What are the common IT elements in the DeFi? And 2) How the elements to the IT strategic alignment in DeFi?
  arXiv  Detail & Related papers  (2024-05-17T10:19:20Z)
• Interplay between Cryptocurrency Transactions and Online Financial Forums [41.94295877935867]
  This study focuses on the study of the interplay between these cryptocurrency forums and fluctuations in cryptocurrency values. It shows that the activity of Bitcointalk forum keeps a direct relationship with the trend in the values of BTC. The experiment highlights that forum data can explain specific events in the financial field.
  arXiv  Detail & Related papers  (2023-11-27T16:25:28Z)
• Deep Learning and NLP in Cryptocurrency Forecasting: Integrating Financial, Blockchain, and Social Media Data [3.6390165502400875]
  We introduce novel approaches to cryptocurrency price forecasting, leveraging Machine Learning (ML) and Natural Language Processing (NLP) techniques. By analysing news and social media content, we assess the impact of public sentiment on cryptocurrency markets.
  arXiv  Detail & Related papers  (2023-11-23T16:14:44Z)
• A Framework for Empowering Reinforcement Learning Agents with Causal Analysis: Enhancing Automated Cryptocurrency Trading [1.4356611205757077]
  This research focuses on developing a reinforcement learning (RL) framework to tackle the complexities of trading five prominent cryptocurrencys: Coin, Litecoin, Ripple, and Tether. We present the CausalReinforceNet(CRN) framework, which integrates both Bayesian and dynamic Bayesian network techniques to empower the RL agent in trade decision-making. We develop two agents using the framework based on distinct RL algorithms to analyse performance compared to the Buy-and-Hold benchmark strategy and a baseline RL model.
  arXiv  Detail & Related papers  (2023-10-14T01:08:52Z)
• Cryptocurrency Portfolio Optimization by Neural Networks [81.20955733184398]
  This paper proposes an effective algorithm based on neural networks to take advantage of these investment products. A deep neural network, which outputs the allocation weight of each asset at a time interval, is trained to maximize the Sharpe ratio. A novel loss term is proposed to regulate the network's bias towards a specific asset, thus enforcing the network to learn an allocation strategy that is close to a minimum variance strategy.
  arXiv  Detail & Related papers  (2023-10-02T12:33:28Z)
• A Game of NFTs: Characterizing NFT Wash Trading in the Ethereum Blockchain [53.8917088220974]
  The Non-Fungible Token (NFT) market experienced explosive growth in 2021, with a monthly trade volume reaching $6 billion in January 2022. Concerns have emerged about possible wash trading, a form of market manipulation in which one party repeatedly trades an NFT to inflate its volume artificially. We find that wash trading affects 5.66% of all NFT collections, with a total artificial volume of $3,406,110,774.
  arXiv  Detail & Related papers  (2022-12-02T15:03:35Z)
• Algorithmic Trading Using Continuous Action Space Deep Reinforcement Learning [11.516147824168732]
  This paper aims to offer an approach using Twin-Delayed DDPG (TD3) and the daily close price in order to achieve a trading strategy in the stock and cryptocurrency markets. Both the stock (Amazon) and cryptocurrency (Bitcoin) markets are addressed in this research to evaluate the performance of the proposed algorithm.
  arXiv  Detail & Related papers  (2022-10-07T11:42:31Z)
• Exploration of Algorithmic Trading Strategies for the Bitcoin Market [1.933681537640272]
  This work brings an algorithmic trading approach to the Bitcoin market to exploit the variability in its price on a day-to-day basis. As an empirical test of our models, we evaluate them using a real-world trading strategy on completely unseen data collected throughout the first quarter of 2021. Using only a binary predictor, our models showed an average profit of 86%, matching the results of the more traditional buy-and-hold strategy.
  arXiv  Detail & Related papers  (2021-10-28T08:13:34Z)
• The Doge of Wall Street: Analysis and Detection of Pump and Dump Cryptocurrency Manipulations [50.521292491613224]
  This paper performs an in-depth analysis of two market manipulations organized by communities over the Internet: The pump and dump and the crowd pump. The pump and dump scheme is a fraud as old as the stock market. Now, it got new vitality in the loosely regulated market of cryptocurrencies. We report on three case studies related to pump and dump groups.
  arXiv  Detail & Related papers  (2021-05-03T10:20:47Z)
• Pump and Dumps in the Bitcoin Era: Real Time Detection of Cryptocurrency Market Manipulations [50.521292491613224]
  We perform an in-depth analysis of pump and dump schemes organized by communities over the Internet. We observe how these communities are organized and how they carry out the fraud. We introduce an approach to detect the fraud in real time that outperforms the current state of the art.
  arXiv  Detail & Related papers  (2020-05-04T21:36:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.