The Recurrent Reinforcement Learning Crypto Agent
- URL: http://arxiv.org/abs/2201.04699v1
- Date: Wed, 12 Jan 2022 21:00:43 GMT
- Title: The Recurrent Reinforcement Learning Crypto Agent
- Authors: Gabriel Borrageiro, Nick Firoozye, Paolo Barucca
- Abstract summary: We demonstrate an application of online transfer learning as a digital assets trading agent.
The agent learns to trade the XBTUSD (Bitcoin versus US dollars) perpetual swap derivatives contract on BitMEX.
Overall, our crypto agent realises a total return of 350%, net of transaction costs, over roughly five years.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We demonstrate an application of online transfer learning as a digital assets
trading agent. This agent makes use of a powerful feature space representation
in the form of an echo state network, the output of which is made available to
a direct, recurrent reinforcement learning agent. The agent learns to trade the
XBTUSD (Bitcoin versus US dollars) perpetual swap derivatives contract on
BitMEX. It learns to trade intraday on five minutely sampled data, avoids
excessive over-trading, captures a funding profit and is also able to predict
the direction of the market. Overall, our crypto agent realises a total return
of 350%, net of transaction costs, over roughly five years, 71% of which is
down to funding profit. The annualised information ratio that it achieves is
1.46.
Related papers
- Reinforcement Learning Pair Trading: A Dynamic Scaling approach [3.4698840925433774]
Trading crypto-currency is difficult due to the inherent volatility of the crypto-market.
In this work, we combine Reinforcement Learning (RL) with pair trading.
Our results show that RL can significantly outperform manual and traditional pair trading techniques when applied to volatile markets such as cryptocurrencies.
arXiv Detail & Related papers (2024-07-23T00:16:27Z) - When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environments [55.19252983108372]
We have developed a multi-agent AI system called StockAgent, driven by LLMs.
The StockAgent allows users to evaluate the impact of different external factors on investor trading.
It avoids the test set leakage issue present in existing trading simulation systems based on AI Agents.
arXiv Detail & Related papers (2024-07-15T06:49:30Z) - Cryptocurrency Portfolio Optimization by Neural Networks [81.20955733184398]
This paper proposes an effective algorithm based on neural networks to take advantage of these investment products.
A deep neural network, which outputs the allocation weight of each asset at a time interval, is trained to maximize the Sharpe ratio.
A novel loss term is proposed to regulate the network's bias towards a specific asset, thus enforcing the network to learn an allocation strategy that is close to a minimum variance strategy.
arXiv Detail & Related papers (2023-10-02T12:33:28Z) - Don't Let MEV Slip: The Costs of Swapping on the Uniswap Protocol [0.17999333451993949]
We present the first empirical characterization of the costs of trading on a decentralized exchange (DEX)
Using quoted prices from the Uniswap Labs interface, we evaluate the efficiency of trading on DEXs.
Our results provide preliminary evidence that DEXs offer a compelling trust-less alternative to centralized exchanges for trading digital assets.
arXiv Detail & Related papers (2023-09-24T14:22:15Z) - Uniswap Liquidity Provision: An Online Learning Approach [49.145538162253594]
Decentralized Exchanges (DEXs) are new types of marketplaces leveraging technology.
One such DEX, Uniswap v3, allows liquidity providers to allocate funds more efficiently by specifying an active price interval for their funds.
This introduces the problem of finding an optimal strategy for choosing price intervals.
We formalize this problem as an online learning problem with non-stochastic rewards.
arXiv Detail & Related papers (2023-02-01T17:21:40Z) - A Game of NFTs: Characterizing NFT Wash Trading in the Ethereum Blockchain [53.8917088220974]
The Non-Fungible Token (NFT) market experienced explosive growth in 2021, with a monthly trade volume reaching $6 billion in January 2022.
Concerns have emerged about possible wash trading, a form of market manipulation in which one party repeatedly trades an NFT to inflate its volume artificially.
We find that wash trading affects 5.66% of all NFT collections, with a total artificial volume of $3,406,110,774.
arXiv Detail & Related papers (2022-12-02T15:03:35Z) - Deep Reinforcement Learning for Cryptocurrency Trading: Practical
Approach to Address Backtest Overfitting [15.69458914236069]
We propose a practical approach to address backtest overfitting for cryptocurrency trading using deep reinforcement learning.
We train the DRL agents, estimate the probability of overfitting, and reject the overfitted agents, increasing the chance of good trading performance.
We show that the less overfitted deep reinforcement learning agents have a higher Sharpe ratio than that of more over-fitted agents, an equal weight strategy, and the S&P DBM Index.
arXiv Detail & Related papers (2022-09-12T19:18:48Z) - Reinforcement Learning for Systematic FX Trading [0.0]
We conduct a detailed experiment on major cash pairs, accurately accounting for transaction and funding costs.
These sources of profit and loss, including the price trends that occur in the currency markets, are made available to our recurrent reinforcement learner.
This is despite forcing the model to trade at the close of the trading day 5pm EST, when trading costs are statistically the most expensive.
arXiv Detail & Related papers (2021-10-10T09:44:29Z) - The Doge of Wall Street: Analysis and Detection of Pump and Dump Cryptocurrency Manipulations [50.521292491613224]
This paper performs an in-depth analysis of two market manipulations organized by communities over the Internet: The pump and dump and the crowd pump.
The pump and dump scheme is a fraud as old as the stock market. Now, it got new vitality in the loosely regulated market of cryptocurrencies.
We report on three case studies related to pump and dump groups.
arXiv Detail & Related papers (2021-05-03T10:20:47Z) - Pump and Dumps in the Bitcoin Era: Real Time Detection of Cryptocurrency Market Manipulations [50.521292491613224]
We perform an in-depth analysis of pump and dump schemes organized by communities over the Internet.
We observe how these communities are organized and how they carry out the fraud.
We introduce an approach to detect the fraud in real time that outperforms the current state of the art.
arXiv Detail & Related papers (2020-05-04T21:36:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.