Modelling crypto markets by multi-agent reinforcement learning

• URL: http://arxiv.org/abs/2402.10803v1
• Date: Fri, 16 Feb 2024 16:28:58 GMT
• Title: Modelling crypto markets by multi-agent reinforcement learning
• Authors: Johann Lussange, Stefano Vrizzi, Stefano Palminteri, Boris Gutkin
• Abstract summary: This study introduces a multi-agent reinforcement learning (MARL) model simulating crypto markets. It is calibrated to the crypto's daily closing prices of $153$ cryptocurrencies that were continuously traded between 2018 and 2022.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Building on a previous foundation work (Lussange et al. 2020), this study introduces a multi-agent reinforcement learning (MARL) model simulating crypto markets, which is calibrated to the Binance's daily closing prices of $153$ cryptocurrencies that were continuously traded between 2018 and 2022. Unlike previous agent-based models (ABM) or multi-agent systems (MAS) which relied on zero-intelligence agents or single autonomous agent methodologies, our approach relies on endowing agents with reinforcement learning (RL) techniques in order to model crypto markets. This integration is designed to emulate, with a bottom-up approach to complexity inference, both individual and collective agents, ensuring robustness in the recent volatile conditions of such markets and during the COVID-19 era. A key feature of our model also lies in the fact that its autonomous agents perform asset price valuation based on two sources of information: the market prices themselves, and the approximation of the crypto assets fundamental values beyond what those market prices are. Our MAS calibration against real market data allows for an accurate emulation of crypto markets microstructure and probing key market behaviors, in both the bearish and bullish regimes of that particular time period.

Related papers

• FinBERT-BiLSTM: A Deep Learning Model for Predicting Volatile Cryptocurrency Market Prices Using Market Sentiment Dynamics [3.6423651166048874]
  We propose a hybrid model that combines Bidirectional Long Short-Term Memory (Bi-LSTM) networks with FinBERT to enhance forecasting accuracy for cryptocurrencies. This approach fills a key gap in forecasting volatile financial markets by blending advanced time series models with sentiment analysis.
  arXiv  Detail & Related papers  (2024-11-02T14:43:06Z)
• Neuro-Symbolic Traders: Assessing the Wisdom of AI Crowds in Markets [0.0]
  We develop a form of virtual traders that use deep generative models to make buy/sell decisions. Under our framework, neuro-symbolic traders are agents that use vision-language models to discover a model of the fundamental value of an asset. We find that this leads to price suppression compared to the historical data, highlighting a future risk to market stability.
  arXiv  Detail & Related papers  (2024-10-18T16:37:52Z)
• Predicting Bitcoin Market Trends with Enhanced Technical Indicator Integration and Classification Models [6.39158540499473]
  This study presents a machine learning model based on classification to forecast the direction of the cryptocurrency market. It is trained using historical data and important technical indicators such as the Moving Average Convergence Divergence, the Relative Strength Index, and Bollinger Bands. The results show a buy/sell signal accuracy of over 92%.
  arXiv  Detail & Related papers  (2024-10-09T14:29:50Z)
• A Multi-agent Market Model Can Explain the Impact of AI Traders in Financial Markets -- A New Microfoundations of GARCH model [3.655221783356311]
  We propose a multi-agent market model to derive the microfoundations of the GARCH model, incorporating three types of agents: noise traders, fundamental traders, and AI traders. We validate this model through multi-agent simulations, confirming its ability to reproduce the stylized facts of financial markets.
  arXiv  Detail & Related papers  (2024-09-19T07:14:13Z)
• When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environments [55.19252983108372]
  We have developed a multi-agent AI system called StockAgent, driven by LLMs. The StockAgent allows users to evaluate the impact of different external factors on investor trading. It avoids the test set leakage issue present in existing trading simulation systems based on AI Agents.
  arXiv  Detail & Related papers  (2024-07-15T06:49:30Z)
• A Network Simulation of OTC Markets with Multiple Agents [3.8944986367855963]
  We present a novel approach to simulating an over-the-counter (OTC) financial market in which trades are intermediated solely by market makers. We show that our network-based model can lend insights into the effect of market-structure on price-action.
  arXiv  Detail & Related papers  (2024-05-03T20:45:00Z)
• Joint Latent Topic Discovery and Expectation Modeling for Financial Markets [45.758436505779386]
  We present a groundbreaking framework for financial market analysis. This approach is the first to jointly model investor expectations and automatically mine latent stock relationships. Our model consistently achieves an annual return exceeding 10%.
  arXiv  Detail & Related papers  (2023-06-01T01:36:51Z)
• Finding General Equilibria in Many-Agent Economic Simulations Using Deep Reinforcement Learning [72.23843557783533]
  We show that deep reinforcement learning can discover stable solutions that are epsilon-Nash equilibria for a meta-game over agent types. Our approach is more flexible and does not need unrealistic assumptions, e.g., market clearing. We demonstrate our approach in real-business-cycle models, a representative family of DGE models, with 100 worker-consumers, 10 firms, and a government who taxes and redistributes.
  arXiv  Detail & Related papers  (2022-01-03T17:00:17Z)
• Deep Q-Learning Market Makers in a Multi-Agent Simulated Stock Market [58.720142291102135]
  This paper focuses precisely on the study of these markets makers strategies from an agent-based perspective. We propose the application of Reinforcement Learning (RL) for the creation of intelligent market markers in simulated stock markets.
  arXiv  Detail & Related papers  (2021-12-08T14:55:21Z)
• OSOUM Framework for Trading Data Research [79.0383470835073]
  We supply, to the best of our knowledge, the first open source simulation platform, Open SOUrce Market Simulator (OSOUM) to analyze trading markets and specifically data markets. We describe and implement a specific data market model, consisting of two types of agents: sellers who own various datasets available for acquisition, and buyers searching for relevant and beneficial datasets for purchase. Although commercial frameworks, intended for handling data markets, already exist, we provide a free and extensive end-to-end research tool for simulating possible behavior for both buyers and sellers participating in (data) markets.
  arXiv  Detail & Related papers  (2021-02-18T09:20:26Z)
• Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction States [71.54651874063865]
  Portfolio management (PM) aims to achieve investment goals such as maximal profits or minimal risks. In this paper, we propose SARL, a novel State-Augmented RL framework for PM. Our framework aims to address two unique challenges in financial PM: (1) data Heterogeneous data -- the collected information for each asset is usually diverse, noisy and imbalanced (e.g., news articles); and (2) environment uncertainty -- the financial market is versatile and non-stationary.
  arXiv  Detail & Related papers  (2020-02-09T08:10:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.