Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning

• URL: http://arxiv.org/abs/2303.04833v1
• Date: Fri, 24 Feb 2023 17:16:27 GMT
• Title: Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning
• Authors: Ruitu Xu, Yifei Min, Tianhao Wang, Zhaoran Wang, Michael I. Jordan, Zhuoran Yang
• Abstract summary: We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. We propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model.
• Score: 151.03738099494765
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. Each household earns income and engages in consumption at each time step while aiming to maximize a concave utility subject to the underlying market conditions. The households aim to find the optimal saving strategy that maximizes their discounted cumulative utility given the market condition, while the firms determine the market conditions through maximizing corporate profit based on the household population behavior. The model captures a wide range of applications in macroeconomic studies, and we propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model. The proposed algorithm enjoys theoretical guarantees in converging to the equilibrium of the market at a sub-linear rate.

Related papers

• Deep Reinforcement Learning Agents for Strategic Production Policies in Microeconomic Market Simulations [1.6499388997661122]
  We propose a DRL-based approach to obtain an effective policy in competitive markets with multiple producers. Our framework enables agents to learn adaptive production policies to several simulations that consistently outperform static and random strategies. The results show that agents trained with DRL can strategically adjust production levels to maximize long-term profitability.
  arXiv  Detail & Related papers  (2024-10-27T18:38:05Z)
• Convergence-aware Clustered Federated Graph Learning Framework for Collaborative Inter-company Labor Market Forecasting [38.13767335441753]
  Labor market forecasting on talent demand and supply is essential for business management and economic development. Previous studies ignore the interconnection between demand-supply sequences among different companies for predicting variations. We propose a Meta-personalized Convergence-aware Clustered Federated Learning framework to provide accurate and timely collaborative talent demand and supply prediction.
  arXiv  Detail & Related papers  (2024-09-29T04:11:23Z)
• Parity in Markets -- Methods, Costs, and Consequences [109.5267969644294]
  We show how market designers can use taxes or subsidies in Fisher markets to ensure that market equilibrium outcomes fall within certain constraints. We adapt various types of fairness constraints proposed in existing literature to the market case and show who benefits and who loses from these constraints.
  arXiv  Detail & Related papers  (2022-10-05T22:27:44Z)
• Efficient Model-based Multi-agent Reinforcement Learning via Optimistic Equilibrium Computation [93.52573037053449]
  H-MARL (Hallucinated Multi-Agent Reinforcement Learning) learns successful equilibrium policies after a few interactions with the environment. We demonstrate our approach experimentally on an autonomous driving simulation benchmark.
  arXiv  Detail & Related papers  (2022-03-14T17:24:03Z)
• Finding General Equilibria in Many-Agent Economic Simulations Using Deep Reinforcement Learning [72.23843557783533]
  We show that deep reinforcement learning can discover stable solutions that are epsilon-Nash equilibria for a meta-game over agent types. Our approach is more flexible and does not need unrealistic assumptions, e.g., market clearing. We demonstrate our approach in real-business-cycle models, a representative family of DGE models, with 100 worker-consumers, 10 firms, and a government who taxes and redistributes.
  arXiv  Detail & Related papers  (2022-01-03T17:00:17Z)
• Multi-Asset Spot and Option Market Simulation [52.77024349608834]
  We construct realistic spot and equity option market simulators for a single underlying on the basis of normalizing flows. We leverage the conditional invertibility property of normalizing flows and introduce a scalable method to calibrate the joint distribution of a set of independent simulators.
  arXiv  Detail & Related papers  (2021-12-13T17:34:28Z)
• Achieving Diverse Objectives with AI-driven Prices in Deep Reinforcement Learning Multi-agent Markets [35.02265584959417]
  We propose a practical approach to computing market prices and allocations via a deep reinforcement learning policymaker agent. Our policymaker is much more flexible, allowing us to tune the prices with regard to diverse objectives. As a highlight of our findings, our policymaker is significantly more successful in maintaining resource sustainability.
  arXiv  Detail & Related papers  (2021-06-10T21:26:17Z)
• Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning [0.0]
  General equilibrium macroeconomic models are a core tool used by policymakers to understand a nation's economy. We use techniques from reinforcement learning to solve such models in a way that is simple, heterogeneous, and computationally efficient.
  arXiv  Detail & Related papers  (2021-03-31T10:55:10Z)
• Beating the market with a bad predictive model [0.0]
  We prove that it is generally possible to make systematic profits with a completely inferior price-predicting model. The key idea is to alter the training objective of the predictive models to explicitly decorrelate them from the market.
  arXiv  Detail & Related papers  (2020-10-23T16:20:35Z)
• Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions [80.49176924360499]
  We establish a framework for directing a society of simple, specialized, self-interested agents to solve sequential decision problems. We derive a class of decentralized reinforcement learning algorithms. We demonstrate the potential advantages of a society's inherent modular structure for more efficient transfer learning.
  arXiv  Detail & Related papers  (2020-07-05T16:41:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.