Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2103.16977v1
• Date: Wed, 31 Mar 2021 10:55:10 GMT
• Title: Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning
• Authors: Edward Hill, Marco Bardoscia and Arthur Turrell
• Abstract summary: General equilibrium macroeconomic models are a core tool used by policymakers to understand a nation's economy. We use techniques from reinforcement learning to solve such models in a way that is simple, heterogeneous, and computationally efficient.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: General equilibrium macroeconomic models are a core tool used by policymakers to understand a nation's economy. They represent the economy as a collection of forward-looking actors whose behaviours combine, possibly with stochastic effects, to determine global variables (such as prices) in a dynamic equilibrium. However, standard semi-analytical techniques for solving these models make it difficult to include the important effects of heterogeneous economic actors. The COVID-19 pandemic has further highlighted the importance of heterogeneity, for example in age and sector of employment, in macroeconomic outcomes and the need for models that can more easily incorporate it. We use techniques from reinforcement learning to solve such models incorporating heterogeneous agents in a way that is simple, extensible, and computationally efficient. We demonstrate the method's accuracy and stability on a toy problem for which there is a known analytical solution, its versatility by solving a general equilibrium problem that includes global stochasticity, and its flexibility by solving a combined macroeconomic and epidemiological model to explore the economic and health implications of a pandemic. The latter successfully captures plausible economic behaviours induced by differential health risks by age.

Related papers

• Global Solutions to Master Equations for Continuous Time Heterogeneous Agent Macroeconomic Models [2.133330089821556]
  We approximate the agent distribution so that equilibrium in the economy can be characterized by a non-linear partial differential equation. We represent the value function using a neural network and train it to solve the differential equation using deep learning tools. The main advantage of this technique is that it allows us to find global solutions to high dimensional, non-linear problems.
  arXiv  Detail & Related papers  (2024-06-19T17:42:53Z)
• Model-Based RL for Mean-Field Games is not Statistically Harder than Single-Agent RL [57.745700271150454]
  We study the sample complexity of reinforcement learning in Mean-Field Games (MFGs) with model-based function approximation. We introduce the Partial Model-Based Eluder Dimension (P-MBED), a more effective notion to characterize the model class complexity.
  arXiv  Detail & Related papers  (2024-02-08T14:54:47Z)
• EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities [43.70290385026672]
  We introduce EconAgent, a large language model-empowered agent with human-like characteristics for macroeconomic simulation. We first construct a simulation environment that incorporates various market dynamics driven by agents' decisions. Through the perception module, we create heterogeneous agents with distinct decision-making mechanisms.
  arXiv  Detail & Related papers  (2023-10-16T14:19:40Z)
• Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes [72.13373216644021]
  We study the societal impact of machine learning by considering the collection of models that are deployed in a given context. We find deployed machine learning is prone to systemic failure, meaning some users are exclusively misclassified by all models available. These examples demonstrate ecosystem-level analysis has unique strengths for characterizing the societal impact of machine learning.
  arXiv  Detail & Related papers  (2023-07-12T01:11:52Z)
• Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning [151.03738099494765]
  We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. We propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model.
  arXiv  Detail & Related papers  (2023-02-24T17:16:27Z)
• Forecasting and stabilizing chaotic regimes in two macroeconomic models via artificial intelligence technologies and control methods [0.3670422696827526]
  One of the key tasks in the economy is forecasting the economic agents' expectations of the future values of economic variables. The behavior of mathematical models can be irregular, including chaotic, which reduces their predictive power. We study the regimes of behavior of two economic models and identify irregular dynamics in them.
  arXiv  Detail & Related papers  (2023-02-20T11:55:15Z)
• Finding General Equilibria in Many-Agent Economic Simulations Using Deep Reinforcement Learning [72.23843557783533]
  We show that deep reinforcement learning can discover stable solutions that are epsilon-Nash equilibria for a meta-game over agent types. Our approach is more flexible and does not need unrealistic assumptions, e.g., market clearing. We demonstrate our approach in real-business-cycle models, a representative family of DGE models, with 100 worker-consumers, 10 firms, and a government who taxes and redistributes.
  arXiv  Detail & Related papers  (2022-01-03T17:00:17Z)
• On the Opportunities and Risks of Foundation Models [256.61956234436553]
  We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration.
  arXiv  Detail & Related papers  (2021-08-16T17:50:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.