The AI Economist: Optimal Economic Policy Design via Two-level Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2108.02755v1
• Date: Thu, 5 Aug 2021 17:42:35 GMT
• Title: The AI Economist: Optimal Economic Policy Design via Two-level Deep Reinforcement Learning
• Authors: Stephan Zheng, Alexander Trott, Sunil Srinivasa, David C. Parkes, Richard Socher
• Abstract summary: We show that machine-learning-based economic simulation is a powerful policy and mechanism design framework. The AI Economist is a two-level, deep RL framework that trains both agents and a social planner who co-adapt. In simple one-step economies, the AI Economist recovers the optimal tax policy of economic theory.
• Score: 126.37520136341094
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: AI and reinforcement learning (RL) have improved many areas, but are not yet widely adopted in economic policy design, mechanism design, or economics at large. At the same time, current economic methodology is limited by a lack of counterfactual data, simplistic behavioral models, and limited opportunities to experiment with policies and evaluate behavioral responses. Here we show that machine-learning-based economic simulation is a powerful policy and mechanism design framework to overcome these limitations. The AI Economist is a two-level, deep RL framework that trains both agents and a social planner who co-adapt, providing a tractable solution to the highly unstable and novel two-level RL challenge. From a simple specification of an economy, we learn rational agent behaviors that adapt to learned planner policies and vice versa. We demonstrate the efficacy of the AI Economist on the problem of optimal taxation. In simple one-step economies, the AI Economist recovers the optimal tax policy of economic theory. In complex, dynamic economies, the AI Economist substantially improves both utilitarian social welfare and the trade-off between equality and productivity over baselines. It does so despite emergent tax-gaming strategies, while accounting for agent interactions and behavioral change more accurately than economic theory. These results demonstrate for the first time that two-level, deep RL can be used for understanding and as a complement to theory for economic design, unlocking a new computational learning-based approach to understanding economic policy.

Related papers

• Modelling of Economic Implications of Bias in AI-Powered Health Emergency Response Systems [0.0]
  We analyze how algorithmic bias affects resource allocation, health outcomes, and social welfare. We propose mitigation strategies, including fairness-constrained optimization, algorithmic adjustments, and policy interventions.
  arXiv  Detail & Related papers  (2024-10-26T17:11:23Z)
• Artificial intelligence, rationalization, and the limits of control in the public sector: the case of tax policy optimization [0.0]
  We show how much of the criticisms directed towards AI systems spring from well known tensions at the heart of Weberian rationalization. Our analysis shows that building a machine-like tax system that promotes social and economic equality is possible. It also highlights that AI driven policy optimization comes at the exclusion of other competing political values.
  arXiv  Detail & Related papers  (2024-07-07T11:54:14Z)
• Finding General Equilibria in Many-Agent Economic Simulations Using Deep Reinforcement Learning [72.23843557783533]
  We show that deep reinforcement learning can discover stable solutions that are epsilon-Nash equilibria for a meta-game over agent types. Our approach is more flexible and does not need unrealistic assumptions, e.g., market clearing. We demonstrate our approach in real-business-cycle models, a representative family of DGE models, with 100 worker-consumers, 10 firms, and a government who taxes and redistributes.
  arXiv  Detail & Related papers  (2022-01-03T17:00:17Z)
• Building a Foundation for Data-Driven, Interpretable, and Robust Policy Design using the AI Economist [67.08543240320756]
  We show that the AI Economist framework enables effective, flexible, and interpretable policy design using two-level reinforcement learning and data-driven simulations. We find that log-linear policies trained using RL significantly improve social welfare, based on both public health and economic outcomes, compared to past outcomes.
  arXiv  Detail & Related papers  (2021-08-06T01:30:41Z)
• Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions [80.49176924360499]
  We establish a framework for directing a society of simple, specialized, self-interested agents to solve sequential decision problems. We derive a class of decentralized reinforcement learning algorithms. We demonstrate the potential advantages of a society's inherent modular structure for more efficient transfer learning.
  arXiv  Detail & Related papers  (2020-07-05T16:41:09Z)
• The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policies [119.07163415116686]
  We train social planners that discover tax policies that can effectively trade-off economic equality and productivity. We present an economic simulation environment that features competitive pressures and market dynamics. We show that AI-driven tax policies improve the trade-off between equality and productivity by 16% over baseline policies.
  arXiv  Detail & Related papers  (2020-04-28T06:57:18Z)
• Learning from Learning Machines: Optimisation, Rules, and Social Norms [91.3755431537592]
  It appears that the area of AI that is most analogous to the behaviour of economic entities is that of morally good decision-making. Recent successes of deep learning for AI suggest that more implicit specifications work better than explicit ones for solving such problems.
  arXiv  Detail & Related papers  (2019-12-29T17:42:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.