A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback

• URL: http://arxiv.org/abs/2102.09180v1
• Date: Thu, 18 Feb 2021 06:41:59 GMT
• Title: A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback
• Authors: Benjamin Patrick Evans, Mikhail Prokopenko
• Abstract summary: We propose an information-theoretic approach to the inference of agent decisions under Smithian competition. The model explicitly captures the boundedness of agents as the cost of information acquisition for expanding their prior beliefs. We verified the proposed model using Australian housing market data, showing how the incorporation of prior knowledge alters the resulting agent decisions.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Bounded rationality is an important consideration stemming from the fact that agents often have limits on their processing abilities, making the assumption of perfect rationality inapplicable to many real tasks. We propose an information-theoretic approach to the inference of agent decisions under Smithian competition. The model explicitly captures the boundedness of agents (limited in their information-processing capacity) as the cost of information acquisition for expanding their prior beliefs. The expansion is measured as the Kullblack-Leibler divergence between posterior decisions and prior beliefs. When information acquisition is free, the \textit{homo economicus} agent is recovered, while in cases when information acquisition becomes costly, agents instead revert to their prior beliefs. The maximum entropy principle is used to infer least-biased decisions, based upon the notion of Smithian competition formalised within the Quantal Response Statistical Equilibrium framework. The incorporation of prior beliefs into such a framework allowed us to systematically explore the effects of prior beliefs on decision-making, in the presence of market feedback. We verified the proposed model using Australian housing market data, showing how the incorporation of prior knowledge alters the resulting agent decisions. Specifically, it allowed for the separation (and analysis) of past beliefs and utility maximisation behaviour of the agent.

Related papers

• Quantum Decision Theory [0.0]
  We propose to use the formalism of quantum mechanics to describe and explain the so-called "abnormal" behaviour of agents. The basic idea is to postulate that the preferences of these agents are indeterminate before the choice is made or the decision is taken.
  arXiv  Detail & Related papers  (2024-11-22T11:37:52Z)
• Language Models Can Reduce Asymmetry in Information Markets [100.38786498942702]
  We introduce an open-source simulated digital marketplace where intelligent agents, powered by language models, buy and sell information on behalf of external participants. The central mechanism enabling this marketplace is the agents' dual capabilities: they have the capacity to assess the quality of privileged information but also come equipped with the ability to forget. To perform well, agents must make rational decisions, strategically explore the marketplace through generated sub-queries, and synthesize answers from purchased information.
  arXiv  Detail & Related papers  (2024-03-21T14:48:37Z)
• Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning [17.752461521448236]
  This paper focuses on decision planning with uncertainty estimation to address the problem in language models. Our uncertainty estimation and decision-making agent design offer a cost-efficient approach for AI agent development.
  arXiv  Detail & Related papers  (2024-02-01T00:23:31Z)
• Online Decision Mediation [72.80902932543474]
  Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior. In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
  arXiv  Detail & Related papers  (2023-10-28T05:59:43Z)
• On Imperfect Recall in Multi-Agent Influence Diagrams [57.21088266396761]
  Multi-agent influence diagrams (MAIDs) are a popular game-theoretic model based on Bayesian networks. We show how to solve MAIDs with forgetful and absent-minded agents using mixed policies and two types of correlated equilibrium. We also describe applications of MAIDs to Markov games and team situations, where imperfect recall is often unavoidable.
  arXiv  Detail & Related papers  (2023-07-11T07:08:34Z)
• Application of Causal Inference to Analytical Customer Relationship Management in Banking and Insurance [6.228766191647919]
  In statistics, causality has been studied and applied for many years, but not in great detail in artificial intelligence (AI) In this study, we employed the principles of causal inference to provide explainability for solving the analytical customer relationship management problems. Good quality counterfactuals were generated for the loan default, insurance fraud detection, and credit card fraud detection datasets.
  arXiv  Detail & Related papers  (2022-08-19T05:57:58Z)
• Causal Fairness Analysis [68.12191782657437]
  We introduce a framework for understanding, modeling, and possibly solving issues of fairness in decision-making settings. The main insight of our approach will be to link the quantification of the disparities present on the observed data with the underlying, and often unobserved, collection of causal mechanisms. Our effort culminates in the Fairness Map, which is the first systematic attempt to organize and explain the relationship between different criteria found in the literature.
  arXiv  Detail & Related papers  (2022-07-23T01:06:34Z)
• Bounded rationality for relaxing best response and mutual consistency: An information-theoretic model of partial self-reference [0.0]
  This work focuses on some of the assumptions underlying rationality such as mutual consistency and best-response. We consider ways to relax these assumptions using concepts from level-$k$ reasoning and quantal response equilibrium (QRE) respectively.
  arXiv  Detail & Related papers  (2021-06-30T06:56:56Z)
• Alternative Microfoundations for Strategic Classification [33.67797984699066]
  We show that rational agents with perfect information produce discontinuities in the aggregate response to a decision rule. optimal decision rules under standard microfoundations maximize a measure of negative externality known as social burden. Our model retains analytical tractability, leads to more robust insights about stable points, and imposes a lower social burden at optimality.
  arXiv  Detail & Related papers  (2021-06-24T00:30:58Z)
• Maximizing Information Gain in Partially Observable Environments via Prediction Reward [64.24528565312463]
  This paper tackles the challenge of using belief-based rewards for a deep RL agent. We derive the exact error between negative entropy and the expected prediction reward. This insight provides theoretical motivation for several fields using prediction rewards.
  arXiv  Detail & Related papers  (2020-05-11T08:13:49Z)
• VCG Mechanism Design with Unknown Agent Values under Stochastic Bandit Feedback [104.06766271716774]
  We study a multi-round welfare-maximising mechanism design problem in instances where agents do not know their values. We first define three notions of regret for the welfare, the individual utilities of each agent and that of the mechanism. Our framework also provides flexibility to control the pricing scheme so as to trade-off between the agent and seller regrets.
  arXiv  Detail & Related papers  (2020-04-19T18:00:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.