Human adaptation to adaptive machines converges to game-theoretic equilibria

• URL: http://arxiv.org/abs/2305.01124v1
• Date: Mon, 1 May 2023 23:35:51 GMT
• Title: Human adaptation to adaptive machines converges to game-theoretic equilibria
• Authors: Benjamin J. Chasnov, Lillian J. Ratliff, Samuel A. Burden
• Abstract summary: We show how game theory can be used to predict and design outcomes of co-adaptive interactions between intelligent humans and machines. One algorithm steers the human-machine interaction to the machine's optimum, effectively controlling the human's actions.
• Score: 13.234975857626752
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Adaptive machines have the potential to assist or interfere with human behavior in a range of contexts, from cognitive decision-making to physical device assistance. Therefore it is critical to understand how machine learning algorithms can influence human actions, particularly in situations where machine goals are misaligned with those of people. Since humans continually adapt to their environment using a combination of explicit and implicit strategies, when the environment contains an adaptive machine, the human and machine play a game. Game theory is an established framework for modeling interactions between two or more decision-makers that has been applied extensively in economic markets and machine algorithms. However, existing approaches make assumptions about, rather than empirically test, how adaptation by individual humans is affected by interaction with an adaptive machine. Here we tested learning algorithms for machines playing general-sum games with human subjects. Our algorithms enable the machine to select the outcome of the co-adaptive interaction from a constellation of game-theoretic equilibria in action and policy spaces. Importantly, the machine learning algorithms work directly from observations of human actions without solving an inverse problem to estimate the human's utility function as in prior work. Surprisingly, one algorithm can steer the human-machine interaction to the machine's optimum, effectively controlling the human's actions even while the human responds optimally to their perceived cost landscape. Our results show that game theory can be used to predict and design outcomes of co-adaptive interactions between intelligent humans and machines.

Related papers

• Unlocking the power of partnership: How humans and machines can work together to improve face recognition [0.6157382820537719]
  We examined the benefits of human-human and human-machine collaborations.<n>We implemented "intelligent human-machine fusion" by selecting people with the potential to increase the accuracy of a high-performing machine.<n>The highest system-wide accuracy achievable with human-only partnerships was found by graph theory.
  arXiv  Detail & Related papers  (2025-10-02T21:19:56Z)
• Modeling Others' Minds as Code [11.32494166591141]
  We introduce ROTE, a novel algorithm for synthesizing behavioral programs in code.<n>ROTE predicts human and AI behaviors from sparse observations, outperforming competitive baselines.<n>By treating action understanding as a program synthesis problem, ROTE opens a path for AI systems to efficiently and effectively predict human behavior in the real-world.
  arXiv  Detail & Related papers  (2025-09-29T22:56:34Z)
• HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario [63.77482302352545]
  HHI-Assist is a dataset comprising motion capture clips of human-human interactions in assistive tasks.<n>Our work has the potential to significantly enhance robotic assistance policies.
  arXiv  Detail & Related papers  (2025-09-12T09:38:17Z)
• Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environments [2.037693212747679]
  We propose a novel causality-based decision-making framework to predict battery usage and human obstructions. We also develop a new Gazebo-based simulator designed to model context-sensitive human-robot spatial interactions. Our findings highlight how causal reasoning enables autonomous robots to operate more efficiently and safely in dynamic environments shared with humans.
  arXiv  Detail & Related papers  (2025-04-16T09:26:04Z)
• A Comparison of Human and Machine Learning Errors in Face Recognition [8.064574155970963]
  We perform experiments in the area of face recognition and compare two automated face recognition systems against human annotators. Our research uncovers important ways in which machine learning errors and human errors differ from each other, and suggests potential strategies in which human-machine collaboration can improve accuracy in face recognition.
  arXiv  Detail & Related papers  (2025-02-17T01:27:35Z)
• Mixed-Initiative Human-Robot Teaming under Suboptimality with Online Bayesian Adaptation [0.6591036379613505]
  We develop computational modeling and optimization techniques for enhancing the performance of suboptimal human-agent teams. We adopt an online Bayesian approach that enables a robot to infer people's willingness to comply with its assistance in a sequential decision-making game. Our user studies show that user preferences and team performance indeed vary with robot intervention styles.
  arXiv  Detail & Related papers  (2024-03-24T14:38:18Z)
• Scalable Interactive Machine Learning for Future Command and Control [1.762977457426215]
  Future warfare will require Command and Control (C2) personnel to make decisions at shrinking timescales. integration of artificial and human intelligence holds the potential to revolutionize the C2 operations process. This paper identifies several gaps in state-of-the-art science and technology that future work should address to extend these approaches to function in complex C2 contexts.
  arXiv  Detail & Related papers  (2024-02-09T16:11:04Z)
• SACSoN: Scalable Autonomous Control for Social Navigation [62.59274275261392]
  We develop methods for training policies for socially unobtrusive navigation. By minimizing this counterfactual perturbation, we can induce robots to behave in ways that do not alter the natural behavior of humans in the shared space. We collect a large dataset where an indoor mobile robot interacts with human bystanders.
  arXiv  Detail & Related papers  (2023-06-02T19:07:52Z)
• Causal Discovery of Dynamic Models for Predicting Human Spatial Interactions [5.742409080817885]
  We propose an application of causal discovery methods to model human-robot spatial interactions. New methods and practical solutions are discussed to exploit, for the first time, a state-of-the-art causal discovery algorithm.
  arXiv  Detail & Related papers  (2022-10-29T08:56:48Z)
• Data-driven emotional body language generation for social robotics [58.88028813371423]
  In social robotics, endowing humanoid robots with the ability to generate bodily expressions of affect can improve human-robot interaction and collaboration. We implement a deep learning data-driven framework that learns from a few hand-designed robotic bodily expressions. The evaluation study found that the anthropomorphism and animacy of the generated expressions are not perceived differently from the hand-designed ones.
  arXiv  Detail & Related papers  (2022-05-02T09:21:39Z)
• Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness [92.26039686430204]
  We show that even in carefully-designed systems, complementary performance can be elusive. First, we provide a theoretical framework for modeling simple human-algorithm systems. Next, we use this model to prove conditions where complementarity is impossible.
  arXiv  Detail & Related papers  (2022-02-17T18:44:41Z)
• Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together [68.44697646919515]
  This paper presents several human-robot systems that utilize spatial computing to enable novel robot use cases. The combination of spatial computing and egocentric sensing on mixed reality devices enables them to capture and understand human actions and translate these to actions with spatial meaning.
  arXiv  Detail & Related papers  (2022-02-03T10:04:26Z)
• Ergonomically Intelligent Physical Human-Robot Interaction: Postural Estimation, Assessment, and Optimization [3.681892767755111]
  We show that we can estimate human posture solely from the trajectory of the interacting robot. We propose DULA, a differentiable ergonomics model, and use it in gradient-free postural optimization for physical human-robot interaction tasks.
  arXiv  Detail & Related papers  (2021-08-12T21:13:06Z)
• Machine Common Sense [77.34726150561087]
  Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI) This article deals with the aspects of modeling commonsense reasoning focusing on such domain as interpersonal interactions.
  arXiv  Detail & Related papers  (2020-06-15T13:59:47Z)
• Learning to Complement Humans [67.38348247794949]
  A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams.
  arXiv  Detail & Related papers  (2020-05-01T20:00:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.