Who/What is My Teammate? Team Composition Considerations in Human-AI Teaming

• URL: http://arxiv.org/abs/2105.11000v1
• Date: Sun, 23 May 2021 19:06:18 GMT
• Title: Who/What is My Teammate? Team Composition Considerations in Human-AI Teaming
• Authors: Nathan J. McNeese, Beau G. Schelble, Lorenzo Barberis Canonico, Mustafa Demir
• Abstract summary: This paper investigates essential aspects of human-AI teaming such as team performance, team situation awareness, and perceived team cognition. Perceived team cognition was highest in human-only teams, with mixed composition teams reporting perceived team cognition 58% below the all-human teams.
• Score: 1.3477333339913569
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: There are many unknowns regarding the characteristics and dynamics of human-AI teams, including a lack of understanding of how certain human-human teaming concepts may or may not apply to human-AI teams and how this composition affects team performance. This paper outlines an experimental research study that investigates essential aspects of human-AI teaming such as team performance, team situation awareness, and perceived team cognition in various mixed composition teams (human-only, human-human-AI, human-AI-AI, and AI-only) through a simulated emergency response management scenario. Results indicate dichotomous outcomes regarding perceived team cognition and performance metrics, as perceived team cognition was not predictive of performance. Performance metrics like team situational awareness and team score showed that teams composed of all human participants performed at a lower level than mixed human-AI teams, with the AI-only teams attaining the highest performance. Perceived team cognition was highest in human-only teams, with mixed composition teams reporting perceived team cognition 58% below the all-human teams. These results inform future mixed teams of the potential performance gains in utilizing mixed teams' over human-only teams in certain applications, while also highlighting mixed teams' adverse effects on perceived team cognition.

Related papers

• Generative AI Enhances Team Performance and Reduces Need for Traditional Teams [1.5031024722977635]
  We show that teams augmented with generative AI significantly outperformed those relying solely on human collaboration. Our analysis suggests that centralized AI usage by a few team members is more effective than distributed engagement.
  arXiv  Detail & Related papers  (2024-05-28T07:47:03Z)
• Capturing Humans' Mental Models of AI: An Item Response Theory Approach [12.129622383429597]
  We show that people expect AI agents' performance to be significantly better on average than the performance of other humans. Our results indicate that people expect AI agents' performance to be significantly better on average than the performance of other humans.
  arXiv  Detail & Related papers  (2023-05-15T23:17:26Z)
• Kill Chaos with Kindness: Agreeableness Improves Team Performance Under Uncertainty [0.0]
  Agreeableness has demonstrated a non-significant and highly variable relationship with team performance. An agent-based model (ABM) is used to predict the effects of personality traits on teamwork. A genetic algorithm is then used to explore the limits of the ABM in order to discover which traits correlate with best and worst performing teams.
  arXiv  Detail & Related papers  (2022-08-09T16:04:32Z)
• Collusion Detection in Team-Based Multiplayer Games [57.153233321515984]
  We propose a system that detects colluding behaviors in team-based multiplayer games. The proposed method analyzes the players' social relationships paired with their in-game behavioral patterns. We then automate the detection using Isolation Forest, an unsupervised learning technique specialized in highlighting outliers.
  arXiv  Detail & Related papers  (2022-03-10T02:37:39Z)
• On some Foundational Aspects of Human-Centered Artificial Intelligence [52.03866242565846]
  There is no clear definition of what is meant by Human Centered Artificial Intelligence. This paper introduces the term HCAI agent to refer to any physical or software computational agent equipped with AI components. We see the notion of HCAI agent, together with its components and functions, as a way to bridge the technical and non-technical discussions on human-centered AI.
  arXiv  Detail & Related papers  (2021-12-29T09:58:59Z)
• Team Power and Hierarchy: Understanding Team Success [11.09080707714613]
  This research examines in depth the relationships between team power and team success in the field of Computer Science. By analyzing 4,106,995 CS teams, we find that high power teams with flat structure have the best performance. On the contrary, low-power teams with hierarchical structure is a facilitator of team performance.
  arXiv  Detail & Related papers  (2021-08-09T15:10:58Z)
• Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi [0.0]
  We evaluate teams of humans and AI agents in the cooperative card game emphHanabi with both rule-based and learning-based agents. We find that humans have a clear preference toward a rule-based AI teammate over a state-of-the-art learning-based AI teammate.
  arXiv  Detail & Related papers  (2021-07-15T22:19:15Z)
• From Motor Control to Team Play in Simulated Humanoid Football [56.86144022071756]
  We train teams of physically simulated humanoid avatars to play football in a realistic virtual environment. In a sequence of stages, players first learn to control a fully articulated body to perform realistic, human-like movements. They then acquire mid-level football skills such as dribbling and shooting. Finally, they develop awareness of others and play as a team, bridging the gap between low-level motor control at a timescale of milliseconds.
  arXiv  Detail & Related papers  (2021-05-25T20:17:10Z)
• Game Plan: What AI can do for Football, and What Football can do for AI [83.79507996785838]
  Predictive and prescriptive football analytics require new developments and progress at the intersection of statistical learning, game theory, and computer vision. We illustrate that football analytics is a game changer of tremendous value, in terms of not only changing the game of football itself, but also in terms of what this domain can mean for the field of AI.
  arXiv  Detail & Related papers  (2020-11-18T10:26:02Z)
• Learning to Complement Humans [67.38348247794949]
  A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams.
  arXiv  Detail & Related papers  (2020-05-01T20:00:23Z)
• Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork [54.309495231017344]
  We argue that AI systems should be trained in a human-centered manner, directly optimized for team performance. We study this proposal for a specific type of human-AI teaming, where the human overseer chooses to either accept the AI recommendation or solve the task themselves. Our experiments with linear and non-linear models on real-world, high-stakes datasets show that the most accuracy AI may not lead to highest team performance.
  arXiv  Detail & Related papers  (2020-04-27T19:06:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.