TRAIL: A Platform for Configurable Human--AI Teaming Experiments
- URL: http://arxiv.org/abs/2607.12180v1
- Date: Mon, 13 Jul 2026 21:59:13 GMT
- Title: TRAIL: A Platform for Configurable Human--AI Teaming Experiments
- Abstract summary: An AI teammate's design properties can shape a team's trust, coordination, and decisions.<n>We present the Team Research and AI Integration Lab (TRAIL), a web platform that makes the AI teammate a customizable design object.<n>In a real six-session classroom deployment (about 51 students), TRAIL sustained longitudinal chaining, held the AI to a stable minority of the conversation.
- Score: 1.53934570513443
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: An AI teammate's design properties (personality, communication style, when it speaks) can shape a team's trust, coordination, and decisions. Studying this rigorously demands infrastructure no existing tool provides: reproducible configuration of an AI teammate embedded in instrumented, real-time collaboration sustained over time. We present the Team Research and AI Integration Lab (TRAIL), a web platform that makes the AI teammate a configurable, reproducible design object, pairing a Big Five persona with a selective-participation message pipeline, dual memory, chained longitudinal experiments, and export-ready analytics. In a real six-session classroom deployment (about 51 students), TRAIL sustained longitudinal chaining, held the AI to a stable minority of the conversation, and enabled export-driven AI-human text-similarity analysis. A single blind persona change produced a design-consistent double dissociation: a cognitive-scaffolding agent drew stronger contribution ratings and closer linguistic alignment; a socially-supportive agent, a warmer team climate and lower over-reliance.
Related papers
- The Social Cost of an AI Teammate: How an Artificial Teammate Reshapes Human-Human Communication in Small-Team Decision-Making [1.4658400971135652]
We examined sociocognitive communication dynamics in team decision-making using Group Communication Analysis (GCA), team surveys, and lexical analyses of team discourse.<n>We find that the AI teammate was the single most talkative and self-cohesive member of every treatment team.<n>In AI-human teams, human teammates showed lower responsivity and social impact toward one another and reported lower levels of belonging and status.
arXiv Detail & Related papers (2026-07-29T17:51:32Z) - Characterizing initial human-AI proof formalization workflows [66.06866890889131]
Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
arXiv Detail & Related papers (2026-06-02T22:58:19Z) - Solipsistic Superintelligence is Unlikely to be Cooperative [48.65947679109806]
We argue that superintelligence, an extremely capable task solver, is unlikely to be cooperative.<n>We call for a non-solipsistic research paradigm that treats interdependence as a core design principle.
arXiv Detail & Related papers (2026-06-02T06:54:55Z) - Personalities at Play: Probing Alignment in AI Teammates [1.0742675209112622]
Large language models (LLMs) increasingly function as collaborators rather than tools.<n>We investigate AI personality alignment through a three-lens evaluation framework.<n>Results suggest that AI personality is measurable but multi-layered and context-dependent.
arXiv Detail & Related papers (2026-02-28T03:06:02Z) - AI as Teammate or Tool? A Review of Human-AI Interaction in Decision Support [0.514825619161626]
Current AI systems remain largely passive due to an overreliance on explainability-centric designs.<n> transitioning AI to an active teammate requires adaptive, context-aware interactions.
arXiv Detail & Related papers (2026-01-26T19:18:50Z) - Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactions [110.43343503158306]
This paper embeds the manual-assisted task into a vision-language-action framework, where the assistant provides services to the instructor following egocentric vision and commands.<n>Under this setting, we accomplish InterVLA, the first large-scale human-object-human interaction dataset with 11.4 hours and 1.2M frames of multimodal data.<n>We establish novel benchmarks on egocentric human motion estimation, interaction synthesis, and interaction prediction with comprehensive analysis.
arXiv Detail & Related papers (2025-08-06T17:46:23Z) - Unraveling Human-AI Teaming: A Review and Outlook [2.3396455015352258]
Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity.<n>Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling short of its transformative possibilities.<n>This paper explores the evolution of AI agents from passive tools to active collaborators in human-AI teams, emphasizing their ability to learn, adapt, and operate autonomously in complex environments.
arXiv Detail & Related papers (2025-04-08T07:37:25Z) - Towards Anthropomorphic Conversational AI Part I: A Practical Framework [49.62013440962072]
We introduce a multi- module framework designed to replicate the key aspects of human intelligence involved in conversations.<n>In the second stage of our approach, these conversational data, after filtering and labeling, can serve as training and testing data for reinforcement learning.
arXiv Detail & Related papers (2025-02-28T03:18:39Z) - The AI Collaborator: Bridging Human-AI Interaction in Educational and Professional Settings [3.506120162002989]
AI Collaborator, powered by OpenAI's GPT-4, is a groundbreaking tool designed for human-AI collaboration research.
Its standout feature is the ability for researchers to create customized AI personas for diverse experimental setups.
This functionality is essential for simulating various interpersonal dynamics in team settings.
arXiv Detail & Related papers (2024-05-16T22:14:54Z) - DIAMBRA Arena: a New Reinforcement Learning Platform for Research and
Experimentation [91.3755431537592]
This work presents DIAMBRA Arena, a new platform for reinforcement learning research and experimentation.
It features a collection of high-quality environments exposing a Python API fully compliant with OpenAI Gym standard.
They are episodic tasks with discrete actions and observations composed by raw pixels plus additional numerical values.
arXiv Detail & Related papers (2022-10-19T14:39:10Z) - Game Plan: What AI can do for Football, and What Football can do for AI [83.79507996785838]
Predictive and prescriptive football analytics require new developments and progress at the intersection of statistical learning, game theory, and computer vision.
We illustrate that football analytics is a game changer of tremendous value, in terms of not only changing the game of football itself, but also in terms of what this domain can mean for the field of AI.
arXiv Detail & Related papers (2020-11-18T10:26:02Z) - Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork [54.309495231017344]
We argue that AI systems should be trained in a human-centered manner, directly optimized for team performance.
We study this proposal for a specific type of human-AI teaming, where the human overseer chooses to either accept the AI recommendation or solve the task themselves.
Our experiments with linear and non-linear models on real-world, high-stakes datasets show that the most accuracy AI may not lead to highest team performance.
arXiv Detail & Related papers (2020-04-27T19:06:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.