Towards Actionable Surgical Team Dynamics: from Teamwork to Counterfactual Annotations

• URL: http://arxiv.org/abs/2608.23344v1
• Date: Mon, 24 Aug 2026 14:55:18 GMT
• Title: Towards Actionable Surgical Team Dynamics: from Teamwork to Counterfactual Annotations
• Abstract summary: We introduce an extended multimodal dataset for surgical team interaction analysis, built from real operating room recordings.<n>Team performance is assessed using a standardized surgical evaluation protocol, while interaction quality and individual attributes are annotated.<n>To further support the study of coordination breakdowns and performance variability, we introduce counterfactual annotations.<n>The dataset is designed to support the study of how individual actions, interaction patterns, and team-level processes jointly contribute to team outcomes in surgical settings.
• Score: 8.839435095280962
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modeling team interactions in high-stakes environments such as operating rooms is critical for understanding how coordination, communication, and individual behaviors shape team performance and safety outcomes. Existing datasets in this domain are often fragmented across modalities, annotation schemes, and formats, limiting their ability to support integrated analyses of real-world collaborative processes. We address this limitation by introducing an extended multimodal dataset for surgical team interaction analysis, built from real operating room recordings. Starting from an existing corpus, we construct an analysis-ready version of the data by providing speaker diarization, transcripts, and multi-level annotations capturing team performance, interaction processes, and individual characteristics. Team performance is assessed using a standardized surgical teamwork evaluation protocol, while interaction quality and individual attributes are annotated through structured rating schemes covering collaboration, group dynamics, and non-technical skills. To further support the study of coordination breakdowns and performance variability, we introduce counterfactual annotations that describe plausible alternative team outcomes in the presence of observed interaction failures, enabling analysis of how specific behavioral patterns may relate to different trajectories of team performance. In addition, we provide structured temporal and relational representations designed to support computational modeling of teamwork processes and the design of AI-assisted collaborative systems. The dataset is designed to support the study of how individual actions, interaction patterns, and team-level processes jointly contribute to team outcomes in surgical settings, providing a unified resource for analyzing collaborative behavior in high-stakes domains.

Related papers

• From Multimodal Observation to Interpretable Suggestions: Counterfactual Time-Expanded Relational Modeling of Surgical Teams [9.813151093947097]
  We propose a tempo-relational framework for modeling surgical team dynamics from multimodal observations.<n>Such modeling enables the generation of efficient, interpretable, and actionable suggestions for clinicians.<n>This work advances surgical AI beyond outcome-driven prediction towards a socially grounded, team-centric, and actionable paradigm.
  arXiv  Detail & Related papers  (2026-08-24T13:46:46Z)
• CoMind: Understanding Collaborative Human Activity from Multiple Minds and Views [82.15362247351763]
  We introduce a novel egocentric and exocentric video dataset capturing real-world collaboration in cooking scenarios.<n>The dataset integrates multi-perspective video, high-quality audio, gaze tracking, and 3D scene and object scans, with annotations for shared attention to objects.<n>We establish benchmarks for Joint Attention Estimation, Socially Conditioned Object Interaction Anticipation, and Collaborative Handover Prediction.
  arXiv  Detail & Related papers  (2026-07-07T18:08:45Z)
• HRIBench: Benchmarking Interaction-Centric Human-Robot Collaboration [62.19372189311434]
  We introduce HRIBench, a diagnostic benchmark for intent-aware human-robot collaboration based on executable scenarios.<n>HRIBench represents collaborative tasks as structured scenario scripts that explicitly model agent roles, temporal dependencies, coordination constraints, and human behavior distributions.<n>Results show that current foundation robot policies struggle substantially in collaborative settings despite strong manipulation ability.
  arXiv  Detail & Related papers  (2026-07-05T09:15:35Z)
• Actionable Real-Time Modeling of Surgical Team Dynamics via Time-Expanded Interaction Graphs [9.813151093947097]
  We propose a real-time actionable approach for modeling surgical team dynamics using time-expanded interaction graphs.<n>This work advances surgical AI toward real-time, team-aware, and actionable decision support in the operating room.
  arXiv  Detail & Related papers  (2026-05-05T18:05:24Z)
• Learning Human-Object Interaction as Groups [52.28258599873394]
  GroupHOI is a framework that propagates contextual information in terms of geometric proximity and semantic similarity.<n>It exhibits leading performance on the more challenging Nonverbal Interaction Detection task.
  arXiv  Detail & Related papers  (2025-10-21T07:25:10Z)
• TeamMedAgents: Enhancing Medical Decision-Making of LLMs Through Structured Teamwork [3.7492721712385397]
  We present TeamMedAgents, a novel multi-agent approach that integrates evidence-based teamwork into medical decision-making with large language models (LLMs)<n>Our approach validates an organizational psychology teamwork model from human collaboration to computational multi-agent medical systems.
  arXiv  Detail & Related papers  (2025-08-11T15:55:06Z)
• Knowledge-based Reasoning and Learning under Partial Observability in Ad Hoc Teamwork [4.454557728745761]
  This paper introduces an architecture that determines an ad hoc agent's behavior based on non-monotonic logical reasoning. It supports online selection, adaptation, and learning of the models that predict the other agents' behavior. We show that the performance of our architecture is comparable or better than state of the art data-driven baselines in both simple and complex scenarios.
  arXiv  Detail & Related papers  (2023-06-01T15:21:27Z)
• Detecting and Optimising Team Interactions in Software Development [58.720142291102135]
  This paper presents a data-driven approach to detect the functional interaction structure for software development teams. Our approach considers differences in the activity levels of team members and uses a block-constrained configuration model. We show how our approach enables teams to compare their functional interaction structure against synthetically created benchmark scenarios.
  arXiv  Detail & Related papers  (2023-02-28T14:53:29Z)
• Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey [71.43956423427397]
  We aim to identify the nonverbal cues and computational methodologies resulting in effective performance. This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings. Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
  arXiv  Detail & Related papers  (2022-07-20T13:37:57Z)
• Coordination Among Neural Modules Through a Shared Global Workspace [78.08062292790109]
  In cognitive science, a global workspace architecture has been proposed in which functionally specialized components share information. We show that capacity limitations have a rational basis in that they encourage specialization and compositionality.
  arXiv  Detail & Related papers  (2021-03-01T18:43:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.