Real-Time Assessment of Bystander Situation Awareness in Drone-Assisted First Aid
- URL: http://arxiv.org/abs/2510.03558v1
- Date: Fri, 03 Oct 2025 23:11:30 GMT
- Title: Real-Time Assessment of Bystander Situation Awareness in Drone-Assisted First Aid
- Authors: Shen Chang, Renran Tian, Nicole Adams, Nan Kong,
- Abstract summary: Rapid naloxone delivery via drones offers a promising solution for responding to opioid overdose emergencies (OOEs)<n>We address the critical role of bystander situational awareness (SA) in human-autonomy teaming (HAT)<n>We propose a video-based real-time SA assessment framework that utilizes graph embeddings and transformer models to assess bystander SA in real time.
- Score: 6.986130179800924
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Rapid naloxone delivery via drones offers a promising solution for responding to opioid overdose emergencies (OOEs), by extending lifesaving interventions to medically untrained bystanders before emergency medical services (EMS) arrive. Recognizing the critical role of bystander situational awareness (SA) in human-autonomy teaming (HAT), we address a key research gap in real-time SA assessment by introducing the Drone-Assisted Naloxone Delivery Simulation Dataset (DANDSD). This pioneering dataset captures HAT during simulated OOEs, where college students without medical training act as bystanders tasked with administering intranasal naloxone to a mock overdose victim. Leveraging this dataset, we propose a video-based real-time SA assessment framework that utilizes graph embeddings and transformer models to assess bystander SA in real time. Our approach integrates visual perception and comprehension cues--such as geometric, kinematic, and interaction graph features--and achieves high-performance SA prediction. It also demonstrates strong temporal segmentation accuracy, outperforming the FINCH baseline by 9% in Mean over Frames (MoF) and 5% in Intersection over Union (IoU). This work supports the development of adaptive drone systems capable of guiding bystanders effectively, ultimately improving emergency response outcomes and saving lives.
Related papers
- DispatchMAS: Fusing taxonomy and artificial intelligence agents for emergency medical services [49.70819009392778]
Large Language Models (LLMs) and Multi-Agent Systems (MAS) offer opportunities to augment dispatchers.<n>This study aimed to develop and evaluate a taxonomy-grounded, multi-agent system for simulating realistic scenarios.
arXiv Detail & Related papers (2025-10-24T08:01:21Z) - Will You Be Aware? Eye Tracking-Based Modeling of Situational Awareness in Augmented Reality [7.811210736680597]
Augmented Reality (AR) systems pose risks of inducing cognitive tunneling-a hyperfocus on virtual content that compromises situational awareness (SA) in safety-critical scenarios.<n>This paper investigates SA in AR-guided resuscitation (CPR), where responders must balance effective compressions with vigilance to unpredictable cardiopulmonary hazards.<n>We developed an AR app that overlays real-time CPR feedback (compression depth and rate) and conducted a user study with simulated unexpected incidents.<n>Eye tracking analysis revealed that higher SA levels were associated with greater saccadic amplitude and velocity, and with reduced proportion and frequency of fixations on virtual content.
arXiv Detail & Related papers (2025-08-07T04:35:50Z) - Accurate AI-Driven Emergency Vehicle Location Tracking in Healthcare ITS Digital Twin [3.906021256484084]
This study proposes integrating AI predictive models, specifically Support Vector Regression (SVR) and Deep Neural Networks (DNN), within a constructed mock DT data pipeline framework.<n>Through various testing scenarios, we visually demonstrate the efficacy of our methodology and our key role in significantly reducing the witnessed gap within the HITS's DT.
arXiv Detail & Related papers (2025-02-05T17:32:07Z) - Psych-Occlusion: Using Visual Psychophysics for Aerial Detection of Occluded Persons during Search and Rescue [41.03292974500013]
Small Unmanned Aerial Systems (sUAS) as "eyes in the sky" during Emergency Response (ER) scenarios.<n> efficient detection of persons from aerial views plays a crucial role in achieving a successful mission outcome.<n>Performance of Computer Vision (CV) models onboard sUAS substantially degrades under real-life rigorous conditions.<n>We exemplify the use of our behavioral dataset, Psych-ER, by using its human accuracy data to adapt the loss function of a detection model.
arXiv Detail & Related papers (2024-12-07T06:22:42Z) - Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Care [46.2482873419289]
We introduce a deep Q-learning approach to obtain more reliable critical care policies.
We evaluate our method in off-policy and offline settings using simulated environments and real health records from intensive care units.
arXiv Detail & Related papers (2023-06-13T18:02:57Z) - Forecasting Patient Flows with Pandemic Induced Concept Drift using
Explainable Machine Learning [0.0]
This study investigates how a suite of novel quasi-real-time variables can improve the forecasting models of patient flows.
The prevailing COVID-19 Alert Level feature together with Google search terms and pedestrian traffic were effective at producing generalisable forecasts.
arXiv Detail & Related papers (2022-11-01T20:42:26Z) - SSM-DTA: Breaking the Barriers of Data Scarcity in Drug-Target Affinity
Prediction [127.43571146741984]
Drug-Target Affinity (DTA) is of vital importance in early-stage drug discovery.
wet experiments remain the most reliable method, but they are time-consuming and resource-intensive.
Existing methods have primarily focused on developing techniques based on the available DTA data, without adequately addressing the data scarcity issue.
We present the SSM-DTA framework, which incorporates three simple yet highly effective strategies.
arXiv Detail & Related papers (2022-06-20T14:53:25Z) - Robust and Efficient Medical Imaging with Self-Supervision [80.62711706785834]
We present REMEDIS, a unified representation learning strategy to improve robustness and data-efficiency of medical imaging AI.
We study a diverse range of medical imaging tasks and simulate three realistic application scenarios using retrospective data.
arXiv Detail & Related papers (2022-05-19T17:34:18Z) - MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos.
We release a new dataset, MEDICA, for mental health patient engagement detection.
arXiv Detail & Related papers (2020-11-17T15:18:38Z) - BiteNet: Bidirectional Temporal Encoder Network to Predict Medical
Outcomes [53.163089893876645]
We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey.
An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys.
We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
arXiv Detail & Related papers (2020-09-24T00:42:36Z) - Effects of Voice-Based Synthetic Assistant on Performance of Emergency
Care Provider in Training [0.0]
It is critical that medical first responders are well trained to deal with emergencies more effectively.
We introduced a voice-based SA to augment the training process of medical first responders and enhance their performance in the field.
The potential benefits of SAs include a reduction in training costs and enhanced monitoring mechanisms.
arXiv Detail & Related papers (2020-08-12T01:55:28Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.