Robotic Classification of Divers' Swimming States using Visual Pose Keypoints as IMUs

• URL: http://arxiv.org/abs/2510.17863v1
• Date: Wed, 15 Oct 2025 19:57:03 GMT
• Title: Robotic Classification of Divers' Swimming States using Visual Pose Keypoints as IMUs
• Authors: Demetrious T. Kutzke, Ying-Kun Wu, Elizabeth Terveen, Junaed Sattar,
• Abstract summary: We introduce a novel hybrid approach that bridges the gap to monitor scuba diver safety.<n>Our method leverages computer vision to generate high-fidelity motion data, effectively creating a pseudo-IMU'' from a stream of 3D human joint keypoints.<n>We apply this system to the vital task of identifying anomalous scuba diver behavior that signals the onset of a medical emergency.
• Score: 8.231695165378568
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traditional human activity recognition uses either direct image analysis or data from wearable inertial measurement units (IMUs), but can be ineffective in challenging underwater environments. We introduce a novel hybrid approach that bridges this gap to monitor scuba diver safety. Our method leverages computer vision to generate high-fidelity motion data, effectively creating a ``pseudo-IMU'' from a stream of 3D human joint keypoints. This technique circumvents the critical problem of wireless signal attenuation in water, which plagues conventional diver-worn sensors communicating with an Autonomous Underwater Vehicle (AUV). We apply this system to the vital task of identifying anomalous scuba diver behavior that signals the onset of a medical emergency such as cardiac arrest -- a leading cause of scuba diving fatalities. By integrating our classifier onboard an AUV and conducting experiments with simulated distress scenarios, we demonstrate the utility and effectiveness of our method for advancing robotic monitoring and diver safety.

Related papers

• Enhancing Network Security Management in Water Systems using FM-based Attack Attribution [43.48086726793515]
  We propose a novel model-agnostic Factorization Machines (FM)-based approach that capitalizes on water system sensor-actuator interactions to provide granular explanations and attributions for cyber attacks.<n>In multi-feature cyber attack scenarios involving intricate sensor-actuator interactions, our FM-based attack attribution method effectively ranks attack root causes, achieving approximately 20% average improvement over SHAP and LEMNA.
  arXiv  Detail & Related papers  (2025-03-03T06:52:00Z)
• Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning [52.6706505729803]
  We introduce Federated Learning (FL) to collaboratively train a decentralized shared model of Intrusion Detection Systems (IDS) FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results show that the proposed approach outperforms local training and traditional FL in terms of both speed and performance.
  arXiv  Detail & Related papers  (2024-01-22T14:16:37Z)
• AI-Based Energy Transportation Safety: Pipeline Radial Threat Estimation Using Intelligent Sensing System [52.93806509364342]
  This paper proposes a radial threat estimation method for energy pipelines based on distributed optical fiber sensing technology. We introduce a continuous multi-view and multi-domain feature fusion methodology to extract comprehensive signal features. We incorporate the concept of transfer learning through a pre-trained model, enhancing both recognition accuracy and training efficiency.
  arXiv  Detail & Related papers  (2023-12-18T12:37:35Z)
• AIDPS:Adaptive Intrusion Detection and Prevention System for Underwater Acoustic Sensor Networks [15.322411959318929]
  This paper proposes an Adaptive decentralised Intrusion Detection and Prevention System (AIDPS) for Underwater Acoustic Sensor Networks (UW-ASNs) The proposed AIDPS can improve the security of the UW-ASNs so that they can efficiently detect underwater-related attacks.
  arXiv  Detail & Related papers  (2023-09-14T14:07:11Z)
• A Diver Attention Estimation Framework for Effective Underwater Human-Robot Interaction [14.267807345588581]
  Recent advancements in vision-based underwater HRI methods have the capability to interact with their human partners without requiring assistance from a topside operator.<n>In these methods, the AUV assumes that the diver is ready for interaction, while in reality, the diver may be distracted.<n>This paper presents a diver attention estimation framework for AUVs to autonomously determine the attentiveness of a diver.
  arXiv  Detail & Related papers  (2022-09-28T22:08:41Z)
• Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation [78.17108227614928]
  We propose a benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. We consider a value-based and policy-gradient Deep Reinforcement Learning (DRL) We also propose a verification strategy that checks the behavior of the trained models over a set of desired properties.
  arXiv  Detail & Related papers  (2021-12-16T16:53:56Z)
• Data-driven controllers and the need for perception systems in underwater manipulation [4.060731229044571]
  The modeling of UVMSs is a complicated and costly process due to the highly nonlinear dynamics. This is aggravated in tasks where the manipulation of objects is necessary. We introduce a control strategy for UVMSs working with unknown payloads.
  arXiv  Detail & Related papers  (2021-09-21T17:25:10Z)
• Underwater Acoustic Networks for Security Risk Assessment in Public Drinking Water Reservoirs [5.227907960942717]
  We implement an innovative AI-based approach to detect, classify and localize underwater events. We discuss the challenges of installing and using the hydrophone network in a water reservoir.
  arXiv  Detail & Related papers  (2021-07-29T14:02:51Z)
• Movement Tracks for the Automatic Detection of Fish Behavior in Videos [63.85815474157357]
  We offer a dataset of sablefish (Anoplopoma fimbria) startle behaviors in underwater videos, and investigate the use of deep learning (DL) methods for behavior detection on it. Our proposed detection system identifies fish instances using DL-based frameworks, determines trajectory tracks, derives novel behavior-specific features, and employs Long Short-Term Memory (LSTM) networks to identify startle behavior in sablefish.
  arXiv  Detail & Related papers  (2020-11-28T05:51:19Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)
• Adversarial vs behavioural-based defensive AI with joint, continual and active learning: automated evaluation of robustness to deception, poisoning and concept drift [62.997667081978825]
  Recent advancements in Artificial Intelligence (AI) have brought new capabilities to behavioural analysis (UEBA) for cyber-security. In this paper, we present a solution to effectively mitigate this attack by improving the detection process and efficiently leveraging human expertise.
  arXiv  Detail & Related papers  (2020-01-13T13:54:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.