Towards nation-wide analytical healthcare infrastructures: A privacy-preserving augmented knee rehabilitation case study
- URL: http://arxiv.org/abs/2412.20733v1
- Date: Mon, 30 Dec 2024 06:14:48 GMT
- Title: Towards nation-wide analytical healthcare infrastructures: A privacy-preserving augmented knee rehabilitation case study
- Authors: Boris Bačić, Claudiu Vasile, Chengwei Feng, Marian G. Ciucă,
- Abstract summary: This paper contributes towards the near-future privacy-preserving big data analytical healthcare platforms.
The experimental work includes a real-life knee rehabilitation video dataset.
To convert video from mobile into privacy-preserving diagnostic timeseries data, we employed Google MediaPipe pose estimation.
The developed proof-of-concept algorithms can augment knee exercise videos by overlaying the patient with stick figure elements.
- Score: 0.0
- License:
- Abstract: The purpose of this paper is to contribute towards the near-future privacy-preserving big data analytical healthcare platforms, capable of processing streamed or uploaded timeseries data or videos from patients. The experimental work includes a real-life knee rehabilitation video dataset capturing a set of exercises from simple and personalised to more general and challenging movements aimed for returning to sport. To convert video from mobile into privacy-preserving diagnostic timeseries data, we employed Google MediaPipe pose estimation. The developed proof-of-concept algorithms can augment knee exercise videos by overlaying the patient with stick figure elements while updating generated timeseries plot with knee angle estimation streamed as CSV file format. For patients and physiotherapists, video with side-to-side timeseries visually indicating potential issues such as excessive knee flexion or unstable knee movements or stick figure overlay errors is possible by setting a-priori knee-angle parameters. To address adherence to rehabilitation programme and quantify exercise sets and repetitions, our adaptive algorithm can correctly identify (91.67%-100%) of all exercises from side- and front-view videos. Transparent algorithm design for adaptive visual analysis of various knee exercise patterns contributes towards the interpretable AI and will inform near-future privacy-preserving, non-vendor locking, open-source developments for both end-user computing devices and as on-premises non-proprietary cloud platforms that can be deployed within the national healthcare system.
Related papers
- Sync from the Sea: Retrieving Alignable Videos from Large-Scale Datasets [62.280729345770936]
We introduce the task of Alignable Video Retrieval (AVR)
Given a query video, our approach can identify well-alignable videos from a large collection of clips and temporally synchronize them to the query.
Our experiments on 3 datasets, including large-scale Kinetics700, demonstrate the effectiveness of our approach.
arXiv Detail & Related papers (2024-09-02T20:00:49Z) - Learning to Estimate Critical Gait Parameters from Single-View RGB
Videos with Transformer-Based Attention Network [0.0]
This paper introduces a novel Transformer network to estimate critical gait parameters from RGB videos captured by a single-view camera.
Empirical evaluations on a public dataset of cerebral palsy patients indicate that the proposed framework surpasses current state-of-the-art approaches.
arXiv Detail & Related papers (2023-12-01T07:45:27Z) - Pose2Gait: Extracting Gait Features from Monocular Video of Individuals
with Dementia [3.2739089842471136]
Video-based ambient monitoring of gait for older adults with dementia has the potential to detect negative changes in health.
Computer vision-based pose tracking models can process video data automatically and extract joint locations.
These models are not optimized for gait analysis on older adults or clinical populations.
arXiv Detail & Related papers (2023-08-22T14:59:17Z) - A spatio-temporal network for video semantic segmentation in surgical
videos [11.548181453080087]
We propose a novel architecture for modelling temporal relationships in videos.
The proposed model includes a decoder to enable semantic video segmentation.
The proposed decoder can be used on top of any segmentation encoder to improve temporal consistency.
arXiv Detail & Related papers (2023-06-19T16:36:48Z) - Transform-Equivariant Consistency Learning for Temporal Sentence
Grounding [66.10949751429781]
We introduce a novel Equivariant Consistency Regulation Learning framework to learn more discriminative representations for each video.
Our motivation comes from that the temporal boundary of the query-guided activity should be consistently predicted.
In particular, we devise a self-supervised consistency loss module to enhance the completeness and smoothness of the augmented video.
arXiv Detail & Related papers (2023-05-06T19:29:28Z) - Automated Detection of Patients in Hospital Video Recordings [1.759613153663764]
In a clinical setting, epilepsy patients are monitored via video electroencephalogram (EEG) tests.
Currently, there are no existing automated methods for tracking the patient's location during a seizure.
We evaluate an ImageNet pre-trained Mask R-CNN, a standard deep learning model for object detection, on the task of patient detection.
arXiv Detail & Related papers (2021-11-28T23:15:06Z) - HighlightMe: Detecting Highlights from Human-Centric Videos [52.84233165201391]
We present a domain- and user-preference-agnostic approach to detect highlightable excerpts from human-centric videos.
We use an autoencoder network equipped with spatial-temporal graph convolutions to detect human activities and interactions.
We observe a 4-12% improvement in the mean average precision of matching the human-annotated highlights over state-of-the-art methods.
arXiv Detail & Related papers (2021-10-05T01:18:15Z) - Vogtareuth Rehab Depth Datasets: Benchmark for Marker-less Posture
Estimation in Rehabilitation [55.41644538483948]
We propose two rehabilitation-specific pose datasets containing depth images and 2D pose information of patients performing rehab exercises.
We use a state-of-the-art marker-less posture estimation model which is trained on a non-rehab benchmark dataset.
We show that our dataset can be used to train pose models to detect rehab-specific complex postures.
arXiv Detail & Related papers (2021-08-23T16:18:26Z) - ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton
Gait Preference Landscapes [64.87637128500889]
Region of Interest Active Learning (ROIAL) framework actively learns each user's underlying utility function over a region of interest.
ROIAL learns from ordinal and preference feedback, which are more reliable feedback mechanisms than absolute numerical scores.
Results demonstrate the feasibility of recovering gait utility landscapes from limited human trials.
arXiv Detail & Related papers (2020-11-09T22:45:58Z) - Towards Real-time Drowsiness Detection for Elderly Care [0.0]
This paper produces a proof of concept extracting drowsiness information from videos to help elderly living on their own.
To yawning, eyelid and head movement over time, we extracted 3000 images from videos for training and testing of deep learning models integrated with OpenCV.
arXiv Detail & Related papers (2020-10-21T05:48:59Z) - BiteNet: Bidirectional Temporal Encoder Network to Predict Medical
Outcomes [53.163089893876645]
We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey.
An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys.
We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
arXiv Detail & Related papers (2020-09-24T00:42:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.