Respiratory Status Detection with Video Transformers

• URL: http://arxiv.org/abs/2603.21349v1
• Date: Sun, 22 Mar 2026 18:16:18 GMT
• Title: Respiratory Status Detection with Video Transformers
• Abstract summary: We evaluate whether recent advances in video transformers can enable Artificial Intelligence systems to recognize the signs of respiratory distress from video.<n>Our findings suggest that modern video transformers can recognize subtle changes in respiratory mechanics.
• Score: 1.1101763410958634
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recognition of respiratory distress through visual inspection is a life saving clinical skill. Clinicians can detect early signs of respiratory deterioration, creating a valuable window for earlier intervention. In this study, we evaluate whether recent advances in video transformers can enable Artificial Intelligence systems to recognize the signs of respiratory distress from video. We collected videos of healthy volunteers recovering after strenuous exercise and used the natural recovery of each participants respiratory status to create a labeled dataset for respiratory distress. Splitting the video into short clips, with earlier clips corresponding to more shortness of breath, we designed a temporal ordering challenge to assess whether an AI system can detect respiratory distress. We found a ViViT encoder augmented with Lie Relative Encodings (LieRE) and Motion Guided Masking, combined with an embedding based comparison strategy, can achieve an F1 score of 0.81 on this task. Our findings suggest that modern video transformers can recognize subtle changes in respiratory mechanics.

Related papers

• A Low-Power Wearable Respiratory Sensor for Non-Invasive Stress Monitoring [0.5416422382471174]
  We present a compact non-invasive respiratory sensing system based on a force-sensitive resistor embedded in an abdominal belt.<n>We evaluate the complete sensing pipeline across multiple breathing patterns and body positions.<n>Our results show that the proposed platform enables real-time respiratory monitoring across diverse daily-life scenarios.
  arXiv  Detail & Related papers  (2026-08-06T07:41:34Z)
• Video-based detection of cessation of breathing in pre-term infants using machine learning [1.8148201112091653]
  We investigated whether camera-based signals can detect apnoea-related cessation of breathing.<n>Using video and clinical recordings from 30 pre-term infants, respiratory motion was extracted from dynamically tracked torso regions.<n>Camera-only models achieved a balanced accuracy of 76.9%, demonstrating the feasibility of non-contact COBE detection.
  arXiv  Detail & Related papers  (2026-07-06T15:42:21Z)
• Stop Holding Your Breath: CT-Informed Gaussian Splatting for Dynamic Bronchoscopy [19.10420788280643]
  Bronchoscopic navigation relies on registering endoscopic video to a preoperative CT scan.<n> respiratory motion deforms the airway by 5-20 mm, creating CT-to-body divergence.<n>We propose to eliminate the need for breath-hold protocols by leveraging patient-specific respiratory modeling.
  arXiv  Detail & Related papers  (2026-04-30T17:57:19Z)
• Towards Athlete Fatigue Assessment from Association Football Videos [53.20057980542362]
  This paper builds on state-of-theart Game State Reconstruction methods to extract player trajectories in pitch coordinates.<n>We then construct acceleration--speed profiles from these signals and analyze their behavior as fatigue-related performance indicators.<n>Our results indicate that monocular broadcast videos can recover kinematic patterns that are compatible with A-S-temporal while also revealing sensitivity to trajectory noise, calibration errors, and temporal discontinuities inherent to broadcast footage.
  arXiv  Detail & Related papers  (2026-04-07T09:36:28Z)
• EchoLVFM: One-Step Video Generation via Latent Flow Matching for Echocardiogram Synthesis [1.703077957571322]
  We introduce EchoLVFM, a one-step latent video flow-matching framework for controllable echocardiogram generation.<n> operating in the latent space, EchoLVFM synthesises temporally coherent videos in a single inference step.<n>Results demonstrate competitive video quality, strong EF adherence, and 57.9% discrimination accuracy by expert clinicians.
  arXiv  Detail & Related papers  (2026-03-14T14:39:09Z)
• Pediatric Asthma Detection with Googles HeAR Model: An AI-Driven Respiratory Sound Classifier [0.8463972278020965]
  This work presents an AI-powered diagnostic pipeline to detect early signs of asthma from pediatric respiratory sounds.<n>The SPRSound dataset is used to extract 2-second audio segments labeled as wheeze, crackle, rhonchi, stridor, or normal.<n>The system achieves over 91% accuracy, with strong performance on precision-recall metrics for positive cases.
  arXiv  Detail & Related papers  (2025-04-28T12:52:17Z)
• Machine learning-based algorithms for at-home respiratory disease monitoring and respiratory assessment [45.104212062055424]
  This work aims to develop machine learning-based algorithms to facilitate at-home respiratory disease monitoring and assessment. Data were collected from 30 healthy adults, encompassing respiratory pressure, flow, and dynamic thoraco-abdominal circumferential measurements. Various machine learning models, including the random forest classifier, logistic regression, and support vector machine (SVM), were trained to predict breathing types.
  arXiv  Detail & Related papers  (2024-09-05T02:14:31Z)
• Using BOLD-fMRI to Compute the Respiration Volume per Time (RTV) and Respiration Variation (RV) with Convolutional Neural Networks (CNN) in the Human Connectome Development Cohort [55.41644538483948]
  This study proposes a one-dimensional CNN model for reconstruction of two respiratory measures, RV and RVT. Results show that a CNN can capture informative features from resting BOLD signals and reconstruct realistic RV and RVT timeseries.
  arXiv  Detail & Related papers  (2023-07-03T18:06:36Z)
• REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
  REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
  arXiv  Detail & Related papers  (2022-08-17T03:42:19Z)
• D'ARTAGNAN: Counterfactual Video Generation [3.4079278794252232]
  Causally-enabled machine learning frameworks could help clinicians to identify the best course of treatments by answering counterfactual questions. We combine deep neural networks, twin causal networks and generative adversarial methods for the first time to build D'ARTAGNAN. We generate new ultrasound videos, retaining the video style and anatomy of the original patient, with variations of the Ejection Fraction conditioned on a given input.
  arXiv  Detail & Related papers  (2022-06-03T15:53:32Z)
• An Apparatus for the Simulation of Breathing Disorders: Physically Meaningful Generation of Surrogate Data [24.50116388903113]
  We introduce an apparatus comprising of PVC tubes and 3D printed parts as a simple yet effective method of simulating both obstructive and restrictive respiratory waveforms in healthy subjects. Independent control over both inspiratory and expiratory resistances allows for the simulation of obstructive breathing disorders through the whole spectrum of FEV1/FVC spirometry ratios. waveform characteristics of breathing disorders, such as a change in inspiratory duty cycle or peak flow are also observed in the waveforms resulting from use of the artificial breathing disorder simulation apparatus.
  arXiv  Detail & Related papers  (2021-09-14T14:00:37Z)
• Perceptual Learned Video Compression with Recurrent Conditional GAN [158.0726042755]
  We propose a Perceptual Learned Video Compression (PLVC) approach with recurrent conditional generative adversarial network. PLVC learns to compress video towards good perceptual quality at low bit-rate. The user study further validates the outstanding perceptual performance of PLVC in comparison with the latest learned video compression approaches.
  arXiv  Detail & Related papers  (2021-09-07T13:36:57Z)
• 2-D Respiration Navigation Framework for 3-D Continuous Cardiac Magnetic Resonance Imaging [61.701281723900216]
  We propose a sampling adaption to acquire 2-D respiration information during a continuous scan. We develop a pipeline to extract the different respiration states from the acquired signals, which are used to reconstruct data from one respiration phase.
  arXiv  Detail & Related papers  (2020-12-26T08:29:57Z)
• Collaborative Three-Tier Architecture Non-contact Respiratory Rate Monitoring using Target Tracking and False Peaks Eliminating Algorithms [10.232449356645608]
  Non-contact respiratory monitoring techniques have poor accuracy because they are sensitive to environmental influences like lighting and motion artifacts. frequent contact between users and the cloud might cause service request delays and potentially the loss of personal data. We proposed a non-contact respiratory rate monitoring system with a cooperative three-layer design to increase the precision of respiratory monitoring and decrease data transmission latency.
  arXiv  Detail & Related papers  (2020-11-17T07:33:00Z)
• VideoForensicsHQ: Detecting High-quality Manipulated Face Videos [77.60295082172098]
  We show how the performance of forgery detectors depends on the presence of artefacts that the human eye can see. We introduce a new benchmark dataset for face video forgery detection, of unprecedented quality.
  arXiv  Detail & Related papers  (2020-05-20T21:17:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.