Robotic Eye-in-hand Visual Servo Axially Aligning Nasopharyngeal Swabs with the Nasal Cavity

• URL: http://arxiv.org/abs/2408.12437v1
• Date: Thu, 22 Aug 2024 14:36:06 GMT
• Title: Robotic Eye-in-hand Visual Servo Axially Aligning Nasopharyngeal Swabs with the Nasal Cavity
• Abstract summary: The nasopharyngeal (NP) swab test is a method for collecting cultures to diagnose respiratory illnesses, including COVID-19. A critical component of the NP swab test is having the swab aligned properly with the nasal cavity so that it does not cause excessive discomfort or injury by traveling down the wrong passage. Our work creates a vision-guided pipeline to allow an instrumented robot arm to properly position and orient NP swabs with respect to the nostrils of free-standing patients.
• Score: 7.209758868768353
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The nasopharyngeal (NP) swab test is a method for collecting cultures to diagnose for different types of respiratory illnesses, including COVID-19. Delegating this task to robots would be beneficial in terms of reducing infection risks and bolstering the healthcare system, but a critical component of the NP swab test is having the swab aligned properly with the nasal cavity so that it does not cause excessive discomfort or injury by traveling down the wrong passage. Existing research towards robotic NP swabbing typically assumes the patient's head is held within a fixture. This simplifies the alignment problem, but is also dissimilar to clinical scenarios where patients are typically free-standing. Consequently, our work creates a vision-guided pipeline to allow an instrumented robot arm to properly position and orient NP swabs with respect to the nostrils of free-standing patients. The first component of the pipeline is a precomputed joint lookup table to allow the arm to meet the patient's arbitrary position in the designated workspace, while avoiding joint limits. Our pipeline leverages semantic face models from computer vision to estimate the Euclidean pose of the face with respect to a monocular RGB-D camera placed on the end-effector. These estimates are passed into an unscented Kalman filter on manifolds state estimator and a pose based visual servo control loop to move the swab to the designated pose in front of the nostril. Our pipeline was validated with human trials, featuring a cohort of 25 participants. The system is effective, reaching the nostril for 84% of participants, and our statistical analysis did not find significant demographic biases within the cohort.

Related papers

• Structured Visual Evidence Decomposition for Evidence-Grounded Multimodal Screening of Obstructive Sleep Apnea-Hypopnea Syndrome [12.95586927836034]
  EviOSAHS is an evidence-grounded multimodal reasoning framework.<n>It separates image-only anatomical evidence acquisition from final clinical adjudication.<n>It achieved 88.47% accuracy, 94.86% sensitivity, 93.74% F1-score, and a 5.14% false-negative rate.
  arXiv  Detail & Related papers  (2026-05-23T06:09:31Z)
• Stop Holding Your Breath: CT-Informed Gaussian Splatting for Dynamic Bronchoscopy [19.10420788280643]
  Bronchoscopic navigation relies on registering endoscopic video to a preoperative CT scan.<n> respiratory motion deforms the airway by 5-20 mm, creating CT-to-body divergence.<n>We propose to eliminate the need for breath-hold protocols by leveraging patient-specific respiratory modeling.
  arXiv  Detail & Related papers  (2026-04-30T17:57:19Z)
• SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound [60.64817443833982]
  We present SAMe, a semantic anatomy mapping engine that provides robotic ultrasound with an explicit anatomical prior layer.<n> SAMe addresses scan initiation as a target-to-anatomy-to-action process.<n>It instantiates a patient-specific anatomical representation for the grounded targets from a single external body image.
  arXiv  Detail & Related papers  (2026-04-28T13:44:09Z)
• Towards Automated Initial Probe Placement in Transthoracic Teleultrasound Using Human Mesh and Skeleton Recovery [2.99938892718088]
  A novice or robot faces the difficult task of first placing the probe on the patient without in-person expert assistance.<n>We present a framework for automating Patient registration and anatomy-informed Initial Probe placement Guidance.<n>Pilot experiments with healthy volunteers suggest that the proposed probe placement prediction and MR guidance yield consistent initial placement.
  arXiv  Detail & Related papers  (2026-03-11T19:36:29Z)
• R2I-rPPG: A Robust Region of Interest Selection Method for Remote Photoplethysmography to Extract Heart Rate [31.04888697756927]
  The COVID-19 pandemic has underscored the need for low-cost, scalable approaches to measuring contactless vital signs. Remote photoplethymographys (r) can accurately estimate heart rate (HR) when applied to close-up videos of healthy volunteers in well-lit laboratory settings. One significant barrier to the practical application of r in health care is the accurate localization of the region of interest.
  arXiv  Detail & Related papers  (2024-10-21T10:27:57Z)
• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• AIOSA: An approach to the automatic identification of obstructive sleep apnea events based on deep learning [1.5381930379183162]
  OSAS is associated with higher mortality, worse neurological deficits, worse functional outcome after rehabilitation, and a higher likelihood of uncontrolled hypertension. The gold standard test for diagnosing OSAS is polysomnography (PSG) We propose a convolutional deep learning architecture able to reduce the temporal resolution of raw waveform data.
  arXiv  Detail & Related papers  (2023-02-10T11:21:47Z)
• End-to-End Machine Learning Framework for Facial AU Detection in Intensive Care Units [3.8168092489216385]
  Pain is a common occurrence among patients admitted to Intensive Care Units. Current manual observation-based pain assessment tools are limited by the frequency of pain observations administered and are subjective to the observer. We present our Pain-ICU dataset, the largest dataset available targeting facial behavior analysis in the dynamic ICU environment.
  arXiv  Detail & Related papers  (2022-11-12T04:43:16Z)
• LAD: A Hybrid Deep Learning System for Benign Paroxysmal Positional Vertigo Disorders Diagnostic [3.26735648891204]
  "Look and Diagnose" aims to support doctors in the medical field in diagnosing effectively the Benign Paroxysmal Positional Vertigo (BPPV) disorder. Given the body postures of the patient in the Dix-Hallpike and lateral head turns test, the visual information of both eyes is captured and fed into LAD. With the patient's body postures, the system can accurately classify given BPPV disorder into the six types of disorders with an accuracy of 91% on the validation set.
  arXiv  Detail & Related papers  (2022-10-15T13:07:27Z)
• Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion [48.52403516006036]
  This paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
  arXiv  Detail & Related papers  (2022-08-10T15:39:20Z)
• An Algorithm for the Labeling and Interactive Visualization of the Cerebrovascular System of Ischemic Strokes [59.116811751334225]
  VirtualDSA++ is an algorithm designed to segment and label the cerebrovascular tree on CTA scans. We extend the labeling mechanism for the cerebral arteries to identify occluded vessels. We present the generic concept of iterative systematic search for pathways on all nodes of said model, which enables new interactive features.
  arXiv  Detail & Related papers  (2022-04-26T14:20:26Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• Rapid head-pose detection for automated slice prescription of fetal-brain MRI [2.0526610003396657]
  In fetal-brain MRI, head-pose changes between prescription and acquisition present a challenge to obtaining the standard sagittal, coronal and axial views. We propose a robust head-pose detection algorithm using full-uterus scout scans (EPI) which take 5 seconds to acquire. The success rate of the method exceeds 94% in the third trimester, outperforming a trained technologist by up to 20%.
  arXiv  Detail & Related papers  (2021-10-08T13:59:05Z)
• COVIDNet-CT: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest CT Images [75.74756992992147]
  We introduce COVIDNet-CT, a deep convolutional neural network architecture that is tailored for detection of COVID-19 cases from chest CT images. We also introduce COVIDx-CT, a benchmark CT image dataset derived from CT imaging data collected by the China National Center for Bioinformation.
  arXiv  Detail & Related papers  (2020-09-08T15:49:55Z)
• Deep Negative Volume Segmentation [60.44793799306154]
  We propose a new angle to the 3D segmentation task: segment empty spaces between all the tissues surrounding the object. Our approach is an end-to-end pipeline that comprises a V-Net for bone segmentation. We validate the idea on the CT scans in a 50-patient dataset, annotated by experts in maxillofacial medicine.
  arXiv  Detail & Related papers  (2020-06-22T16:55:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.