DeepStroke: An Efficient Stroke Screening Framework for Emergency Rooms with Multimodal Adversarial Deep Learning

• URL: http://arxiv.org/abs/2109.12065v1
• Date: Fri, 24 Sep 2021 16:46:13 GMT
• Title: DeepStroke: An Efficient Stroke Screening Framework for Emergency Rooms with Multimodal Adversarial Deep Learning
• Authors: Tongan Cai, Haomiao Ni, Mingli Yu, Xiaolei Huang, Kelvin Wong, John Volpi, James Z. Wang, Stephen T.C. Wong
• Abstract summary: In an emergency room (ER) setting, the diagnosis of stroke is a common challenge. Due to excessive execution time and cost, an MRI scan is usually not available in the ER. We propose a novel multimodal deep learning framework, DeepStroke, to achieve computer-aided stroke presence assessment.
• Score: 18.097454820713555
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In an emergency room (ER) setting, the diagnosis of stroke is a common challenge. Due to excessive execution time and cost, an MRI scan is usually not available in the ER. Clinical tests are commonly referred to in stroke screening, but neurologists may not be immediately available. We propose a novel multimodal deep learning framework, DeepStroke, to achieve computer-aided stroke presence assessment by recognizing the patterns of facial motion incoordination and speech inability for patients with suspicion of stroke in an acute setting. Our proposed DeepStroke takes video data for local facial paralysis detection and audio data for global speech disorder analysis. It further leverages a multi-modal lateral fusion to combine the low- and high-level features and provides mutual regularization for joint training. A novel adversarial training loss is also introduced to obtain identity-independent and stroke-discriminative features. Experiments on our video-audio dataset with actual ER patients show that the proposed approach outperforms state-of-the-art models and achieves better performance than ER doctors, attaining a 6.60% higher sensitivity and maintaining 4.62% higher accuracy when specificity is aligned. Meanwhile, each assessment can be completed in less than 6 minutes, demonstrating the framework's great potential for clinical implementation.

Related papers

• STIED: A deep learning model for the SpatioTemporal detection of focal Interictal Epileptiform Discharges with MEG [0.08030359871216612]
  Magnetoencephalography (MEG) allows the non-invasive detection of interictal epileptiform discharges (IEDs) Deep learning (DL) could revolutionize clinical MEG practice. We developed STIED, a powerful yet supervised DL algorithm combining two convolutional neural networks with temporal (1D time-course) and spatial (2D topography) features of MEG signals.
  arXiv  Detail & Related papers  (2024-10-30T18:41:22Z)
• Detecting and clustering swallow events in esophageal long-term high-resolution manometry [48.688209040613216]
  We propose a Deep Learning based swallowing detection method to accurately identify swallowing events and secondary non-deglutitive-induced esophageal motility disorders. We evaluate our computational pipeline on a total of 25 LTHRMs, which were meticulously annotated by medical experts.
  arXiv  Detail & Related papers  (2024-05-02T09:41:31Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• MAMAF-Net: Motion-Aware and Multi-Attention Fusion Network for Stroke Diagnosis [1.4680035572775534]
  Stroke is a major cause of mortality and disability worldwide from which one in four people are in danger of incurring in their lifetime. We propose a motion-aware and multi-attention fusion network (MAMAF-Net) that can detect stroke from multimodal examination videos. The proposed MAMAF-Net consists of motion-aware modules to sense the mobility of patients, attention modules to fuse the multi-input video data, and 3D convolutional layers to perform diagnosis from the attention-based extracted features.
  arXiv  Detail & Related papers  (2023-04-19T07:27:21Z)
• AIOSA: An approach to the automatic identification of obstructive sleep apnea events based on deep learning [1.5381930379183162]
  OSAS is associated with higher mortality, worse neurological deficits, worse functional outcome after rehabilitation, and a higher likelihood of uncontrolled hypertension. The gold standard test for diagnosing OSAS is polysomnography (PSG) We propose a convolutional deep learning architecture able to reduce the temporal resolution of raw waveform data.
  arXiv  Detail & Related papers  (2023-02-10T11:21:47Z)
• Collective Intelligent Strategy for Improved Segmentation of COVID-19 from CT [0.2062593640149623]
  We propose a novel non-invasive tool, using deep learning and imaging, for delineating COVID-19 infection in lungs. The Ensembling Attention-based Multi-scaled Convolution network (EAMC) exhibits high sensitivity and precision in outlining infected regions. Its clinical significance lies in its unprecedented scope in providing low-cost decision-making for patients lacking specialized healthcare at remote locations.
  arXiv  Detail & Related papers  (2022-12-23T11:24:29Z)
• Outlier-based Autism Detection using Longitudinal Structural MRI [6.311381904410801]
  This paper proposes structural Magnetic Resonance Imaging (sMRI)-based Autism Spectrum Disorder diagnosis via an outlier detection approach. Generative Adversarial Network (GAN) is trained exclusively with sMRI scans of healthy subjects. Experiments reveal that our ASD detection framework performs comparably with the state-of-the-art with far fewer training data.
  arXiv  Detail & Related papers  (2022-02-21T04:37:25Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• An Interpretable Multiple-Instance Approach for the Detection of referable Diabetic Retinopathy from Fundus Images [72.94446225783697]
  We propose a machine learning system for the detection of referable Diabetic Retinopathy in fundus images. By extracting local information from image patches and combining it efficiently through an attention mechanism, our system is able to achieve high classification accuracy. We evaluate our approach on publicly available retinal image datasets, in which it exhibits near state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-03-02T13:14:15Z)
• Cross-Modal Information Maximization for Medical Imaging: CMIM [62.28852442561818]
  In hospitals, data are siloed to specific information systems that make the same information available under different modalities. This offers unique opportunities to obtain and use at train-time those multiple views of the same information that might not always be available at test-time. We propose an innovative framework that makes the most of available data by learning good representations of a multi-modal input that are resilient to modality dropping at test-time.
  arXiv  Detail & Related papers  (2020-10-20T20:05:35Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.