TransSleep: Transitioning-aware Attention-based Deep Neural Network for Sleep Staging

• URL: http://arxiv.org/abs/2203.12590v1
• Date: Tue, 22 Mar 2022 08:55:32 GMT
• Title: TransSleep: Transitioning-aware Attention-based Deep Neural Network for Sleep Staging
• Authors: Jauen Phyo, Wonjun Ko, Eunjin Jeon, and Heung-Il Suk
• Abstract summary: We propose a novel deep neural network structure, TransSleep, that captures distinctive local temporal patterns. Results show that TransSleep achieves promising performance in automatic sleep staging.
• Score: 2.105172041656126
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine learning as well as deep learning architectures for sleep staging. However, two key challenges hinder the practical use of these architectures: effectively capturing salient waveforms in sleep signals and correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep adopts an attention-based multi-scale feature extractor module to capture salient waveforms; a stage-confusion estimator module with a novel auxiliary task, epoch-level stage classification, to estimate confidence scores for identifying confusing stages; and a context encoder module with the other novel auxiliary task, stage-transition detection, to represent contextual relationships across neighboring epochs. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets, Sleep-EDF and MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep learning-based sleep staging.

Related papers

• WaveSleepNet: An Interpretable Network for Expert-like Sleep Staging [4.4697567606459545]
  WaveSleepNet is an interpretable neural network for sleep staging. WaveSleepNet uses latent space representations to identify characteristic wave prototypes corresponding to different sleep stages. The efficacy of WaveSleepNet is validated across three public datasets.
  arXiv  Detail & Related papers  (2024-04-11T03:47:58Z)
• Quantifying the Impact of Data Characteristics on the Transferability of Sleep Stage Scoring Models [0.10878040851637998]
  Deep learning models for scoring sleep stages based on single-channel EEG have been proposed as a promising method for remote sleep monitoring. Applying these models to new datasets, particularly from wearable devices, raises two questions. First, when annotations on a target dataset are unavailable, which different data characteristics affect the sleep stage scoring performance the most and by how much? We propose a novel method for quantifying the impact of different data characteristics on the transferability of deep learning models.
  arXiv  Detail & Related papers  (2023-03-28T07:57:21Z)
• Sleep Activity Recognition and Characterization from Multi-Source Passively Sensed Data [67.60224656603823]
  Sleep Activity Recognition methods can provide indicators to assess, monitor, and characterize subjects' sleep-wake cycles and detect behavioral changes. We propose a general method that continuously operates on passively sensed data from smartphones to characterize sleep and identify significant sleep episodes. Thanks to their ubiquity, these devices constitute an excellent alternative data source to profile subjects' biorhythms in a continuous, objective, and non-invasive manner.
  arXiv  Detail & Related papers  (2023-01-17T15:18:45Z)
• ProductGraphSleepNet: Sleep Staging using Product Spatio-Temporal Graph Learning with Attentive Temporal Aggregation [4.014524824655106]
  This work proposes an adaptive product graph learning-based graph convolutional network, named ProductGraphSleepNet, for learning joint-temporal graphs. The proposed network makes it possible for clinicians to comprehend and interpret the learned connectivity graphs for sleep stages.
  arXiv  Detail & Related papers  (2022-12-09T14:34:58Z)
• Heterogeneous Hidden Markov Models for Sleep Activity Recognition from Multi-Source Passively Sensed Data [67.60224656603823]
  Psychiatric patients' passive activity monitoring is crucial to detect behavioural shifts in real-time. Sleep Activity Recognition constitutes a behavioural marker to portray patients' activity cycles. Mobile passively sensed data captured from smartphones constitute an excellent alternative to profile patients' biorhythm.
  arXiv  Detail & Related papers  (2022-11-08T17:29:40Z)
• SleePyCo: Automatic Sleep Scoring with Feature Pyramid and Contrastive Learning [0.0]
  We propose a deep learning framework named SleePyCo that incorporates 1) a feature pyramid and 2) supervised contrastive learning for automatic sleep scoring. For the feature pyramid, we propose a backbone network named SleePyCo-backbone to consider multiple feature sequences on different temporal and frequency scales. Supervised contrastive learning allows the network to extract class discriminative features by minimizing the distance between intra-class features and simultaneously maximizing that between inter-class features.
  arXiv  Detail & Related papers  (2022-09-20T04:10:49Z)
• Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic Downscaling [51.316408685035526]
  Learning new tasks and skills in succession without losing prior learning is a computational challenge for both artificial and biological neural networks. Here, we investigate how modeling three distinct components of mammalian sleep together affects continual learning in artificial neural networks.
  arXiv  Detail & Related papers  (2022-09-09T13:45:27Z)
• Preliminary study on using vector quantization latent spaces for TTS/VC systems with consistent performance [55.10864476206503]
  We investigate the use of quantized vectors to model the latent linguistic embedding. By enforcing different policies over the latent spaces in the training, we are able to obtain a latent linguistic embedding. Our experiments show that the voice cloning system built with vector quantization has only a small degradation in terms of perceptive evaluations.
  arXiv  Detail & Related papers  (2021-06-25T07:51:35Z)
• SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging [10.269152939137854]
  We propose SalientSleepNet, a salient wave detection network for sleep staging. It is composed of two independent $rm U2$-like streams to extract salient features from multimodal data. Experiments on the two datasets demonstrate that SalientSleepNet outperforms the state-of-the-art baselines.
  arXiv  Detail & Related papers  (2021-05-24T16:32:09Z)
• Temporal Memory Relation Network for Workflow Recognition from Surgical Video [53.20825496640025]
  We propose a novel end-to-end temporal memory relation network (TMNet) for relating long-range and multi-scale temporal patterns. We have extensively validated our approach on two benchmark surgical video datasets.
  arXiv  Detail & Related papers  (2021-03-30T13:20:26Z)
• Automatic detection of microsleep episodes with deep learning [55.41644538483948]
  Brief fragments of sleep shorter than 15 s are defined as microsleep episodes (MSEs) maintenance of wakefulness test (MWT) is often used in a clinical setting to assess vigilance. MSEs are mostly not considered in the absence of established scoring criteria defining MSEs. We aimed for automatic detection of MSEs with machine learning based on raw EEG and EOG data as input.
  arXiv  Detail & Related papers  (2020-09-07T11:38:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.