Deep Learning for Sleep Stages Classification: Modified Rectified Linear Unit Activation Function and Modified Orthogonal Weight Initialisation

• URL: http://arxiv.org/abs/2203.04371v1
• Date: Fri, 18 Feb 2022 18:29:15 GMT
• Title: Deep Learning for Sleep Stages Classification: Modified Rectified Linear Unit Activation Function and Modified Orthogonal Weight Initialisation
• Authors: Akriti Bhusal, Abeer Alsadoon, P.W.C. Prasad, Nada Alsalami, Tarik A. Rashid
• Abstract summary: This research aims to increase the accuracy and reduce the learning time of Convolutional Neural Network. The proposed system uses Leaky Rectified Linear Unit (ReLU) instead of sigmoid activation function as an activation function.
• Score: 27.681891555949672
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Background and Aim: Each stage of sleep can affect human health, and not getting enough sleep at any stage may lead to sleep disorder like parasomnia, apnea, insomnia, etc. Sleep-related diseases could be diagnosed using Convolutional Neural Network Classifier. However, this classifier has not been successfully implemented into sleep stage classification systems due to high complexity and low accuracy of classification. The aim of this research is to increase the accuracy and reduce the learning time of Convolutional Neural Network Classifier. Methodology: The proposed system used a modified Orthogonal Convolutional Neural Network and a modified Adam optimisation technique to improve the sleep stage classification accuracy and reduce the gradient saturation problem that occurs due to sigmoid activation function. The proposed system uses Leaky Rectified Linear Unit (ReLU) instead of sigmoid activation function as an activation function. Results: The proposed system called Enhanced Sleep Stage Classification system (ESSC) used six different databases for training and testing the proposed model on the different sleep stages. These databases are University College Dublin database (UCD), Beth Israel Deaconess Medical Center MIT database (MIT-BIH), Sleep European Data Format (EDF), Sleep EDF Extended, Montreal Archive of Sleep Studies (MASS), and Sleep Heart Health Study (SHHS). Our results show that the gradient saturation problem does not exist anymore. The modified Adam optimiser helps to reduce the noise which in turn result in faster convergence time. Conclusion: The convergence speed of ESSC is increased along with better classification accuracy compared to the state of art solution.

Related papers

• SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stages [4.649202082648198]
  This paper develops a generative adversarial network (GAN)-powered ensemble deep learning model, named SleepEGAN, for the imbalanced classification of sleep stages. We show that the proposed method can improve classification accuracy compared to several existing state-of-the-art methods using three public sleep datasets.
  arXiv  Detail & Related papers  (2023-07-04T01:56:00Z)
• Classification of sleep stages from EEG, EOG and EMG signals by SSNet [2.1915057426589746]
  Classification of sleep stages plays an essential role in diagnosing sleep-related diseases including Sleep Disorder Breathing (SDB) disease. We propose an end-to-end deep learning architecture, named SSNet, which comprises of two deep learning networks based on CNN andLSTM. Our model achieves the best performance in classifying sleep stages when compared with the state-of-the-art techniques.
  arXiv  Detail & Related papers  (2023-07-03T01:05:24Z)
• Sleep Model -- A Sequence Model for Predicting the Next Sleep Stage [18.059360820527687]
  Sleep-stage classification using simple sensors, such as single-channel electroencephalography (EEG), electrooculography (EOG), electromyography (EMG) or electrocardiography (ECG) has gained substantial interest. In this study, we proposed a sleep model that predicts the next sleep stage and used it to improve sleep classification accuracy.
  arXiv  Detail & Related papers  (2023-02-17T07:37:54Z)
• Continual learning benefits from multiple sleep mechanisms: NREM, REM, and Synaptic Downscaling [51.316408685035526]
  Learning new tasks and skills in succession without losing prior learning is a computational challenge for both artificial and biological neural networks. Here, we investigate how modeling three distinct components of mammalian sleep together affects continual learning in artificial neural networks.
  arXiv  Detail & Related papers  (2022-09-09T13:45:27Z)
• DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain Medical Images [56.72015587067494]
  We propose a novel dynamic learning rate adjustment method for test-time adaptation, called DLTTA. Our method achieves effective and fast test-time adaptation with consistent performance improvement over current state-of-the-art test-time adaptation methods.
  arXiv  Detail & Related papers  (2022-05-27T02:34:32Z)
• FedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine Transform Loss [58.58979566599889]
  We propose a novel self-supervised learning (FedMed) for brain image synthesis. An affine transform loss (ATL) was formulated to make use of severely distorted images without violating privacy legislation. The proposed method demonstrates advanced performance in both the quality of synthesized results under a severely misaligned and unpaired data setting.
  arXiv  Detail & Related papers  (2022-01-29T13:45:39Z)
• SOUL: An Energy-Efficient Unsupervised Online Learning Seizure Detection Classifier [68.8204255655161]
  Implantable devices that record neural activity and detect seizures have been adopted to issue warnings or trigger neurostimulation to suppress seizures. For an implantable seizure detection system, a low power, at-the-edge, online learning algorithm can be employed to dynamically adapt to neural signal drifts. SOUL was fabricated in TSMC's 28 nm process occupying 0.1 mm2 and achieves 1.5 nJ/classification energy efficiency, which is at least 24x more efficient than state-of-the-art.
  arXiv  Detail & Related papers  (2021-10-01T23:01:20Z)
• Sleep syndromes onset detection based on automatic sleep staging algorithm [0.0]
  A Fast Fourier Transform is applied to 30 seconds long epochs of EEG recordings to provide localized time-frequency information. A deep convolutional LSTM neural network is trained for sleep stage classification. The code evaluation showed impressive results, reaching an accuracy of 86.43, precision of 77.76, recall of 93,32, F1-score of 89.12 with the final mean false error loss of 0.09.
  arXiv  Detail & Related papers  (2021-07-07T15:38:47Z)
• Automatic detection of microsleep episodes with deep learning [55.41644538483948]
  Brief fragments of sleep shorter than 15 s are defined as microsleep episodes (MSEs) maintenance of wakefulness test (MWT) is often used in a clinical setting to assess vigilance. MSEs are mostly not considered in the absence of established scoring criteria defining MSEs. We aimed for automatic detection of MSEs with machine learning based on raw EEG and EOG data as input.
  arXiv  Detail & Related papers  (2020-09-07T11:38:40Z)
• Automate Obstructive Sleep Apnea Diagnosis Using Convolutional Neural Networks [4.882119124419393]
  This paper presents a CNN architecture with 1D convolutional and FCN layers for classification. The proposed 1D CNN model achieves excellent classification results without manually preprocesssing PSG signals.
  arXiv  Detail & Related papers  (2020-06-13T15:35:18Z)
• Rectified Meta-Learning from Noisy Labels for Robust Image-based Plant Disease Diagnosis [64.82680813427054]
  Plant diseases serve as one of main threats to food security and crop production. One popular approach is to transform this problem as a leaf image classification task, which can be addressed by the powerful convolutional neural networks (CNNs) We propose a novel framework that incorporates rectified meta-learning module into common CNN paradigm to train a noise-robust deep network without using extra supervision information.
  arXiv  Detail & Related papers  (2020-03-17T09:51:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.