SI-SD: Sleep Interpreter through awake-guided cross-subject Semantic Decoding
- URL: http://arxiv.org/abs/2309.16457v3
- Date: Sun, 19 May 2024 20:15:04 GMT
- Title: SI-SD: Sleep Interpreter through awake-guided cross-subject Semantic Decoding
- Authors: Hui Zheng, Zhong-Tao Chen, Hai-Teng Wang, Jian-Yang Zhou, Lin Zheng, Pei-Yang Lin, Yun-Zhe Liu,
- Abstract summary: We design a novel cognitive neuroscience experiment and collect a comprehensive, well-annotated electroencephalography (EEG) dataset from 134 subjects during both wakefulness and sleep.
We develop SI-SD that enhances sleep semantic decoding through the position-wise alignment of neural latent sequence between wakefulness and sleep.
- Score: 5.283755248013948
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Understanding semantic content from brain activity during sleep represents a major goal in neuroscience. While studies in rodents have shown spontaneous neural reactivation of memories during sleep, capturing the semantic content of human sleep poses a significant challenge due to the absence of well-annotated sleep datasets and the substantial differences in neural patterns between wakefulness and sleep. To address these challenges, we designed a novel cognitive neuroscience experiment and collected a comprehensive, well-annotated electroencephalography (EEG) dataset from 134 subjects during both wakefulness and sleep. Leveraging this benchmark dataset, we developed SI-SD that enhances sleep semantic decoding through the position-wise alignment of neural latent sequence between wakefulness and sleep. In the 15-way classification task, our model achieves 24.12% and 21.39% top-1 accuracy on unseen subjects for NREM 2/3 and REM sleep, respectively, surpassing all other baselines. With additional fine-tuning, decoding performance improves to 30.32% and 31.65%, respectively. Besides, inspired by previous neuroscientific findings, we systematically analyze how the "Slow Oscillation" event impacts decoding performance in NREM 2/3 sleep -- decoding performance on unseen subjects further improves to 40.02%. Together, our findings and methodologies contribute to a promising neuro-AI framework for decoding brain activity during sleep.
Related papers
- A Systematic Review on Sleep Stage Classification and Sleep Disorder Detection Using Artificial Intelligence [0.0]
This study aims to provide a comprehensive, systematic review of the recent literature to analyze the different approaches and their outcomes in sleep studies.
In this review, 183 articles were initially selected from different journals, among which 80 records were enlisted for explicit review, ranging from 2016 to 2023.
Brain waves were the most commonly employed body parameters for sleep staging and disorder studies.
arXiv Detail & Related papers (2024-05-17T11:09:33Z) - NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEG [2.3310092106321365]
Sleep stage classification is a pivotal aspect of diagnosing sleep disorders and evaluating sleep quality.
Recent advancements in deep learning have substantially propelled the automation of sleep stage classification.
This paper introduces NeuroNet, a self-supervised learning framework designed to harness unlabeled single-channel sleep electroencephalogram (EEG) signals.
arXiv Detail & Related papers (2024-04-10T18:32:22Z) - Domain Invariant Representation Learning and Sleep Dynamics Modeling for
Automatic Sleep Staging [6.86283473936335]
We propose a neural network based sleep staging model, DREAM, to learn domain generalized representations from physiological signals and models sleep dynamics.
DREAM learns sleep related and subject invariant representations from diverse subjects' sleep signals and models sleep dynamics by capturing interactions between sequential signal segments and between sleep stages.
We conducted a comprehensive empirical study to demonstrate the superiority of DREAM, including sleep stage prediction experiments, a case study, the usage of unlabeled data, and uncertainty.
arXiv Detail & Related papers (2023-12-06T00:28:08Z) - Sleep Activity Recognition and Characterization from Multi-Source
Passively Sensed Data [67.60224656603823]
Sleep Activity Recognition methods can provide indicators to assess, monitor, and characterize subjects' sleep-wake cycles and detect behavioral changes.
We propose a general method that continuously operates on passively sensed data from smartphones to characterize sleep and identify significant sleep episodes.
Thanks to their ubiquity, these devices constitute an excellent alternative data source to profile subjects' biorhythms in a continuous, objective, and non-invasive manner.
arXiv Detail & Related papers (2023-01-17T15:18:45Z) - Heterogeneous Hidden Markov Models for Sleep Activity Recognition from
Multi-Source Passively Sensed Data [67.60224656603823]
Psychiatric patients' passive activity monitoring is crucial to detect behavioural shifts in real-time.
Sleep Activity Recognition constitutes a behavioural marker to portray patients' activity cycles.
Mobile passively sensed data captured from smartphones constitute an excellent alternative to profile patients' biorhythm.
arXiv Detail & Related papers (2022-11-08T17:29:40Z) - Continual learning benefits from multiple sleep mechanisms: NREM, REM,
and Synaptic Downscaling [51.316408685035526]
Learning new tasks and skills in succession without losing prior learning is a computational challenge for both artificial and biological neural networks.
Here, we investigate how modeling three distinct components of mammalian sleep together affects continual learning in artificial neural networks.
arXiv Detail & Related papers (2022-09-09T13:45:27Z) - Deep Learning for Sleep Stages Classification: Modified Rectified Linear
Unit Activation Function and Modified Orthogonal Weight Initialisation [27.681891555949672]
This research aims to increase the accuracy and reduce the learning time of Convolutional Neural Network.
The proposed system uses Leaky Rectified Linear Unit (ReLU) instead of sigmoid activation function as an activation function.
arXiv Detail & Related papers (2022-02-18T18:29:15Z) - Voxel-level Importance Maps for Interpretable Brain Age Estimation [70.5330922395729]
We focus on the task of brain age regression from 3D brain Magnetic Resonance (MR) images using a Convolutional Neural Network, termed prediction model.
We implement a noise model which aims to add as much noise as possible to the input without harming the performance of the prediction model.
We test our method on 13,750 3D brain MR images from the UK Biobank, and our findings are consistent with the existing neuropathology literature.
arXiv Detail & Related papers (2021-08-11T18:08:09Z) - Automatic detection of microsleep episodes with deep learning [55.41644538483948]
Brief fragments of sleep shorter than 15 s are defined as microsleep episodes (MSEs)
maintenance of wakefulness test (MWT) is often used in a clinical setting to assess vigilance.
MSEs are mostly not considered in the absence of established scoring criteria defining MSEs.
We aimed for automatic detection of MSEs with machine learning based on raw EEG and EOG data as input.
arXiv Detail & Related papers (2020-09-07T11:38:40Z) - Patch-based Brain Age Estimation from MR Images [64.66978138243083]
Brain age estimation from Magnetic Resonance Images (MRI) derives the difference between a subject's biological brain age and their chronological age.
Early detection of neurodegeneration manifesting as a higher brain age can potentially facilitate better medical care and planning for affected individuals.
We develop a new deep learning approach that uses 3D patches of the brain as well as convolutional neural networks (CNNs) to develop a localised brain age estimator.
arXiv Detail & Related papers (2020-08-29T11:50:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.