SelfEEG: A Python library for Self-Supervised Learning in
Electroencephalography
- URL: http://arxiv.org/abs/2401.05405v1
- Date: Wed, 20 Dec 2023 14:58:07 GMT
- Title: SelfEEG: A Python library for Self-Supervised Learning in
Electroencephalography
- Authors: Federico Del Pup, Andrea Zanola, Louis Fabrice Tshimanga, Paolo Emilio
Mazzon, Manfredo Atzori
- Abstract summary: SelfEEG is an open-source Python library developed to assist researchers in conducting Self-Supervised Learning (SSL) experiments on electroencephalography (EEG) data.
Its primary objective is to offer a user-friendly but highly customizable environment, enabling users to efficiently design and execute self-supervised learning tasks on EEG data.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: SelfEEG is an open-source Python library developed to assist researchers in
conducting Self-Supervised Learning (SSL) experiments on electroencephalography
(EEG) data. Its primary objective is to offer a user-friendly but highly
customizable environment, enabling users to efficiently design and execute
self-supervised learning tasks on EEG data.
SelfEEG covers all the stages of a typical SSL pipeline, ranging from data
import to model design and training. It includes modules specifically designed
to: split data at various granularity levels (e.g., session-, subject-, or
dataset-based splits); effectively manage data stored with different
configurations (e.g., file extensions, data types) during mini-batch
construction; provide a wide range of standard deep learning models, data
augmentations and SSL baseline methods applied to EEG data.
Most of the functionalities offered by selfEEG can be executed both on GPUs
and CPUs, expanding its usability beyond the self-supervised learning area.
Additionally, these functionalities can be employed for the analysis of other
biomedical signals often coupled with EEGs, such as electromyography or
electrocardiography data.
These features make selfEEG a versatile deep learning tool for biomedical
applications and a useful resource in SSL, one of the currently most active
fields of Artificial Intelligence.
Related papers
- LESS: Selecting Influential Data for Targeted Instruction Tuning [64.78894228923619]
We propose LESS, an efficient algorithm to estimate data influences and perform Low-rank gradiEnt Similarity Search for instruction data selection.
We show that training on a LESS-selected 5% of the data can often outperform training on the full dataset across diverse downstream tasks.
Our method goes beyond surface form cues to identify data that the necessary reasoning skills for the intended downstream application.
arXiv Detail & Related papers (2024-02-06T19:18:04Z) - EEGFormer: Towards Transferable and Interpretable Large-Scale EEG
Foundation Model [39.363511340878624]
We present a novel EEG foundation model, namely EEGFormer, pretrained on large-scale compound EEG data.
To validate the effectiveness of our model, we extensively evaluate it on various downstream tasks and assess the performance under different transfer settings.
arXiv Detail & Related papers (2024-01-11T17:36:24Z) - Deep learning applied to EEG data with different montages using spatial
attention [0.0]
We explore using spatial attention applied to EEG electrode coordinates to perform channel harmonization of raw EEG data.
We show that a deep learning model trained on data using different channel montages performs significantly better than deep learning models trained on fixed 23- and 128-channel data montages.
arXiv Detail & Related papers (2023-10-16T16:17:33Z) - EEG4Students: An Experimental Design for EEG Data Collection and Machine
Learning Analysis [3.8224226881450187]
This paper explores machine learning algorithms that can run efficiently on personal computers for BCI classification tasks.
We investigate how to conduct such BCI experiments using affordable consumer-grade devices to collect EEG-based BCI data.
We have developed the data collection protocol, EEG4Students, that grants non-experts who are interested in a guideline for such data collection.
arXiv Detail & Related papers (2022-08-24T19:10:11Z) - BERT WEAVER: Using WEight AVERaging to enable lifelong learning for
transformer-based models in biomedical semantic search engines [49.75878234192369]
We present WEAVER, a simple, yet efficient post-processing method that infuses old knowledge into the new model.
We show that applying WEAVER in a sequential manner results in similar word embedding distributions as doing a combined training on all data at once.
arXiv Detail & Related papers (2022-02-21T10:34:41Z) - 2021 BEETL Competition: Advancing Transfer Learning for Subject
Independence & Heterogenous EEG Data Sets [89.84774119537087]
We design two transfer learning challenges around diagnostics and Brain-Computer-Interfacing (BCI)
Task 1 is centred on medical diagnostics, addressing automatic sleep stage annotation across subjects.
Task 2 is centred on Brain-Computer Interfacing (BCI), addressing motor imagery decoding across both subjects and data sets.
arXiv Detail & Related papers (2022-02-14T12:12:20Z) - BENDR: using transformers and a contrastive self-supervised learning
task to learn from massive amounts of EEG data [15.71234837305808]
We consider how to adapt techniques and architectures used for language modelling (LM) to encephalography modelling (EM)
We find that a single pre-trained model is capable of modelling completely novel raw EEG sequences recorded with differing hardware.
Both the internal representations of this model and the entire architecture can be fine-tuned to a variety of downstream BCI and EEG classification tasks.
arXiv Detail & Related papers (2021-01-28T14:54:01Z) - PyHealth: A Python Library for Health Predictive Models [53.848478115284195]
PyHealth is an open-source Python toolbox for developing various predictive models on healthcare data.
The data preprocessing module enables the transformation of complex healthcare datasets into machine learning friendly formats.
The predictive modeling module provides more than 30 machine learning models, including established ensemble trees and deep neural network-based approaches.
arXiv Detail & Related papers (2021-01-11T22:02:08Z) - Uncovering the structure of clinical EEG signals with self-supervised
learning [64.4754948595556]
Supervised learning paradigms are often limited by the amount of labeled data that is available.
This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG)
By extracting information from unlabeled data, it might be possible to reach competitive performance with deep neural networks.
arXiv Detail & Related papers (2020-07-31T14:34:47Z) - Opportunities and Challenges of Deep Learning Methods for
Electrocardiogram Data: A Systematic Review [62.490310870300746]
The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare.
Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals.
This paper presents a systematic review of deep learning methods for ECG data from both modeling and application perspectives.
arXiv Detail & Related papers (2019-12-28T02:44:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.