Feature matching as improved transfer learning technique for wearable
EEG
- URL: http://arxiv.org/abs/2201.00644v1
- Date: Wed, 29 Dec 2021 12:07:42 GMT
- Title: Feature matching as improved transfer learning technique for wearable
EEG
- Authors: Elisabeth R. M. Heremans, Huy Phan, Amir H. Ansari, Pascal Borz\'ee,
Bertien Buyse, Dries Testelmans, Maarten De Vos
- Abstract summary: We propose a new transfer learning strategy as an alternative to the commonly used finetuning approach.
This method consists of training a model with larger amounts of data from the source modality and few paired samples of source and target modality.
We compare feature matching to finetuning for three different target domains, with two different neural network architectures, and with varying amounts of training data.
- Score: 9.508350808051908
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Objective: With the rapid rise of wearable sleep monitoring devices with
non-conventional electrode configurations, there is a need for automated
algorithms that can perform sleep staging on configurations with small amounts
of labeled data. Transfer learning has the ability to adapt neural network
weights from a source modality (e.g. standard electrode configuration) to a new
target modality (e.g. non-conventional electrode configuration). Methods: We
propose feature matching, a new transfer learning strategy as an alternative to
the commonly used finetuning approach. This method consists of training a model
with larger amounts of data from the source modality and few paired samples of
source and target modality. For those paired samples, the model extracts
features of the target modality, matching these to the features from the
corresponding samples of the source modality. Results: We compare feature
matching to finetuning for three different target domains, with two different
neural network architectures, and with varying amounts of training data.
Particularly on small cohorts (i.e. 2 - 5 labeled recordings in the
non-conventional recording setting), feature matching systematically
outperforms finetuning with mean relative differences in accuracy ranging from
0.4% to 4.7% for the different scenarios and datasets. Conclusion: Our findings
suggest that feature matching outperforms finetuning as a transfer learning
approach, especially in very low data regimes. Significance: As such, we
conclude that feature matching is a promising new method for wearable sleep
staging with novel devices.
Related papers
- Automatic Classification of Sleep Stages from EEG Signals Using Riemannian Metrics and Transformer Networks [6.404789669795639]
In sleep medicine, assessing the evolution of a subject's sleep often involves the costly manual scoring of electroencephalographic (EEG) signals.
We present a novel way of integrating learned signal-wise features into said matrices without sacrificing their Symmetric Definite Positive (SPD) nature.
arXiv Detail & Related papers (2024-10-18T06:49:52Z) - On Machine Learning Approaches for Protein-Ligand Binding Affinity Prediction [2.874893537471256]
This study evaluates the performance of classical tree-based models and advanced neural networks in protein-ligand binding affinity prediction.
We show that combining 2D and 3D model strengths improves active learning outcomes beyond current state-of-the-art approaches.
arXiv Detail & Related papers (2024-07-15T13:06:00Z) - DiTMoS: Delving into Diverse Tiny-Model Selection on Microcontrollers [34.282971510732736]
We introduce DiTMoS, a novel DNN training and inference framework with a selector-classifiers architecture.
A composition of weak models can exhibit high diversity and the union of them can significantly boost the accuracy upper bound.
We deploy DiTMoS on the Neucleo STM32F767ZI board and evaluate it based on three time-series datasets for human activity recognition, keywords spotting, and emotion recognition.
arXiv Detail & Related papers (2024-03-14T02:11:38Z) - SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced
Classification of Sleep Stages [4.649202082648198]
This paper develops a generative adversarial network (GAN)-powered ensemble deep learning model, named SleepEGAN, for the imbalanced classification of sleep stages.
We show that the proposed method can improve classification accuracy compared to several existing state-of-the-art methods using three public sleep datasets.
arXiv Detail & Related papers (2023-07-04T01:56:00Z) - Neural Priming for Sample-Efficient Adaptation [92.14357804106787]
We propose Neural Priming, a technique for adapting large pretrained models to distribution shifts and downstream tasks.
Neural Priming can be performed at test time, even for pretraining as large as LAION-2B.
arXiv Detail & Related papers (2023-06-16T21:53:16Z) - Convolutional Monge Mapping Normalization for learning on sleep data [63.22081662149488]
We propose a new method called Convolutional Monge Mapping Normalization (CMMN)
CMMN consists in filtering the signals in order to adapt their power spectrum density (PSD) to a Wasserstein barycenter estimated on training data.
Numerical experiments on sleep EEG data show that CMMN leads to significant and consistent performance gains independent from the neural network architecture.
arXiv Detail & Related papers (2023-05-30T08:24:01Z) - Functional Neural Networks: Shift invariant models for functional data
with applications to EEG classification [0.0]
We introduce a new class of neural networks that are shift invariant and preserve smoothness of the data: functional neural networks (FNNs)
For this, we use methods from functional data analysis (FDA) to extend multi-layer perceptrons and convolutional neural networks to functional data.
We show that the models outperform a benchmark model from FDA in terms of accuracy and successfully use FNNs to classify electroencephalography (EEG) data.
arXiv Detail & Related papers (2023-01-14T09:41:21Z) - ScoreMix: A Scalable Augmentation Strategy for Training GANs with
Limited Data [93.06336507035486]
Generative Adversarial Networks (GANs) typically suffer from overfitting when limited training data is available.
We present ScoreMix, a novel and scalable data augmentation approach for various image synthesis tasks.
arXiv Detail & Related papers (2022-10-27T02:55:15Z) - Learning to Learn with Generative Models of Neural Network Checkpoints [71.06722933442956]
We construct a dataset of neural network checkpoints and train a generative model on the parameters.
We find that our approach successfully generates parameters for a wide range of loss prompts.
We apply our method to different neural network architectures and tasks in supervised and reinforcement learning.
arXiv Detail & Related papers (2022-09-26T17:59:58Z) - Decision Forest Based EMG Signal Classification with Low Volume Dataset
Augmented with Random Variance Gaussian Noise [51.76329821186873]
We produce a model that can classify six different hand gestures with a limited number of samples that generalizes well to a wider audience.
We appeal to a set of more elementary methods such as the use of random bounds on a signal, but desire to show the power these methods can carry in an online setting.
arXiv Detail & Related papers (2022-06-29T23:22:18Z) - Towards Open-World Feature Extrapolation: An Inductive Graph Learning
Approach [80.8446673089281]
We propose a new learning paradigm with graph representation and learning.
Our framework contains two modules: 1) a backbone network (e.g., feedforward neural nets) as a lower model takes features as input and outputs predicted labels; 2) a graph neural network as an upper model learns to extrapolate embeddings for new features via message passing over a feature-data graph built from observed data.
arXiv Detail & Related papers (2021-10-09T09:02:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.