LAtte: Hyperbolic Lorentz Attention for Cross-Subject EEG Classification
- URL: http://arxiv.org/abs/2603.10881v1
- Date: Wed, 11 Mar 2026 15:27:39 GMT
- Title: LAtte: Hyperbolic Lorentz Attention for Cross-Subject EEG Classification
- Abstract summary: LAtte is a novel framework that integrates a Lorentz Attention Module with an InceptionTime-based encoder to enable robust and generalizable EEG classification.<n>First, we learn a shared baseline signal across all subjects using pretraining tasks to capture common underlying patterns.<n>Then, we utilize novel Lorentz low-rank adapters to learn subject-specific embeddings that model individual differences.<n>This allows us to learn a shared model that performs robustly across subjects, and can be subsequently finetuned for individual subjects or used to generalize to unseen subjects.
- Score: 13.887781479252332
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Electroencephalogram (EEG) classification is critical for applications ranging from medical diagnostics to brain-computer interfaces, yet it remains challenging due to the inherently low signal-to-noise ratio (SNR) and high inter-subject variability. To address these issues, we propose LAtte, a novel framework that integrates a Lorentz Attention Module with an InceptionTime-based encoder to enable robust and generalizable EEG classification. Unlike prior work, which evaluates primarily on single-subject performance, LAtte focuses on cross-subject training. First, we learn a shared baseline signal across all subjects using pretraining tasks to capture common underlying patterns. Then, we utilize novel Lorentz low-rank adapters to learn subject-specific embeddings that model individual differences. This allows us to learn a shared model that performs robustly across subjects, and can be subsequently finetuned for individual subjects or used to generalize to unseen subjects. We evaluate LAtte on three well-established EEG datasets, achieving a substantial improvement in performance over current state-of-the-art methods.
Related papers
- ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding [47.35612571473169]
EEG visual decoding aims to recover visual semantics from non-invasive neural time-series signals.<n>Existing methods rely on fixed visual or textual anchors whose semantic relations may become misaligned with EEG representations that vary across trials, subjects, and learning stages.<n>We propose Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment.
arXiv Detail & Related papers (2026-09-04T12:48:25Z) - Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decoding [0.34797121357690153]
We propose a framework that structurally decouples subject-invariant knowledge from subject-specific neural signatures.<n> Experiments on BCI Competition IV-2a, PhysioNet Motor Imagery, and the clinical Zuo2025 benchmark show that Stacked LoRA effectively mitigates inter-subject variability.
arXiv Detail & Related papers (2026-07-03T08:31:57Z) - EEG-D3: A Solution to the Hidden Overfitting Problem of Deep Learning Models [33.22173262655432]
We introduce Disentangled Decoding Decomposition (D3), a weakly supervised method for training deep learning models across EEG datasets.<n>By predicting the place in the respective trial sequence from which the input window was sampled, EEG-D3 separates latent components of brain activity.<n>We exploit the linearly separable latent space for effective few-shot learning on sleep stage classification.
arXiv Detail & Related papers (2025-12-15T19:00:10Z) - MultiDiffNet: A Multi-Objective Diffusion Framework for Generalizable Brain Decoding [1.6528632644902828]
We introduce textitMultiDiffNet, a diffusion-based framework that bypasses generative augmentation entirely by learning a compact latent space optimized for multiple objectives.<n>We decode directly from this space and achieve state-of-the-art generalization across various neural decoding tasks using subject and session disjoint evaluation.
arXiv Detail & Related papers (2025-11-23T05:22:27Z) - FACE: Few-shot Adapter with Cross-view Fusion for Cross-subject EEG Emotion Recognition [57.08108545219043]
Cross-subject EEG emotion recognition is challenged by significant inter-subject variability and intricately entangled intra-subject variability.<n>Recent few-shot learning paradigms attempt to address these limitations but often encounter catastrophic overfitting during subject-specific adaptation with limited samples.<n>This article introduces the few-shot adapter with a cross-view fusion method called FACE for cross-subject EEG emotion recognition.
arXiv Detail & Related papers (2025-03-24T03:16:52Z) - CEReBrO: Compact Encoder for Representations of Brain Oscillations Using Efficient Alternating Attention [46.47343031985037]
We introduce a Compact for Representations of Brain Oscillations using alternating attention (CEReBrO)<n>Our tokenization scheme represents EEG signals at a per-channel patch.<n>We propose an alternating attention mechanism that jointly models intra-channel temporal dynamics and inter-channel spatial correlations, achieving 2x speed improvement with 6x less memory required compared to standard self-attention.
arXiv Detail & Related papers (2025-01-18T21:44:38Z) - Disentangled Counterfactual Learning for Physical Audiovisual
Commonsense Reasoning [48.559572337178686]
We propose a Disentangled Counterfactual Learning approach for physical audiovisual commonsense reasoning.
Our proposed method is a plug-and-play module that can be incorporated into any baseline.
arXiv Detail & Related papers (2023-10-30T14:16:34Z) - Learnable Weight Initialization for Volumetric Medical Image Segmentation [66.3030435676252]
We propose a learnable weight-based hybrid medical image segmentation approach.
Our approach is easy to integrate into any hybrid model and requires no external training data.
Experiments on multi-organ and lung cancer segmentation tasks demonstrate the effectiveness of our approach.
arXiv Detail & Related papers (2023-06-15T17:55:05Z) - The Overlooked Classifier in Human-Object Interaction Recognition [82.20671129356037]
We encode the semantic correlation among classes into the classification head by initializing the weights with language embeddings of HOIs.
We propose a new loss named LSE-Sign to enhance multi-label learning on a long-tailed dataset.
Our simple yet effective method enables detection-free HOI classification, outperforming the state-of-the-arts that require object detection and human pose by a clear margin.
arXiv Detail & Related papers (2022-03-10T23:35:00Z) - 2021 BEETL Competition: Advancing Transfer Learning for Subject
Independence & Heterogenous EEG Data Sets [89.84774119537087]
We design two transfer learning challenges around diagnostics and Brain-Computer-Interfacing (BCI)
Task 1 is centred on medical diagnostics, addressing automatic sleep stage annotation across subjects.
Task 2 is centred on Brain-Computer Interfacing (BCI), addressing motor imagery decoding across both subjects and data sets.
arXiv Detail & Related papers (2022-02-14T12:12:20Z) - Inter-subject Contrastive Learning for Subject Adaptive EEG-based Visual
Recognition [20.866855009168606]
This paper tackles the problem of subject adaptive EEG-based visual recognition.
Its goal is to accurately predict the categories of visual stimuli based on EEG signals with only a handful of samples for the target subject during training.
We introduce a novel method that allows for learning subject-independent representation by increasing the similarity of features sharing the same class but coming from different subjects.
arXiv Detail & Related papers (2022-02-07T01:34:57Z) - Subject Adaptive EEG-based Visual Recognition [14.466626957417864]
This paper focuses on EEG-based visual recognition, aiming to predict the visual object class observed by a subject based on his/her EEG signals.
One of the main challenges is the large variation between signals from different subjects.
We introduce a novel problem setting, namely subject adaptive EEG-based visual recognition.
arXiv Detail & Related papers (2021-10-26T08:06:55Z) - Few-Shot Relation Learning with Attention for EEG-based Motor Imagery
Classification [11.873435088539459]
Brain-Computer Interfaces (BCI) based on Electroencephalography (EEG) signals have received a lot of attention.
Motor imagery (MI) data can be used to aid rehabilitation as well as in autonomous driving scenarios.
classification of MI signals is vital for EEG-based BCI systems.
arXiv Detail & Related papers (2020-03-03T02:34:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.