Cross-Modal Consistency-Guided Active Learning for Affective BCI Systems

• URL: http://arxiv.org/abs/2511.15138v1
• Date: Wed, 19 Nov 2025 05:33:48 GMT
• Title: Cross-Modal Consistency-Guided Active Learning for Affective BCI Systems
• Authors: Hyo-Jeong Jang, Hye-Bin Shin, Kang Yin,
• Abstract summary: We propose an uncertainty-aware active learning framework that enhances robustness to label noise.<n>Instead of relying solely on EEG-based uncertainty estimates, the method evaluates cross-modal alignment.<n>This feedback-driven process guides the network toward reliable, informative samples and reduces the impact of noisy labels.
• Score: 1.9556470931534158
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep learning models perform best with abundant, high-quality labels, yet such conditions are rarely achievable in EEG-based emotion recognition. Electroencephalogram (EEG) signals are easily corrupted by artifacts and individual variability, while emotional labels often stem from subjective and inconsistent reports-making robust affective decoding particularly difficult. We propose an uncertainty-aware active learning framework that enhances robustness to label noise by jointly leveraging model uncertainty and cross-modal consistency. Instead of relying solely on EEG-based uncertainty estimates, the method evaluates cross-modal alignment to determine whether uncertainty originates from cognitive ambiguity or sensor noise. A representation alignment module embeds EEG and face features into a shared latent space, enforcing semantic coherence between modalities. Residual discrepancies are treated as noise-induced inconsistencies, and these samples are selectively queried for oracle feedback during active learning. This feedback-driven process guides the network toward reliable, informative samples and reduces the impact of noisy labels. Experiments on the ASCERTAIN dataset examine the efficiency and robustness of ours, highlighting its potential as a data-efficient and noise-tolerant approach for EEG-based affective decoding in brain-computer interface systems.

Related papers

• Semi-Supervised Regression with Heteroscedastic Pseudo-Labels [50.54050677867914]
  We propose an uncertainty-aware pseudo-labeling framework that dynamically adjusts pseudo-label influence from a bi-level optimization perspective.<n>We provide theoretical insights and extensive experiments to validate our approach across various benchmark SSR datasets.
  arXiv  Detail & Related papers  (2025-10-17T03:06:23Z)
• Uncertainty-Aware Cross-Modal Knowledge Distillation with Prototype Learning for Multimodal Brain-Computer Interfaces [26.585985828583304]
  multimodal knowledge distillation (KD) has been explored to transfer knowledge from visual models to EEG-based models.<n>This paper addresses semantic uncertainty caused by ambiguous features and weakly defined labels.<n>We propose a novel cross-modal knowledge distillation framework that mitigates both modality and label inconsistencies.
  arXiv  Detail & Related papers  (2025-07-17T13:03:20Z)
• Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning [3.472622494096705]
  Cross-subject variability and noisy labels hinder the performance of emotion recognition models.<n>We propose a novel bi-level self-supervised continual learning framework, SSOCL, based on a dynamic memory buffer.<n>This bi-level architecture iteratively refines the dynamic buffer and pseudo-label assignments to effectively retain representative samples.<n>Key components of the framework, including a fast adaptation module and a cluster-mapping module, enable robust learning and effective handling of evolving data streams.
  arXiv  Detail & Related papers  (2025-05-13T23:47:04Z)
• LEL: A Novel Lipschitz Continuity-constrained Ensemble Learning Model for EEG-based Emotion Recognition [6.9292405290420005]
  We introduce LEL (Lipschitz continuity-constrained Ensemble Learning), a novel framework that enhances EEG-based emotion recognition.<n> Experimental results on three public benchmark datasets demonstrated the LEL's state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-04-12T09:41:23Z)
• AEON: Adaptive Estimation of Instance-Dependent In-Distribution and Out-of-Distribution Label Noise for Robust Learning [17.397478141194778]
  Real-world datasets often contain a mix of in-distribution (ID) and out-of-distribution (OOD) instance-dependent label noise.<n>We propose the Adaptive Estimation of Instance-Dependent In-Distribution and Out-of-Distribution Label Noise (AEON) approach to address these research gaps.<n>AEON is an efficient one-stage noisy-label learning methodology that dynamically estimates instance-dependent ID and OOD label noise rates.
  arXiv  Detail & Related papers  (2025-01-23T05:19:00Z)
• Disentangled Noisy Correspondence Learning [56.06801962154915]
  Cross-modal retrieval is crucial in understanding latent correspondences across modalities. DisNCL is a novel information-theoretic framework for feature Disentanglement in Noisy Correspondence Learning.
  arXiv  Detail & Related papers  (2024-08-10T09:49:55Z)
• Sample Dominance Aware Framework via Non-Parametric Estimation for Spontaneous Brain-Computer Interface [27.077560296908423]
  Inconsistent EEG signals resulting from non-stationary characteristics can lead to poor performance. In this study, we introduce the concept of sample dominance as a measure of EEG signal inconsistency. We present a two-stage dominance score estimation technique that compensates for performance caused by sample inconsistencies.
  arXiv  Detail & Related papers  (2023-11-13T05:08:26Z)
• A Discrepancy Aware Framework for Robust Anomaly Detection [51.710249807397695]
  We present a Discrepancy Aware Framework (DAF), which demonstrates robust performance consistently with simple and cheap strategies. Our method leverages an appearance-agnostic cue to guide the decoder in identifying defects, thereby alleviating its reliance on synthetic appearance. Under the simple synthesis strategies, it outperforms existing methods by a large margin. Furthermore, it also achieves the state-of-the-art localization performance.
  arXiv  Detail & Related papers  (2023-10-11T15:21:40Z)
• Free Lunch for Domain Adversarial Training: Environment Label Smoothing [82.85757548355566]
  We propose Environment Label Smoothing (ELS) to improve training stability, local convergence, and robustness to noisy environment labels. We yield state-of-art results on a wide range of domain generalization/adaptation tasks, particularly when the environment labels are highly noisy.
  arXiv  Detail & Related papers  (2023-02-01T02:55:26Z)
• Towards Unbiased Visual Emotion Recognition via Causal Intervention [63.74095927462]
  We propose a novel Emotion Recognition Network (IERN) to alleviate the negative effects brought by the dataset bias. A series of designed tests validate the effectiveness of IERN, and experiments on three emotion benchmarks demonstrate that IERN outperforms other state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-07-26T10:40:59Z)
• Exploiting Sample Uncertainty for Domain Adaptive Person Re-Identification [137.9939571408506]
  We estimate and exploit the credibility of the assigned pseudo-label of each sample to alleviate the influence of noisy labels. Our uncertainty-guided optimization brings significant improvement and achieves the state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2020-12-16T04:09:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.