Channel-Oriented Design for EEG-to-Music Reconstruction

• URL: http://arxiv.org/abs/2606.04040v1
• Date: Tue, 02 Jun 2026 04:13:37 GMT
• Title: Channel-Oriented Design for EEG-to-Music Reconstruction
• Abstract summary: We study EEG-to-music reconstruction, where signals are weak, distributed, and highly susceptible to noise and channel variability.<n>Our central finding is that early channel mixing destroys weak but discriminative EEG signals.<n>We propose a channel-oriented design with three key components.
• Score: 10.381688641790632
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Brain-computer interfaces aim to decode naturalistic stimuli from neural signals, yet most progress to date has focused on vision and language. In this article, we study a more challenging but far less explored setting, EEG-to-music reconstruction, where signals are weak, distributed, and highly susceptible to noise and channel variability. Our central finding is that early channel mixing destroys weak but discriminative EEG signals. To address this, we propose a channel-oriented design with three key components. Specifically, channel-wise tokenization treats each electrode as an explicit token to retain spatially localized neural evidence, channel-wise multi-view self-distillation enforces consistency across temporal crops and random channel subsets to learn robust and distributed representations, and channel-wise data augmentation introduces structured channel dropout to improve invariance to noise, artifacts, and missing electrodes. Together, these components preserve weak yet informative signals across channels and enable stable alignment to a semantic music representation space. We integrate this channel-oriented design within an encoding-alignment-decoding pipeline for EEG-to-music reconstruction. Theoretically, we characterize when preserving channel-level structure leads to improved alignment. Empirically, we compare with a range of state-of-the-art baselines and demonstrate consistent and significant performance gains.

Related papers

• Coordinate-Queryable Neural Field Reconstruction for EEG Spatial Super-Resolution with Unseen-Electrode Generation [11.493595405428815]
  EEG spatial super-resolution (EEGSR) in real deployments is challenged by random channel missingness, unstable electrode quality, and changing visible-channel patterns caused by bad contacts or device variability.<n>Most existing EEGSR methods learn a fixed low-to-high channel mapping under pre-defined input-output layouts.<n>We reformulate EEGSR as learning a shared conditional scalp field from partially observed support channels.
  arXiv  Detail & Related papers  (2026-06-12T03:48:57Z)
• Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments [0.0]
  Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings.<n>We investigate strict channel-free HAR, in which a single shared model performs inference without assuming a fixed number, order, or semantic arrangement of input channels.<n>We propose a channel-free HAR framework that combines channel-wise encoding with a shared encoder, metadata-conditioned late fusion, and joint optimization of channel-level and fused predictions.
  arXiv  Detail & Related papers  (2026-04-23T07:32:36Z)
• Implicit Neural Representations: A Signal Processing Perspective [54.57279006229212]
  Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations.<n>This article examines the evolution of INRs from a signal processing perspective, emphasizing spectral behavior, sampling theory, and multiscale representation.<n>We highlight the utility of INRs across a broad range of applications, including inverse problems in medical and radar imaging, compression, and 3D scene representation.
  arXiv  Detail & Related papers  (2026-04-16T14:12:06Z)
• DC-ViT: Modulating Spatial and Channel Interactions for Multi-Channel Images [9.507520646516719]
  Training and evaluation in multi-channel imaging (MCI) remains challenging due to heterogeneous channel configurations.<n>Recent Multi-Channel Vision Transformers (MC-ViTs) address this by enabling flexible channel inputs, typically by jointly encoding patch tokens from all channels within a unified attention space.<n>We propose Decoupled Vision Transformer (DC-ViT), which explicitly regulates information sharing using Decoupled Self-Attention (DSA)
  arXiv  Detail & Related papers  (2026-03-15T08:31:34Z)
• CAMEL-CLIP: Channel-aware Multimodal Electroencephalography-text Alignment for Generalizable Brain Foundation Models [5.527305245660595]
  We propose a multimodal EEG-text alignment contrastive language-image pretraining model (CAMEL-CLIP)<n>We show that CAMEL-CLIP achieves state-of-the-art performance under linear-probing and outperforms existing foundation models that rely on full-finetuning.
  arXiv  Detail & Related papers  (2026-02-27T05:05:08Z)
• Discrete-Space Generative AI Pipeline for Semantic Transmission of Signals [0.2291770711277359]
  Discernment is a semantic communication system that transmits the meaning of physical signals (baseband radio and audio) over a technical channel using GenAI models.<n>We show that Discernment maintains semantic integrity even as channel capacity severely degrades.
  arXiv  Detail & Related papers  (2026-02-14T02:11:46Z)
• CP Loss: Channel-wise Perceptual Loss for Time Series Forecasting [67.3477355449697]
  We propose a Channel-wise Perceptual Loss (CP Loss) for time-series data.<n>We learn a unique perceptual space for each channel that is adapted to its characteristics.<n>Loss is calculated within these perception spaces to optimize the model.
  arXiv  Detail & Related papers  (2026-01-25T15:31:37Z)
• EEGChaT: A Transformer-Based Modular Channel Selector for SEEG Analysis [33.75063804360241]
  We propose EEGChaT, a novel Transformer-based channel selection module for SEEG data analysis.<n>We show that EEGChaT consistently improves decoding accuracy, achieving up to 17% absolute gains.<n>Our results suggest that EEGChaT is an effective and generalizable solution for channel selection in high-dimensional SEEG analysis.
  arXiv  Detail & Related papers  (2025-10-15T14:22:07Z)
• Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising [94.09442506816724]
  Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID)<n>We build a Transformer-based Blind-Spot Network (TBSN) which shows strong local fitting and global perspective abilities.
  arXiv  Detail & Related papers  (2024-04-11T15:39:10Z)
• On Neural Architectures for Deep Learning-based Source Separation of Co-Channel OFDM Signals [104.11663769306566]
  We study the single-channel source separation problem involving frequency-division multiplexing (OFDM) signals. We propose critical domain-informed modifications to the network parameterization, based on insights from OFDM structures.
  arXiv  Detail & Related papers  (2023-03-11T16:29:13Z)
• Robust learning from corrupted EEG with dynamic spatial filtering [68.82260713085522]
  Building machine learning models using EEG recorded outside of the laboratory requires robust methods to noisy data and randomly missing channels. We propose dynamic spatial filtering (DSF), a multi-head attention module that can be plugged in before the first layer of a neural network. We tested DSF on public EEG data encompassing 4,000 recordings with simulated channel corruption and on a private dataset of 100 at-home recordings of mobile EEG with natural corruption.
  arXiv  Detail & Related papers  (2021-05-27T02:33:16Z)
• Channel Equilibrium Networks for Learning Deep Representation [63.76618960820138]
  This work shows that the combination of normalization and rectified linear function leads to inhibited channels. Unlike prior arts that simply removed the inhibited channels, we propose to "wake them up" during training by designing a novel neural building block. Channel Equilibrium (CE) block enables channels at the same layer to contribute equally to the learned representation.
  arXiv  Detail & Related papers  (2020-02-29T09:02:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.