BioMamba: Leveraging Spectro-Temporal Embedding in Bidirectional Mamba for Enhanced Biosignal Classification

• URL: http://arxiv.org/abs/2503.11741v3
• Date: Tue, 25 Mar 2025 06:23:36 GMT
• Title: BioMamba: Leveraging Spectro-Temporal Embedding in Bidirectional Mamba for Enhanced Biosignal Classification
• Abstract summary: Existing methods for biosignal classification rely on Attention-based frameworks with dense Feed Forward layers.<n>By integrating these three key components, BioMamba effectively addresses the limitations of existing methods.<n>Extensive experiments demonstrate that BioMamba significantly outperforms state-of-the-art methods with marked improvement in classification performance.
• Score: 1.9414307529560617
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Biological signals, such as electroencephalograms (EEGs) and electrocardiograms (ECGs), play a pivotal role in numerous clinical practices, such as diagnosing brain and cardiac arrhythmic diseases. Existing methods for biosignal classification rely on Attention-based frameworks with dense Feed Forward layers, which lead to inefficient learning, high computational overhead, and suboptimal performance. In this work, we introduce BioMamba, a Spectro-Temporal Embedding strategy applied to the Bidirectional Mamba framework with Sparse Feed Forward layers to enable effective learning of biosignal sequences. By integrating these three key components, BioMamba effectively addresses the limitations of existing methods. Extensive experiments demonstrate that BioMamba significantly outperforms state-of-the-art methods with marked improvement in classification performance. The advantages of the proposed BioMamba include (1) Reliability: BioMamba consistently delivers robust results, confirmed across six evaluation metrics. (2) Efficiency: We assess both model and training efficiency, the BioMamba demonstrates computational effectiveness by reducing model size and resource consumption compared to existing approaches. (3) Generality: With the capacity to effectively classify a diverse set of tasks, BioMamba demonstrates adaptability and effectiveness across various domains and applications.

Related papers

• MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models [83.50100003741628]
  Vision and language models (VLMs) hold immense promise to transform biomedical imaging.<n>We introduce the Massive Multimodal Biomedical Understanding (MMBU) benchmark.<n>It is the largest vision and language benchmark to date, covering 35 submodalities with rich structured metadata.
  arXiv  Detail & Related papers  (2026-06-04T20:24:47Z)
• CellMamba: Adaptive Mamba for Accurate and Efficient Cell Detection [28.36875955910259]
  CellMamba is a lightweight and accurate one-stage detector tailored for fine-grained biomedical instance detection.<n>Built upon a VSSD backbone, CellMamba integrates CellMamba Blocks, which couple NC-Mamba or Multi-Head Self-Attention (MSA) with a novel Triple-Mapping Adaptive Coupling (TMAC) module.<n>Extensive experiments on two public datasets-CoNSeP and CytoDArk0-demonstrate that CellMamba outperforms both CNN-based, Transformer-based, and Mamba-based baselines in accuracy, while significantly reducing model size and inference latency.
  arXiv  Detail & Related papers  (2025-12-25T23:05:11Z)
• BarcodeMamba+: Advancing State-Space Models for Fungal Biodiversity Research [19.401485543915452]
  We introduce a foundation model for fungal barcode classification built on a powerful and efficient state-space model architecture.<n>We demonstrate this is substantially more effective than traditional fully-supervised methods in this data-sparse environment.<n>Our work provides a powerful new tool for genomics-based biodiversity research.
  arXiv  Detail & Related papers  (2025-12-17T19:56:03Z)
• State Space Models for Bioacoustics: A comparative Evaluation with Transformers [0.0]
  We first pretrain a Mamba-based audio large language model (LLM) on a large corpus of audio data using self-supervised learning.<n>We fine-tune and evaluate BioMamba on the BEANS benchmark, a collection of diverse bioacoustic tasks including classification and detection.<n>The results show that BioMamba achieves comparable performance with AVES while consumption significantly less VRAM.
  arXiv  Detail & Related papers  (2025-12-03T08:37:09Z)
• MambaMoE: Mixture-of-Spectral-Spatial-Experts State Space Model for Hyperspectral Image Classification [46.67137351665963]
  Mamba-based models have recently demonstrated significant potential in hyperspectral image (HSI) classification.<n>We propose MambaMoE, a novel spectral-spatial Mixture-of-Experts (MoE) framework, which represents the first MoE-based approach in the HSI classification domain.<n>MambaMoE achieves state-of-the-art performance in both classification accuracy and computational efficiency compared to existing advanced methods.
  arXiv  Detail & Related papers  (2025-04-29T07:50:36Z)
• Mamba-Based Ensemble learning for White Blood Cell Classification [6.09628686715121]
  White blood cell (WBC) classification assists in assessing immune health and diagnosing various diseases. Recent advancements in deep learning have shown promise over traditional methods. This paper introduces a novel framework that leverages Mamba models integrated with ensemble learning to improve WBC classification.
  arXiv  Detail & Related papers  (2025-04-15T17:53:18Z)
• Revolutionizing Biomarker Discovery: Leveraging Generative AI for Bio-Knowledge-Embedded Continuous Space Exploration [20.419747013569268]
  We propose a new biomarker identification framework with two important modules: training data preparation and embedding-optimization-generation. The first module uses a multi-agent system to automatically collect pairs of biomarker subsets and their corresponding prediction accuracy as training data. The second module employs an encoder-evaluator-decoder learning paradigm to compress the knowledge of the collected data into a continuous space.
  arXiv  Detail & Related papers  (2024-09-23T23:36:30Z)
• ReMamba: Equip Mamba with Effective Long-Sequence Modeling [50.530839868893786]
  We propose ReMamba, which enhances Mamba's ability to comprehend long contexts.<n>ReMamba incorporates selective compression and adaptation techniques within a two-stage re-forward process.
  arXiv  Detail & Related papers  (2024-08-28T02:47:27Z)
• BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba [11.012644129839922]
  We present BioMamba, a pre-trained model specifically designed for biomedical text mining. Our empirical studies demonstrate that BioMamba significantly outperforms models like BioBERT and general-domain Mamba across various biomedical tasks. For instance, BioMamba achieves a 100 times reduction in perplexity and a 4 times reduction in cross-entropy loss on the BioASQ test set.
  arXiv  Detail & Related papers  (2024-08-05T16:21:36Z)
• ECGMamba: Towards Efficient ECG Classification with BiSSM [3.0120310355085467]
  We propose a novel model, ECGMamba, which employs a bidirectional state-space model (BiSSM) to enhance classification efficiency. The experimental results on two publicly available ECG datasets demonstrate that ECGMamba effectively balances the effectiveness and efficiency of classification.
  arXiv  Detail & Related papers  (2024-06-14T14:55:53Z)
• CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale [21.995678534789615]
  We use contrastive learning to align images, barcode DNA, and text-based representations of taxonomic labels in a unified embedding space. Our method surpasses previous single-modality approaches in accuracy by over 8% on zero-shot learning tasks.
  arXiv  Detail & Related papers  (2024-05-27T17:57:48Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• Improving Biomedical Entity Linking with Retrieval-enhanced Learning [53.24726622142558]
  $k$NN-BioEL provides a BioEL model with the ability to reference similar instances from the entire training corpus as clues for prediction. We show that $k$NN-BioEL outperforms state-of-the-art baselines on several datasets.
  arXiv  Detail & Related papers  (2023-12-15T14:04:23Z)
• Stacking Ensemble Learning in Deep Domain Adaptation for Ophthalmic Image Classification [61.656149405657246]
  Domain adaptation is effective in image classification tasks where obtaining sufficient label data is challenging. We propose a novel method, named SELDA, for stacking ensemble learning via extending three domain adaptation methods. The experimental results using Age-Related Eye Disease Study (AREDS) benchmark ophthalmic dataset demonstrate the effectiveness of the proposed model.
  arXiv  Detail & Related papers  (2022-09-27T14:19:00Z)
• Discriminative Singular Spectrum Classifier with Applications on Bioacoustic Signal Recognition [67.4171845020675]
  We present a bioacoustic signal classifier equipped with a discriminative mechanism to extract useful features for analysis and classification efficiently. Unlike current bioacoustic recognition methods, which are task-oriented, the proposed model relies on transforming the input signals into vector subspaces. The validity of the proposed method is verified using three challenging bioacoustic datasets containing anuran, bee, and mosquito species.
  arXiv  Detail & Related papers  (2021-03-18T11:01:21Z)
• Learning Binary Semantic Embedding for Histology Image Classification and Retrieval [56.34863511025423]
  We propose a novel method for Learning Binary Semantic Embedding (LBSE) Based on the efficient and effective embedding, classification and retrieval are performed to provide interpretable computer-assisted diagnosis for histology images. Experiments conducted on three benchmark datasets validate the superiority of LBSE under various scenarios.
  arXiv  Detail & Related papers  (2020-10-07T08:36:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.