Tiny-BioMoE: a Lightweight Embedding Model for Biosignal Analysis

• URL: http://arxiv.org/abs/2507.21875v4
• Date: Tue, 05 Aug 2025 09:30:22 GMT
• Title: Tiny-BioMoE: a Lightweight Embedding Model for Biosignal Analysis
• Authors: Stefanos Gkikas, Ioannis Kyprakis, Manolis Tsiknakis,
• Abstract summary: This study has been submitted to the textitSecond Multimodal Sensing Grand Challenge for Next-Gen Pain Assessment (AI4PAIN).<n>The proposed approach introduces textitTiny-BioMoE, a lightweight pretrained embedding model for biosignal analysis.
• Score: 0.8602553195689511
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pain is a complex and pervasive condition that affects a significant portion of the population. Accurate and consistent assessment is essential for individuals suffering from pain, as well as for developing effective management strategies in a healthcare system. Automatic pain assessment systems enable continuous monitoring, support clinical decision-making, and help minimize patient distress while mitigating the risk of functional deterioration. Leveraging physiological signals offers objective and precise insights into a person's state, and their integration in a multimodal framework can further enhance system performance. This study has been submitted to the \textit{Second Multimodal Sensing Grand Challenge for Next-Gen Pain Assessment (AI4PAIN)}. The proposed approach introduces \textit{Tiny-BioMoE}, a lightweight pretrained embedding model for biosignal analysis. Trained on $4.4$ million biosignal image representations and consisting of only $7.3$ million parameters, it serves as an effective tool for extracting high-quality embeddings for downstream tasks. Extensive experiments involving electrodermal activity, blood volume pulse, respiratory signals, peripheral oxygen saturation, and their combinations highlight the model's effectiveness across diverse modalities in automatic pain recognition tasks. \textit{\textcolor{blue}{The model's architecture (code) and weights are available at https://github.com/GkikasStefanos/Tiny-BioMoE.

Related papers

• Efficient Pain Recognition via Respiration Signals: A Single Cross-Attention Transformer Multi-Window Fusion Pipeline [0.8602553195689511]
  This study has been submitted to the textitSecond Multimodal Sensing Grand Challenge for Next-Gen Pain Assessment (AI4PAIN).
  arXiv  Detail & Related papers  (2025-07-29T14:58:29Z)
• Multi-Representation Diagrams for Pain Recognition: Integrating Various Electrodermal Activity Signals into a Single Image [0.8602553195689511]
  This study has been submitted to the textitSecond Multimodal Sensing Grand Challenge for Next-Gen Pain Assessment (AI4PAIN).
  arXiv  Detail & Related papers  (2025-07-29T14:53:28Z)
• PainFormer: a Vision Foundation Model for Automatic Pain Assessment [2.8028723950211476]
  Pain is a manifold condition that impacts a significant percentage of the population.<n>This study introduces PainFormer, a vision foundation model based on multi-task learning principles.<n>PainFormer effectively extracts high-quality embeddings from diverse input modalities.
  arXiv  Detail & Related papers  (2025-05-02T20:29:27Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [53.2981100111204]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring.<n>Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors.<n>In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type.<n>Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Thermodynamics-informed graph neural networks for real-time simulation of digital human twins [2.6811507121199325]
  This paper presents a novel methodology aimed at advancing current lines of research in soft tissue simulation.<n>The proposed approach integrates the geometric bias of graph neural networks with the physical bias derived from the imposition of a metriplectic structure.<n>Based on the adopted methodologies, we propose a model that predicts human liver responses to traction and compression loads in as little as 7.3 milliseconds.
  arXiv  Detail & Related papers  (2024-12-16T18:01:40Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• Improving Biomedical Entity Linking with Retrieval-enhanced Learning [53.24726622142558]
  $k$NN-BioEL provides a BioEL model with the ability to reference similar instances from the entire training corpus as clues for prediction. We show that $k$NN-BioEL outperforms state-of-the-art baselines on several datasets.
  arXiv  Detail & Related papers  (2023-12-15T14:04:23Z)
• BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks [68.39821375903591]
  Generalist AI holds the potential to address limitations due to its versatility in interpreting different data types. Here, we propose BiomedGPT, the first open-source and lightweight vision-language foundation model.
  arXiv  Detail & Related papers  (2023-05-26T17:14:43Z)
• A marker-less human motion analysis system for motion-based biomarker discovery in knee disorders [60.99112047564336]
  The NHS has been having increased difficulty seeing all low-risk patients, this includes but not limited to suspected osteoarthritis (OA) patients. We propose a novel method of automated biomarker identification for diagnosis of knee disorders and the monitoring of treatment progression.
  arXiv  Detail & Related papers  (2023-04-26T16:47:42Z)
• Sensitivity analysis of biological washout and depth selection for a machine learning based dose verification framework in proton therapy [19.718172235291647]
  Dose verification based on proton-induced positron emitters is a promising quality assurance tool. To move a step closer towards practical application, the sensitivity analysis of two factors needs to be performed: biological washout and depth selection. Our proposed AI framework shows good immunity to the perturbation associated with two factors.
  arXiv  Detail & Related papers  (2022-12-21T20:43:35Z)
• PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation [54.839600943189915]
  Mobile Health (mHealth) is the ability to use wearable sensors to monitor participant physiology at high frequencies during daily life to enable temporally-precise health interventions. Despite a rich imputation literature, existing techniques are ineffective for the pulsative signals which comprise many mHealth applications. We address this gap with PulseImpute, the first large-scale pulsative signal imputation challenge which includes realistic mHealth missingness models, an extensive set of baselines, and clinically-relevant downstream tasks.
  arXiv  Detail & Related papers  (2022-12-14T21:39:15Z)
• A kinetic approach to consensus-based segmentation of biomedical images [39.58317527488534]
  We apply a kinetic version of a bounded confidence consensus model to biomedical segmentation problems. The large time behavior of the system is then computed with the aid of a surrogate Fokker-Planck approach. We minimize the introduced segmentation metric for a relevant set of 2D gray-scale images.
  arXiv  Detail & Related papers  (2022-11-08T09:54:34Z)
• Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based Sparse PCA Network [93.22587316229954]
  We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E) We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
  arXiv  Detail & Related papers  (2021-10-27T19:28:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.