A Lightweight Transformer for Pain Recognition from Brain Activity

• URL: http://arxiv.org/abs/2604.16491v1
• Date: Mon, 13 Apr 2026 13:25:19 GMT
• Title: A Lightweight Transformer for Pain Recognition from Brain Activity
• Abstract summary: This paper presents a lightweight transformer architecture that fuses multiple fNIRS representations through a unified tokenization mechanism.<n>The proposed token-mixing strategy preserves spatial, temporal, and time-frequency characteristics by projecting heterogeneous inputs onto a shared latent representation.<n>The model is evaluated on the AI4Pain dataset using stacked raw waveform and power spectral density representations of fNIRS inputs.
• Score: 11.72500739025842
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pain is a multifaceted and widespread phenomenon with substantial clinical and societal burden, making reliable automated assessment a critical objective. This paper presents a lightweight transformer architecture that fuses multiple fNIRS representations through a unified tokenization mechanism, enabling joint modeling of complementary signal views without requiring modality-specific adaptations or increasing architectural complexity. The proposed token-mixing strategy preserves spatial, temporal, and time-frequency characteristics by projecting heterogeneous inputs onto a shared latent representation, using a structured segmentation scheme to control the granularity of local aggregation and global interaction. The model is evaluated on the AI4Pain dataset using stacked raw waveform and power spectral density representations of fNIRS inputs. Experimental results demonstrate competitive pain recognition performance while remaining computationally compact, making the approach suitable for real-time inference on both GPU and CPU hardware.

Related papers

• EEGForceFusion: Joint Tokenised-Continuous Representation Learning for Subject-Independent Grasp Force Decoding [7.727905404396572]
  We propose a hybrid EEG decoding framework that jointly models continuous and tokenised representations.<n>The proposed approach integrates convolutional-recurrent representation learning, quantisation-based tokenisation, and transformer-based temporal modelling.<n>Results demonstrate strong cross-subject generalisation and highlight the practicality of hybrid continuous-tokenised representations for real-time EEG-based force decoding.
  arXiv  Detail & Related papers  (2026-07-27T08:08:08Z)
• A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalities [37.393441596436666]
  This study introduces a unified tokenization framework for heterogeneous 3D modalities in pain recognition.<n>The framework preserves spatial, temporal, and time-frequency structure while mapping diverse inputs into a shared token space.<n>On the AI4Pain benchmark dataset, the proposed framework achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-07-22T03:35:12Z)
• PaAno+: Multiscale Encoding and Cross-Variable Attention for Time Series Anomaly Detection [6.394123470044826]
  Time-series anomaly detection has significant practical value for industrial and medical monitoring, as well as other critical domains.<n>This study develops a lightweight, efficient anomaly detection model, dubbed PaAno, within the patch-oriented representation learning paradigm.
  arXiv  Detail & Related papers  (2026-06-18T10:27:59Z)
• Real-Time Glottis Detection Framework via Spatial-decoupled Feature Learning for Nasal Transnasal Intubation [13.846515413602722]
  We propose Mobile GlottisNet, a lightweight and efficient glottis detection framework for embedded and edge devices.<n>The model incorporates structural awareness and spatial alignment mechanisms, enabling robust glottis localization under complex anatomical and visual conditions.<n> Experimental results demonstrate that the model, with a size of only 5MB on both our PID dataset and Clinical datasets, achieves inference speeds of over 62 FPS on devices and 33 FPS on edge platforms.
  arXiv  Detail & Related papers  (2026-03-08T13:36:18Z)
• FAIM: Frequency-Aware Interactive Mamba for Time Series Classification [87.84511960413715]
  Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition.<n>We propose FAIM, a lightweight Frequency-Aware Interactive Mamba model.<n>We show that FAIM consistently outperforms existing state-of-the-art (SOTA) methods, achieving a superior trade-off between accuracy and efficiency.
  arXiv  Detail & Related papers  (2025-11-26T08:36:33Z)
• Knowledge-Informed Neural Network for Complex-Valued SAR Image Recognition [51.03674130115878]
  We introduce the Knowledge-Informed Neural Network (KINN), a lightweight framework built upon a novel "compression-aggregation-compression" architecture.<n>KINN establishes a state-of-the-art in parameter-efficient recognition, offering exceptional generalization in data-scarce and out-of-distribution scenarios.
  arXiv  Detail & Related papers  (2025-10-23T07:12:26Z)
• UniSTFormer: Unified Spatio-Temporal Lightweight Transformer for Efficient Skeleton-Based Action Recognition [10.696548579611381]
  We propose a unified-temporal lightweight transformer framework that integrates spatial and temporal modeling within single module.<n>This approach reduces redundant computations while preserving temporal awareness within the spatial modeling process.<n>Our lightweight model achieves a superior balance between accuracy and efficiency reducing parameter complexity by over 58% and lowering computational cost by over 60%.
  arXiv  Detail & Related papers  (2025-08-12T13:56:39Z)
• CRIA: A Cross-View Interaction and Instance-Adapted Pre-training Framework for Generalizable EEG Representations [52.251569042852815]
  CRIA is an adaptive framework that utilizes variable-length and variable-channel coding to achieve a unified representation of EEG data across different datasets.<n>The model employs a cross-attention mechanism to fuse temporal, spectral, and spatial features effectively.<n> Experimental results on the Temple University EEG corpus and the CHB-MIT dataset show that CRIA outperforms existing methods with the same pre-training conditions.
  arXiv  Detail & Related papers  (2025-06-19T06:31:08Z)
• High-Fidelity Scientific Simulation Surrogates via Adaptive Implicit Neural Representations [51.90920900332569]
  Implicit neural representations (INRs) offer a compact and continuous framework for modeling spatially structured data.<n>Recent approaches address this by introducing additional features along rigid geometric structures.<n>We propose a simple yet effective alternative: Feature-Adaptive INR (FA-INR)
  arXiv  Detail & Related papers  (2025-06-07T16:45:17Z)
• Multi-Granularity Vision Fastformer with Fusion Mechanism for Skin Lesion Segmentation [7.944123371140182]
  This research aims to optimize the balance between computational costs and long-range dependency modelling.<n>We propose a lightweight U-shape network that utilizes Vision Fastformer with Fusion Mechanism (VFFM-UNet)
  arXiv  Detail & Related papers  (2025-04-04T01:27:43Z)
• ESTformer: Transformer utilising spatiotemporal dependencies for electroencephalogram super-resolution [17.375026288273794]
  We develop an EEG framework that uses acquisition dependencies based on a transformer.<n>The Transformer for EEG SR tasks demonstrates the versatility of the Transformer for EEG SR tasks.<n>The superiority of the SR data was verified in an EEG-based person identification and emotion recognition task.
  arXiv  Detail & Related papers  (2023-12-03T12:26:32Z)
• Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentation [48.267001230607306]
  We propose a pretraining framework that enhances multiscale consistency in EM volumes. Our approach leverages a Siamese network architecture, integrating strong and weak data augmentations. It effectively captures voxel and feature consistency, showing promise for learning transferable representations for EM analysis.
  arXiv  Detail & Related papers  (2023-08-19T05:49:13Z)
• Transformer-based Context Condensation for Boosting Feature Pyramids in Object Detection [77.50110439560152]
  Current object detectors typically have a feature pyramid (FP) module for multi-level feature fusion (MFF) We propose a novel and efficient context modeling mechanism that can help existing FPs deliver better MFF results. In particular, we introduce a novel insight that comprehensive contexts can be decomposed and condensed into two types of representations for higher efficiency.
  arXiv  Detail & Related papers  (2022-07-14T01:45:03Z)
• CSformer: Bridging Convolution and Transformer for Compressive Sensing [65.22377493627687]
  This paper proposes a hybrid framework that integrates the advantages of leveraging detailed spatial information from CNN and the global context provided by transformer for enhanced representation learning. The proposed approach is an end-to-end compressive image sensing method, composed of adaptive sampling and recovery. The experimental results demonstrate the effectiveness of the dedicated transformer-based architecture for compressive sensing.
  arXiv  Detail & Related papers  (2021-12-31T04:37:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.