BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition
- URL: http://arxiv.org/abs/2608.06023v1
- Date: Thu, 06 Aug 2026 13:30:13 GMT
- Title: BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition
- Abstract summary: This paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD.<n>By adaptively regulating the strength of knowledge transfer, the framework suppresses negative transfer induced by unreliable physiological supervision.<n>Experiments on DEAP and AMIGOS show that BioKD consistently outperforms representative baselines.
- Score: 6.1225603994944775
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD. The proposed framework leverages physiological signals as privileged information during training to guide a video-based student model in learning deep affective representations, while relying solely on non-intrusive video inputs at inference time. To cope with the high noise and instability of physiological teacher supervision caused by inter-subject variability, signal artifacts, and temporal inconsistency, BioKD incorporates a sample-wise reliability-aware gating mechanism together with a progressive distillation strategy. By adaptively regulating the strength of knowledge transfer, the framework suppresses negative transfer induced by unreliable physiological supervision and enables more stable cross-modal distillation. Experiments on DEAP and AMIGOS show that BioKD consistently outperforms representative baselines under both trial-wise and subject-wise evaluation protocols for valence and arousal recognition. For example, BioKD achieves 68.01\% on DEAP (trial-wise arousal) and 65.29\% under the more challenging subject-wise setting, demonstrating improved performance under a subject-independent evaluation setting. Further analyses show that BioKD effectively mitigates overconfident teacher errors and outperforms an entropy-only weighting strategy, confirming the importance of explicitly modeling supervision reliability. In addition, BioKD introduces no additional inference-time overhead relative to the same video student architecture and removes the need for physiological sensing and multimodal synchronization.
Related papers
- TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs [83.78708832901194]
Large video-language models (LVLMs) have shown remarkable performance on multimodal tasks like multimodal emotion recognition (ER) in the wild.<n>However, real-world deployment remains challenging: modalities may be missing or noisy at test time.<n>We propose a solution in which a frozen teacher guides an adaptive low-rank student via self-distillation.<n>Experiments on MELD, DFEW, and BAH under 0%-50% missing modalities show that this unified adaptation-restoration design consistently outperforms entropy-based adaptation, RAG, and perplexity-based generation.
arXiv Detail & Related papers (2026-08-18T23:40:28Z) - Test-time Adaptation of Pelvic Bone Segmentation Models via Dynamic Reliability-Guided [62.10276009853225]
Reliable pelvic bone segmentation from CT is essential for robot-assisted pelvic trauma surgery.<n>Existing methods show limited effectiveness for PBS.<n>We propose a novel closed-loop dynamic Reliability-Guided framework (ReGA) for PBS.
arXiv Detail & Related papers (2026-08-01T08:13:20Z) - Full-Self Diagnostics (FSD): Physics-Grounded Visual Biomarker Inference from Smartphone Video via Inverse Problems and Operator Learning [0.0]
Full-Self Diagnostics (FSD) is a unified mathematical framework for recovering latent physiological states from unconstrained 9-second facial videos.<n> Empirical validation on 38812 real-world paired scans across 59 subjects demonstrates practical performance.<n>Results confirm that consumer-grade facial video encodes sufficient structured information for clinically relevant, non-invasive inference under fully unconstrained conditions.
arXiv Detail & Related papers (2026-06-11T20:26:47Z) - MARVEL: Universal Murray's Law-informed Vessel Tree Segmentation and Topology Estimation [75.40785674602147]
Deep learning methods for vascular segmentation often neglect biophysical constraints.<n>This leads to physiologically implausible branching and misclassification vascular trees.<n>We introduce MARVEL, a backbone-agnostic framework that integrates biophysical priors into vascular tree extraction.
arXiv Detail & Related papers (2026-05-25T02:32:29Z) - Active Inference for Micro-Gesture Recognition: EFE-Guided Temporal Sampling and Adaptive Learning [28.290563914077932]
This paper presents an active inference-based framework for micro-gesture recognition.<n>It features Expected Free Energy (EFE) micro-guided temporal sampling and uncertainty-aware adaptive learning.<n>It offers an interpretable and scalable paradigm for temporal behavior modeling under low-resource and noisy conditions.
arXiv Detail & Related papers (2026-03-08T09:44:19Z) - Antidistillation Fingerprinting [119.66677613290359]
We introduce antidistillation fingerprinting (ADFP), a principled approach that aligns the fingerprinting objective with the student's learning dynamics.<n>ADFP achieves a significant improvement over state-of-the-art baselines, stronger detection confidence with minimal impact on utility, even when the student model's architecture is unknown.
arXiv Detail & Related papers (2026-02-03T18:15:50Z) - Learning Alzheimer's Disease Signatures by bridging EEG with Spiking Neural Networks and Biophysical Simulations [42.091774598477706]
Conventional deep learning approaches for EEG-based Alzheimer's disease detection are computationally intensive and mechanistically opaque.<n>We propose a neuro-bridge framework that links data-driven learning with biophysically grounded simulations.
arXiv Detail & Related papers (2026-01-30T21:54:16Z) - Multi-modal Knowledge Decomposition based Online Distillation for Biomarker Prediction in Breast Cancer Histopathology [9.978792979899376]
We propose an online distillation approach based on Multi-modal Knowledge Decomposition (MKD) to enhance IHC biomarker prediction.<n>Two teacher and one student models are developed to extract modality-specific and modality-general features.<n>Our approach achieves superior performance in IHC biomarker prediction using uni-modal data.
arXiv Detail & Related papers (2025-08-24T04:56:17Z) - Towards Understanding the Robustness of Diffusion-Based Purification: A Stochastic Perspective [65.10019978876863]
Diffusion-Based Purification (DBP) has emerged as an effective defense mechanism against adversarial attacks.<n>In this paper, we propose that the intrinsicity in the DBP process is the primary factor driving robustness.
arXiv Detail & Related papers (2024-04-22T16:10:38Z) - Learning to Denoise Biomedical Knowledge Graph for Robust Molecular Interaction Prediction [50.7901190642594]
We propose BioKDN (Biomedical Knowledge Graph Denoising Network) for robust molecular interaction prediction.
BioKDN refines the reliable structure of local subgraphs by denoising noisy links in a learnable manner.
It maintains consistent and robust semantics by smoothing relations around the target interaction.
arXiv Detail & Related papers (2023-12-09T07:08:00Z) - Disentangled Adversarial Transfer Learning for Physiological Biosignals [24.02384472840036]
We propose an adversarial inference approach for transfer learning to extract disentangled nuisance-robust representations from physiological biosignal data.
Results on cross-subjects transfer evaluations demonstrate the benefits of the proposed adversarial framework.
arXiv Detail & Related papers (2020-04-15T01:56:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.