When Should a Model Change Its Mind? An Energy-Based Theory and Regularizer for Concept Drift in Electrocardiogram (ECG) Signals
- URL: http://arxiv.org/abs/2602.22294v2
- Date: Fri, 27 Feb 2026 13:26:28 GMT
- Title: When Should a Model Change Its Mind? An Energy-Based Theory and Regularizer for Concept Drift in Electrocardiogram (ECG) Signals
- Abstract summary: Existing concept-drift frameworks are largely distributional and provide no principled guidance on how much a model's internal representation may move.<n>This study introduces Physiologic Energy Conservation Theory (PECT), an energy-based framework for concept stability in dynamic signals.<n>PECT posits that under virtual drift, normalized latent displacement should scale proportionally with normalized signal energy change, while persistent violations of this proportionality indicate real concept drift.
- Score: 0.9239657838690226
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Models operating on dynamic physiologic signals must distinguish benign, label-preserving variability from true concept change. Existing concept-drift frameworks are largely distributional and provide no principled guidance on how much a model's internal representation may move when the underlying signal undergoes physiologically plausible fluctuations in energy. As a result, deep models often misinterpret harmless changes in amplitude, rate, or morphology as concept drift, yielding unstable predictions, particularly in multimodal fusion settings. This study introduces Physiologic Energy Conservation Theory (PECT), an energy-based framework for concept stability in dynamic signals. PECT posits that under virtual drift, normalized latent displacement should scale proportionally with normalized signal energy change, while persistent violations of this proportionality indicate real concept drift. We operationalize this principle through Energy-Constrained Representation Learning (ECRL), a lightweight regularizer that penalizes energy-inconsistent latent movement without modifying encoder architectures or adding inference-time cost. Although PECT is formulated for dynamic signals in general, we instantiate and evaluate it on multimodal ECG across seven unimodal and hybrid models. Experiments show that in the strongest trimodal hybrid (1D+2D+Transformer), clean accuracy is largely preserved (96.0% to 94.1%), while perturbed accuracy improves substantially (72.6% to 85.5%) and fused representation drift decreases by over 45%. Similar trends are observed across all architectures, providing empirical evidence that PECT functions as an energy-drift law governing concept stability in continuous physiologic signals.
Related papers
- Energy-Structured Latent World Models with Neural Time Fields for Physically Constistent Open-World Motion Planning [25.402498594599013]
We propose a novel Energy-Structured Latent World Model (ELWM)<n>Our key idea is to structure the ELWM latent state to explicitly carry energy and momentum, ensuring strictly causal transitions.<n>We further implement this for motion planning by constructing Physics-Conditioned Neural Time Fields (PC-NTF)<n>Compared to generic latent models, PC-NTF reduces 0.8-s motion-prediction NRMSE from 0.36 to 0.29.
arXiv Detail & Related papers (2026-08-10T17:31:18Z) - Controlled Dynamics Attractor Transformer [58.15454173718687]
Transformer architectures have advanced representation learning and inference in deep models through self-attention mechanisms.<n>In parallel,associative memory (AM) frameworks map representations onto energy landscapes, offering interpretable retrieval mechanisms.<n>We propose Controlled Dynamics Attractor Transformer (CCAT), which couples a mixture von Mises-Fisher (Mo-vMF) attention energy with a Hopfield refinement energy.<n>CCAT achieves state-of-the-art performance across multiple benchmarks in graph anomaly detection and graph classification.
arXiv Detail & Related papers (2026-06-13T09:04:22Z) - TIDE: Asymmetric Neural Circuits for Stabilized Temporal Inhibitory-Excitatory Dynamics [51.37317469455798]
Recent Continuous Thought Machine architecture decouples internal computation from external inputs via neural dynamics.<n>We propose to model neural dynamics using asymmetric Excitatory-Inhibitory (E-I) networks.<n>We introduce Temporal Inhibitory-Excitatory Dynamic Engine (TIDE), a neuro-inspired architecture that computes internal representations through neural dynamics stabilized.
arXiv Detail & Related papers (2026-05-19T05:59:13Z) - PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics [0.0]
World models built on recurrent state space architectures produce dynamics that violate conservation and dissipative principles.<n>We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms.<n>Across visual control benchmarks, this paradigm not only attains superior returns but also elevates internal fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.
arXiv Detail & Related papers (2026-05-18T12:20:54Z) - Multi-Headed Transformer Architectures as Time-dependent Wasserstein Gradient Flows [16.7218879608165]
We study the data flow in multi-headed transformer architectures as time-dependent gradient flows for a suitable interaction energy.<n>We prove the $$-convergence of the perturbed interaction energy to the unperturbed one, leading to the convergence of the corresponding gradient flows.<n>We complement these theoretical results with numerical experiments that confirm the predicted energy-dissipation identity and clarify the behavior of the dynamics in both the autonomous-like (Ornstein-Uhlenbeck) and the genuinely non-autonomous (oscillating-weights) regimes.
arXiv Detail & Related papers (2026-05-15T15:32:18Z) - Bidirectional Temporal Dynamics Modeling for EEG-based Driving Fatigue Recognition [8.553069379167221]
Driving fatigue is a major contributor to traffic accidents and poses a serious threat to road safety.<n>EEG-based fatigue recognition is hindered by strong non-stationarity and asymmetric neural dynamics.<n>We propose DeltaGateNet, a novel framework that explicitly captures Bidirectional temporal dynamics for EEG-based driving fatigue recognition.
arXiv Detail & Related papers (2026-02-15T09:42:25Z) - Digital Metabolism: Decoupling Logic from Facts via Regenerative Unlearning -- Towards a Pure Neural Logic Core [4.073707521515039]
"Digital metabolism" is a hypothesis suggesting that targeted forgetting is necessary for distilling a pure neural logic core.<n>We introduce the Regenerative Logic-Core Protocol (RLCP), a dual-stream training framework that renders specific factual dependencies linearly undecodable.<n> Empirical analysis on GSM8K reveals that the "metabolized" model spontaneously adopts Symbolic chain-of-thought scaffolding.
arXiv Detail & Related papers (2026-01-15T19:21:16Z) - PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement [63.007237197267834]
Existing deep learning methods are mostly physiological monitoring and lack theoretical robustness.<n>We propose a physics-informed r paradigm derived from the Navier-Stokes equations of hemodynamics, showing that the pulse signal follows a second-order system.<n>This provides a theoretical justification for using a Temporal Conal Network (TCN)<n>Phase-Net achieves state-of-the-art performance with strong efficiency, offering a theoretically grounded and deployment-ready r solution.
arXiv Detail & Related papers (2025-09-29T14:36:45Z) - Physics-Embedded Neural ODEs for Sim2Real Edge Digital Twins of Hybrid Power Electronics Systems [6.073480880825787]
Edge Digital Twins (EDTs) are crucial for monitoring and control of Power Electronics Systems (PES)<n>Existing modeling approaches struggle to consistently capture continuously evolving hybrid dynamics that are inherent in PES.<n>This paper proposes a Physics-Embedded Neural ODEs (PENODE) that embeds the hybrid operating mechanism as an event automaton to explicitly govern switching discrete.
arXiv Detail & Related papers (2025-08-04T20:34:13Z) - Langevin Flows for Modeling Neural Latent Dynamics [81.81271685018284]
We introduce LangevinFlow, a sequential Variational Auto-Encoder where the time evolution of latent variables is governed by the underdamped Langevin equation.<n>Our approach incorporates physical priors -- such as inertia, damping, a learned potential function, and forces -- to represent both autonomous and non-autonomous processes in neural systems.<n>Our method outperforms state-of-the-art baselines on synthetic neural populations generated by a Lorenz attractor.
arXiv Detail & Related papers (2025-07-15T17:57:48Z) - A PID-Controlled Tensor Wheel Decomposition Model for Dynamic Link Prediction [3.525733859925913]
This study introduces a PID-controlled tensor wheel decomposition (PTWD) model, which mainly adopts the following two ideas.<n>The proposed PTWD model has more accurate link prediction capabilities compared to other models.
arXiv Detail & Related papers (2025-05-20T11:14:30Z) - REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioning [95.07708090428814]
We present REWIND, a one-step diffusion model for real-time, high-fidelity human motion estimation from egocentric image inputs.<n>We introduce cascaded body-hand denoising diffusion, which effectively models the correlation between egocentric body and hand motions.<n>We also propose a novel identity conditioning method based on a small set of pose exemplars of the target identity, which further enhances motion estimation quality.
arXiv Detail & Related papers (2025-04-07T11:44:11Z) - Allostatic Control of Persistent States in Spiking Neural Networks for perception and computation [79.16635054977068]
We introduce a novel model for updating perceptual beliefs about the environment by extending the concept of Allostasis to the control of internal representations.<n>In this paper, we focus on an application in numerical cognition, where a bump of activity in an attractor network is used as a spatial numerical representation.
arXiv Detail & Related papers (2025-03-20T12:28:08Z) - Steady State Photoisomerization Quantum Yield of Model Rhodopsin:
Insights from Wavepacket Dynamics? [0.0]
We simulate the nonequilibrium steady state textitcis-trans photoisomerization of retinal chromophore in rhodopsin.
We find that the steady state reaction quantum yield (QY) correlates strongly with the excess energy above the crossing point of the system.
arXiv Detail & Related papers (2022-01-30T03:31:13Z) - Spherical Motion Dynamics: Learning Dynamics of Neural Network with
Normalization, Weight Decay, and SGD [105.99301967452334]
We show the learning dynamics of neural network with normalization, weight decay (WD), and SGD (with momentum) named as Spherical Motion Dynamics (SMD)
We verify our assumptions and theoretical results on various computer vision tasks including ImageNet and MSCOCO with standard settings.
arXiv Detail & Related papers (2020-06-15T14:16:33Z) - Cat states in a driven superfluid: role of signal shape and switching
protocol [62.997667081978825]
We investigate the behavior of a one-dimensional Bose-Hubbard model whose kinetic energy is made to oscillate with zero time-average.
We analyze the robustness of this unconventional ground state against variations of a number of system parameters.
arXiv Detail & Related papers (2020-05-11T15:15:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.