Degradation-Aware Frequency Regulation of a Heterogeneous Battery Fleet via Reinforcement Learning

• URL: http://arxiv.org/abs/2601.22865v1
• Date: Fri, 30 Jan 2026 11:44:53 GMT
• Title: Degradation-Aware Frequency Regulation of a Heterogeneous Battery Fleet via Reinforcement Learning
• Abstract summary: Repeated charging and discharging induces cycling degradation and reduces battery lifetime.<n>This paper studies the real-time scheduling of a heterogeneous battery fleet that collectively tracks a signal subject to per-battery ramp-rate and capacity constraints.
• Score: 6.833717568444402
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Battery energy storage systems are increasingly deployed as fast-responding resources for grid balancing services such as frequency regulation and for mitigating renewable generation uncertainty. However, repeated charging and discharging induces cycling degradation and reduces battery lifetime. This paper studies the real-time scheduling of a heterogeneous battery fleet that collectively tracks a stochastic balancing signal subject to per-battery ramp-rate and capacity constraints, while minimizing long-term cycling degradation. Cycling degradation is fundamentally path-dependent: it is determined by charge-discharge cycles formed by the state-of-charge (SoC) trajectory and is commonly quantified via rainflow cycle counting. This non-Markovian structure makes it difficult to express degradation as an additive per-time-step cost, complicating classical dynamic programming approaches. We address this challenge by formulating the fleet scheduling problem as a Markov decision process (MDP) with constrained action space and designing a dense proxy reward that provides informative feedback at each time step while remaining aligned with long-term cycle-depth reduction. To scale learning to large state-action spaces induced by fine-grained SoC discretization and asymmetric per-battery constraints, we develop a function-approximation reinforcement learning method using an Extreme Learning Machine (ELM) as a random nonlinear feature map combined with linear temporal-difference learning. We evaluate the proposed approach on a toy Markovian signal model and on a Markovian model trained from real-world regulation signal traces obtained from the University of Delaware, and demonstrate consistent reductions in cycle-depth occurrence and degradation metrics compared to baseline scheduling policies.

Related papers

• Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency [123.12549538776109]
  Cycle-World is a framework designed for stable and temporally consistent long-video generation.<n>Our approach tackles error drift by enforcing strict temporal reversibility across both the training and inference phases.<n>Experiments on the VBench benchmark demonstrate that Cycle-World's dual-phase synergy significantly mitigates error drift.
  arXiv  Detail & Related papers  (2026-07-13T17:27:13Z)
• BattVAE-GP: Generative Modeling of Long-Horizon Battery Degradation with Uncertainty Quantification [0.0]
  Long-horizon physics-based simulations of battery degradation provide mechanistic insight but remain computationally expensive.<n>We propose a hybrid physics-probabilistic learning framework for surrogate modeling of lithium-ion battery degradation trajectories at unseen charging rates.
  arXiv  Detail & Related papers  (2026-07-11T09:48:36Z)
• Continuous-time quantum control across an exponentially small bottleneck in a frustrated Ising ring model [0.0]
  Continuous-time Quantum Annealing (QA) is a strategy for preparing ground state of nontrivial manybody systems.<n>We show how to implement quantum control over the annealing schedule in a frustrated Ising ring.
  arXiv  Detail & Related papers  (2026-06-05T11:38:11Z)
• Energy-Structured Low-Rank Adaptation for Continual Learning [78.5390284258307]
  We propose textbfEnergy-Concentrated and textbfEnergy-Ordered textbfLow-textbfRank textbfAdaptation (E$2$-LoRA)<n>By explicitly ordering and concentrating knowledge into leading ranks, E$2$-LoRA frees capacity for subsequent tasks.
  arXiv  Detail & Related papers  (2026-05-26T12:55:02Z)
• SSR: A Training-Free Approach for Streaming 3D Reconstruction [53.19807901585702]
  Self-expressive Sequence Regularization (SSR) is a plug-and-play operator that enforces Grassmannian sequence regularity during inference.<n>We show that SSR consistently reduces drift and improves reconstruction quality across multiple streaming 3D reconstruction tasks.
  arXiv  Detail & Related papers  (2026-03-16T02:55:14Z)
• World Model for Battery Degradation Prediction Under Non-Stationary Aging [1.2891210250935148]
  This paper formulates battery degradation prognosis as a world model problem.<n>It encodes raw voltage, current, and temperature time-series from each cycle into a latent state.<n>It propagates it forward via a learned dynamics transition to produce a future trajectory spanning 80 cycles.
  arXiv  Detail & Related papers  (2026-03-11T08:30:15Z)
• Scalable Distributed Memory Implementation of the Quasi-Adiabatic Propagator Path Integral [0.0]
  We present a scalable distributed memory implementation of the Mask Assisted Coarse Graining of Influence Coefficients.<n>The method exploits the memory resources of multiple compute nodes and mitigates the memory bottleneck via a new pre-merging algorithm.<n>The efficiency of the new implementation is demonstrated in large-scale dissipative quantum dynamics simulations.
  arXiv  Detail & Related papers  (2025-06-03T17:56:18Z)
• Residual Chain Prediction for Autonomous Driving Path Planning [5.139918355140954]
  Residual Chain Loss dynamically adjusts the loss calculation process to enhance the temporal dependency and accuracy of predicted path points. Our findings highlight the potential of Residual Chain Loss to revolutionize planning component of autonomous driving systems.
  arXiv  Detail & Related papers  (2024-04-08T11:43:40Z)
• PreRoutGNN for Timing Prediction with Order Preserving Partition: Global Circuit Pre-training, Local Delay Learning and Attentional Cell Modeling [84.34811206119619]
  We propose a two-stage approach to pre-routing timing prediction. First, we propose global circuit training to pre-train a graph auto-encoder that learns the global graph embedding from circuit netlist. Second, we use a novel node updating scheme for message passing on GCN, following the topological sorting sequence of the learned graph embedding and circuit graph. Experiments on 21 real world circuits achieve a new SOTA R2 of 0.93 for slack prediction, which is significantly surpasses 0.59 by previous SOTA method.
  arXiv  Detail & Related papers  (2024-02-27T02:23:07Z)
• Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression [70.78523583702209]
  We study training instabilities of behavior cloning with deep neural networks. We observe that minibatch SGD updates to the policy network during training result in sharp oscillations in long-horizon rewards.
  arXiv  Detail & Related papers  (2023-10-17T17:39:40Z)
• Adaptive Planning Search Algorithm for Analog Circuit Verification [53.97809573610992]
  We propose a machine learning (ML) approach, which uses less simulations. We show that the proposed approach is able to provide OCCs closer to the specifications for all circuits.
  arXiv  Detail & Related papers  (2023-06-23T12:57:46Z)
• A Transferable Multi-stage Model with Cycling Discrepancy Learning for Lithium-ion Battery State of Health Estimation [18.980782609740082]
  Multiple degradation patterns of a complete life cycle of a battery make it challenging to pursue transfer learning (TL) A transferable multi-stage SOH estimation model is proposed to perform TL across batteries in the same stage, consisting of four steps. The proposed method outperforms its competitive algorithms in various transfer tasks for a run-to-failure benchmark with three batteries.
  arXiv  Detail & Related papers  (2022-09-01T02:59:46Z)
• Transfer Learning-based State of Health Estimation for Lithium-ion Battery with Cycle Synchronization [16.637948430296227]
  Accurately estimating a battery's state of health (SOH) helps prevent battery-powered applications from failing unexpectedly. With the superiority of reducing the data requirement of model training for new batteries, transfer learning (TL) emerges as a promising machine learning approach. This paper proposes an interpretable TL-based SOH estimation method by exploiting the temporal dynamic to assist transfer learning.
  arXiv  Detail & Related papers  (2022-08-23T21:40:40Z)
• Towards performant and reliable undersampled MR reconstruction via diffusion model sampling [67.73698021297022]
  DiffuseRecon is a novel diffusion model-based MR reconstruction method. It guides the generation process based on the observed signals. It does not require additional training on specific acceleration factors.
  arXiv  Detail & Related papers  (2022-03-08T02:25:38Z)
• Lithium-ion Battery State of Health Estimation based on Cycle Synchronization using Dynamic Time Warping [13.19976118887128]
  State of health (SOH) estimation plays an essential role in battery-powered applications to avoid unexpected breakdowns due to battery capacity fading. This paper proposes an innovative cycle synchronization way to change the existing coordinate system using dynamic time warping. By exploiting the time information of the time series, the proposed method embeds the time index and the original measurements into a novel indicator to reflect the battery degradation status.
  arXiv  Detail & Related papers  (2021-09-28T02:53:54Z)
• Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems [65.44033635330604]
  We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system. We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid.
  arXiv  Detail & Related papers  (2020-10-08T20:25:52Z)
• Targeted free energy estimation via learned mappings [66.20146549150475]
  Free energy perturbation (FEP) was proposed by Zwanzig more than six decades ago as a method to estimate free energy differences. FEP suffers from a severe limitation: the requirement of sufficient overlap between distributions. One strategy to mitigate this problem, called Targeted Free Energy Perturbation, uses a high-dimensional mapping in configuration space to increase overlap.
  arXiv  Detail & Related papers  (2020-02-12T11:10:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.