Reinforcement Learning for Robust Ageing-Aware Control of Li-ion Battery Systems with Data-Driven Formal Verification
- URL: http://arxiv.org/abs/2509.04288v2
- Date: Sat, 06 Sep 2025 20:36:57 GMT
- Title: Reinforcement Learning for Robust Ageing-Aware Control of Li-ion Battery Systems with Data-Driven Formal Verification
- Authors: Rudi Coppola, Hovsep Touloujian, Pierfrancesco Ombrini, Manuel Mazo Jr,
- Abstract summary: A fundamental challenge to be addressed is the trade-off between the speed of charging and the ageing behavior.<n>We rely on a high-fidelity physics-based battery model and propose an approach to data-driven charging and safety protocol design.
- Score: 0.3499870393443268
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Rechargeable lithium-ion (Li-ion) batteries are a ubiquitous element of modern technology. In the last decades, the production and design of such batteries and their adjacent embedded charging and safety protocols, denoted by Battery Management Systems (BMS), has taken central stage. A fundamental challenge to be addressed is the trade-off between the speed of charging and the ageing behavior, resulting in the loss of capacity in the battery cell. We rely on a high-fidelity physics-based battery model and propose an approach to data-driven charging and safety protocol design. Following a Counterexample-Guided Inductive Synthesis scheme, we combine Reinforcement Learning (RL) with recent developments in data-driven formal methods to obtain a hybrid control strategy: RL is used to synthesise the individual controllers, and a data-driven abstraction guides their partitioning into a switched structure, depending on the initial output measurements of the battery. The resulting discrete selection among RL-based controllers, coupled with the continuous battery dynamics, realises a hybrid system. When a design meets the desired criteria, the abstraction provides probabilistic guarantees on the closed-loop performance of the cell.
Related papers
- Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids [50.64533198075622]
Reinforcement learning (RL) is a powerful framework for optimizing decision-making in complex systems under uncertainty.<n>In this paper, we introduce Shielded Controller Units (SCUs), a systematic and interpretable approach that leverages prior knowledge of system dynamics.<n>We demonstrate the effectiveness of SCUs on a remote microgrid optimization task with strict operational requirements.
arXiv Detail & Related papers (2025-11-30T19:28:34Z) - Expert-Guided LLM Reasoning for Battery Discovery: From AI-Driven Hypothesis to Synthesis and Characterization [47.97016882216093]
Large language models (LLMs) leverage chain-of-thought (CoT) techniques to tackle complex problems.<n>We introduce ChatBattery, a novel agentic framework that integrates domain knowledge to steer LLMs toward more effective reasoning in materials design.<n>We successfully identify, synthesize, and characterize three novel lithium-ion battery cathode materials, which achieve practical capacity improvements of 28.8%, 25.2%, and 18.5%, respectively.
arXiv Detail & Related papers (2025-07-21T23:46:11Z) - Optimizing the Charging of Open Quantum Batteries using Long Short-Term Memory-Driven Reinforcement Learning [0.0]
We study the charging process of a quantum battery in an open quantum setting, where the battery interacts with a charger and a structured reservoir.<n>A reinforcement learning (RL) charging strategy is proposed, which utilizes the deep deterministic policy gradient algorithm alongside long short-term memory (LSTM) networks.<n>The RL protocols consistently outperform conventional fixed strategies by real-time controlling the driving field amplitude and coupling parameters.
arXiv Detail & Related papers (2025-04-28T14:40:11Z) - State-of-Health Prediction for EV Lithium-Ion Batteries via DLinear and Robust Explainable Feature Selection [14.672460390509334]
We propose an explainable, data-driven state-of-health (SOH) prediction framework tailored for electric vehicles (EVs)<n>We extract twenty meaningful features from voltage, current, temperature, and time profiles, and select key features using Pearson correlation and Shapley additive explanations (SHAP)<n>The SHAP-based selection yields consistent feature importance across multiple cells, effectively capturing cell-to-cell variability (CtCV)
arXiv Detail & Related papers (2025-01-20T15:28:20Z) - Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimation [0.0]
We present the Battery GraphNets framework that jointly learns to incorporate a discrete dependency graph structure between battery parameters.
The proposed method outperforms several popular methods by a significant margin on publicly available battery datasets and achieves SOTA performance.
arXiv Detail & Related papers (2024-08-14T15:44:56Z) - Generating Comprehensive Lithium Battery Charging Data with Generative AI [24.469319419012745]
This study introduces the End of Life (EOL) and Equivalent Cycle Life (ECL) as conditions for generative AI models.
By integrating an embedding layer into the CVAE model, we developed the Refined Conditional Variational Autoencoder (RCVAE)
Through preprocessing data into a quasi-video format, our study achieves an integrated synthesis of electrochemical data, including voltage, current, temperature, and charging capacity.
This method provides users with a comprehensive electrochemical dataset, pioneering a new research domain for the artificial synthesis of lithium battery data.
arXiv Detail & Related papers (2024-04-11T09:08:45Z) - BatSort: Enhanced Battery Classification with Transfer Learning for Battery Sorting and Recycling [42.453194049264646]
We introduce a machine learning-based approach for battery-type classification and address the problem of data scarcity for the application.
We propose BatSort which applies transfer learning to utilize the existing knowledge optimized with large-scale datasets.
We conducted an experimental study and the results show that BatSort can achieve outstanding accuracy of 92.1% on average and up to 96.2%.
arXiv Detail & Related papers (2024-04-08T18:05:24Z) - Adapting Amidst Degradation: Cross Domain Li-ion Battery Health Estimation via Physics-Guided Test-Time Training [19.606703130917325]
Health modeling of lithium-ion batteries (LIBs) is crucial for safe and efficient energy management and carries significant socio-economic implications.
We introduce a practical Test-Time Training framework, BatteryTTT, which adapts the model continually using each target data (UTD) collected amidst degradation.
To fully utilize each UTD, BatteryTTT integrates the inherent physical laws of modern LIBs into self-supervised learning, termed Physcics-Guided Test-Time Training.
arXiv Detail & Related papers (2024-01-30T14:47:15Z) - A Dynamic Feedforward Control Strategy for Energy-efficient Building
System Operation [59.56144813928478]
In current control strategies and optimization algorithms, most of them rely on receiving information from real-time feedback.
We propose an engineer-friendly control strategy framework that embeds dynamic prior knowledge from building system characteristics simultaneously for system control.
We tested it in a case for heating system control with typical control strategies, which shows our framework owns a further energy-saving potential of 15%.
arXiv Detail & Related papers (2023-01-23T09:07:07Z) - Transfer Learning and Vision Transformer based State-of-Health
prediction of Lithium-Ion Batteries [1.2468700211588883]
Accurately predicting the state of health (SOH) can not only ease the anxiety of users about the battery life but also provide important information for the management of the battery.
This paper presents a prediction method for SOH based on Vision Transformer (ViT) model.
arXiv Detail & Related papers (2022-09-07T16:54:15Z) - Learning Hybrid Control Barrier Functions from Data [66.37785052099423]
Motivated by the lack of systematic tools to obtain safe control laws for hybrid systems, we propose an optimization-based framework for learning certifiably safe control laws from data.
In particular, we assume a setting in which the system dynamics are known and in which data exhibiting safe system behavior is available.
arXiv Detail & Related papers (2020-11-08T23:55:02Z) - State-of-Charge Estimation of a Li-Ion Battery using Deep Forward Neural
Networks [68.8204255655161]
We build a Deep Forward Network for a lithium-ion battery and its performance assessment.
The contribution of this work is to present a methodology of building a Deep Forward Network for a lithium-ion battery and its performance assessment.
arXiv Detail & Related papers (2020-09-20T23:47:11Z) - Universal Battery Performance and Degradation Model for Electric
Aircraft [52.77024349608834]
Design, analysis, and operation of electric vertical takeoff and landing aircraft (eVTOLs) requires fast and accurate prediction of Li-ion battery performance.
We generate a battery performance and thermal behavior dataset specific to eVTOL duty cycles.
We use this dataset to develop a battery performance and degradation model (Cellfit) which employs physics-informed machine learning.
arXiv Detail & Related papers (2020-07-06T16:10:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.