Pretrained Battery Transformer (PBT): A battery life prediction foundation model

• URL: http://arxiv.org/abs/2512.16334v3
• Date: Tue, 23 Dec 2025 02:58:42 GMT
• Title: Pretrained Battery Transformer (PBT): A battery life prediction foundation model
• Authors: Ruifeng Tan, Weixiang Hong, Jia Li, Jiaqiang Huang, Tong-Yi Zhang,
• Abstract summary: We present the Pretrained Battery Transformer (PBT), the first foundation model for battery cycle life prediction.<n>PBT learns transferable representations from 13 lithium-ion battery datasets, outperforming existing models by an average of 19.8%.<n>This work establishes a foundation model pathway for battery lifetime prediction, paving the way toward universal battery lifetime prediction systems.
• Score: 7.954432674499544
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Early prediction of battery cycle life is essential for accelerating battery research, manufacturing, and deployment. Although machine learning methods have shown encouraging results, progress is hindered by data scarcity and heterogeneity arising from diverse aging conditions. In other fields, foundation models (FMs) trained on diverse datasets have achieved broad generalization through transfer learning, but no FMs have been reported for battery cycle life prediction yet. Here we present the Pretrained Battery Transformer (PBT), the first FM for battery life prediction, developed through domain-knowledge-encoded mixture-of-expert layers. Validated on the largest public battery life database, PBT learns transferable representations from 13 lithium-ion battery datasets, outperforming existing models by an average of 19.8%. With transfer learning, PBT achieves state-of-the-art performance across 15 diverse datasets encompassing various operating conditions, formation protocols, and chemistries. This work establishes a foundation model pathway for battery lifetime prediction, paving the way toward universal battery lifetime prediction systems.

Related papers

• SEMPO: Lightweight Foundation Models for Time Series Forecasting [45.456949943052116]
  SEMPO is a lightweight foundation model that requires pretraining on relatively small-scale data, yet exhibits strong general time series forecasting.<n> SEMPO comprises two key modules: 1) energy-aware SpEctral decomposition module, that substantially improves the utilization of pre-training data.<n>Experiments on two large-scale benchmarks covering 16 datasets demonstrate the superior performance of SEMPO in both zero-shot and few-shot forecasting scenarios.
  arXiv  Detail & Related papers  (2025-10-22T15:58:44Z)
• Learning More with Less: A Generalizable, Self-Supervised Framework for Privacy-Preserving Capacity Estimation with EV Charging Data [84.37348569981307]
  We propose a first-of-its-kind capacity estimation model based on self-supervised pre-training.<n>Our model consistently outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-10-05T08:58:35Z)
• Survival Analysis with Machine Learning for Predicting Li-ion Battery Remaining Useful Life [4.6033243214188415]
  We propose a hybrid survival analysis framework integrating survival data reconstruction, survival model learning, and survival probability estimation.<n>Our approach transforms battery voltage time series into time-to-failure data using path signatures.<n> Experiments conducted on the Toyota battery and NASA battery datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2025-03-17T02:49:34Z)
• BatteryLife: A Comprehensive Dataset and Benchmark for Battery Life Prediction [18.442323084350875]
  We propose BatteryLife, a comprehensive dataset and benchmark for Battery Life Prediction (BLP)<n>BatteryLife integrates 16 datasets, offering a 2.5 times sample size compared to the previous largest dataset.<n>BatteryLife is the first to release battery life datasets of zinc-ion batteries, sodium-ion batteries, and industry-tested large-capacity lithium-ion batteries.
  arXiv  Detail & Related papers  (2025-02-26T04:21:20Z)
• ViTime: Foundation Model for Time Series Forecasting Powered by Vision Intelligence [49.60944381032587]
  Time series forecasting (TSF) possesses great practical values in various fields, including power and energy, transportation, etc.<n>TSF models have long been known to be problem-specific and lacking application generalizability.<n>This paper proposes a vision intelligence-powered framework, ViTime, for the first time.
  arXiv  Detail & Related papers  (2024-07-10T02:11:01Z)
• BatSort: Enhanced Battery Classification with Transfer Learning for Battery Sorting and Recycling [42.453194049264646]
  We introduce a machine learning-based approach for battery-type classification and address the problem of data scarcity for the application. We propose BatSort which applies transfer learning to utilize the existing knowledge optimized with large-scale datasets. We conducted an experimental study and the results show that BatSort can achieve outstanding accuracy of 92.1% on average and up to 96.2%.
  arXiv  Detail & Related papers  (2024-04-08T18:05:24Z)
• TimeGPT in Load Forecasting: A Large Time Series Model Perspective [38.92798207166188]
  Machine learning models have made significant progress in load forecasting, but their forecast accuracy is limited in cases where historical load data is scarce.<n>This paper aims to discuss the potential of large time series models in load forecasting with scarce historical data.
  arXiv  Detail & Related papers  (2024-04-07T09:05:09Z)
• Cycle Life Prediction for Lithium-ion Batteries: Machine Learning and More [0.0]
  Batteries are dynamic systems with complicated nonlinear aging. This tutorial begins with an overview of first-principles, machine learning, and hybrid battery models. We highlight the challenges of machine learning models, motivating the incorporation of physics in hybrid modeling approaches.
  arXiv  Detail & Related papers  (2024-04-05T12:05:20Z)
• Accurate battery lifetime prediction across diverse aging conditions with deep learning [20.832988614576983]
  Accurately predicting the lifetime of battery cells in early cycles holds tremendous value for battery research and development as well as numerous downstream applications. Here we introduce a universal deep learning approach that is capable of accommodating various aging conditions and facilitating effective learning under low-resource conditions. A benchmark is built for evaluation, encompassing 401 battery cells utilizing 5 prevalent electrode materials across 168 cycling conditions.
  arXiv  Detail & Related papers  (2023-10-08T07:25:27Z)
• Enhanced Gaussian Process Dynamical Models with Knowledge Transfer for Long-term Battery Degradation Forecasting [0.9208007322096533]
  Predicting the end-of-life or remaining useful life of batteries in electric vehicles is a critical and challenging problem. A number of algorithms have incorporated features that are available from data collected by battery management systems. We develop a highly-accurate method that can overcome this limitation.
  arXiv  Detail & Related papers  (2022-12-03T12:59:51Z)
• Transfer Learning and Vision Transformer based State-of-Health prediction of Lithium-Ion Batteries [1.2468700211588883]
  Accurately predicting the state of health (SOH) can not only ease the anxiety of users about the battery life but also provide important information for the management of the battery. This paper presents a prediction method for SOH based on Vision Transformer (ViT) model.
  arXiv  Detail & Related papers  (2022-09-07T16:54:15Z)
• Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting System [46.39662315849883]
  We introduce CLMFormer, a novel framework that mitigates redundancy through curriculum learning and a memory-driven decoder.<n>CLMFormer consistently improves Transformer-based models by up to 30%, demonstrating its effectiveness in long-horizon forecasting.
  arXiv  Detail & Related papers  (2022-07-16T04:05:15Z)
• Data Driven Prediction of Battery Cycle Life Before Capacity Degradation [0.0]
  This paper utilizes the data and methods implemented by Kristen A. Severson, et al, to explore the methodologies that the research team used. The fundamental effort is to find out if machine learning techniques may be trained to use early life cycle data in order to accurately predict battery capacity.
  arXiv  Detail & Related papers  (2021-10-19T01:35:12Z)
• State-of-Charge Estimation of a Li-Ion Battery using Deep Forward Neural Networks [68.8204255655161]
  We build a Deep Forward Network for a lithium-ion battery and its performance assessment. The contribution of this work is to present a methodology of building a Deep Forward Network for a lithium-ion battery and its performance assessment.
  arXiv  Detail & Related papers  (2020-09-20T23:47:11Z)
• Universal Battery Performance and Degradation Model for Electric Aircraft [52.77024349608834]
  Design, analysis, and operation of electric vertical takeoff and landing aircraft (eVTOLs) requires fast and accurate prediction of Li-ion battery performance. We generate a battery performance and thermal behavior dataset specific to eVTOL duty cycles. We use this dataset to develop a battery performance and degradation model (Cellfit) which employs physics-informed machine learning.
  arXiv  Detail & Related papers  (2020-07-06T16:10:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.