Lifelong reinforcement learning for health-aware fast charging of lithium-ion batteries

TL;DR

This paper introduces a deep reinforcement learning approach for fast charging lithium-ion batteries that balances charging speed with battery health, extending lifespan through a novel SoH-aware voltage constraint.

Contribution

It proposes a health-aware fast charging strategy using a deep learning framework that explicitly incorporates battery health into the charging control process.

Findings

Reduces battery degradation compared to conventional methods

Maintains fast charging times while improving battery longevity

Validated with high-fidelity simulations in PyBaMM

Abstract

Fast charging of lithium-ion batteries remains a critical bottleneck for widespread adoption of electric vehicles and stationary energy storage systems, as improperly designed fast charging can accelerate battery degradation and shorten lifespan. In this work, we address this challenge by proposing a health-aware fast charging strategy that explicitly balances charging speed and battery longevity across the entire service life. The key innovation lies in establishing a mapping between anode overpotential and the state of health (SoH) of battery, which is then used to constrain the terminal charging voltage in a twin delayed deep deterministic policy gradient (TD3) framework. By incorporating this SoH-dependent voltage constraint, our designed deep learning method mitigates side reactions and effectively extends battery life. To validate the proposed approach, a high-fidelity single particle model with electrolyte is implemented in the widely adopted PyBaMM simulation platform, capturing degradation phenomena at realistic scales. Comparative life-cycle simulations against conventional CC-CV, its variants, and constant current-constant overpotential methods show that the TD3-based controller reduces overall degradation while maintaining competitively fast charge times. These results demonstrate the practical viability of deep reinforcement learning for advanced battery management systems and pave the way for future explorations of health-aware, performance-optimized charging strategies.