Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning

• URL: http://arxiv.org/abs/2109.07137v1
• Date: Wed, 15 Sep 2021 07:51:48 GMT
• Title: Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning
• Authors: Vivek Deulkar and Jayakrishnan Nair
• Abstract summary: We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by electricity generation and demand processes. The batteries in the battery bank may differ with respect to their capacities, ramp constraints, losses, as well as cycling costs. We propose a linear function approximation based Q-learning algorithm for learning the optimal solution.
• Score: 5.096724740354125
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by stochastic electricity generation and demand processes. The batteries in the battery bank may differ with respect to their capacities, ramp constraints, losses, as well as cycling costs. The goal is to minimize the degradation costs associated with battery cycling in the long run; this is posed formally as a Markov decision process. We propose a linear function approximation based Q-learning algorithm for learning the optimal solution, using a specially designed class of kernel functions that approximate the structure of the value functions associated with the MDP. The proposed algorithm is validated via an extensive case study.

Related papers

• Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimation [0.0]
  We present the Battery GraphNets framework that jointly learns to incorporate a discrete dependency graph structure between battery parameters. The proposed method outperforms several popular methods by a significant margin on publicly available battery datasets and achieves SOTA performance.
  arXiv  Detail & Related papers  (2024-08-14T15:44:56Z)
• Deep-MPC: A DAGGER-Driven Imitation Learning Strategy for Optimal Constrained Battery Charging [5.192596329990163]
  This manuscript introduces an innovative solution to confront the inherent challenges associated with conventional predictive control strategies for constrained battery charging. Results drawn from a practical battery simulator that incorporates an electrochemical model highlight substantial improvements in battery charging performance.
  arXiv  Detail & Related papers  (2024-06-23T02:36:02Z)
• Depth analysis of battery performance based on a data-driven approach [5.778648596769691]
  Capacity attenuation is one of the most intractable issues in the current of application of the cells. Capacity change of the cell throughout the cycle is predicted using machine learning technology.
  arXiv  Detail & Related papers  (2023-08-30T08:15:27Z)
• Adaptive Planning Search Algorithm for Analog Circuit Verification [53.97809573610992]
  We propose a machine learning (ML) approach, which uses less simulations. We show that the proposed approach is able to provide OCCs closer to the specifications for all circuits.
  arXiv  Detail & Related papers  (2023-06-23T12:57:46Z)
• GP CC-OPF: Gaussian Process based optimization tool for Chance-Constrained Optimal Power Flow [54.94701604030199]
  The Gaussian Process (GP) based Chance-Constrained Optimal Flow (CC-OPF) is an open-source Python code for economic dispatch (ED) problem in power grids. The developed tool presents a novel data-driven approach based on the CC-OP model for solving the large regression problem with a trade-off between complexity and accuracy.
  arXiv  Detail & Related papers  (2023-02-16T17:59:06Z)
• Unsupervised Optimal Power Flow Using Graph Neural Networks [172.33624307594158]
  We use a graph neural network to learn a nonlinear parametrization between the power demanded and the corresponding allocation. We show through simulations that the use of GNNs in this unsupervised learning context leads to solutions comparable to standard solvers.
  arXiv  Detail & Related papers  (2022-10-17T17:30:09Z)
• A Deep Reinforcement Learning-Based Charging Scheduling Approach with Augmented Lagrangian for Electric Vehicle [2.686271754751717]
  This paper formulates the EV charging scheduling problem as a constrained Markov decision process (CMDP) A novel safe off-policy reinforcement learning (RL) approach is proposed in this paper to solve the CMDP. Comprehensive numerical experiments with real-world electricity price demonstrate that our proposed algorithm can achieve high solution optimality and constraints compliance.
  arXiv  Detail & Related papers  (2022-09-20T14:56:51Z)
• Data-Driven Chance Constrained AC-OPF using Hybrid Sparse Gaussian Processes [57.70237375696411]
  The paper proposes a fast data-driven setup that uses the sparse and hybrid Gaussian processes (GP) framework to model the power flow equations with input uncertainty. We advocate the efficiency of the proposed approach by a numerical study over multiple IEEE test cases showing up to two times faster and more accurate solutions.
  arXiv  Detail & Related papers  (2022-08-30T09:27:59Z)
• Microgrid Day-Ahead Scheduling Considering Neural Network based Battery Degradation Model [0.42970700836450487]
  Battery energy storage system (BESS) can effectively mitigate the uncertainty of renewable generation. Main causes of LiB degradation are loss of Li-preventions, loss electrolyte, battery internal degradation. We propose a neural net-work based battery degradation (NNBD) model to quantify degradation with inputs of major degradation factors.
  arXiv  Detail & Related papers  (2022-02-24T23:24:52Z)
• Optimizing a domestic battery and solar photovoltaic system with deep reinforcement learning [69.68068088508505]
  A lowering in the cost of batteries and solar PV systems has led to a high uptake of solar battery home systems. In this work, we use the deep deterministic policy algorithm to optimise the charging and discharging behaviour of a battery within such a system.
  arXiv  Detail & Related papers  (2021-09-10T10:59:14Z)
• Combining Deep Learning and Optimization for Security-Constrained Optimal Power Flow [94.24763814458686]
  Security-constrained optimal power flow (SCOPF) is fundamental in power systems. Modeling of APR within the SCOPF problem results in complex large-scale mixed-integer programs. This paper proposes a novel approach that combines deep learning and robust optimization techniques.
  arXiv  Detail & Related papers  (2020-07-14T12:38:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.