Two-Stage TSO-DSO Services Provision Framework for Electric Vehicle Coordination

TL;DR

This paper introduces a two-stage framework utilizing EVs for frequency and voltage support, combining day-ahead scheduling with real-time decentralized dispatching using reinforcement learning to enhance power system stability.

Contribution

It proposes a novel two-stage coordination framework for EVs supporting TSO frequency and DSO voltage, incorporating a decentralized RL-based dispatch method for large-scale EV integration.

Findings

Effective EV participation in frequency and voltage support demonstrated.

Decentralized RL dispatch reduces communication overhead.

Framework scalable to large distribution networks.

Abstract

High renewable penetration has been witnessed in power systems, resulting in reduced system inertia and increasing requirements for frequency response services. Electric vehicles (EVs), owing to their vehicle-to-grid (V2G) capabilities, can provide cost-effective frequency services for transmission system operators (TSOs). However, EVs that are inherently connected to distribution networks may pose voltage security issues for distribution system operators (DSOs) when supporting TSO frequency. To coordinate both TSO frequency and DSO voltage, this paper proposes a two-stage service provision framework for multi-EVs. At stage one, EVs participate in day-ahead TSO-DSO interactions for frequency reserve schedules; at stage two, EVs make real-time dispatching behaviors in distribution networks for reserve delivery while supporting DSO voltage. Considering the potentially large EV number and environment complexity, a decentralized operation paradigm is introduced for real-time EV dispatches at stage two, while a communication-efficient reinforcement learning (RL) algorithm is proposed to reduce the communication overhead during large-scale multi-agent RL training without compromising policy performance. Case studies are carried out on a 6-bus transmission and 33-bus distribution network as well as a 69-bus distribution network to evaluate the effectiveness and scalability of the proposed method in enabling EVs for frequency service and voltage support.