Transient Stability of Droop-Controlled Inverter Networks with Operating Constraints
Kevin D. Smith, Saber Jafarpour, Francesco Bullo

TL;DR
This paper analyzes the transient stability of droop-controlled inverter networks with operational constraints, providing criteria to ensure frequency synchronization and robustness against disturbances, using Lyapunov functions and cycle flow information.
Contribution
It introduces novel stability criteria incorporating cycle flows to reduce conservativeness and quantify robustness in inverter networks under constraints.
Findings
Less-conservative stability conditions achieved.
Cycle flow information improves stability analysis.
Quantified robustness to parameter disturbances.
Abstract
Due to the rise of distributed energy resources, the control of networks of grid-forming inverters is now a pressing issue for power system operation. Droop control is a popular control strategy in the literature for frequency control of these inverters. In this paper, we analyze transient stability in droop-controlled inverter networks that are subject to multiple operating constraints. Using a physically-meaningful Lyapunov-like function, we provide two sets of criteria (one mathematical and one computational) to certify that a post-fault trajectory achieves frequency synchronization while respecting operating constraints. We show how to obtain less-conservative transient stability conditions by incorporating information from loop flows, i.e., net flows of active power around cycles in the network. Finally, we use these conditions to quantify the scale of parameter disturbances to…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Transient Stability of Droop-Controlled Inverter Networks with Operating Constraints
Kevin D. Smith [\scalerel*
|](https://orcid.org/0000-0002-1407-5893), , Saber Jafarpour [\scalerel*
|](https://orcid.org/0000-0002-7614-2940), and Francesco Bullo [\scalerel*
|](https://orcid.org/0000-0002-4785-2118) This work was supported in part by the U.S. Department of Energy (DOE) Solar Energy Technologies Office under Contract No. DE-EE0000-1583, the National Science Foundation grant DGE-1258507, and the U.S. Defense Threat Reduction Agency under grant HDTRA1-19-1-0017. Kevin D. Smith, Saber Jafarpour, and Francesco Bullo are with the Center of Control, Dynamical Systems and Computation, UC Santa Barbara, CA 93106-5070, USA. {kevinsmith,saber.jafarpour,bullo}@ucsb.edu
Abstract
Due to the rise of distributed energy resources, the control of networks of grid-forming inverters is now a pressing issue for power system operation. Droop control is a popular control strategy in the literature for frequency control of these inverters. In this paper, we analyze transient stability in droop-controlled inverter networks that are subject to multiple operating constraints. Using a physically-meaningful Lyapunov-like function, we provide two sets of criteria (one mathematical and one computational) to certify that a post-fault trajectory achieves frequency synchronization while respecting operating constraints. We show how to obtain less-conservative transient stability conditions by incorporating information from loop flows, i.e., net flows of active power around cycles in the network. Finally, we use these conditions to quantify the scale of parameter disturbances to which the network is robust. We illustrate our results with numerical case studies of the IEEE 24-bus system.
Index Terms:
Transient stability, stability of inverter networks, droop-controlled inverters, Kuramoto-Sakaguchi model.
I Introduction
Transient stability is a power systems problem of both practical importance and theoretical interest. The goal of transient stability analysis is to determine whether or not the system will return to a stable, frequency-synchronized operating point after a large disturbance. Transients are difficult to analyze: the governing differential equations are nonlinear, and linearization techniques are not useful for large-scale disturbances. Therefore, system operators typically rely on numerical simulation [13, Chapter 9.3] to study system behavior. Simulation is an effective tool for analyzing individual disturbance scenarios, but it has limitations. Simulating a comprehensive set of disturbances is computationally expensive, and it does not establish rigorous guarantees.
Direct methods of transient stability analysis address these limitations by establishing theoretical guarantees on transient behavior. Direct methods are not a substitute for simulation in real-world power system operation, since they rely on low-order, theoretically-tractable models. Instead, they provide significant theoretical insight into these simplified systems. Classical works on using Lyapunov-like methods to study transient stability include [2, 24, 8]. More recently, [25, 26] used set-theoretic control techniques to establish regions of attraction for the coupled swing equations. Direct methods are highly model-specific and provide conservative guarantees, so this topic is still the subject of active research.
Historically, the literature on direct methods has focused on networks of high-inertia synchronous generators. But the rise of distributed energy resources has sparked a growing interest in the stability of low-inertia inverter networks, particularly microgrids. Inertia is both a blessing and a curse from a control perspective—the same inertia that makes the system robust to disturbances also makes the system respond sluggishly to control inputs. A suitable fast-acting controller can make a low-inertia inverter network highly robust. Two broad classes of inverter controllers have emerged to exploit this low inertia: grid-following controllers, in which the inverter acts as a current source to track the local voltage signal; and grid-forming controllers, in which the inverter acts as a voltage source to stabilize voltage frequencies throughout the network. Both of these frameworks involve new models and require fresh approaches to direct transient stability analysis.
One of the most popular approaches to grid-forming control is proportional droop control, in which local voltage frequencies are modulated in proportion to the power drawn from neighboring buses. Recent work [23, 1, 29] has studied the dynamics of droop-controlled microgrids (DCMGs) via the inhomogeneous Kuramoto model. Under certain assumptions, equilibrium points of the Kuramoto model correspond to frequency-synchronized operating points of the DCMG, and regions of attraction around these equilibria provide a rigorous way to assess how robust DCMG operating points are to disturbances. Some progress has been made on estimating these regions of attraction [11], but these closed-form estimates tend to be very conservative and require stringent regularity assumptions on the topology or system parameters.
Another limitation of the literature is that few bounds on the transients are available. To a system operator, a guarantee of frequency synchronization alone is not satisfying, if the resulting transient will violate operating constraints (like constraints on line flows and nodal power injections). Recent work has begun to address transient stability in conjunction with other engineering constraints [20, 19]. If direct methods of transient stability are to provide more insight into the operation of DCMGs, then less-conservative regions of attraction, as well as bounds on quantities of engineering significance, are needed. This paper addresses these two needs.
Contributions
Our first contribution is to extend the transient stability problem. In addition to the classical notion of transient stability (asymptotic frequency synchronization), we impose five “desired properties” of transients, so as to enforce operating constraints on nodal frequencies, power flows across transmission lines, nodal power injections, nodal ramping rates, and reserves of stored energy.
Our second contribution is to provide two sufficient conditions for when a trajectory of a DCMG will exhibit transient stability and the five desired properties. Both certificates require only two pieces of information from from the initial condition (nodal frequencies and line angle differences) instead of the full (and harder to measure) vector of voltage angles. The first certificate can be viewed as a DCMG-specific form of Nagumo’s theorem, and it is intended as a theoretical basis for transient-stability-certifying algorithms. The second certificate, which consists of a tractable mixed-integer linear program (MILP), is built on top of the first certificate. These theoretical results use a physically-meaningful Lyapunov function called the “maximum frequency deviation,” which (to our knowledge) has not been used before to study power systems.
Our third contribution is to improve these two certificates using the winding partition of the -torus. We introduced the winding partition in [17] to localize the multiple equilibrium points of network flows on the -torus. This paper provides the first application of the winding partition to analyzing system dynamics (in contrast to its previous applications to statics problems). We show how to incorporate the “winding vector” of the initial condition (a quantity closely related to flows of active power around cycles in the network) into the two certificates, resulting in less-conservative conditions for transient stability and the other desired properties.
As a fourth contribution, we use our transient stability conditions to quantify the size of parameter disturbances with respect to which the DCMG is robust. We define a single number that quantifies the “size” of an arbitrary change in model parameters, and we compute a critical threshold such that post-fault transient stability is guaranteed in any disturbance “smaller” than the threshold. We examine particular disturbance modes, including changes in nominal power injections, voltage magnitudes, and branch admittance magnitudes. We illustrate all of these results numerically, using the IEEE 24-bus system as a case study.
Organization
The next four sections are organized around our four main contributions. After introducing our notation, model, and problem statement, Section II states the extended transient stability problem in Definition 1, formally introducing transient stability and the five desired properties of the transient. Section III presents our two certificates in Theorem 4 and Theorem 6, respectively. We review the winding partition in Section IV and improve both certificates by incorporating the winding vector in Theorem 9, and we show that these improved certificates are less conservative (Theorem 10). Finally, Section V uses the stability certificates to study how robust a DCMG is to changes in parameters, and it presents our numerical case studies.
II Preliminaries and Problem Statement
II-A Notation
The Circle and -Torus
Let be the circle, i.e., the set of phases or angles. For every pair of angles , we use to denote the geodesic distance between them. The counterclockwise difference between two angles is the map , where
[TABLE]
In other words, we consider the clockwise and counterclockwise arcs from to . If the counterclockwise arc is shorter, then is the length of that arc. Otherwise, is the negated length of the clockwise arc. The -torus, denoted , is the product of circles.
Sets
Given any set within or , we refer to the interior of the set by , the closure by , and the boundary by , with respect to the standard topologies on and . Given a function and a scalar , we define a sublevel set
[TABLE]
Linear Algebra
The vector (resp. ) is a vector in n with all the entries equal to one (resp. zero). For every , is a diagonal matrix with entries for every . The -norm of is , and the -norm of is . We define and . For every , we write (resp. ) if (resp. ), for every . For a matrix , the Moore–Penrose pseudoinverse is denoted by .
Graph Theory
An undirected graph is a pair , where is a set of nodes, and is the set of edges. The neighborhood of any node is denoted by . While is undirected, we may enumerate and assign an arbitrary orientation to each edge by labeling one incident node as the “source” and the other as the “sink” . The incidence matrix of the graph [6, §9.1] is the matrix with entries
[TABLE]
Graphs and the -Torus
We may assign a phase-valued state to every node in , so that the full state of the graph is in . Given a state , we use the abuse of notation to represent the vector in of counterclockwise differences across each edge, i.e., , where is the source of and is the sink. Furthermore, given any , we define the phase-cohesive set as the open set
[TABLE]
In contrast to the literature, where takes a scalar-valued , the we refer to in this paper is always a vector, allowing for inhomogeneous phase cohesion.
II-B Model
We consider a DCMG on an undirected topology , with buses and branches (or lines) . We assume that is connected, but otherwise we make no assumptions about its structure; both trees and cyclic graphs are acceptable.
Bus Model
Each bus has a complex voltage , where is the voltage magnitude and is the phase. We assume that voltage controllers are operating at a much faster time scale than frequency controllers, so that is constant but is dynamic. We consider two types of buses: droop-controlled inverters and frequency-dependent loads. Buses in represent droop-controlled inverters, which produce a controllable voltage signal with constant magnitude and time-varying frequency . These inverters operate according to the frequency droop control law [7, 16]:
[TABLE]
Here is the instantaneous AC frequency, is the nominal frequency (for example, 60 Hz), is the nominal active power injection, and is the droop coefficient. Buses in represent frequency-dependent loads [21, §9.1], where the instantaneous active power injection is
[TABLE]
Here is the nominal active power load, and . Note that (1) and (2) are algebraically equivalent.
Branch Model
For each branch , we assume that the real power flow from node into the branch is
[TABLE]
where , and are constants. These constants are not necessarily symmetric (i.e., ), so in general .
The AC steady-state active power flow across many types of branches can be written in the form (3). Transmission lines, for example, are typically represented by the nominal model, which consists of a series admittance that is flanked by two shunt admittances and [21, §6.1]. Active power flow in the nominal model is given by (3) with , , and . In medium-length and short-length lines, the shunt admittance is typically purely capacitive or altogether negligible, either of which leads to the simplification . It is also typical that the series admittance is primarily inductive, so . In the extreme case of lossless lines (with no shunt admittance), the active power flow reduces to the antisymmetric form . For transformers, active power flow in the standard equivalent circuit model can also be written in the form (3). We omit the specifications of the parameters for brevity and refer the reader to [21, §6.2].
Dynamics
Due to conservation of energy, active power injections at each bus must balance against power outflows:
[TABLE]
Substituting this expression for into (1) and (2) leads to a differential equation in that captures the angle dynamics of the grid. We can write these dynamics compactly by defining a constant vector with entries for each , as well as a matrix . Then the system can be written as
[TABLE]
where is a vector with entries
[TABLE]
Equation (4) is the model that we study in this paper. If the sine coefficients are homogeneous and the underlying graph is complete, this model is familiar in the physics community as the Kuramoto-Sakaguchi model [22], which has been used to study synchronization phenomena in coupled oscillator networks [28, 10, 5].
Limitations of the Model
Our model is based on several commonly-used simplifying assumptions that should be examined explicitly. Perhaps the most important simplification is that we neglect voltage dynamics and reactive power. This is particularly common in the controls community, and it is often justified by assuming fast-acting voltage controllers [26, 27]. If voltage control fails, possibly due to insufficient reactive power, then unmodeled dynamics of the and parameters may destabilize the system.
Another simplification is our use of steady-state AC models for branches in (3), which is very common in analysis of conventional power grids. These models assume sinusoidal nodal voltages at a constant frequency, an assumption that is technically contradicted by the dynamic frequencies in (4). But the purpose of this paper is to find sufficient conditions for “safe” transient stability, and a key aspect of safe power grid operation is a tight tolerance around the nominal frequency, typically under 1%. In other words, the trajectories that we are interested in certifying have only a small variance in frequency. Nonetheless, the effects of transmission line dynamics on inverter-based grids is a subject of recent interest, and we refer the reader to [14] for a rigorous study of this topic.
II-C Problem Statement
Under normal operation, nodal frequencies are synchronized at the nominal frequency , and power injections are equal to the nominal power injections . But contingencies, like failing transmission lines or a sudden change in power supply or demand, disrupt this equilibrium behavior. Droop control will stabilize the post-fault system about a new equilibrium, provided that this new equilibrium is sufficiently close to the pre-fault state. This local stability property is well-known and easily verified by eigenvalue analysis of (4).
Unfortunately, the dynamics of droop control after larger-scale disturbances are not as well understood, and local stability alone does not inspire confidence in a power system controller. Furthermore, the controller should ensure that the system’s critical engineering constraints are satisfied during the transient. In this paper, in addition to non-local transient stability, we consider five engineering constraints that are important in the context of inverter networks:
Definition 1** (Desired Properties).**
We define the following six properties that are desirable in a trajectory of (4):
- (P1)
Transient stability.* Nodal frequencies asymptotically synchronize, i.e., for some synchronous frequency .* 2. (P2)
Frequency constraint.* Nodal frequencies are bounded by for all , where is a vector of frequency tolerances.* 3. (P3)
Angle difference constraint.* Voltage angle differences are bounded by for all , where is a vector of angle difference tolerances.* 4. (P4)
Power constraint.* Power injections are sufficiently close to the nominal injection, i.e., for all , where is a vector of power tolerances.* 5. (P5)
Ramping constraint.* The rate of change in power injections is sufficiently small: for all , where is a vector of ramping tolerances.* 6. (P6)
Energy constraint.* The difference from nominal energy injection is bounded by*
[TABLE]
where is a vector of nodal capacities to store or dump energy.
Each of these desired properties are necessary for safe operation of the power system. (P1) and (P2) are the standard objectives of primary and secondary frequency control, which keep nodal frequencies close to the rated frequency of grid components. (P3) protects transmission lines from overheating, since larger angle differences lead to larger current flow, and thus, more thermal dissipation. (P4) and (P6) ensure that the power and energy drawn from inverters are within a reasonable range. For example, an inverter powered by solar panels on a sunny afternoon is more flexible in its active power injection (via curtailment) than the same inverter on a cloudy morning. Finally, (P5) ensures that the rate at which power injections fluctuate is within the tolerance of the inverter.
The objective of this paper is to find computationally-tractable sufficient conditions on for each of these six properties.
III Main Theoretical Results
We now proceed with our main results: two sets of sufficient conditions to certify that a trajectory satisfies transient stability and the five desired properties in Definition 1.
III-A Lyapunov Function
Our analysis is based on the frequency deviation vector, which measures the difference between instantaneous and nominal frequencies at each bus:
[TABLE]
From , we define our Lyapunov candidate function, the maximum frequency deviation
[TABLE]
If a trajectory is clear from context, we will abuse notation and write instead of . We will show that the min-max frequency deviation is non-increasing when voltage angle differences are sufficiently small; exactly how small depends on . For each branch, we define a critical arc length
[TABLE]
Due to the assumption that , the critical arc lengths satisfy the bound , and the maximum value of is achieved by lossless transmission lines (for which ). We collect the critical arc lengths into a vector .
As long as the angle difference across each branch is less than the critical arc length, the maximum frequency deviation is non-increasing:
Lemma 2** (Max Frequency Deviation is Non-Increasing).**
Let be a trajectory of (4) such that on some interval . Then .
The proof of this property is based on the following lemma, which is (to our knowledge) novel:
Lemma 3** (Sign-Definiteness of Laplacian Matrices).**
Let be a Laplacian matrix. For any , let be the set of nodes with maximal absolute value. Then
[TABLE]
Furthermore, if the digraph corresponding to is strongly connected, then equality holds if and only if .
Proof of Lemma 3.
For every , we compute
[TABLE]
The first line follows because has zero row sums and the second line because off-diagonal entries of are non-positive. But implies that , so we conclude that . Equality clearly holds in the case where . Now suppose that , which implies that for some particular . But each summand is non-positive, so for each for which ; consequently, for each out-neighbor of . It follows that . Extending the same argument to and all of its neighbors, we see that if a directed path exists from to any node , then . But the graph is strongly connected, so we conclude that . ∎
Proof of Lemma 2.
We first observe that , where is the Jacobian matrix of . For ,
[TABLE]
If , then . Furthermore, evaluating the diagonal entries of reveals that the matrix has zero row sums, so is the Laplacian matrix of a weighted, directed graph whose topology is identical to (treating each undirected edge in is a pair of directed edges). Note that this graph is strongly connected.
Let be the set of buses with maximal frequency deviation, so we can write
[TABLE]
Using [6, Lemma 15.16(iii)] to compute the upper right Dini derivative of a pointwise-maximum function, we obtain
[TABLE]
where the last step follows because . But is a Laplacian matrix corresponding to a strongly connected graph, so by Lemma 3, . Lemma 2 follows from this bound [6, Lemma 15.16(ii)]. ∎
In summary, the maximum frequency deviation is positive definite about the subspace of frequency-synchronized states, and it is non-increasing inside of .
III-B Set-Theoretic Certificate
We now use the maximum frequency deviation to establish a set-theoretic transient stability and operating constraint certification. Our approach is to construct forward-invariant sets using , based on the following optimization problem:
Problem 1** (Min-Max Frequency Deviation).**
Let . We define to be the minimum value of the following:
[TABLE]
If the problem is infeasible, we define .
The min-max frequency deviation is the minimum value of along the “outward boundary” of , i.e., the portion of where is pointed away from the set.
Minimizing a Lyapunov function around a set boundary is a well-established technique for constructing forward-invariant sets—see, for example, Nagumo’s 1942 theorem [3, Theorem 4.7]. More recently, [26] applied this technique to a quadratic Lyapunov function for the coupled swing equations. In our case, the min-max frequency deviation is defined so that sets of the form are forward invariant. This observation, together with the monotonicity of , leads to the central theorem of the paper.
Theorem 4** (Set-Theoretic Certificate).**
Let be a trajectory of (4). Let and denote the initial angle differences and max frequency deviation. If there exist a vector and a set such that , then
- (i)
* for all .* 2. (ii)
The transient stability property (P1) is satisfied.
Further conditions on and lead to various desirable properties from Definition 1:
- (iii)
The frequency constraint (P2) is satisfied for each bus if . 2. (iv)
The angle difference constraint (P3) is satisfied for each line if . 3. (v)
The power constraint (P4) is satisfied for each bus if . 4. (vi)
The ramping constraint (P5) is satisfied for each bus if
[TABLE]
Additionally, in the special case of lossless networks (where and ), the following is true:
- (vii)
The energy constraint (P6) is satisfied for each bus if
[TABLE]
where is the smallest non-zero eigenvalue of the Laplacian matrix .
Proof.
To prove statement (i), observe that any trajectory which escapes must cross through some point on where is pointed outward from . By definition, at such a point . But Lemma 2 implies that , which further implies that if the trajectory reaches this point. Forward invariance of follows by contrapositive. Regarding statement (ii), recall from the proof of Lemma 2 that the frequency dynamics can be written , where is the negated Laplacian matrix of a strongly connected digraph when . It follows from [6, Theorem 12.10] that converges to a consensus state.
Statements (iii) and (iv) follow trivially from statement (i). Statement (v) follows because droop control relates power injections to frequencies by for each . Therefore for all . To prove statement (vi), we observe for each bus that
[TABLE]
since . To prove (vii), observe that
[TABLE]
where the last step follows because . Under the lossless assumption, is negated symmetric Laplacian matrix, and the edge weights in the corresponding graph are , which is lower-bounded by . It follows from [6, Lemma 6.9(ii)] that , so
[TABLE]
Therefore has an exponential upper bound, which decays in time at the rate . The integrand in (P6) can be upper-bounded using both and this exponential, yielding the condition in statement (vii). ∎
Theorem 4 simplifies transient analysis in two ways. First, the conditions depend on the quantities and , rather than the full initial state . A system operator can measure through line flows and through nodal frequencies, rather than using state estimation to obtain . Second, the theorem recasts transient analysis as the search for a set with a sufficiently large min-max frequency deviation. The remainder of the section examines a computationally-efficient way to search for such a set.
III-C Groundwork for the MILP Certificate
It is impractical to repeatedly evaluate while searching for a set that satisfies Theorem 4. Fortunately, we can efficiently compute upper bounds on if we restrict our search to sets of the form . We obtain these upper bounds through a series of relaxations to Problem 1, and then we use these bounds to establish an easily-computable transient stability certificate. This subsection lays out the first of two relaxations that we make for this certificate.
When for some , Problem 1 admits the following relaxation:
Problem 2** (Min-Max Frequency Deviation, Lower Bound).**
Let . We define to be the minimum value of the following:
[TABLE]
If the problem is infeasible, we define .
Recall that and represent the arbitrary “source” and “target” nodes of each . To express constraint (6b) succinctly, we decompose the incidence matrix into two matrices , where if and only if , and if and only if , so that . We also define two diagonal matrices and . Constraints (6f) and (6g) are indicator constraints: if , then the constraints and become “active,” but these constraints do not apply if . Indicator constraints are easily encoded in the MILP framework [4], and many MILP solvers allow indicator constraints to be supplied explicitly.111CPLEX 12.9 supports explicit indicator constraints. Similarly, the Python interface to Gurobi 9 provides the method Model.addGenConstrIndicator(). Both links accessed 8/9/2020.
Problem 2 relaxes Problem 1 by optimizing the vector of counterclockwise differences directly, instead of optimizing . Given this interpretation of , constraints (6b)–(6d) ensure that and that the cost function (6a) is equal to . Constraint (6e) guarantees that , and (6f)–(6h) ensure that the underlying is on the “outward-pointing” boundary of .
The most important property of Problem 2 is that it yields a lower bound to :
Lemma 5** (Problem 2 is a Relaxation).**
Let , and let . The solutions to Problems 1 and 2 are related by , where equality holds if the underlying graph is a tree.
The proof is contained in Appendix A. Due to this bound, we can replace the condition in Theorem 4 with the stricter (but computable) condition .
Theorem 6** (Computational Certificate).**
Consider a trajectory of (4) on any connected graph . Let and denote the initial angle differences and initial max frequency deviation. If there exists a vector such that , then statements (i)–(vii) from Theorem 4 hold, with respect to the set .
Proof.
Let . By Lemma 5, , so and satisfy the hypothesis of Theorem 4. ∎
Given a particular , Theorem 6 provides a certificate for transient stability and the other operating constraints in Definition 1, using only two properties of the initial condition: the initial angle differences , and the initial maximal frequency deviation . Furthermore, Theorem 6 replaces Problem 1 with Problem 2, which is more readily solved by numerical methods.
But two issues still remain. The first problem with Theorem 6 is that it is conservative, since Problem 2 is a lower bound on Problem 1. This bound is only tight in acyclic networks, and the gap between these two problems tends to increase with the number of edges in the graph. In other words, denser graphs lead to more conservative certificates provided by Theorem 6 (compared to Theorem 4 applied to ). Closing this gap with additional constraints requires some deeper analysis of the -torus geometry, which we postpone to Section IV.
The second issue is that Problem 2 is difficult to solve. It is possible to tackle the problem using nonlinear programming techniques, but it is faster and safer to relax the problem to obtain a lower bound, which we examine next.
III-D MILP Certificate
Problem 2 is challenging to solve numerically, since it contains the nonlinear equality constraints (6c) and (6d). Furthermore, we must be careful about using nonlinear solvers to estimate . If the solver obtains a sub-optimal solution, then this solution may exceed , thereby invalidating Theorem 6. But any lower bound on can be used in place of in Theorem 6. We can get a lower bound—while simultaneously making the problem much easier to solve—by further relaxing Problem 2 into a MILP.
The relaxation is conceptually simple; all we need to do is replace (6c) and (6d) with linear and integer constraints. The general idea is to find a polytope or a union of polytopes that contain the sine curve. Then these bounds can be encoded within the MILP and substituted in for (6c) and (6d). The process of constructing these polytopes is a messy exercise in elementary geometry, so we do not go into details here. Instead, we present two examples in Figure 1, both of which relax the sine constraints with four linear bounds (although tighter and more complicated bounds are clearly possible.) In fact, one can achieve arbitrary precision in the relaxed sine constraints by using piecewise-linear bounds, at the expense of additional binary variables and slower computation.
Replacing (6c) and (6d) with the polytope relaxation turns Problem 2 into a MILP. This MILP can be solved with standard software like Gurobi, CPLEX, or MATLAB. The solution is a lower bound on , which can safely be used in place of in Theorem 6. We also note that this MILP is computationally tractable, since the binary variables essentially split the problem into linear programming sub-problems, each corresponding to one of the faces of . Informally, Problem 2 is no more complex than a collection of linear programs.
IV Improved Guarantees for Meshed Networks
In the previous section, we found transient guarantees based on two properties of the initial condition, and . But if is a cyclic topology (i.e., the graph is not a tree), we can make use of an additional property of the initial condition: its winding vector, . Winding vectors have recently gained attention in the study of power transmission networks due to their relationship with loop flows [18, 9], i.e., net flows of power around cycles in the network. In [17], we partitioned the -torus into equivalence classes of winding vectors, and we showed that a wide class of network systems with phase-valued states (including the Kuramoto model) have at most one equilibrium point within each equivalence class. Since winding vectors contain enough information to uniquely characterize equilibrium points of the system, it seems they may also provide information about the transient behavior.
In this section, we briefly review concepts related to the winding partition. We then apply these concepts to the transient stability problem at hand, using knowledge of the initial winding vector to obtain less-conservative certificates from Theorem 4 and completely close the gap between Problems 1 and 2. For simplicity, we assume throughout this section that contains at least one cycle. (Otherwise is a tree, in which case there is no gap between Problems 1 and 2 to begin with.)
IV-A Winding Partition of the -Torus
Preliminaries
We start with some preliminaries on algebraic graph theory and its application to graph cycles. We refer the reader to [6, §9.3] for a more detailed discussion of these concepts. A simple cycle in is a sequence of consecutive nodes, where the first and last nodes are identical, but all other nodes are distinct. Given a simple cycle , the cycle vector is defined with respect to the incidence matrix by
[TABLE]
for each . More formally, given an adjacent pair of nodes in , we say that traverses the edge positively if and ; otherwise, it traverses the edge negatively. The set of cycle vectors for all simple cycles in span a vector space, called the cycle space of . A set of simple cycles is called a cycle basis if the cycle vectors corresponding to elements of are a basis for the cycle space. A cycle basis can be encoded in a cycle-edge incidence matrix , where
[TABLE]
Clearly is the cycle space. Furthermore, because is a connected graph, the dimension of the cycle space is .
Winding Vectors and Winding Partition
We now review basic definitions regarding winding vectors and the winding partition. The partition divides the -torus into equivalence classes induced by an underlying graph . These equivalence classes are defined by how many times the phase differences across basis cycles of “wind” around the unit circle:
Definition 7** (Winding Numbers, Vectors, and Cells).**
Let . Given any simple cycle in with nodes, the winding number of along is
[TABLE]
where the nodes in are indexed and . Given a cycle basis of , the winding vector of along is the vector
[TABLE]
For every winding vector , the -winding cell is the equivalence class
[TABLE]
We note that winding cells were introduced in [17], but winding vectors have been used in the study of power flows since [18]. The reader has likely encountered a similar concept of “winding number” from interpreting Nyquist plots.
Winding vectors are always integer-valued, a property which is analogous to Kirchoff’s voltage law (KVL). For real-valued nodal potentials, KVL guarantees that potential differences sum to zero around any cycle. Similarly, phase differences (in the sense of counter-clockwise arc length) sum to an integer multiple of around any cycle. For example, suppose that is the triangle graph, consisting of a single cycle . Let . If there is an arc of length that contains , then . Otherwise, . Figure 2 (top) illustrates these three possible winding numbers, based on the configuration of phases around the cycle. Meanwhile, Figure 2 (bottom) illustrates for each .
The cycle basis of a graph is often non-unique, and each valid cycle basis leads to a different definition of the winding vector . However, it turns out that the equivalence classes of , namely the winding cells, do not depend on the particular choice of cycle basis. Given two cycle bases and , every winding cell based on is identical to a winding cell based on .
Physical Interpretation of Winding Vectors
Winding vectors are closely connected to net flows of active power around cycles in the network. These flows, called loop flows, are of considerable interest to the power systems community because they do not deliver useful power and can jeopardize system stability. For example, flows around the Lake Erie Loop were a major factor in the 2003 Northeast Blackout [15]. Rigorous connections between loop flows and winding vectors are discussed in detail in [18, 9, 17]. We here provide some basic intuition and show how to measure the initial winding vector using line flows, instead of the full state .
Consider the active power flows across each line given by (3). We assume that these flows are measurable, so that is known, even if the state is not. If , then (7) can be written
[TABLE]
If we ignore shunt and series losses by setting and , and we expand the arcsine function about the origin, we obtain
[TABLE]
The quantity is a normalized line flow, scaled by the capacity of the line. Thus, up to second order, the winding number is a normalized loop flow (at least in the case of short, lossless transmission lines). While somewhat informal, this analysis suggests that winding vectors are a quantized measure of these loop flows. We can also use (10) to infer the winding vector from line flow data. Therefore, like the vector of angle differences , we can identify the initial winding vector using measurements of line flows instead of the full state .
IV-B Improved Certificates
We have previously seen (in Theorems 4 and 6) how to certify transient stability and other desirable properties from the initial condition, using the measurable quantities and instead of the full state . As with and , the initial winding vector provides additional information that we can exploit to make guarantees about the transient. In the remainder of this section, we will show how to use the winding vector to obtain better certificates out of Theorems 4 and 6, replacing the antecedents of these theorems with less-conservative conditions.
The new conditions are straightforward to state and prove. We modify Theorem 4 to search over sets of the form instead of . Reducing the lower bound from to directly incorporates and results in a larger search space for , thereby expanding the set of cases that satisfy the antecedent of Theorem 4. Shrinking the upper bound from to is not strictly necessary, but as we will see later on, we can always find an optimal within this smaller upper bound. Similarly, we will modify Theorem 6 by adding a constraint to Problem 2 that forces the optimum to reside within :
Problem 3** (Min-Max Frequency Deviation, Exact).**
Let and . We define as the minimum value of Problem 2, under the additional constraint . If the problem is infeasible, we define .
The additional constraint confines the solution to , completely closing the gap between Problems 1 and 2:
Lemma 8** (Relations of Minima).**
Let , let , and let . The solutions to Problems 1, 2, and 3 are related by
[TABLE]
The proof is contained in Appendix A. We can now state the new transient stability certificates that account for the initial winding vector.
Theorem 9** (Certificates with Winding Vectors).**
Consider a trajectory of (4), and let be a cycle basis of the underlying graph. Let , , and denote the initial angle differences, max frequency deviation, and winding vector. Consider the following two conditions:
- (a)
There exist a vector and a set such that . 2. (b)
There exists a vector such that .
If either (a) or (b) are true, then statements (i)–(vii) from Theorem 4 hold, with respect to from condition (a) or from condition (b).
Proof.
The proof that statements (i)–(vii) follow from (a) is identical to the proof of Theorem 4, since the new upper and lower bounds on do not impact the argument for statement (i), and (because is still contained within ) they have no bearing on statements (ii)–(vii). We can use this result from condition (a) to prove that (i)–(vii) follow from condition (b). Let , and observe that due to Lemma 8. Then satisfies (a), so all of the statements hold. ∎
It is straightforward to show that these new conditions which incorporate are valid certificates for transient stability, but this is not enough—if we are to go to the trouble of measuring , we would like the assurance that this additional information actually leads to better transient stability certificates. With some simple but careful reasoning about the winding partition, we can see that (a) and (b) are less-conservative versions of the antecedents to Theorems 4 and 6, respectively:
Theorem 10** **(Theorem 9 is less conservative than Theorems
Consider a trajectory of (4), let be a cycle basis of the underlying graph, and let , , and . The following are true:
- (i)
If the hypothesis of Theorem 4 is satisfied, i.e., if there exist a vector and a set such that , then the set satisfies condition (a) of Theorem 9. 2. (ii)
If the hypothesis of Theorem 6 is satisfied, i.e., if there exists a vector such that , then satisfies condition (b) of Theorem 9.
Proof.
To prove (i), it is sufficient to show that , for which it is sufficient to show that . Because the winding cells partition , each of the sets are disjoint. In fact, because , the boundaries of these sets are non-overlapping. Since , we may conclude that itself is partitioned into non-overlapping pieces ; hence . Similarly, for (ii) it is sufficient to show that , which we have from Lemma 8. ∎
The initial winding vector provides an additional bit of information about the initial state , and like the vector of initial angle differences , the initial winding vector can be inferred from measurements of active power flows. With knowledge of , we can replace the set-theoretic certificate in Theorem 4 and the MILP certificate in Theorem 6 with the less-conservative conditions (a) and (b) of Theorem 9.
V Quantifying Robustness
An important task in power systems control is understanding how robust an operating point is to disturbances. It is straightforward to study the effects of a particular disturbance using simulation, but simulating a comprehensive set of contingencies (or combinations thereof) is time consuming. Our transient stability certificates can aid with this analysis by quantifying the scale of disturbances to which an operating point is robust.
In this section, we consider a DCMG that is operating at a synchronous state . At time , certain model parameters undergo an instantaneous perturbation—nominal injections change, for example, or a drop in nodal voltages or branch admittances occurs. The initial condition is no longer a synchronous state in the “post-fault” model. If the system is sufficiently resilient, then the post-fault transient will settle back down to a synchronous state, and none of the engineering constraints will be violated in the process—but this is not always the case. We will construct a sufficient condition for post-fault transient stability, based on the scale of the perturbations to model parameters.
Numerical Case Study
Throughout the section, we will illustrate our results using numerical examples from the IEEE-RTS 24-bus test case [12]. We parameterized (4) using branch and bus values from this test case, and we selected the initial voltage angles , voltage magnitudes, and nominal power injections by solving for the optimal power flow in MATPOWER. For simplicity, we chose uniform droop coefficients of and a uniform nominal frequency of . We will refer to this model as the “pre-fault” model. Note that is a synchronous equilibrium of the pre-fault model (since it solves the active power flow equations with nominal injections), and the initial winding vector is (corresponding to the winding cell with minimal loop flows).
Code
The code that we used to generate numerical results in this section is publicly available at https://github.com/KevinDalySmith/DCMG-transient-stability. The optimization problems are implemented using the Python interface to Gurobi 9.0, so a local installation of Gurobi and an active license are needed to run it.
V-A Evaluating Post-Fault Transient Stability
We begin by examining how Theorems 6 and 9 apply to the problem of quantifying system robustness. Both of these theorems certify transient stability if the post-fault initial condition (i.e., the pre-fault synchronous state) is sufficiently close to a post-fault synchronous state, as measured by the initial max frequency deviation, . Then transient stability is certified if there exists any such that or , as in the following example.
Example 11** (Certificates in the 24-Bus System).**
To illustrate Theorems 6 and 9 in the 24-bus system, we randomly select a set of 100 test points and evaluate and at each , with . Consider an arbitrary initial condition with a maximum angle difference and initial frequency deviation . Theorem 6 certifies transient stability of the resulting trajectory if
[TABLE]
Under the additional assumption that , Theorem 9 certifies transient stability if
[TABLE]
Figure 3 plots both of these conditions. Each curve plots the right-hand side of the preceding inequalities as a function of (using polytopic relaxations to the sine constraints). For any initial condition corresponding to a point below the curve, transient stability is certified.
The curve maximizing is significantly lower than the curve maximizing , i.e., the transient stability condition from Theorem 6 is more conservative than that from Theorem 9 (as guaranteed by Theorem 10). This plot makes a strong case for incorporating information from the initial winding vector—without it, only very small angle disturbances are certified in the 24-bus system.
In order to certify transient stability after a fault, we must ensure that the initial post-fault frequency deviation is below the critical threshold. One approach is to follow the procedure of Example 11: generate a plot similar to Figure 3 using the post-fault parameters, and check whether or not corresponds to a point below the curve. But this approach is cumbersome when considering a large number of contingencies, and it offers little advantage over simulation.
A much more efficient approach, similar to that in [26], is to define the “size” of a general disturbance and establish a threshold below which transient stability is certified in all disturbances that are “smaller” than the threshold. A natural way to define the size of a disturbance is to quantify its effect on the frequency deviation vector from (5). Suppose that is the frequency deviation vector field defined with the pre-fault model parameters, and similarly, let be the vector field defined with the post-fault parameters. If we can bound the difference , then we can bound the solutions to Problems 2 and 3 after the disturbance based on their solutions before the disturbance:
Theorem 12** (Robustness to Parameter Changes).**
Consider the model (4), and let be the associated frequency deviation vector. Let be a state for which , i.e., for which all nodal frequencies are identical to . After some perturbation in model parameters, suppose that the new frequency deviation vector is given by , and let and in the post-fault model. If there exists such that
[TABLE]
where either or , then the trajectory of the perturbed model starting from satisfies statements (i)–(vii) from Theorem 4 with respect to .
Proof.
Let be the feasible set of Problem 1 evaluated on the perturbed model, i.e., the set of points such that is pointed outward from . Then the solution to Problem 1 (evaluated on the perturbed model) is
[TABLE]
Given the initial condition to the perturbed model, the initial frequency deviation is , so applying (11) and the lower bound on , we obtain
[TABLE]
Therefore and satisfy the hypothesis of Theorem 4 in the perturbed model, and the theorem statements follow. ∎
Condition (11) bounds the scale of the perturbation . As we will see, in many cases, the left-hand size of the equation is straightforward to compute (or at least upper bound). The right-hand side of (11) is almost identical to either or (depending on whether is intersected with the winding cell); the only difference is that the “ is pointed outward from ” constraint is removed. It is straightforward to obtain a lower bound on with a minor relaxation to either or : simply remove the constraints from (6f) and (6g). This lower bound can be used in place of the left-hand side of (11).
In the IEEE 24-bus test case, we use random sampling to identify a point for which , with respect to the set , . The arc lengths in this particular range from 18.5 to 22.1 degrees, with a median of 20.3 degrees. Therefore, Theorem 12 guarantees that the IEEE 24-bus steady-state is robust to any perturbations in parameters for which .
In the remaining subsections, we will apply Theorem 12 to particular modes of disturbances: fluctuations in nominal power injections, changes in nodal voltages, and changes in branch admittances.
V-B Perturbations of Nominal Injections
Suppose that the perturbed model is identical to the original model, except the vector of nominal frequency deviations has been shifted to . It is then clear from (5) that the vector of frequency deviations suffers the perturbation . This quantity is constant, and condition (11) reduces to the condition
[TABLE]
for some , with . In the IEEE 24-bus test case, a sufficient condition is . The median bus in this test case has a nominal injection magnitude of , so our certificate guarantees that the system is robust to disturbances of in the nominal injection of this bus. Figure 4 plots the relative tolerance of all buses in the system.
V-C Perturbations of Voltage and Admittance Magnitudes
Next, we consider perturbations to nodal voltage magnitudes and branch admittance magnitudes. Both of these values are encoded in the and parameters, so these perturbations can be represented with perturbations and . The entries of the corresponding perturbation vector are
[TABLE]
For simplicity, assume that and (i.e., there is a loss in voltage magnitudes or branch admittances). In order to compute , we first compute using , so that
[TABLE]
Similarly, defining as an upper bound on for , we can bound
[TABLE]
Then condition (11) is satisfied if the sum of these two quantities is less than . Note that this condition is a set of linear constraints on and .
For a simple illustrative example, suppose that one particular bus suffers a loss in voltage magnitude, so that for some . Then , , and for all , while the remaining perturbations are zero. In the IEEE 24-bus test case, we compute the largest value of that satisfies the previous equation for each , using 0.0435 for the right-hand side of the bound. These largest are plotted in Figure 5. The median bus can tolerate a 1% loss of voltage magnitude before and violate the above bound. This is much more restrictive than the bound for nominal power injections, which is to be expected, given that we used a conservative upper bound on instead of the exact value.
VI Conclusion
In this paper, we study transient stability in power networks consisting of droop-controlled inverters and frequency-dependent loads. We extend the notion of transient stability to include not only frequency synchronization but also operating constraints on nodal frequencies, angle differences, power injections, ramping, and storage reserves. To analyze the transients, we introduce a physically-meaningful Lyapunov-like function, and we re-cast the transient stability problem as an optimization problem that admits an efficient relaxation. We show that incorporating information from loop flows (in the form of the winding vector) can make these transient stability certificates less conservative. Finally, we show how these certificates can be used to quantify the size of parameter disturbances to which the system is robust.
The model we use in this paper is, of course, a highly simplified model for frequency dynamics. Nonetheless, we hope that this paper provides a step toward understanding the fundamental behavior of future low-inertia power grids. Extensions of this work may offer rigorous answers to open theoretical questions about these systems. At what scale do the ubiquitous grid-following inverters harm system stability, and how can power engineers use droop-controlled inverters to mitigate this effect? How do legacy high-inertia generators affect transient behavior in power networks that are dominated by inverters? Future research may enrich this work with models of different types of generators, to better-understand frequency dynamics as power grids transition to low-inertia power sources.
Appendix A Proof of Lemmas 5 and 8
Proof of Lemma 5.
Let be the minimizing argument of Problem 1, let be the counterclockwise angle difference across each branch , and define , , and according to (6b)–(6d). Because , (6e) holds because , and there exists some edge such that . In the case where , let , so the two linear constraints in (6f) activate. The first constraint is just , which we have assumed is true. The second constraint, , holds because points outward from . Thus (6f) is satisfied, and (6g) and (6h) are satisfied by setting all other entries of and equal to zero. In the case where , we employ a complementary argument with . In both cases, all constraints are satisfied, so is feasible. Finally, the cost function (6a) is equal to (the cost function of Problem 1) when evaluated at . Hence .
To see that equality holds in the tree case, let us consider the argmin of Problem 2. Because is a tree and , there always exists for which for all . Then (6e)–(6h) ensure that , and (6a)–(6d) ensure that the cost function of Problem 2 is identical to . Hence if is acyclic. ∎
The proof of Lemma 8 proceeds similarly, but it uses some properties of the winding partition of the -torus. Readers unfamiliar with the winding partition are encouraged to read IV-A and glance at [17]. The property that we need is the following lemma, which shows how the winding partition relates to the boundaries of phase-cohesive sets:
Lemma 13**.**
Let be a winding cell, and let . Consider the set . Then .
Proof.
We first argue that . If , then for all (by the assumption that ). Then there is a neighborhood around within which the winding numbers around each cycle do not change, so belongs to the interior of a winding cell.
First, using elementary properties of topology, we have
[TABLE]
Because , we have that . Therefore, from the elementary property , we obtain the result . Furthermore, because but , we have that . Hence .
To show equality, we invoke the winding partition to write
[TABLE]
For , the sets and are disjoint, since we have shown that . Thus, intersecting both sides of the equation with , we obtain . This completes the proof. ∎
We now prove Lemma 8.
Proof of Lemma 8.
The statement that is obvious, since Problem 2 is a relaxation of Problem 3.
To show that , let be the minimizing argument of Problem 1. As in the proof of Lemma 5, select the values of the decision variables accordingly to satisfy (6b)–(6h), thereby ensuring that the cost function (6a) is equal to . Because , [17, Theorem 3.5] guarantees the existence of such that . Multiplying across by , we obtain
[TABLE]
We have performed two simplifications in this equation. First, is the cycle space, which is identical to [6, Theorem 9.5], so the term vanishes. Second, the summation structure in (7) implies that , so the orthogonal projection matrix has no effect on . Thus satisfies all of the constraints of Problem 3, so .
Next, we will show that . Let be the minimizing argument of Problem 3. Consider the equation . Note that , so we can decompose with and , and the equation can be split into and . The first equation has a unique solution , while the second equation is true because , so there is a unique point that satisfies . It follows from [17, Theorem 3.5] that there exists such that for all . From the remaining constraints in Problem 3, we can see that , so it follows from Lemma 13 that . Furthermore, the constraints imply that the velocity vector is pointed outward. Thus is within the feasible set of Problem 1, and the identical values of the cost functions imply that . ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] N. Ainsworth and S. Grijalva. A structure-preserving model and sufficient condition for frequency synchronization of lossless droop inverter-based AC networks. IEEE Transactions on Power Systems , 28(4):4310–4319, 2013. doi:10.1109/TPWRS.2013.2257887 . · doi ↗
- 2[2] T. Athay, R. Podmore, and S. Virmani. A practical method for the direct analysis of transient stability. IEEE Transactions on Power Apparatus and Systems , 98(2):573–584, 1979. doi:10.1109/TPAS.1979.31940 . · doi ↗
- 3[3] F. Blanchini and S. Miani. Set-Theoretic Methods in Control . Springer, 2015, ISBN 9783319179322.
- 4[4] P. Bonami, A. Lodi, A. Tramontani, and S. Wiese. On mathematical programming with indicator constraints. Mathematical Programming , 151:191–223, 2015. doi:10.1007/s 10107-015-0891-4 . · doi ↗
- 5[5] J. C. Bronski, T. Carty, and L. De Ville. Configurational stability for the Kuramoto–Sakaguchi model. Chaos: An Interdisciplinary Journal of Nonlinear Science , 28(10):103109, 2018. doi:10.1063/1.5029397 . · doi ↗
- 6[6] F. Bullo. Lectures on Network Systems . Kindle Direct Publishing, 1.4 edition, July 2020, ISBN 978-1986425643. With contributions by J. Cortés, F. Dörfler, and S. Martínez. URL: http://motion.me.ucsb.edu/book-lns .
- 7[7] M. C. Chandorkar, D. M. Divan, and R. Adapa. Control of parallel connected inverters in standalone AC supply systems. IEEE Transactions on Industry Applications , 29(1):136–143, 1993. doi:10.1109/28.195899 . · doi ↗
- 8[8] H.-D. Chiang, C. C. Chu, and G. Cauley. Direct stability analysis of electric power systems using energy functions: Theory, applications, and perspective. Proceedings of the IEEE , 83(11):1497–1529, 1995. doi:10.1109/5.481632 . · doi ↗
