Coherence in Synchronizing Power Networks with Distributed Integral Control
Martin Andreasson, Emma Tegling, Henrik Sandberg, Karl H. Johansson

TL;DR
This paper analyzes frequency control in power networks, showing that distributed averaging PI control outperforms centralized and standard methods, especially as network size grows, with demonstrated benefits on the Nordic power grid.
Contribution
It introduces and compares distributed averaging PI control with centralized and droop control, highlighting superior transient performance and scalability in power network synchronization.
Findings
DAPI control outperforms CAPI and droop control in transient performance.
Performance of CAPI and droop control worsens with larger networks.
Simulations confirm advantages of DAPI on the Nordic power grid.
Abstract
We consider frequency control of synchronous generator networks and study transient performance under both primary and secondary frequency control. We model random step changes in power loads and evaluate performance in terms of expected deviations from a synchronous frequency over the synchronization transient; what can be thought of as lack of frequency coherence. We compare a standard droop control strategy to two secondary proportional integral (PI) controllers: centralized averaging PI control (CAPI) and dis- tributed averaging PI control (DAPI). We show that the performance of a power system with DAPI control is always superior to that of a CAPI controlled system, which in turn has the same transient performance as standard droop control. Furthermore, for a large class of network graphs, performance scales unfavorably with network size with CAPI and droop control, which is not the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Coherence in Synchronizing Power Networks
with Distributed Integral Control
Martin Andreasson, Emma Tegling, Henrik Sandberg and Karl H. Johansson M. Andreasson, deceased, was with the School of Electrical Engineering and the ACCESS Linnaeus Centre, KTH Royal Institute of Technology, Stockholm, Sweden. He sadly passed away after the completion of this work. E. Tegling, H. Sandberg and K.H. Johansson are with the same organization. Corresponding author: E. Tegling ([email protected])This work was supported in part by the European Commission, the Knut and Alice Wallenberg Foundation, by the Swedish Research Council through grants 2014-6282 and 2013-5523, and by the Swedish Foundation for Strategic Research.
Abstract
We consider frequency control of synchronous generator networks and study transient performance under both primary and secondary frequency control. We model random step changes in power loads and evaluate performance in terms of expected deviations from a synchronous frequency over the synchronization transient; what can be thought of as lack of frequency coherence. We compare a standard droop control strategy to two secondary proportional integral (PI) controllers: centralized averaging PI control (CAPI) and distributed averaging PI control (DAPI). We show that the performance of a power system with DAPI control is always superior to that of a CAPI controlled system, which in turn has the same transient performance as standard droop control. Furthermore, for a large class of network graphs, performance scales unfavorably with network size with CAPI and droop control, which is not the case with DAPI control. We discuss optimal tuning of the DAPI controller and describe how inter-nodal alignment of the integral states affects performance. Our results are demonstrated through simulations of the Nordic power grid.
I Introduction
Maintaining the frequency close to its nominal value is one of the key control objectives in alternating current (AC) power systems. This is traditionally achieved through a hierarchy of control actions, starting with decentralized primary control (droop control), via the secondary control layer with the automatic generation control (AGC) to the tertiary control layer, where an optimal economic dispatch of generators takes place [1]. These control layers operate at different time scales and, traditionally, with different degrees of centralization. In light of ongoing developments in power systems, in particular large-scale integration of distributed generation sources, recent years have seen an increased interest for more flexible, distributed schemes for optimal frequency control.
On the one hand, this problem has been addressed through online optimization techniques that exploit the frequency dynamics of the power network, see e.g. [2, 3, 4, Li2014Connecting]. These approaches include load-side frequency control [2, 3], as well as adaptations of the AGC to incorporate the optimal dispatch problem [Li2014Connecting], and are typically based on primal-dual gradient methods. Another line of research has studied various integral control strategies, which address the secondary control problem, that is, to adjust the steady-state frequency reached through droop control to the desired setpoint [5, 6, 7, 8, 9, 10]. Among the proposed controllers are fully decentralized proportional integral (PI) controllers, which have been shown to suffer from poor robustness properties and typically lead to sub-optimal power injections [8, 9]. When complemented by a distributed averaging of the integral state, however, these controllers eliminate frequency errors while maintaining optimality properties, in what is often referred to as power sharing [6, 7].
In this paper, we consider one such distributed averaging PI (DAPI) controller, and compare it to a centralized averaging PI (CAPI) controller as well as to standard droop control, with respect to their control performance. Specifically, we study a network of synchronous generators modeled by coupled swing equations, and evaluate the systems’ transient performance under these control laws, after being subjected to random step disturbances in the power loads. We study performance in terms of expected deviations from a synchronous frequency over the transient, or in other words, the level of coherence in the network frequency.
The concept of coherence has been widely used to study performance of networked control systems, in particular, in order to point at fundamental limitations in large-scale networks [11, 12]. In the context of power networks, related metrics have been used to characterize transient performance in terms of losses due to non-equilibrium power flows [13, 14, 15, 16]. These metrics have also served as performance criteria in inertia-allocation problems [17] and have been used to evaluate the efficiency of primal-dual algorithms for optimal frequency control [18]. In all of these works, the performance metric can be cast as an norm of an input-output system where the output typically captures phase angle deviations.
The performance metric we propose in this paper differs subtly, but in important respects, from these previous works. Firstly, it captures deviations in frequency, rather than phase angles, and therefore represents a more direct notion of control performance and coherence, given the control objective of maintaining a uniform frequency over the power network. Secondly, we model step changes in loads, as opposed to impulses or white noise, and the proposed metric can therefore not be directly formulated as an norm.
Our main result shows, to begin with, that CAPI control has the same transient performance as primary droop control. This can be understood by the fact that the secondary control input in CAPI is equal at all nodes, and therefore, while it shifts the equilibrium, it does not affect how fast it is reached. Furthermore, and more importantly, we show that the performance of DAPI control is always superior to that of CAPI and droop control. In particular, and in contrast to the results in [14, 15], their respective control performance scales differently with network size. For instance, in sparse network topologies, this may imply an unbounded growth of expected frequency deviations with CAPI or droop control, while they remain bounded for any number of generators with DAPI control.
The DAPI controller is distinguished from the decentralized PI-controller through the distributed averaging of the integral state, which improves robustness and power sharing properties. In this paper, we discuss optimal tuning of this distributed averaging with respect to performance, and extend a related analysis carried out in [15]. It turns out that, for highly damped systems, the theoretical performance is optimized by setting the distributed averaging gain to zero, leading to decentralized PI control. For other cases, we show that this optimal gain is relatively small. This indicates a trade-off between transient performance and robustness to measurement bias, which will be explored in future work.
The remainder of this paper is organized as follows. We introduce the problem setup and performance metric in Section II. In Section III, we calculate the performance metric for the different controllers, and in Section IV, we discuss optimal tuning of the DAPI controller. We present a numerical simulation in Section V and conclude in Section VI.
II Problem setup
II-A Definitions
Let denote the identity matrix of dimension . A column vector of dimension whose elements are all equal to is denoted , and an by matrix whose elements are all equal to is denoted . Denote by .
II-B Droop controlled power system
Consider a network of synchronous generators modeled by a graph , where is the set of generators, and is the set of network lines. We here assume a Kron-reduced network model (see, e.g. [19]), in which constant-impedance loads have been absorbed into the line models in . The neighbor set of generator in is denoted .
Each generator , here referred to as a bus, is assumed to obey the swing equation, as described in [1]
[TABLE]
where is the voltage phase angle and is the frequency deviation at bus , in which is the nominal frequency (typically 50 Hz or 60 Hz). The constants and are, respectively, the inertia and damping (droop) coefficients, and is the power load at bus . We denote by the input from the secondary controller, which, for the droop-controlled system is not present, so . The constants are edge weights, where is the voltage magnitude at bus , and is the susceptance of the line . By linearizing (1) around the equilibrium where , and making use of the shifted frequency , we write the linearized swing equation as
[TABLE]
By defining , and , we may rewrite (2) in vector form:
[TABLE]
where , , and is the weighted Laplacian matrix whose elements if and if . The vector of loads is denoted , and contains the secondary controller inputs. Note that if no secondary controller is present.
II-C CAPI controller
The droop-controlled power system () can be shown to return to a stable operating point. However, since droop control is effectively a proportional control law, the equilibrium will in general not be the desired operating point . This can be overcome by designing the secondary control input to make the only stable equilibrium of (). That can be achieved by adding an averaging integral control term, resulting in a centralized averaging proportional integral (CAPI) controller, which was proposed in [20]. The CAPI controller requires the control signal to be computed centrally through integration of the average frequency deviation and, subsequently, to be broadcast to all generators. The controller takes the form:
[TABLE]
where is a controller gain. By substituting for in (2), we obtain the following closed-loop dynamics in vector form:
[TABLE]
We remark that this control design assumes that all generators take equal part in the secondary frequency control. The design can, however, be generalized to arbitrary positive weights for each bus, see [9, 21].
II-D DAPI controller
DAPI controllers have recently been proposed for frequency control of synchronous generator networks as well as for microgrids [6, 7, 10]. By including a distributed averaging of the integral states instead of centralized averaging, this controller structure eliminates the need for a central control entity and can be implemented in a distributed fashion. The DAPI controller takes the form
[TABLE]
where and are positive gains and is the set of generators that generator can communicate with. The communication graph is assumed to be undirected and connected, i.e., implies and there exists a path along the communication graph connecting any two generators in .
The DAPI controller has been shown to achieve the important property of stationary power sharing, implying that the generated power of all generators is equal at steady state [6, 7]. It can also be modified to achieve weighted power sharing [6].
By substituting for in (2), we obtain the closed-loop dynamics in vector form as
[TABLE]
where is the weighted graph Laplacian of the communication network, defined in analogy to , and .
II-E Decentralized PI controller
A special case of the DAPI controller is obtained when , i.e., there is no averaging of the integral states. In this case the DAPI controller reduces to a decentralized PI (DePI) controller. DePI controllers have been proposed for frequency control of power networks [22, 20], however, their implementation requires phasor measurements at every node. Furthermore, the power sharing property that is achieved by the DAPI controller is not in general achievable through DePI control [23]. The DePI controller takes the form
[TABLE]
where are positive controller gains.
II-F Performance metric
We use an integral metric to compare transient performance of the closed-loop systems of Sections II-B–II-D. Let the synchronization performance of an arbitrary system be given by
[TABLE]
where the expectation is taken over the power load, which is assumed to be a Gaussian zero-mean random variable with unit covariance, i.e.,
[TABLE]
The initial state is assumed to be the origin. The metric (3) can be interpreted as the expected total deviation from a synchronous frequency, normalized by the number of generators. As such, it characterizes the level of coherence in the network frequency over the transient. This performance metric does not require the synchronous frequency to equal the nominal frequency, or even to be constant. It is therefore well-defined for a large class of frequency controllers. In particular, this metric enables the comparison between the transients of droop-controlled generators and secondary controllers, even though the former will not synchronize at in general. The performance metric (3) can be written in vector-form as
[TABLE]
where
[TABLE]
We will refer to the metric (3) as a synchronization norm and note that it is related to, but distinct from a standard norm metric. Specifically, the integral (3) would correspond to an norm of a system with output (5) if the input were either white process noise or impulses at time , see [14] for details. We argue that the random step disturbance in the load that we consider here is a more relevant input in the power system context. We remark, however, that this performance analysis will characterize the system performance under “normal” operation, i.e. small step disturbances, but does not necessarily give insights to the system’s robustness towards extreme transient stability events.
The proposed metric (3) is a suitable indicator of the transient performance of a power network, as it relates directly to the control objective of frequency synchronization. A large synchronization norm (3) indicates lack of frequency coherence, i.e., non-fulfillment of the control objective. Defining a corresponding metric based on phase deviations, as suggested in previous work [14, 17, 16], does not capture this notion of frequency coherence.
III Evaluating performance
In this section, we compute the performance metric (3) for the closed-loop power system controlled with, respectively, a droop controller, a CAPI controller, and a DAPI controller. We first make the following assumptions that will be assumed to hold henceforth, in order to obtain closed-form expressions for the performance metric.
Assumption 1** (Uniform system parameters).**
The inertia constants , the damping constants , as well as the controller gains are uniform across the network and given by , and , respectively.
Assumption 2** (Communication topology).**
The communication graph used in the DAPI controller resembles that of the power network. That is, for all , or equivalently . The parameter can be thought of as a communication gain that governs the speed of the distributed averaging filter of the DAPI controller.
The following theorem summarizes the main result of this section.
Theorem 1** (Performance calculation).**
Let Assumptions 1 and 2 hold. The performance of the droop-controlled power system () and the CAPI controlled power system () is equal, and given by
[TABLE]
The performance of the DAPI controlled power system () is given by
[TABLE]
Proof.
Consider first the droop controlled power system () with load input and output given by (5). Similar to [13], we begin by performing the state transformations: , , where is the unitary matrix that diagonalizes , i.e., , in which is a diagonal matrix of the eigenvalues of . Let the first column of , , be the eigenvector corresponding to , so . It is easily verified that is invariant under this unitary transformation. In the new coordinates and by Assumption 1, the dynamics of the droop-controlled power system become
[TABLE]
where . Since and , we conclude that .
The system () consists of decoupled subsystems, meaning that , where is given by
[TABLE]
and
[TABLE]
for . Since , we have that . The equilibrium of () is verified to be
[TABLE]
It follows that the synchronization norm can be equivalently obtained by instead considering the dynamics in the translated states
[TABLE]
with initial condition given by (8). We recognize that is then given by the squared -norm of the translated system, whose transfer function is . This -norm can be calculated by, e.g., solving the Lyapunov equation for
[TABLE]
after which the norm is given as . In our case, , and summing over yields the expression (6). The synchronization norm (7) for the DAPI controlled system () is obtained through analogous calculations.
Now consider the CAPI controlled system (). By similar calculations as before, we transform the state to obtain decoupled subsystems. These are given by
[TABLE]
since is parallel to , and by
[TABLE]
for . Since () is unobservable and the systems () and () are identical for , it follows that . ∎
It is clear from Theorem 1 that if the damping is the same for both systems. We conclude that the synchronization performance of the DAPI controller is always superior to that of the droop and CAPI controllers. Perhaps surprisingly, the CAPI controller does not offer a benefit compared to the droop controller in terms of the performance metric (3). This can be understood by noting that CAPI only introduces integral feedback control on the average state, and affects all buses equally. It therefore does not affect the synchronization itself, but rather shifts the equilibrium point.
III-A Implications for large-scale networks
The results in Theorem 1 have implications for how well the control laws scale to large networks. In particular, it is easily shown that for any underlying network graph . That is, for any finite , the synchronization norm for DAPI remains bounded, even as the number of generators increases. For CAPI and droop control, on the other hand, , an expression that in many cases scales unfavorably in .
The expression appears often in the coherency literature, and is related to the concept of total effective resistance in resistor networks. As such, a number of recent studies have focused on characterizing bounds and scalings for this expression in various types of networks, see [11, 12, 24]. While the interested reader is referred to these works for details, we note here that their results imply that grow unboundedly with the network size for certain sparse network graphs. Examples of such graphs are tree graphs or graphs that can be embedded in two-dimensional lattices [12, 24].
The unfavorable scaling of the droop and CAPI controllers’ performance implies an increasing lack of coherence as the number of generators increases. Therefore, these control laws are not as scalable to large networks as DAPI control, unless the underlying graphs are densely interconnected.
IV Optimizing DAPI performance
In the previous section, we showed that the DAPI controller outperforms the droop and the CAPI controllers in terms of transient synchronization performance. We now focus on optimizing the performance of the DAPI controller by tuning its parameters. By Assumptions 1 and 2, this reduces to optimizing over (positive) and , assuming that the inertia and the damping are fixed.
We begin this discussion by considering the function
[TABLE]
from the denominator of (7). We note that , implying that for a communication gain and an inverse integral gain ,
[TABLE]
Similarly . Thus for any fixed and for ,
[TABLE]
that is, the performance of the DAPI controller approaches that of the CAPI (or, equivalently, droop) controller. This is expected, as increasing the communication gain in the DAPI controller to infinity implies arbitrarily fast distributed averaging, ultimately resembling centralized averaging like in CAPI control. On the other hand, setting , which can achieve zero synchronization cost, is not practically feasible as it would require infinite control effort. A question of practical relevance is therefore that of choosing the optimal given a fixed . To address that question, we begin by focusing on a special case.
IV-A Special case: complete graphs
We first consider the case in which the power network can be modeled as a complete graph. We further assume that the edge weights for all are uniform and equal to . For this graph, the Laplacian eigenvalues satisfy . Therefore, minimizing is equivalent to maximizing from (9), with . In this case, we can derive a closed-form expression for the optimal value of , denoted , depending on the network parameters and the gain :
Theorem 2** (Optimizing performance in complete graphs).**
Let Assumptions 1 and 2 hold. Assume furthermore that the power network is a complete graph and that the edge weights are uniform and equal to . Let the integral controller gain be fixed. Then, if , the value of that minimizes is . Otherwise the optimal choice of is
[TABLE]
Proof.
We rewrite as
[TABLE]
and note that maximizing is equivalent to minimizing
[TABLE]
Differentiating with respect to and setting the derivative equal to zero yields which implies
[TABLE]
From the above equation we conclude that there is a positive extreme point if and only if . Furthermore, and , so clearly the positive extreme point is a local minimum. It follows that the positive extreme point minimizes if , and otherwise is minimized by the lower end point of the interval, namely . Recalling that for concludes the proof. ∎
Theorem 2 answers the question of when DAPI control has a theoretical performance superior to DePI control. If the damping is sufficiently large, the optimal value of is zero and thus the DePI controller minimizes the synchronization norm. If, on the other hand, the damping is sufficiently small, the optimal value of is nonzero.
We also note that the optimal increases with increasing and with decreasing , that is, with decreasing integral gain or damping. An intuitive explanation for this can be given as follows. A smaller damping or integral gain will cause disturbances to spread across the network rather than to be suppressed locally. A DAPI controller with large communication gain anticipates this spreading by faster distributing the integral control action across the generators.
Further, it can be shown that, given a fixed and , the largest possible value for is attained when , and is . Therefore, if the number of generators grows large, or if or are large, will approach zero. On the other hand, when , and are instead small, so that , is also zero, as seen from Theorem 2. In conclusion, the averaging taking place within the DAPI controller is of most importance for medium-sized power grids with moderate susceptances and inertia.
We note that a result similar to that of Theorem 2 was proposed in [15] for a different performance metric and input scenario. The optimal value for in the complete graph case is the same in both cases. This shows that choosing the parameter as is relevant with respect to several performance metrics.
It is, however, important to remember that the results of Theorem 2 do not take the control cost into account. In particular, the DAPI controller is, thanks to its power sharing properties, known to minimize the static generation cost, whereas the DePI controller does not possess this desirable property. The optimality of the DePI controller with respect to minimizing the synchronization norm should thus be seen in light of the DAPI controller’s ability to minimize generation costs.
IV-B General connected graphs with arbitrary susceptances
In this section, we generalize the results in Section IV-A to power networks with general underlying graph structures. This implies that the eigenvalues for will in general not be equal, and minimizing is not equivalent to maximizing . The following theorem summarizes when there is a positive , when it is zero, and when the optimum must be evaluated on a case-by-case basis.
Theorem 3** (Optimizing performance in general graphs).**
*Let Assumptions 1 and 2 hold. The optimal choices of are as follows:
If for all then*
[TABLE]
if for then
[TABLE]
and if for all , then
[TABLE]
Proof.
The case when is trivial since is then minimized by for all , by the proof of Theorem 2. Now consider the case when . Assume for the sake of contradiction that . This would imply that \frac{\partial g_{i}(\gamma,q)}{\partial\gamma}\big{|}_{\gamma=\gamma^{\star}}<0 for , and hence cannot be the minimizer of . The remaining cases are proven similarly. ∎
V Simulations
We consider a model of the Nordic power transmission network, consisting of generators. For simplicity we assume uniform generator inertia and damping, specifically and . The admittances of the power transmission lines were assumed to be proportional to their inverse physical length. We simulate the response of the network after a random step disturbance on the load, taken from a normal distribution, with, respectively, the droop controller and the DAPI controller. For the DAPI controller, we set .
The responses are shown in Fig. 1, where two different choices of have been used. In Fig. 2, the corresponding (squared) control error of the droop controlled and the DAPI controlled systems are compared for different choices of . It is clear that a smaller value of substantially improves performance, as predicted by Theorem 3. The same theorem predicts a large to be the optimal choice as the inertia and the gain increase. In this case, however, DAPI offers only a marginal performance improvement, as a large makes DAPI similar to CAPI control.
VI Discussion
In this paper, we have studied the dynamic performance of synchronizing power networks by means of a coherency measure, which can be evaluated using an -norm framework. We showed that the performance of a power system controlled with DAPI control is always superior to that of a droop controlled as well as a CAPI controlled system for the same system and controller parameters. The performance of the respective controllers also scales differently with network size. Therefore, the advantage of DAPI control has the potential to become increasingly accentuated as the number of generators grows, for example, through large-scale integration of distributed generation sources. This is because the performance metric may grow unboundedly with CAPI or droop control, while it remains bounded with DAPI. We note that this result stands in contrast to previous work that has evaluated performance in terms or transient power losses [13, 14, 15], where the losses, when normalized by the number of generators, always remained bounded.
It was shown in Section IV that the optimal choice of the communication gain is zero in many cases, which would result in a decentralized proportional integral (DePI) controller. This, however, proves problematic as constant measurement noise can destabilize DePI controllers, unless phase measurement units are deployed at every node [23]. Clearly, a positive , that ensures that the DAPI controller is robustly stable, must be chosen, although it may be suboptimal with respect to the performance metric considered here. A characterization of the performance of the DAPI controller under measurement noise is left as future work.
Acknowledgements
We would like to thank John W. Simpson-Porco for his insightful comments and a number of interesting discussions.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] J. Machowski, J. Bialek, and J. Bumby, Power System Dynamics: Stability and Control . Wiley, 2008.
- 2[2] C. Zhao, U. Topcu, N. Li, and S. Low, “Design and stability of load-side primary frequency control in power systems,” IEEE Trans. Autom. Control , vol. 59, no. 5, pp. 1177–1189, May 2014.
- 3[3] E. Mallada, C. Zhao, and S. Low, “Optimal load-side control for frequency regulation in smart grids,” in 52nd Annual Allerton Conference on Communication, Control, and Computing , Sept 2014, pp. 731–738.
- 4[4] X. Zhang and A. Papachristodoulou, “A real-time control framework for smart power networks,” Automatica , vol. 58, no. C, pp. 43–50, Aug. 2015.
- 5[5] Q. Shafiee, J. C. Vasquez, and J. M. Guerrero, “Distributed secondary control for islanded microgrids - a networked control systems approach,” in IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society , Oct 2012, pp. 5637–5642.
- 6[6] J. W. Simpson-Porco, F. Dörfler, and F. Bullo, “Synchronization and power sharing for droop-controlled inverters in islanded microgrids,” Automatica , vol. 49, no. 9, pp. 2603 – 2611, 2013.
- 7[7] M. Andreasson, D. Dimarogonas, K. H. Johansson, and H. Sandberg, “Distributed vs. centralized power systems frequency control,” in European Control Conf. , July 2013, pp. 3524–3529.
- 8[8] M. Andreasson, D. V. Dimarogonas, H. Sandberg, and K. H. Johansson, “Distributed PI-control with applications to power systems frequency control,” in American Control Conf. , June 2014, pp. 3183–3188.
