Zero controllability in discrete-time structured systems
Jacob van der Woude

TL;DR
This paper explores how to select minimal driver nodes in discrete-time complex networks to ensure controllability near a linearization point, using graph-based conditions and algorithms.
Contribution
It introduces graph-based conditions and an algorithm for selecting minimal driver nodes to achieve controllability in nonlinear discrete-time networks.
Findings
Conditions for controllability via driver nodes are derived.
An algorithm for minimal driver node selection is proposed.
The approach ensures the network can be steered close to linearization.
Abstract
In this paper we consider complex dynamical networks modeled by means of state space systems running in discrete time. We assume that the dependency structure of the variables within the (nonlinear) network equations is known and use directed graphs to represent this structure. The dependency structure also appears in the equations of a linearization of the network. In order for such a linearization to be a good approximation of the original network, its state should stay as close as possible to the point of linearization. In this paper, we investigate how the latter can be achieved by an appropriate selection of states as driver nodes, so that through these driver nodes the whole state of the network can be steered to the point of linearization. We present conditions in graph terms for this to be possible and derive an algorithm for the associated driver node selection, possibly of…
Click any figure to enlarge with its caption.
Figure 2
Figure 4Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGene Regulatory Network Analysis · Nonlinear Dynamics and Pattern Formation · Control and Stability of Dynamical Systems
Zero controllability in discrete-time structured systems
Jacob van der Woude Jacob van der Woude is with DIAM, EWI, Delft University of Technology, Mekelweg 4, 2628 CD, Delft, the Netherlands, (email: [email protected])
Abstract
In this paper we consider complex dynamical networks modeled by means of state space systems running in discrete time. We assume that the dependency structure of the variables within the (nonlinear) network equations is known and use directed graphs to represent this structure. The dependency structure also appears in the equations of a linearization of the network. In order for such a linearization to be a good approximation of the original network, its state should stay as close as possible to the point of linearization. In this paper, we investigate how the latter can be achieved by an appropriate selection of states as driver nodes, so that through these driver nodes the whole state of the network can be steered to the point of linearization. We present conditions in graph terms for this to be possible and derive an algorithm for the associated driver node selection, possibly of smallest size.
I Introduction and motivation
In this paper we consider complex dynamical networks modeled by means of state space systems running in discrete time. We assume that we know how the equations describing the network look like, meaning that we know how the variables depend on each other. More specifically, we assume that we have an explicit difference equation for each of the variables and knowledge on which variables play a role in each of these equations. Hence, the dependency structure of the variables in the equations is assumed to be known.
In general, the network models are too large, too complicated and have too many unknown parameters, etc., to be studied or even to be used in practice. For this reason, we assume that we can approximate the network equations by linear ones, for instance, by linearizing them. In such linearizations, the equation structure follows from the dependency structure of variables within the equations of the original network. However, the coefficients in these linearized equations in general will have an unknown value. This is due to modeling errors, parameter uncertainties in the original network equations, etc. Nevertheless, although not known, the value of these coefficients will in general be nonzero. Hence, the result of the linearization of the network is a linear discrete-time model, with a known zero-nonzero coefficient structure for the equations, but with nonzero coefficients having an unknown value.
The obtained linear model is only valid in a neighborhood of the point of linearization. However, in general the size of this neighborhood is unknown. The linear model is a perfect approximation of the network when the state of the network is at the point of linearization or, said differently, when the state of the linearization is equal to zero. Hence, the linear approximation is a good representation of the original network model when its state is close to the zero state.
To that end, it would be useful if we could steer the state of the linearization to the zero state, and preferably in finite time. This is especially important in cases when this state is deviating from the zero state too much and may reach the (unknown) boundary of the region of linearization. This steering can be achieved by controlling (some of) the states in the network. Such states are then attached to controls and are called driver nodes in literature. A big question then is which states should actually be selected to become a driver state. Another question concerns the minimal number of driver nodes in order to have that the state can be steered to zero.
In this paper we will address the above questions and provide answers to them. To that end, we recall some aspects of zero controllability for discrete-time systems and connect them to the above questions.
The outline of this paper is as follows. In Section II we recall linear discrete-time systems and known results on zero controllability. In Section III we introduce the type of structured systems that we consider in this paper together with a graph representation, and some notions and results from graph theory. The introduced concepts are illustrated by means of an example. In Section IV we recall some of the well-known results on structural controllability for linear discrete-time structured systems. In Section V we present our main results in terms of necessary and sufficient conditions for a linear discrete-time structured system to be finite time zero controllable. The conditions will be stated in graph theory terms. In Section VI we use our main result to obtain a method for driver node selection such that the state can be steered to zero in finite time. Also the method will be illustrated by means of an example. The paper is concluded by means of Section VII containing remarks and topics for future research.
The current paper is partly based on the conference paper [8] where zero controllability (or deadbeat controllability) already was studied. The driver node selection aspect in the context of zero controllability is however completely new.
II Problem formulation
In order to address the questions raised in the introduction, we first consider the following class of linear discrete time systems
[TABLE]
with state and control . The variable stands for the discrete time, and for the time being and are real numerically specified matrices of dimensions and , respectively.
We recall that system (1) is said to be controllable if the state of the system (1) can be steered from any initial value at time to any final value value if there exists some finite time and a sequence of controls on times such that .
As a special case we call system (1) is finite time zero controllable if the state of the system (1) can be steered from any initial value at time to the zero state at some finite time .
Later in this paper we assume that only the zero-nonzero structure of matrix is known and that matrix is not present. The goal then is to find a matrix of certain structure, corresponding to a driver node selection, such that the zero controllability problem mentioned in the introduction can be solved.
It is easily seen from (1) that
[TABLE]
for all integer .
The next list of well-known equivalent statements can be proved.
Theorem 1
Given system (1) the following statements are equivalent.
- (i)
System (1) is controllable, 2. (ii)
, 3. (iii)
rank* for every eigenvalue of matrix ,* 4. (iv)
rank* for every .*
Using the expression in (2) with and the Cayley Hamilton theorem, the equivalence of statements and can be easily proved. The equivalence of statements and is immediate. The equivalence of statements and (or ) is known as the Hautus test for controllablity.
In a similar way it can be proved that the statements in the following theorem are equivalent.
Theorem 2
Given system (1) the following statements are equivalent.
- (i)
System (1) is zero controllable, 2. (ii)
, 3. (iii)
rank* for every nonzero eigenvalue of matrix ,* 4. (iv)
rank* for every .*
In fact, the equivalence of statements and in Theorem 2 again follows easily from (2) with and the Cayley Hamilton theorem. The equivalence of statements and (or ) follows from the Hautus test for stabilizability with only the origin in the complex plane as stability region.
From statement in Theorem 2 it is clear that a sufficient condition for system (1) to be zero controllable is that matrix is nilpotent, i.e., . In that case matrix can even be the zero matrix.
The latter is precisely the situation we mentioned in the introduction. Indeed, later in this paper we assume that we only know the zero-nonzero structure of matrix and that matrix is not present. Then we first check whether matrix is nilpotent in structural sense, meaning that this property only depends on the structure in , and not on the numerical values within this matrix. If it happens that matrix is nilpotent in structural sense, the system is generically zero controllable, even without using a control.f
However, if matrix is not nilpotent in structural sense, we will investigate how we should choose driver nodes, defining (the structure of) matrix , so that the system becomes generically zero controllable. Also we will be able to determine the minimal number of driver nodes needed for generic zero controllability.
III Structured systems and directed graphs
As indicated in the introduction, in many cases only the zero-nonzero structure of the matrices and is known. The actual value of the nonzero entries in the matrices is then not known exactly.
The zero-nonzero structure of the system matrices and can be represented by means of a directed graph. This directed graph will be denoted by with a vertex set and an edge set . Here denotes the set of state vertices, the set of input vertices, denotes an edge from to , denotes an edge from to , means that the -th entry of is a nonzero, and similarly for .
Given two vertices we say that there is a path in from to , or that can be reached from , if there are vertices such that , and for . The begin vertex of the path is and the end vertex is . The path then has length .
We say that a state vertex is reachable from the input vertices , if there is a path from some input vertex to that state vertex. Correspondingly, we call a state vertex unreachable from the input vertices , if the state vertex can not be reached from any input vertex. A path that starts in is also referred to as a -rooted path.
We also use the notion of cycle. A cycle is a path of which only the begin and end vertex coincide. Clearly, a cycle must have all its vertices in . Hence, a cycle is a collection of edges for such that vertices are mutually distinct and .
Occasionally, will be referred to as the weight of edge , and similarly for . The weight of a path is given by the product of the weights of the edges it consists of. It can be show that the -th entry of , denoted , can be obtained as the sum of the weights of all paths from vertex to vertex of length , and similarly for , being the -th entry of .
In this paper we also will consider the graph without taking into account the set of input vertices . Then, and .
Having introduced the reachability between vertices in , we define a maximal strongly connected component to be a largest set of vertices in , such that for any two vertices in there is a path from to , and a path from to , where the paths may have any length, including zero.
We say that a maximal strongly connected component is nontrival if it contains at least one edge between its vertices, otherwise it is called trivial. It follows easily that a trivial maximal strongly connected component must consist of just one vertex with no edges, i.e., no self loops.
The graph can be partitioned into a collection of maximal strongly connected components that can be ordered as follows. Given maximal strongly connected components , we define/denote if there is a path in from a (=any) vertex in to a (=any) vertex in . The partitioning into maximal strongly connected components can be done by means of well-known and efficient algorithms.
Example 1
Consider the pair of structured matrices given by
[TABLE]
where the ’s denote unknown nonzero entries. The graph of the corresponding system is displayed in Figure 1.
The collection of edges forms a -rooted path that ends in node and starts in . The path has length . The weight of the path will occasionally be indicated by . The path from node to node has length .
The collection of edges forms a cycle in the state node set . Also and are cycles in .
The -rooted path and the cycles and form a disjoint collection that covers every node of .
Note that the nodes and are reachable from . Node is not reachable from .
Ignoring the input node , the maximal strongly connected components are , , and . The sets and are nontrivial ones, whereas and are trivial maximal strongly connected components. The components are ordered as follows , and , implying that also and . Note that the set is a strongly connected component, that however is not maximal, i.e., is not as large as possible.
Finally, note that entry of equals .
IV Generic results
In this section we recall some results on generic controllability. Also we present a result on the nilpotency of a square structured matrix. Therefore, we assume that from now on that we only know the zero-nonzero structure of the matrices and , forming a structured pair and defining a structured system of type (1).
We say that a pair of numerically specified matrices is admissible to the structured pair , if can be obtained from by fixing each of the nonzeros in the matrices and to a numerical value.
IV-A Controllability
We say that the structured pair is generically controllable if almost all admissible pairs are controllable in the usual sense, i.e., im or, equivalently, rank for every eigenvalue of . Here ’almost all’ means ’all except for those in some proper algebraic variety (a set of zero measure) in the set of all admissible pairs’. It can be shown that if there is one admissible pair that is controllable, then almost all admissible pairs are controllable, see [4].
To present graph theoretic conditions for the generic controllability of a structured system we need two notions.
First, we say that the structured pair is reducible, if there is a permutation matrix such that
[TABLE]
with an matrix, , an matrix and . If such a permutation does not exist, we say that the structured pair is irreducible.
Next, we define the generic rank of the structured matrix to be the maximum of the ranks of the matrices , taking into account all pairs that are admissible to the structured pair . We denote this rank by g-rank .
We can now formulate the next well-known result, see [2], [3], [7].
Theorem 3
The structured pair , with , is generically controllable if and only if the following two conditions hold.
- (i)
The structured pair is irreducible, 2. (ii)
g-rank .
Note that if the structured pair is reducible, the associated system (1) can be rewritten as
[TABLE]
where and , with , are subvectors of obtained by a permutation of the components of .
Clearly, if the goal is to send each component of to zero, this also has to apply to the components of and . For this means that matrix should be such that this happens automatically for any initial condition. Such behaviour will be investigated in more detail in the next subsection.
IV-B Nilpotency
We are going to focus on the original system (1) without taking the control into account. Hence, we are going to look at system
[TABLE]
and investigate when the solution of this equation, i.e., , goes to zero in a finite number of steps. Loosely, the latter means that has to be nilpotent or, equivalently, that only has the eigenvalue [math].
Now recall that matrix is structured. Following [3], let stand for the largest order of a principal minor of matrix that is not identically equal to zero. According to Lemma 2 of [3], matrix generically has eigenvalues that are nonzero and mutually distinct, whereas the remaining eigenvalues are all located at [math].
Hence, it follows that if and only if is generically not nilpotent. Indeed, if , then generically has at least one eigenvalue that is nonzero, implying that is generically not nilpotent. Conversely, if is generically not nilpotent, then generically has at least one nonzero eigenvalue, implying that .
From the proof of Lemma 2 in [3], it follows that the characteristic polynomial of matrix has the form det, where is a polynomial with a generic degree and mutually distinct zeros not located at zero.
The next result relates to a property of the graph of matrix .
Theorem 4
Let be a structured matrix. Then if and only if the graph of matrix contains no cycles.
Proof Let be the -th entry of matrix . As indicated before, the entry is equal to the sum of the weights of all paths of length from vertex to vertex . Since does not contain any cycle, there is a maximum to the length of any path in , say the maximum length is . It then follows that with has to be zero. Indeed, the entry can be seen as the sum of the weights of paths of length that each are zero because the paths can be thought of as being composed of edges of which at least one is nonexisting with zero weight. Hence, it follows that for all and all . It even follows that the weight of the individual edges in is irrelevant. Hence, any matrix that is admissible to is nilpotent and has only eigenvalues at [math]. However, by Lemma 2 of [3], the latter can only happen if .
Assume there exists a cycle in of some positive length. Now set the weight of the edges in the cycle to some (random) nonzero value and set the weight of all other edges equal to zero. Then an admissible matrix is found with a nonzero principal minor which easily can be shown to have a positive order, implying that . The latter implies that , which contradicts the fact that .
V Generic zero controllability
In this section we combine the results of the previous sections and we derive a method to determine whether or not a system is generically zero controllable. First we define what we mean by generic zero controllability.
We say that the structured pair is generically zero controllable if almost all pairs admissible to are zero controllable in the usual sense, i.e., im or, equivalently, rank for every nonzero eigenvalue of .
Now consider a structured pair and assume that is not irreducible. So, there exists a permutation matrix such that
[TABLE]
with and irreducible. The latter can always be accomplished.
It now clearly follows that g-rank for all if and only if g-rank and g-rank for all . The latter means that generically does not have any eigenvalues that are nonzero, which can only happen if and only if . Indeed, if , then generically has at least one eigenvalue not equal to zero. Conversely, if generically has a nonzero eigenvalue, then there is a principle minor of positive order, implying that .
To come to our conditions we now recall one of the results of [3]. See also [6] (proposition 14.5) and [9] (theorem 6.2), where extensions of the next result are discussed.
Proposition 1
Let be the graph of the structured system described by the pair . If is irreducible, then generically rank for all .
Recalling that in decomposition (4) the pair is irreducible, we therefore have with decomposition (4) that g-rank for all if and only if g-rank for all . The condition that g-rank for all is automatically fulfilled by the irreducibility of . The condition that g-rank for all is equivalent to , which by Theorem 4 means that the part of the graph that is not reachable from does not contain any cycle.
To present results in graph terms we decompose with , where denotes the set of reachable states from and denotes the set of unreachable states from . Next we remove from all vertices in , together with all edges that have a vertex in as begin or as end vertex. We denote the graph that remains by . Clearly represents the part of that is not reachable from .
We can summarize our observations as follows.
Theorem 5
Let be the graph of the structured system described by the pair with the part of that is not reachable from . The structured pair is generically zero controllable if and only if contains no cycles.
Example 1. (cont.): Note that in Example 1 the unreachable part consists of {\cal G}_{u}=\big{(}\{x_{5}\}, \{(x_{5},x_{5})\}\big{)}. Since it contains a cycle the system in Example 1 is not generically zero controllable. However, when in Example 1 the entry is replaced by a fixed zero, then does not contain a cycle anymore and the system does become generically zero controllable.
The above theorem is important in the development of an algorithm to select driver nodes to make a system become generically zero controllable.
VI Driver node selection
We consider a system of the form
[TABLE]
and assume that matrix is a structured matrix. The objective is to find a driver node selection such that with the induced structured matrix a structured system is obtained that is generically zero controllable. To that end, we consider the index as introduced before.
If , then the above objective is realized, because matrix is nilpotent in structural sense, and the associated structured system is generically zero controllable automatically, even without using control. By Theorem 4 it can be checked easily whether or not .
If , then by Theorem 4, the graph contains cycles and can be decomposed into maximal strongly connected components of which at least one is nontrivial, i.e., contains a cycle. Then to achieve the above objective some driver nodes should be selected, defining matrix , such that the associated system becomes generically zero controllable.
Recall that if the graph of matrix contains cycles, then they are contained in the nontrivial maximal strongly connected components. Hence, by Theorem 5, a driver node selection to achieve generic zero controllability should have an unreachable part that does not contain any of the nontrivial components or, equivalently, should have a reachable part that contains all nontrivial components. Trivial components may appear in the unreachable part, since they don’t contain any cycle.
To formulate the latter in graph terms, let be the graph of the structured system described by matrix with state vertex set . Let be a given driver node selection and decompose as with the set of states that are reachable from and the other vertices. Like before, remove from all nodes in and all edges with begin or end node in . Denote the the remaining graph by . It can be thought of as the part of that is not reachable from . Then the application of Theorem 5 can formulated as follows.
Corollary 1
Consider the graph of matrix and let be a driver node selection. Denote for the part of that is not reachable from . Then the system is generically zero controllable using the driver nodes in if and only if contains no cycle.
To achieve generic zero controllability a driver node set can be selected as follows.
Algorithm 1
Given the structured system with matrix and associated graph .
- •
If contains no cycles, then the system is generically zero controllable automatically.
- •
If does contain cycles, search for a driver node selection such that every cycle is reachable from one of the nodes in . For a minimal driver node selection look for the smallest of such driver node selections.
Remark 1
The minimal number of driver nodes to solve the problem of generic zero controllability equals the minimal number of nodes from which all nontrivial components in the associated graph can be reached. Because of the aperiodic structure in which the (non)trivial maximal strongly connected components can be arranged the computation of a minimal driver node set can be done by means of efficient methods.
Example 2
Consider the system with the structured matrix
[TABLE]
where the ’s denote unknown nonzero entries. The graph of the corresponding system is displayed in Figure 2 in which also the trivial and nontrivial maximal strongly connected components are indicated.
Taking as a driver node selection, it follows that the conditions in Corollary 1 are not met. Indeed, in the associated subgraph there is for instance a cycle at node , i.e., a self loop . Furthermore, this unreachable graph contains the cycle . Also is not yet an adequate driver node selection, because the associated subgraph still contains a cycle at node .
It is easily seen that any driver node set that meets the conditions of Corollary 1 should contain node . Further, nodes should be at least reachable from a suitable set of driver nodes. Note that through these nodes then also nodes are reachable from the selected driver nodes. So, for instance, is a suitable driver node set to make the system generically zero controllable, since all cycles can be reached from these nodes.
A smaller suitable driver node is , or alternatively with . All make that the system becomes zero controllable, and all contain the minimal number of driver nodes to do so.
Occasionally the relation between driver nodes and controls is defined in different ways. One definition requires that one control can be used to steer all driver nodes. Another definition requires each driver node to have its own control. This difference leads to different matrices to achieve generic zero controllability. For the minimal driver nodes selection , given in Example 2, the previous two definitions lead to the following versions of the structured matrix
[TABLE]
respectively.
VII Concluding remarks
The idea underlying this paper is to keep a linear approximation of a complex real-life discrete time network valid as long as possible. This can be done by keeping the state of the associated linearization at zero or having that it goes to zero in a finite number of steps. The latter happens automatically for systems of which the matrix of the associated linearization is structurally nilpotent. The graph of such systems does not contain any cycle. For systems where the previous is not the case state nodes may have to be selected as driver nodes to control the entire system. The objective then is to select these driver nodes such that the state of the linearization can be steered to zero in finite time. The latter can be achieved if the driver nodes are selected in such a way that all cycles in the graph of the system can be reached from these nodes. The selection of these nodes and the minimal number to achieve the desired behaviour is described in this paper. From the paper it follows that for achieving generic zero controllability the connectability of the graph of the system is most relevant. The latter is in contrast with recent results on controllability of complex networks where the focus is more on the generic rank of the structured system matrices, cf. [5]. A topic for future research may be a classification of nodes into essential, useful and useless driver nodes for achieving generic zero controllability.
VIII Acknowledgement
The topic of this paper is inspired by the bachelor thesis of Tim den Haan, cf. [1], who is greatly acknowledged for the nice collaboration during his project. Further, the author wants to thank Christian Commault and Taha Boukhobza for useful remarks made in the process of writing this paper.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] T.R.B. den Haan. Nulbestuurbaarheid met behulp van grafen. Bachelor thesis of TU Delft, June 2016.
- 2[2] J. M. Dion, C. Commault, and J. van der Woude. Generic properties and control of linear structured systems: a survey. Automatica , 39(7):1125–1144, 2003.
- 3[3] S. Hosoe and K. Matsumoto. On the irreducibility condition in the structural controllability theorem. IEEE Trans. Automat. Control , AC-24:963–966, 1979.
- 4[4] C. T. Lin. Structural controllability. IEEE Trans. Automat. Control , 19(3):201–208, 1974.
- 5[5] Y. Y. Liu, J. J. Slotine, and A. L. Barabasi. Controllability of complex networks. Nature , 473:167–173, 2011.
- 6[6] K. Murota. Systems Analysis by Graphs and Matroids , volume 3 of Algorithms and Combinatorics . Springer-Verlag New-York, Inc., 1987.
- 7[7] K.J. Reinschke. Multivariable control: a graph-theoretic approach . Springer Verlag, 1988.
- 8[8] J.W. van der Woude. Deadbeat control for linear structured systems. In IFAC Symposium Systems Structure and Control , pages 90–97, 1997.
