Synthesis for observability of logical control networks
Kuize Zhang

TL;DR
This paper investigates how to synthesize control strategies to ensure observability in logical control networks (LCNs), using semitensor products and observability graphs, with algorithms to verify and enforce observability.
Contribution
It introduces a novel synthesis method for observability in LCNs using state feedback with exogenous input, including bounds and algorithms for practical verification.
Findings
State feedback can both enforce and weaken observability.
Unobservable LCNs can be made observable by feedback, with or without exogenous input.
An observability synthesis algorithm based on bounds, greedy, and dynamic programming methods.
Abstract
Finite-state systems have applications in systems biology, formal verification and synthesis of infinite-state (hybrid) systems, etc. As deterministic finite-state systems, logical control networks (LCNs) consist of a finite number of nodes which can be in a finite number of states and update their states. In this paper, we investigate the synthesis problem for observability of LCNs based on state feedback with exogenous input by using the semitensor product proposed by Daizhan Cheng and the notion of observability graph (previously called weighted pair graph) proposed by us. We show that state feedback with exogenous input can either enforce or weaken observability of an LCN. We prove that for an LCN and another closed-loop LCN obtained by feeding a state-feedback controller with exogenous input into , (1) if is observable,…
| Def. 2.4 | Def. 2.3 | Def. 2.5 | Def. 2.2 | |
| Fornasini and Valcher [21] | ||||
| Li et al. [49] | ||||
| Zhang and Zhang [36] | ||||
| Zhang and Zhang [22] | ||||
| weighted pair graph (WPG, ) | ||||
| (renamed observability graph in [17, 37]) | ||||
| Li et al. [23] | ||||
| computational algebra | ||||
| (very fast in sparse BCNs) | ||||
| Cheng et al. [38] | ||||
| observability matrix | ||||
| (i.e., adjacency matrix of WPG) | ||||
| Zhu et al. [39] | ||||
| observability graph (i.e., WPG) | ||||
| Cheng et al. [40] | ||||
| set controllability | ||||
| Guo [42] | ||||
| parallel extension | ||||
| (i.e., adjacency matrix of WPG) |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications
Synthesis for observability of logical control networks
Kuize Zhang [email protected]
Department of Computer Science, University of Surrey, Guildford GU2 7XH, UK
Abstract
Finite-state systems have applications in systems biology, formal verification and synthesis of infinite-state (hybrid) systems, etc. As deterministic finite-state systems, logical control networks (LCNs) consist of a finite number of nodes which can be in a finite number of states and update their states. In this paper, we investigate the synthesis problem for observability of LCNs based on state feedback with exogenous input by using the semitensor product proposed by Daizhan Cheng and the notion of observability graph (previously called weighted pair graph) proposed by us. We show that state feedback with exogenous input can either enforce or weaken observability of an LCN. We prove that for an LCN and another closed-loop LCN obtained by feeding a state-feedback controller with exogenous input into , (1) if is observable, then can be either observable or not; (2) if is not observable, can also be observable or not. We also prove that if an unobservable LCN can be made observable by state feedback with exogenous input, then it can also be made observable by state feedback (without exogenous input, equivalent to state feedback with constant input). Furthermore, we give an upper bound on the number of state-feedback controllers that are needed to be tested in order to verify whether an unobservable LCN can be made observable by state feedback, and based on the procedure of obtaining the upper bound, we design an observability synthesis algorithm, by additionally combining the ideas of a greedy algorithm and dynamic programming. These results open the study of observability synthesis in LCNs.
keywords:
logical control network, observability, state feedback, synthesis, semitensor product, observability graph
\savesymbol
AND \savesymbolOR \savesymbolNOT \savesymbolTO \savesymbolCOMMENT \savesymbolBODY \savesymbolIF \savesymbolELSE \savesymbolELSIF \savesymbolFOR \savesymbolWHILE
††thanks: The author discussed these issues with Dr. Karl Henrik Johansson at KTH Royal Institute of Technology, and is grateful to him for his suggestions.
1 Introduction
1.1 Background
Finite-state systems have applications in many areas such as formal verification and synthesis of infinite-state (hybrid) systems [1, 2, 3], systems biology [4], etc.
As special deterministic finite-state systems in which all nodes can be only in one of two states, Boolean control networks (BCNs) were proposed to describe genetic regulatory networks [5, 6]. In a BCN, nodes can be in one of two discrete states “” and “[math]”, which represent a gene state “on” (high concentration of a protein) and “off” (low concentration), respectively. Every node updates its state according to a Boolean function of the states of several of the network nodes. Although BCNs are a simplified model of genetic regulatory networks, they can be used to characterize many important phenomena of biological systems, e.g., cell cycles [7], cell apoptosis [8]. Hence the study on BCNs has been paid wide attention [9, 10, 11, 12].
A logical control network (LCN) is also a deterministic finite-state system but naturally extends a BCN in the sense that the nodes of the former can be in one of a finite number (but not necessarily ) of states [13]. From a practical point of view, LCNs can be used to describe more biological systems than BCNs. However, under the semitensor product (STP) framework, they have the same algebraic form [13], hence they can be dealt with by using the same method. In this paper, we study LCNs.
In 2007, Akutsu et al. [14] proved that it is -hard to verify whether a BCN is controllable in the number of nodes, hence there exists no polynomial-time algorithm for determining controllability of BCNs unless . They also pointed out that “One of the major goals of systems biology is to develop a control theory for complex biological systems”. Later in 2013, Laschov et al. [15] proved that it is also -hard to verify whether a BCN is observable in the number of nodes. These -hardness results show that it is generally intractable to verify controllability and observability for large-scale BCNs (those with more than approximately nodes, i.e., more than states), and also stimulate explorations on how to design efficient verification algorithms that work on large-scale BCNs with special structures, e.g., in [16, 17].
Recently, a control-theoretic framework for BCNs based on the STP of matrices (proposed by Cheng [18] in 2001) was established by Cheng and Qi [19] in 2009. Although the STP method cannot make the generally intractable problems related to BCNs become tractable, it provides a matrix method for characterizing BCNs, so that many matrix-based techniques in control theory can be used to study BCNs. As a result, it stimulates the studies on control problems of BCNs based on diverse methods, e.g., controllability [19, 20], observability [19, 21, 22, 23], reconstructibility [21, 24], identifiability [25, 26], invertibility [27], Kalman decomposition [28], disturbance decoupling [29], and other related results [30, 31, 32, 33, 34]. Among these results, some was worked out based on a computational-algebra method [23], some based on finite automata and graph theory [22, 24], some based on the STP and graph theory [21], and some based on symbolic dynamics [27, 35].
1.2 Literature review
Among many control properties, controllability and observability are the most fundamental ones. The former implies that an arbitrary given state of a system can be steered to an arbitrary given state by some input sequence. The latter implies that the initial state can be determined by a sufficiently long input sequence and the corresponding output sequence. The importance of controllability and observability of BCNs can be found in [14] and [8], etc. Lack of these properties makes a system lose many good behaviors. So, it is important to investigate how to enforce controllability and observability, e.g., by means of feedback and controller synthesis. Matrix forms of necessary and sufficient conditions for controllability of BCNs were given in [19, 20]. Necessary and sufficient conditions for observability of BCNs are much more difficult to obtain, and furthermore, there exist nonequivalent definitions of observability in BCNs, e.g., it was proven in [22] that four definitions of observability are pairwise nonequivalent, showing that observability is not dual to controllability, remarkably differentiating BCNs from linear control systems. A summary on necessary and sufficient conditions of different definitions of observability of BCNs is given in Table 1. In [36, 22], a notion of weighted pair graph was proposed (later it was renamed observability graph in [17, 37]), and verifiable necessary and sufficient conditions for four definitions of observability (shown in Definitions 2.2, 2.3, 2.4, 2.5) were obtained by computing different types of deterministic finite automata from an observability graph adapted to the four definitions of observability. Later on, the observability graph was used in many papers to solve related problems, e.g., [38] (the observability graph was called observability matrix therein, the set of diagonal vertices and the set of non-diagonal vertices in an observability graph (see Definition 2.6) are exactly the set and the set in [38, Page 78]), [39, 17] (called observability graph therein), [40, 41]111 [41, Theorem 1] is a special case of [22, Theorem 3.15] (i.e., Lemma 2.7)., [42, 43] (called parallel extension therein), [44]. In addition, the non-diagonal subgraph of an observability graph (see Definition 2.6) was proposed in [24] (called weighted pair graph therein, later renamed reconstructibility graph in [17] and detectability graph in [37]) to verify two definitions of reconstructibility of BCNs (the stronger one was earlier studied in [21]). Recently, a variant of the reconstructibility graph was used to study reconstructibility of singular Boolean control networks [45], where such networks are a subclass of nondeterministic finite-transition systems [46] by definition.
Observability results have also been extended to nondeterministic finite-transition systems (NFTS’s) [46] and probabilistic Boolean networks (PBNs) [47, 43, 48, 44], where the stochastic switching signals in PBNs are independent and identically distributed processes, hence the PBNs are actually discrete-time finite-state time-homogeneous Markov chains. Moreover, if all probabilities in such a PBN are removed then it becomes an NFTS in which the input is constant. That is, the systems considered in [46] are more general than the systems considered in [47, 43, 48, 44]. In [46], the notion of observability graph was extended from BCNs to NFTS’s, where the matrix in Eqn. (5) of [46] is the adjacency matrix of the (extended) observability graph of an NFTS. By additionally computing different types of deterministic finite automata from an observability graph, verifiable necessary and sufficient conditions were given for Definitions 2.2, 2.3, 2.5 extended to NFTS’s. In [47, 43, 48, 44], three definitions of observability for PBNs were studied: observability in probability on with (see notation in Section 2.1), finite-time observability in probability, and asymptotic observability in distribution. The main results in [43, 44] were obtained by using the observability graph (called parallel extension in [43]). Later, by definition we will show that the first two of the above three definitions of observability in PBNs are actually a slightly stronger version of Definition 2.3 and Definition 2.3 itself, in BCNs, respectively. We will also point out that the results in [44] already show that the third one is also a slightly stronger version of Definition 2.3 of BCNs. That is, the probabilities in the PBNs studied in [47, 43, 48, 44] play no role in adding stochasticity when studying observability. See Remark A.1, in which the deterministic essence of observability of PBNs studied in [47, 43, 48, 44] is revealed.
1.3 Potential applications
The verification problem for controllability or observability of (infinite-state) hybrid systems is generally undecidable. If one can construct an LCN as a finite abstraction that (bi)simulates a given hybrid system in the sense of preserving controllability or observability, then one can verify controllability or observability for the hybrid system by verifying the LCN. An attempt of using a similar scheme to verify opacity of (infinite-state) transition systems can be found in [50]. Related results on using finite abstractions to do verification or synthesis for infinite-state systems can be found in [51, 52], etc.
As for the synthesis problem, it is known that for linear control systems, state feedback with exogenous input does not affect controllability, but may affect observability [53]. However, both properties may be affected by state feedback with exogenous input for nonlinear control systems and hybrid systems. By using a simulation-based method, if one can construct an LCN as a finite abstraction that (bi)simulates a given unobservable hybrid system in the sense of preserving observability, then one can first try to find a state-feedback controller to make the obtained unobservable LCN observable, and then refine the obtained controller into the original hybrid system so as to make the original hybrid system observable. Here we do not mention controllability because state feedback with exogenous input cannot enforce controllability for LCNs but sometimes can weaken their controllability [54]: If an LCN is not controllable, then no state-feedback controller with exogenous input can make it controllable; if an LCN is controllable, then there may exist a state-feedback controller with exogenous input that makes the LCN uncontrollable.
1.4 Contribution
The main contributions of this paper are as follows: Let be an LCN and an LCN obtained by feeding a state-feedback controller with exogenous input into .
We prove that state feedback with exogenous input sometimes can enforce observability of LCNs. If is observable, then can be either observable or not; if is unobservable, then can also be either observable or not. 2. 2.
We prove that if an unobservable can be made observable by state feedback with exogenous input, then it can also be made observable by state feedback (without exogenous input, equivalent to state feedback with constant exogenous input). This result yields an algorithm for verifying whether an unobservable LCN can be made observable by state feedback with exogenous input, since there are finitely many state-feedback controllers (although there are infinitely many state-feedback controllers with exogenous input). 3. 3.
We also obtain an upper bound on the number of state-feedback controllers that are needed to be substituted into an unobservable LCN to check whether can be made observable by state feedback, and based on the procedure of obtaining the upper bound, we design an observability synthesis algorithm, by additionally combining the ideas of a greedy algorithm and dynamic programming, opening the study of observability synthesis in LCNs.
The above (1) had been presented at the 58th IEEE Conference on Decision and Control 2019 [54] and are also illustrated in Table 2. The other contributions show substantially new results compared with (1).
The remainder of this paper is organized as follows. Section 2 introduces preliminaries, i.e., LCNs with their algebraic form under the STP framework, basic verification methods for observability of LCNs. The main results are shown in Section 3. Section 4 is a short conclusion.
2 Preliminary results
2.1 The semitensor product of matrices
We introduce necessary notation as follows.
- •
and denote subset and strict subset relations, respectively
- •
: power set of set
- •
: set of positive integers
- •
: set of natural numbers (including [math])
- •
: set of -length real column vectors
- •
: set of real matrices
- •
: set of -value logic
- •
: -th column of the identity matrix
- •
:
- •
: set ()
- •
: , where and
- •
: logical matrix , where
- •
: set of logical matrices
- •
: -th column of matrix
- •
: set of columns of matrix
- •
: transpose of matrix
- •
: cardinality of set
- •
:
Definition 2.1** ([55]).**
Let , , and be the least common multiple of and . The STP of and is defined as
[TABLE]
where denotes the Kronecker product.
From this definition, it is easy to see that the conventional product of matrices is a particular case of the STP, since if then . Since the STP keeps most properties of the conventional product, e.g., the associative law [37]222In [55], the associative law was proven in the special case that divides (or vice versa) and divides (or vice versa), where and are the numbers of columns of and , respectively, and are the numbers of rows of and , respectively., the distributive law, etc. [55], we usually omit the symbol “” hereinafter.
2.2 Logical control networks and their algebraic form
In this paper, we investigate the following LCN with state nodes, input nodes, and output nodes:
[TABLE]
where denote discrete time steps; , , and denote values of state node , input node , and output node at time step , respectively, , , ; ; ; ; and are logical mappings, , .
When , Eqn. (1) is a BCN.
Eqn. (1) can be represented in the compact form
[TABLE]
where ; , , and stand for the state, input, and output of the LCN at time step ; and are mappings.
For each greater than , we map in to in for all , and write . Then under the STP framework, Eqn. (2) can be transformed to its equivalent algebraic form as follows [55]:
[TABLE]
where ; , , ; and are called the structure matrices, , .
2.3 Preliminary results for observability
In [36, 22], four types of observability were verified for BCNs by proposing a unified automaton method (computing four types of deterministic finite automata from the observability graph (proposed in [36, 22] and called weighted pair graph therein, and renamed observability graph in [17, 37]) of a BCN to verify the corresponding four types of observability). In this paper, we are particularly interested in the linear type (as in Definition 2.2, i.e., the strongest one among the four types, earlier studied in [21]), as if an LCN satisfies this observability property, it is very easy to recover the initial state by using an input sequence and the corresponding output sequence. Note that all results in [36, 22] can be trivially extended to LCNs. The necessary and sufficient condition for Definition 2.2 given in [21] is as follows: a BCN satisfies Definition 2.2 if and only if for every pair of different periodic (state, input)-trajectories of the same minimal period and the same input trajectory, the corresponding output trajectories are also different and periodic of minimal period . Obviously, the necessary and sufficient condition given in [21] is much more complex than the one given in the subsequent Lemma 2.7 [22].
The four types of observability studied in [36, 22] are as follows (also see Table 1). We adopt the terminology used in [37].
Definition 2.2**.**
*An LCN (2) is called arbitrary-experiment observable if for all different initial states , for each input sequence , the corresponding output sequences and are different. *
Definition 2.3**.**
An LCN (2) is called multiple-experiment observable if for very two different initial states , there is an input sequence such that the output sequences corresponding to and are different. Such an input sequence is called a distinguishing input sequence of and .
Definition 2.4**.**
An LCN (2) is called strongly multiple-experiment observable if for every initial state , there exists an input sequence such that for each initial state different from , the output sequences corresponding to and are different.
Definition 2.5**.**
An LCN (2) is called single-experiment observable if there exists an input sequence such that for every two different initial states , the output sequences corresponding to and are different.
From now on when we mention “observability”, we always mean Definition 2.2 unless otherwise stated.
Now we introduce the notion of observability graph.
Definition 2.6**.**
[36, 22]** Consider an LCN (2). A triple is called its observability graph if (elements of are called vertices) is equal to 333vertices are unordered state pairs, i.e., ., (elements of are called edges) is equal to , and the weight function assigns to each edge a set of inputs. A vertex is called diagonal if , and called non-diagonal otherwise. For a vertex , its outdegree is , i.e., the number of inputs appearing in the edges starting from . The diagonal subgraph of an observability graph is defined by all diagonal vertices and all edges between them. Similarly, the non-diagonal subgraph is defined by all non-diagonal vertices and all edges between them.
Lemma 2.7** ([22]).**
An LCN (2) is not observable if and only if in its observability graph there is a non-diagonal vertex , a cycle , and a path from to a vertex of . Particularly if in there exists a path from to a diagonal vertex, then (2) is not observable.
Since in a diagonal subgraph, there must exist a cycle and each vertex will go to a cycle, we will denote the subgraph briefly by a symbol when drawing an observability graph. Hence if there exists an edge from a non-diagonal vertex to a diagonal vertex, then the LCN is not observable.
Example 2.8**.**
Consider the BCN
[TABLE]
where , , , . Consider the output function
[TABLE]
where , , . The observability graph of BCN (4) with output function (5) is shown in Fig. 1. This graph shows that the BCN is not observable by Lemma 2.7 since there is a self-loop on non-diagonal vertex .
3 Synthesis results for observability
In this section, we show synthesis results for observability of LCN (2) (or its algebraic form (3)) based on state feedback with exogenous input.
3.1 Closed-loop logical control networks by state feedback with exogenous input
Consider an LCN (2). Let a state-feedback controller with exogenous input be
[TABLE]
where is the exogenous input, with each greater than (corresponding to new input nodes); or , which means that there is only one constant input; is a mapping. Equivalently in the algebraic form, for an LCN (3), we set a state-feedback controller with exogenous input to be
[TABLE]
where , is called the structure matrix, , .
In particular, when , a state-feedback controller with exogenous input is called a state-feedback controller. When and , controller (7) will not change the algebraic form of the original LCN, and hence will not change controllability or observability of the LCN.
Suppose we are free to modify LCN (2) by setting controller (6). Substituting (6) into (2), we obtain a closed-loop LCN (see Fig. 2 for a sketch) as
[TABLE]
Equivalently, substituting (7) into (3), we obtain the algebraic form of the closed-loop LCN (8) as
[TABLE]
Proposition 3.1**.**
Eqn (9) is equivalent to
[TABLE]
**Proof ** By Lemmas A.2 and A.3, (9) can be rewritten as
[TABLE]
Consider the newly obtained LCN (10), if , then the corresponding structure matrix is square. However, generally the structure matrix is not necessarily square, hence the updating of states generally depends on the exogenous input .
3.2 How state feedback influences observability of LCNs
Unlike controllability, we next give an example to show that state feedback with exogenous input can enforce observability of an LCN.
Example 3.2**.**
We have proved that BCN (4) with the output function (5) is not observable in Example 2.8.
Substituting the controller
[TABLE]
where , , , into (4) to obtain the closed-loop BCN
[TABLE]
where . The observability graph of BCN (12) with output function (5) is shown in Fig. 3. This graph shows that the BCN is observable by Lemma 2.7.
Next we show that a state-feedback controller can make an observable LCN unobservable.
Example 3.3**.**
Consider the LCN
[TABLE]
where , , .
The observability graph of (13) consists of vertex and the diagonal subgraph , and there is no path from to . Then by Lemma 2.7, the BCN is observable.
Substituting state-feedback controller
[TABLE]
into (13), by Proposition 3.1, we obtain LCN
[TABLE]
There is a self-loop on vertex in the observability graph of (14), then by Lemma 2.7, (14) is not observable.
Next we show that there exists an unobservable LCN such that no state-feedback controller with exogenous input can make it observable. This example also shows that sometimes state feedback with exogenous input never affects observability of LCNs.
Example 3.4**.**
Consider the BCN
[TABLE]
where , , , .
By Lemma 2.7, the BCN with output function (5) is not observable, since there exists a path in its observability graph.
Substituting an arbitrary state-feedback controller with exogenous input , where , , is an arbitrary positive integer, into (15), by Proposition 3.1, we obtain closed-loop LCN
[TABLE]
where , .
The observability graph of (16) with output function (5) contains a path , then the LCN is not observable by Lemma 2.7.
Based on the above discussion, we know that state feedback with exogenous input sometimes can enforce observability of an LCN, sometimes cannot. Next we study when a state-feedback controller can enforce observability.
3.3 Controller synthesis for enforcing observability of LCNs
The following main result shows that in order to test whether an unobservable LCN can be made observable by state feedback with exogenous input, it is enough to check whether the LCN can be made observable by state feedback.
Theorem 3.5**.**
Consider an unobservable LCN (3). If it can be made observable by a state-feedback controller (7) with exogenous input, then it can also be made observable by a state-feedback controller (i.e., (7) with ).
**Proof ** Assume an unobservable LCN (3) and a controller (7) that makes (3) observable. Then by Lemma 2.7, in the observability graph of the corresponding closed-loop LCN obtained by substituting (7) into (3),
[TABLE]
Now consider the structure matrix of (7), we choose a new state-feedback controller
[TABLE]
where is arbitrarily given, and consider the observability graph of the closed-loop LCN obtained by substituting (18) into (3).
It can be seen that the vertex sets of and coincide, since and have the same output function. One also sees that for every two vertices and in the vertex set, if there exists an edge from to in , then there also exists an edge from to in , i.e., the edge set of is a subset of that of . Hence also satisfies (17), and is also observable by Lemma 2.7.
Because there are infinitely many state-feedback controllers with exogenous input, generally one cannot directly check whether an unobservable LCN can be made observable by state feedback with exogenous input. However, by Theorem 3.5, one can do the above check because there are totally finitely many state-feedback controllers. Formally, the following Theorem 3.6 holds.
Theorem 3.6**.**
An unobservable LCN (3) can be made observable by state feedback with exogenous input if and only if it can be made observable by state feedback.
By Proposition 3.1 and the proof of Theorem 3.5, the following result holds. The subsequent discussions on observability synthesis will be based on this result.
Theorem 3.7**.**
An LCN (3) can be made observable by state feedback with exogenous input if and only if there exist such that the BN
[TABLE]
is observable.
Remark 3.1**.**
In order to verify whether an unobservable LCN (3) can be made observable by state feedback, one should substitute several state-feedback controllers into the LCN, and then check whether there exists an observable closed-loop LCN. Now we analyze how many state-feedback controllers should be substituted into the LCN in order to do the verification.
Consider LCN (3), it is sufficient to substitute state-feedback controllers into the LCN to do the above verification. It is because, in order not to do repetitive check, for every two of the chosen state-feedback controllers, where their structure matrices are and , respectively, they must satisfy (see (19))
[TABLE]
which means the obtained closed-loop LCNs are different. On the other hand, in order not to lose any necessary check, it is sufficient to choose state-feedback controllers every two of which satisfy (20) to do the above check.
Next we give some special conditions for whether an unobservable LCN can be made observable by state feedback, which can be checked under much less computational cost than the equivalent condition in Theorem 3.7. In addition, using these conditions we can furthermore reduce the number (shown in Remark 3.1) of state-feedback controllers that are needed to be substituted into the unobservable LCN to do the above check.
Theorem 3.8**.**
Consider an unobservable LCN (3). The LCN cannot be made observable by any state-feedback controller if at least one of the following holds.
- (i)
* satisfies for some different and some , where .* 2. (ii)
There exist different such that and , or and , where .
**Proof ** Assume (i) holds, then in the observability graph of the closed-loop LCN obtained by feeding an arbitrary state-feedback controller into the original unobservable LCN, there exists an edge , where is a diagonal vertex. Then by Lemma 2.7, no obtained closed-loop LCN is observable.
Assume (ii) holds, then in the observability graph of the closed-loop LCN obtained by feeding an arbitrary state-feedback controller into the original unobservable LCN, there exists a self-loop on the non-diagonal vertex , then also by Lemma 2.7, no obtained closed-loop LCN is observable.
By Theorem 3.8 and the previously obtained results, we show how to furthermore reduce the number (shown in Remark 3.1) of state-feedback controllers that are needed to be substituted into an unobservable LCN to check whether the LCN can be made observable by state feedback. Consider an unobservable LCN (3) and a state-feedback controller
[TABLE]
where , . Substituting (21) into (3), we obtain a closed-loop LCN
[TABLE]
by Proposition 3.1, which is consistent with Eqn. (19).
Denote
[TABLE]
where are distinct. For each , we denote
[TABLE]
The collection of state sets partitions .
In order to make (22) observable, we must assume that for each , for all different with , it holds that . Otherwise, in the observability graph of (22), there exists an edge , where is a non-diagonal vertex, and is a diagonal vertex, which shows that (22) is not observable by Lemma 2.7. Hence in order to make (22) observable, we must furthermore assume that
[TABLE]
i.e., with are distinct.
The above analysis yields the following result stronger than the first implication of Theorem 3.8 (i.e., (i) implies that (3) cannot be made observable by any state-feedback controller).
Theorem 3.9**.**
Given an unobservable LCN (3), assume there exists ( is defined in (23)) such that for all ( is defined in (24)), , then (3) cannot be made observable by any state-feedback controller.
**Proof ** Consider an arbitrary given state-feedback controller (21) and the corresponding closed-loop LCN (22) obtained by substituting (21) into the unobservable (3). By assumption, there exists and different such that and . Hence in the observability graph of (22), there exists an edge , where is a non-diagonal vertex, is a diagonal vertex. By Lemma 2.7, (22) is not observable.
Remark 3.2**.**
Theorem 3.9 is stronger than the first implication in Theorem 3.8, because (i) in Theorem 3.8 is stronger the assumption in Theorem 3.9, but they have the same conclusion (i.e., (3) cannot be made observable by any state-feedback controller).
Based on these analysis, the following result holds.
Theorem 3.10**.**
Consider an unobservable LCN (3). In order to verify whether (3) can be made observable by state feedback, it is sufficient to substitute
[TABLE]
state-feedback controllers of the form (21) into (3) to check whether there exists an observable closed-loop LCN, where
[TABLE]
* is defined in (23), and are defined in (24). In addition, for every two of the above (26) chosen state-feedback controllers, their structure matrices and must satisfy*
[TABLE]
for some . Particularly, if (26) is equal to [math], then the unobservable LCN (3) cannot be made observable by state feedback.
**Proof ** Firstly, observe that if (26) is equal to [math], then the assumption in Theorem 3.9 is satisfied, and then the unobservable LCN (3) cannot be made observable by state feedback.
On the contrary, if the assumption in Theorem 3.9 is not satisfied, then for all , there exist such that
[TABLE]
which implies that . Hence (26) is greater than [math].
Secondly, if (26) is greater than [math], we can find state-feedback controllers such that the observability graphs of the obtained closed-loop LCNs must not have an edge from a non-diagonal vertex to a diagonal vertex. We check whether some of these closed-loop LCNs is observable. In order not to do repetitive check, for every two of the found state-feedback controllers, where their structure matrices are denoted by and , respectively, they must satisfy that there exists such that (28) holds, which implies that the obtained two closed-loop LCNs are different. On the other hand, in order not to lose any necessary check, it is sufficient to choose (26) state-feedback controllers every two of which satisfy (28) to do the above check.
Remark 3.3**.**
It is easy to see that (26) is no greater than the number shown in Remark 3.1, hence Theorem 3.10 strengthens the result shown in Remark 3.1.
Note that the above number (26) is obtained by avoiding the existence of an edge from a non-diagonal vertex to a diagonal vertex in the observability graph of an obtained closed-loop LCN. In addition to avoiding this, we must also avoid the existence of cycles in the non-diagonal subgraphs of the observability graphs, so the minimal number of state-feedback controllers that are needed to do the above check could be further reduced.
In the remainder of this section, we give an observability synthesis algorithm based on Lemma 2.7 and the results obtained in Section 3.3. To this end, we first give a motivating example.
3.4 A motivating example
Example 3.11**.**
Consider the following LCN
[TABLE]
where , , . In the observability graph of (29), there exists a path
[TABLE]
hence (29) is not observable by Lemma 2.7.
Next we try to find a state-feedback controller (if any)
[TABLE]
to make (29) observable, where .
We might as well firstly choose . Substituting this controller into (29), we obtain the closed-loop LCN
[TABLE]
The observability graph of (31) (shown in Fig. 4) contains self-loops in its non-diagonal subgraph, hence (31) is not observable by Lemma 2.7.
Secondly, we try to modify to make (29) observable. The basic idea guiding us to choose new is to remove all self-loops and all edges from a non-diagonal vertex to a diagonal vertex in Fig. 4. Since there exists a self-loop on vertex originally, we keep invariant, and change from to , then the self-loop on is changed to an edge . Since there also exists a self-loop on vertex originally, we change to , then the self-loop on is changed to an edge . Now consider vertex . Since originally goes to the self-loop on , we change from to , then there exists no edge from vertex to any vertex. After doing these modifications, there exists no edge from vertex to any vertex (originally there is a path from to the diagonal subgraph), there is a path from to , and there exists no edge from to any vertex (originally there is a self-loop on ).
Now we substitute the new state-feedback controller
[TABLE]
into (29), we then obtain a new closed-loop LCN
[TABLE]
Luckily, in the observability graph of (33) (shown in Fig. 5), there is no path from any non-diagonal vertex to any cycle, hence (33) is observable by Lemma 2.7. Hence LCN (29) can be made observable by state-feedback controller (32).
Now we compute the upper bounds on the numbers of state-feedback controllers that are needed to be tested in order to verify whether LCN (29) can be made observable by state feedback obtained respectively in Remark 3.1 and Theorem 3.10.
For (29), we have
[TABLE]
where we denote and . Then
[TABLE]
[TABLE]
As shown in Remark 3.1, the upper bound is
[TABLE]
As shown in Theorem 3.10, the corresponding upper bound (26) is equal to
[TABLE]
where ’s are defined by (27).
Next we give a relatively “smarter” method to made LCN (29) observable. We first choose state-feedback controller
[TABLE]
After substituting (34) into (29), we obtain the following closed-loop LCN
[TABLE]
The purpose of choosing (34) is to force the observability graph of the obtained closed-loop LCN (35) to have no edge from a non-diagonal vertex to a diagonal vertex. The observability graph of (35) is shown in Fig. 6.
There are three self-loops on three non-diagonal vertices in Fig. 6. The next step is to remove these three self-loops and meanwhile disable appearance of edges from a non-diagonal vertex to a diagonal vertex. Consider the self-loop on vertex . We change (34) to the following
[TABLE]
After substituting (36) into (29), we obtain the following closed-loop LCN
[TABLE]
In the observability graph (Fig. 7) of (37), there is still no edge from a non-diagonal vertex to a diagonal vertex, but only one of the previous three self-loops on non-diagonal vertices is left.
We furthermore change (36) to the following
[TABLE]
After substituting (38) into into (29), we obtain the following closed-loop LCN
[TABLE]
In the observability graph (Fig. 8) of (39), there is no cycle in the non-diagonal subgraph, LCN (39) is observable.
In the above example, in the first method, we are lucky that the second chosen state-feedback controller (32) makes LCN (29) observable. If we modify in another way, the second chosen controller may not make (29) observable. However, due to the existence of (32), we know that finally we will find a state-feedback controller (which might not be (32)) that makes (29) observable.
In the second method, when updating the state-feedback controllers (from (34) to (36), then to (38)), we always have in the observability graphs of the obtained closed-loop LCNs (from (35) to (37), then to (39)), there is no edge from a non-diagonal vertex to a diagonal vertex, which is guaranteed by forcing the first columns of the structure matrices of these closed-loop LCNs to be distinct and also forcing the last columns to be distinct (i.e., (25)). In this sense, the obtained LCNs are closer and closer to be observable, and it is very likely that after several steps, the obtained closed-loop LCN is observable. Hence this method can result in an observability synthesis algorithm that makes an unobservable LCN become observable (if possible) in a large extent, and the speed is not very slow.
3.5 An observability synthesis algorithm for LCNs
The above procedure of modifying state-feedback controllers is similar to the fundamental idea of a greedy algorithm, i.e., in every step of modification, the purpose is to remove at least one (simple) cycle in the non-diagonal subgraph of the corresponding observability graph, so that after several steps, no cycle exists and the obtained closed-loop LCN is observable. Following the procedure, for a given unobservable LCN (3) that can be made observable by state feedback, if the initial state-feedback controller was chosen appropriately, and the following modifications were done appropriately, then the procedure could return a state-feedback controller that makes the unobservable LCN observable. However, because of the high nonlinearity of the observability synthesis problem, there is no guarantee that such an appropriate initial state-feedback controller could be definitely chosen, neither for appropriate following steps of modifications. Hence in order to implement the procedure, one could additionally add the fundamental idea of dynamic programming, i.e., rollback is permitted when in some step, no modification can reduce the number of cycles. To sum up the hybrid procedure containing the ideas of a greedy algorithm and dynamic programming, we show the following Algorithm 3.5 for observability synthesis.
Algorithm 1 An observability synthesis algorithm
0: An unobservable LCN as in (3)
0: “Yes” if can be made observable by state feedback, “No” otherwise; in case of “Yes”, a state-feedback controller as in (21) that makes observable
1: **initialization: ** A state-feedback controller as in (21) such that the closed-loop LCN as in (22) (obtained by feeding into ) satisfies (25) (this implies that the observability graph of contains no edge from any non-diagonal vertex to any diagonal vertex), and a threshold
2: if such an initial controller does not exist then
3: return “No”
4: stop
5: else
6: if is observable (i.e., the non-diagonal subgraph of its observability graph contains no cycle by Lemma 2.7) then
7: return “Yes” and
8: stop
9: else
10: while the current is not observable, and, not all closed-loop LCNs as in (22) satisfying (25) have been tested do
11: Choose to modify a number at most of columns of the structure matrix of so that the number of cycles in the non-diagonal subgraph of the observability graph of the updated decreases, has not been tested, and meanwhile still satisfies (25)
12: if such a modification does not exist then
13: move backward to some of the previously tested controllers until such a modification exists and then do the modification as in Line 11 (if after moving to the initial state-feedback controller but such a modification still does not exist, then reinitialize the procedure as in Line 1)
14: end if
15: if the current is observable then
16: return “Yes” and
17: stop
18: end if
19: end while
20: return “No”
21: stop
22: end if
23: end if
Now we analyze Algorithm 3.5. In Line 1, by Lemma 2.7, if does not satisfy (25), then it is not observable. Hence throughout Algorithm 3.5, all closed-loop LCNs must satisfy (25). Line 11 shows a modification method similar to the idea of a greedy algorithm, i.e., the obtained closed-loop LCN is closer to be observable than the previous one, because observable closed-loop LCNs are exactly those containing no cycle in the non-diagonal subgraphs of their observability graphs by Lemma 2.7. Line 13 is a rollback similar to the idea of dynamic programming. It works when the modification in Line 11 does not work and not all closed-loop LCNs as in (22) satisfying (25) have been tested. Particularly if , rollback is not needed. The nondeterminism of Algorithm 3.5 comes from Line 1 (nondeterministically choosing an initial state-feedback controller), Line 11 (nondeterministically choosing columns of the structure matrix of the current controller ), and Line 13. Overall, Algorithm 3.5 generates a tree structure, in which each node is a pair of a state-feedback controller and the corresponding closed-loop LCN satisfying (25). In each edge, the number of cycles in the non-diagonal subgraph of the observability graph of the LCN in the head is smaller than that number corresponding to the LCN in the tail.
Algorithm 3.5 could be refined in several ways to change its running performance, e.g., by adding additional rules, e.g., choosing , setting priorities for columns of the structure matrix of to be chosen, etc.
Example 3.12**.**
Recall the LCN (29) in Example 3.11. The second method follows the procedure in Algorithm 3.5, see Table 3.
4 Conclusion
In this paper, we showed that state feedback with exogenous input sometimes can enforce or weaken observability of a logical control network (LCN). We also characterized how to verify whether observability of an LCN can be enforced by state feedback with exogenous input. In addition, we gave an upper bound on the number of state-feedback controllers that are needed to be tested in order to verify whether an unobservable LCN can be made observable by state feedback with exogenous input. Finally, based on the method of obtaining the upper bound, an observability synthesis algorithm was designed by additionally combining the ideas of a greedy algorithm and dynamic programming. Note that the observability synthesis algorithm is preliminary, a lot of work could be done to improve its running performance.
In this paper, we only studied the synthesis problem for observability of LCNs in the sense of Definition 2.2. The other three types of observability as in Definitions 2.3, 2.4, and 2.5 can also be studied by using our observability graph, where in order to study Definitions 2.4 and 2.5, one additionally needs to compute deterministic finite automata from an observability graph as introduced in Section 1.2.
In order to make the obtained results be applied to the simulation-based method for controller synthesis of hybrid systems over their finite abstractions introduced in the Introduction section, a future topic is to generalize the obtained results to nondeterministic finite-transition systems, since usually nondeterministic finite-transition systems better simulate hybrid systems. In addition, another natural generalization of the paper is to consider output-feedback controllers instead of state-feedback controllers.
Appendix A Concepts and properties related to the STP of matrices
Definition A.1**.**
The matrix is called the power-reducing matrix. Particularly, we denote .
By definition, the following result holds.
Lemma A.2** ([55]).**
For power-reducing matrix , we have
[TABLE]
for each .
Lemma A.3** ([55]).**
Let and . Then
[TABLE]
Next, we reveal the deterministic essence of the three definitions of observability of PBNs studied in [47, 43, 48, 44].
Remark A.1**.**
The PBNs studied in [47, 43, 48, 44] are as follows:
[TABLE]
where with is an independent and identically distributed process and at each time , , , with 444In [47, 43, 48, 44], the authors considered . Here we consider with loss of generality because all structure matrices with could be removed equivalently. and , is the probability distribution of ; are the system matrices; is the output matrix; ; .
Because is independent and identically distributed, (40) can be reformulated as the following BCN:
[TABLE]
where , the other variables are the same as above.
Let (resp., ) be any of the admissible state (resp., output) sequences of (40) starting from initial state on discrete time set .
A PBN (40) is called observable in probability on with [47] if for every two different , it holds that555Note that in and , the only difference lies in the different initial states. At each time step, in both of them, the switching signal takes the same value. Hence for any . Note also that increases as increases and its limit need not be reached in finite time steps.
[TABLE]
By definition, (42) holds, if and only if, in the corresponding BCN (41), and have a distinguishing input sequence of length . Hence a PBN (40) is observable in probability on with if and only if the BCN (41) satisfies Definition 2.3 and additionally all pairs of different initial states have a distinguishing input sequence of fixed length .
A PBN (40) is called finite-time observable in probability [43] if there is such that (40) is observable in probability on . Then a PBN (40) is finite-time observable in probability if and only if the BCN (41) satisfies Definition 2.3.
A PBN (40) is called asymptotically observable in distribution [43] if for every two different , it holds that
[TABLE]
If and have no distinguishing input sequence in (41), then for any . Hence in order to make (40) asymptotically observable in distribution, every pair of different states must have at least one distinguishing input sequence in (41), i.e., (41) satisfies Definition 2.3. One can see that (41) satisfies Definition 2.3 if and only if666This necessary and sufficient condition is exactly the result shown in [22, Theorem 3.7], [36, Theorem 5.7], [38, Theorem 3.5], and [39, Algorithm 1]. in the observability graph of (41), for every non-diagonal vertex , either 777In this case, any in is a distinguishing input sequence of and , where . or some vertex with is reachable from 888 In this case, any input sequence is a distinguishing input sequence of and , where , is the input sequence of any path from to , .. In order to make (40) asymptotically observable in distribution, one additionally must have in the observability graph of (41), there is no path from any non-diagonal vertex to any diagonal vertex, because for a non-diagonal vertex from which there is a path to some diagonal vertex, there exists such that for any greater than the length of the path, . Then .
Conversely, assume that (i) (41) satisfies Definition 2.3 and (ii) in the observability graph of (41), there is no path from any non-diagonal vertex to any diagonal vertex. We endow the edges of with probabilities according to the probability distribution as in (40): for all with , ; for all with , . Denote the set of diagonal vertices and the set of non-diagonal vertices of by and , respectively. Then by (ii), for all and , . Denote the adjacency matrix of the non-diagonal subgraph of by . Then also by (ii), the sum of the -th column of is equal to , where . By (i) (i.e., for every in , and have a distinguishing input sequence in ), there exists such that in , the sum of each column is less than . Then the spectral radius of is less than , so is . Hence has all entries equal to [math]. That is, for all with , , . For all with , for any . Then (40) is asymptotically observable in distribution.
Based on the above discussion, a PBN (40) is asymptotically observable in distribution if and only if the corresponding BCN (41) satisfies Definition 2.3 and in the observability graph of (41), there is no path from any non-diagonal vertex to any diagonal vertex999This is exactly the result in [44, Proposition 1]..
The above three conclusions show that the three definitions of observability in probability on with , finite-time observability in probability, and asymptotic observability in distribution are rather close to each other and do not depend on probability distributions of the stochastic switching signal . Formally, given two probability distributions , , for PBN (40), one has PBN (40) with is observable if and only if PBN (40) with is observable, both in the sense of any one of the above three definitions.
Moreover, [44, Lemma 3] is exactly [56, Theorem 6], and the central idea therein is the equivalence relation for a BCN for which two states have the relation if and only if they do not have any distinguishing input sequence of length , also see [37, Remark 4.1]. This idea was also used in [21] (see Eqn. (4) therein) to study observability and reconstructibility of BCNs, as well as in [29, 57] to give a necessary and sufficient condition for the disturbance decoupling problem and to solve the observability (Definition 2.3) decomposition problem, in BCNs. In addition, there exist two mistakes in [44, Table @slowromancapii@], the time complexity of Algorithm 3.4 of [16] in the table (i.e., of [38] in the current paper) is not but , the time complexity of Algorithm 1 of [18] in the table (i.e., of [39] in the current paper) is not but also . That is, the algorithms obtained in [38, 39] are more efficient than [44, Algorithm 1].
In [44], observability of switched Boolean networks was mentioned. As one can easily see, observability of switched Boolean control networks can be equivalently transformed to observability of BCNs if inputs and switching signals of switched Boolean control networks are with the same quantifier (either or ). For a given switched Boolean control network, one could regard the Cartesian product of the set of inputs and the codomain of the switching signal as the new set of inputs so that a new equivalent Boolean control network is obtained. The results in [58] showed that Definition 2.5 extended to switched Boolean control networks for which the switching signals are with the quantifier is actually Definition 2.5 of BCNs. As a sequence, controllability of switched Boolean control networks studied in [59] (in which inputs and switching signals are both with quantifier) is actually controllability of BCNs.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. Tabuada. Verification and Control of Hybrid Systems: A Symbolic Approach . Springer Publishing Company, Incorporated, 1st edition, 2009.
- 2[2] C. Belta, B. Yordanov, and E. A. Gol. Formal Methods for Discrete-Time Dynamical Systems . Springer International Publishing AG, 2017.
- 3[3] C. Baier and J. P. Katoen. Principles of Model Checking . The MIT Press, 2008.
- 4[4] T. Akutsu. Algorithms for Analysis, Inference, and Control of Boolean Networks . World Scientific, 2018.
- 5[5] S.A. Kauffman. Metabolic stability and epigenesis in randomly constructed genetic nets. Journal of Theoretical Biology , 22(3):437–467, 1969.
- 6[6] T. Ideker, T. Galitski, and L. Hood. A new approach to decoding life: systems biology. Annual Review of Genomics and Human Genetics , 2:343–372, 2001.
- 7[7] A. Fauré, A. Naldi, C. Chaouiya, and D. Thieffry. Dynamical analysis of a generic Boolean model for the control of the mammalian cell cycle. Bioinformatics , 22(14):e 124, 2006.
- 8[8] S. Sridharan, R. Layek, A. Datta, and J Venkatraj. Boolean modeling and fault diagnosis in oxidative stress response. BMC Genomics , 13(Suppl 6), S 4:1–16, 2012.
