Approximating Constrained Minimum Cost Input-Output Selection for Generic Arbitrary Pole Placement in Structured Systems
Shana Moothedath, Prasanna Chaporkar, Madhu N. Belur

TL;DR
This paper introduces a polynomial-time approximation algorithm for selecting minimum cost input-output sets in structured systems to achieve arbitrary pole placement without fixed modes, addressing an NP-hard problem.
Contribution
It proposes a novel approximation algorithm by decomposing the problem into three sub-problems and linking them to set cover and perfect matching problems, providing an order-optimal solution.
Findings
The algorithm effectively solves the minimum cost input-output selection problem.
It reduces complex sub-problems to well-known polynomial-time solvable problems.
The approach guarantees an order-optimal solution within polynomial time.
Abstract
This paper is about minimum cost constrained selection of inputs and outputs for generic arbitrary pole placement. The input-output set is constrained in the sense that the set of states that each input can influence and the set of states that each output can sense is pre-specified. Our goal is to optimally select an input-output set that the system has no structurally fixed modes. Polynomial algorithms do not exist for solving this problem unless P=NP. To this end, we propose an approximation algorithm by splitting the problem in to three sub-problems: a) minimum cost accessibility problem, b) minimum cost sensability problem and c) minimum cost disjoint cycle problem. We prove that problems a) and b) are equivalent to a suitably defined weighted set cover problems. We also show that problem c) is equivalent to a minimum cost perfect matching problem. Using these we give an…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
\usetikzlibrary
fit,shapes
Approximating Constrained Minimum Cost Input-Output Selection for Generic Arbitrary Pole Placement in Structured Systems
Shana Moothedath, Prasanna Chaporkar and Madhu N. Belur The authors are in the Department of Electrical Engineering, Indian Institute of Technology Bombay, India. Email: shana, chaporkar, belur@ee.iitb.ac.in. This work was supported in part by SERB (DST) and BRNS, India.
Abstract
This paper is about minimum cost constrained selection of inputs and outputs in structured systems for generic arbitrary pole placement. The input-output set is constrained in the sense that the set of states that each input can influence and the set of states that each output can sense is pre-specified. Our goal is to optimally select an input-output set that the system has no structurally fixed modes. Polynomial time algorithms do not exist for solving this problem unless P = NP. To this end, we propose an approximation algorithm by splitting the problem in to three sub-problems: a) minimum cost accessibility problem, b) minimum cost sensability problem and c) minimum cost disjoint cycle problem. We prove that problems a) and b) are equivalent to the weighted set cover problem. We also show that problem c) can be solved using a minimum cost perfect matching algorithm. Using these, we give an approximation algorithm which solves the minimum cost generic arbitrary pole placement problem. The proposed algorithm incorporates an approximation algorithm to solve the weighted set cover problem to solve a) and b) and a minimum cost perfect matching algorithm to solve c). Further, we show that the algorithm has polynomial complexity and gives an order optimal approximate solution to the minimum cost input-output selection for generic arbitrary pole placement problem, where denotes the number of states in the system.
Index Terms:
Large scale control system design, Linear structured systems, Arbitrary pole placement, Input-output selection, Approximation algorithms..
1 Introduction
Consider structured matrices , and whose entries are either or [math]. The matrices , and structurally represent state, input and output matrices respectively of any control system , such that:
[TABLE]
Any triple that satisfy (1) is said to be a numerical realization of the structural system , , . Further, the matrix , where if the output is available for static output feedback to the input is referred as the feedback matrix. Let is the collection of all numerical realizations of , i.e., .
Definition 1**.**
The structural system is said not to have structurally fixed modes (SFMs) with respect to an information pattern if there exists one numerical realization of such that , where the function denotes the set of eigenvalues of any square matrix .
Let , where every entry , , indicates the cost of using input. Also, , where every entry , , indicates the cost of using output. For , , let be the restriction of to columns only in and be the restriction of to rows only in . Furthermore, let . Our aim is to find such that the cost of inputs and outputs is minimized. Specifically, we wish to solve the following optimization: for any , define .
Problem 1**.**
Given a structural system , feedback matrix and cost vectors , , find
[TABLE]
We refer to Problem 1 as minimum cost constrained input-output selection for generic arbitrary pole placement. Let . Thus, denotes the minimum cost for constrained input-output selection that ensures generic arbitrary pole placement. Without loss of generality, assume has no SFMs. Thus is non-empty.
In this paper we consider a special case in which is complete, i.e., for all . Even with this restriction the problem is NP-hard. In our main contribution, we propose an approximation algorithm of computational complexity . In the worst case, the proposed algorithm achieves approximation ratio of , and the ratio can be improved significantly in many practical systems. We also establish a negative result which states that no polynomial time algorithm can achieve approximation ratio of . Thus our algorithm is order optimal as it provides approximation. Formally, the main result of our paper is the following:
Theorem 1**.**
Consider a structural system , a complete feedback matrix and cost vectors . Let be the number of states in the system and be an output of Algorithm 4.1. Then the following hold:
- i)
, i.e., has no SFMs, and
- ii)
,
Moreover, there does not exist any polynomial time algorithm to solve Problem 1 that has approximation ratio . Thus the proposed algorithm is an order optimal approximation algorithm.
The organization of this paper is as follows: in Section 2 we discuss preliminaries, existing results and related work in this area. In Section 3 we explain our approach to solve the minimum cost input-output selection problem for generic arbitrary pole placement by splitting it in to three sub-problems: minimum cost accessibility, minimum cost sensability and minimum cost disjoint cycle problem. In Section 4 we discuss an approximation algorithm for solving the problem and then prove the main results of the paper. In Section 5 we explain the approximation result in the context of few special cases. In Section 6 we give the final concluding remarks.
2 Preliminaries, Existing Results and Related Work
In this section we first discuss few graph theoretic concepts used in the sequel and some existing results. Then we discuss related work in this area.
2-A Preliminaries and Existing Results
Arbitrary pole placement is said to be possible in a structural system if it has no structurally fixed modes (SFMs). Basically there are two types of fixed modes, Type-1 and Type-2 (see [1], [2] for more details). To ensure non-existence of SFMs one has to ensure that both these types are absent in the system. Presence of Type-1 SFMs can be checked using the concept of strong connectedness of the system digraph which is constructed as follows: firstly, we construct the state digraph , where and if . Thus a directed edge exists if state can influence state . Now we construct the system digraph , where and . An edge if , if and if . Thus a directed edge exists if input can actuate state and a directed edge exists if output can sense state . Construction of state digraph and system digraph is illustrated through an example in Figure 1. Next we define two concepts, namely accessibility and sensability, that we need for explaining our algorithm.
Definition 2**.**
A state is said to be accessible if there exists a directed simple path from some input to in the digraph . Also, a state is said to be sensable if there exists a directed simple path from to some output in the digraph .
A digraph is said to be strongly connected if for each ordered pair of vertices there exists an elementary path from to . A strongly connected component (SCC) of a digraph is a maximal strongly connected subgraph of it. If is a single SCC, then the system is said to be irreducible.
Using the digraph a necessary and sufficient graph theoretic condition for absence of SFMs is given in the following result.
Proposition 1** ([2], Theorem 4).**
*A structural system has no structurally fixed modes with respect to a feedback matrix if and only if the following conditions hold:
a) in the digraph , each state node is contained in an SCC which includes an edge in , and
b) there exists a finite disjoint union of cycles in where is a positive integer such that .*
In Proposition 1, condition a) corresponds to SFMs of Type 1 and condition b) corresponds to SFMs of Type 2. In order to characterize condition a) we first generate a directed acyclic graph (DAG) associated with by condensing each SCC to a supernode. In this DAG, vertex set comprises of all SCCs in . A directed edge exists between two nodes of the DAG if and only if there exists a directed edge connecting two states in the respective SCCs in . Using this DAG we have the following definition that characterizes SCCs in .
Definition 3**.**
An SCC is said to be linked if it has atleast one incoming or outgoing edge from another SCC. Further, an SCC is said to be non-top linked (non-bottom linked, resp.) if it has no incoming (outgoing, resp.) edges to (from, resp.) its vertices from (to, resp.) the vertices of another SCC.
Without loss of generality we will assume that has non-top linked SCCs, and non-bottom linked SCCs, . We have the following definition.
Definition 4**.**
An SCC is said to be covered by input if there exists a state in the SCC such that . Similarly, an SCC is said to be covered by output if there exists a state in the SCC such that .
We define and . Let and . In the example given in Figure 1(a) each state is individually an SCC. Moreover, there are two non-top linked SCCs, and and one non-bottom linked SCC, . Note that is neither non-top linked nor non-bottom linked SCC. Also, , , , and . Thus and . Following is an important observation.
Corollary 1**.**
All states are accessible (sensable, resp.) if all non-top (non-bottom, resp.) linked SCCs are covered by input (output, resp.).
Corollary 1 is an immediate consequence of Definitions 2 and 3. For a generic system with feedback matrix , verifying absence of SFMs has polynomial complexity. Specifically, condition a) can be verified in computations using the concept of SCCs in [3]. Condition b) can be verified in computations using concepts of information paths given in [4] or using bipartite matching as proposed in [5]. In our work, we use bipartite matching condition and so we explain this in detail.
Given an undirected bipartite graph , where denotes the set of vertices and denotes the set of edges, a matching is a collection of edges such that for any two edges , and . A perfect matching is a matching such that . Now for checking condition b) in a structural system, we use the bipartite graph constructed in [5]. Let , where , , and , and . Also, , , and . Moreover, include edges for and include edges for . We show that there exists a perfect matching in if and only if the system along with feedback matrix satisfies condition b) (see Section 4).
Note that , are digraphs, but is an undirected graph. Also, denotes directed edges and denotes undirected edges. The system bipartite graph for the structural system given in Figure 1 is shown in Figure 2. Summarizing, a structural closed-loop system is said not to have SFMs if and only if all state vertices lie in some SCC of with an edge in and the system bipartite graph has a perfect matching. Thus, using the two graph theoretic conditions explained in this section, we conclude that presence of SFMs in a structural closed-loop system can be checked in computations. Hence one can conclude if generic arbitrary pole placement is possible in a structural system in polynomial time. However, optimal selection of input-output set that guarantee arbitrary pole placement cannot be solved in polynomial time unless P = NP [5].
2-B Related Work
In large scale systems, including biological systems, the web, power grids and social network to name a few, more often only the connections in the graph are known. The exact parameters are unavailable. In this context, structural analysis of the system is performed to study the various system properties generically (see [6], [7], [4], [2] and references therein). Study of controllability and observability of the system generically using the structure of the system is referred to as structural controllability and structural observability. Structural controllability was introduced by Lin in [6]. Since then various associated problems including minimum input selection [8], [9], [10] and [11], input addition for structural controllability [12], strong structural controllability [13], minimum cost control selection and control configuration selection [5] are addressed in the literature. In most of these papers the structure of the input (output, resp.) matrix is not constrained. For example [11] discusses the problem of finding sparsest set for a given such that arbitrary pole placement is possible. This problem can be solved in polynomial complexity. However, constrained input (output, resp.) selection for structural controllability (observability, resp.) is NP-hard [14]. A special class of systems where the state bipartite graph has a perfect matching and every input can influence a single state (dedicated input) is discussed in [14]. Note that under these assumptions the problem is not NP-hard. However, for the general case there are no known approximation results. Given finding the sparsest such that the closed-loop system has no SFMs is proved to be NP-hard in [15].
This paper focusses on minimum cost constrained input-output selection for generic arbitrary pole placement of structural systems. It is shown to be NP-hard in [5]. This paper is motivated by [5] where Pequito et.al investigated Problem 1 along with costs for on a class of systems whose graph is irreducible. For this class of systems Problem 1 is not NP-hard. However, for general systems there are no known results. We address Problem 1 in its full generality. Note that we do not assume cost on . Unfortunately there do not exist polynomial algorithms for solving this unless P = NP. To this end, we propose an approximation algorithm for solving Problem 1.
Our key contributions in this paper are threefold:
We provide a polynomial time approximation algorithm that gives approximation ratio for solving Problem 1.
We prove that no polynomial time algorithm can achieve approximation ratio . Thus the proposed algorithm is order optimal
We show that the approximation can be much tighter in practical systems.
In the next section we detail our approach.
3 Approximating Minimum Cost Constrained Input-Output Selection Problem for Generic Arbitrary Pole Placement
Our approach for solving Problem 1 is to split the problem in to three sub-problems listed below:
Minimum cost accessibility problem
Minimum cost sensability problem
Minimum cost disjoint cycle problem
Broadly, minimum cost accessibility (sensability, resp.) problem aims at finding minimum cost sub-collection of inputs (outputs, resp.) that cover all states. In minimum cost disjoint cycle problem, our aim is to find minimum cost sub-collection of inputs and outputs such that condition b) is satisfied given that all chosen outputs connect to all chosen inputs (recall that for all ). For better readability and notational brevity we denote the structural system with feedback matrix and cost vectors as (without output) while discussing the accessibility problem and as (without input) while discussing the sensability problem.
Firstly we show that the minimum cost accessibility (sensability, resp.) problem is “equivalent to” the weighted set cover problem. On account of the equivalence any algorithm for weighted set cover can be used for solving the minimum cost accessibility and sensability problems with the same performance guarantees and vice-versa. Weighted set cover problem is a well studied NP-hard problem [16]. There exist approximation algorithms that give solution to the weighted set cover problem up to log factor in problem size [17]. However, there also exist inapproximability result showing that it cannot be approximated up to a constant factor [18]. Thus, using the equivalence of the problems we provide an order optimal approximation algorithm to solve the minimum cost accessibility and sensability problems.
Then we show that the minimum cost disjoint cycle problem can be solved using a minimum cost perfect matching problem defined on . Bipartite matching is also a well studied area and there exist polynomial time algorithm of complexity that find minimum cost perfect matching in a bipartite graph with nodes on one side [16]. Using the minimum cost perfect matching algorithm we provide a polynomial time algorithm to solve the minimum cost disjoint cycle problem optimally. Then we prove that combining the solutions to these sub-problems we can obtain an approximate solution to Problem 1. Now we formally define and tackle each of these sub-problems separately in the following subsections.
3-A Solving Minimum Cost Accessibility Problem
In this subsection, we establish a relation between the accessibility condition for structural controllability and the weighted set cover problem. Specifically, we show that when the inputs are constrained and each input is associated with a cost, then satisfying minimum cost accessibility condition is equivalent to solving a weighted set cover problem defined on the structural system.
Consider a structural system () and a cost vector denoted as (). This system is said to satisfy the minimum cost accessibility condition if all the non-top linked SCCs in are covered using the least cost input set possible. That is, we need to find a set of inputs such that all state nodes are accessible in and for any that satisfy accessibility of all state nodes in . Specifically, we need to solve the following optimization: for any , define .
Problem 2**.**
Given , find
[TABLE]
such that all state nodes are accessible in .
We refer to Problem 2 as the minimum cost accessibility problem. Before showing the equivalence between Problem 2 and the weighted set cover problem, we first describe the weighted set cover problem for the sake of completeness. Weighted set cover problem is a well studied NP-hard problem [17]. Given a universe of elements , a set of sets with and and a weight function from to the set of non-negative real numbers, weighted set cover problem consists of finding a set such that and for any that satisfies . Now we reduce Problem 2 to an instance of the weighted set cover problem in polynomial time.
The pseudo-code showing a reduction of Problem 2 to an instance of weighted set cover problem is presented in Algorithm 3.1. Given (), we define a weighted set cover problem as follows: the universe consists of all non-top linked SCCs in (see Step 3). The Sets is defined in such a way that set consists of all non-top linked SCCs that are covered by the input (see Step 4). Further, for each set we define weight as shown in Step 5. Given a solution to the weighted set cover problem, we define the associated weight as the sum of the weights of all sets selected under (see Step 7). Also, the indices of the sets selected in is denoted as and its cost is denoted as as shown in Steps 8 and 9 respectively. We denote an optimal solution to Problem 2 as and its cost as . Also an optimal solution to the weighted set cover problem given in Algorithm 3.1 is denoted by and its weight is denoted by . Now we prove the following preliminary results.
Lemma 1**.**
Consider any structural system , feedback matrix and cost vectors . Then, Algorithm 3.1 reduces Problem 2 to a weighted set cover problem in time. Moreover, for any cover , the set and cost given in Steps 8 and 9 respectively can be obtained in computations, where denotes the number of states in the system.
Proof.
Given state digraph all the non-top linked SCCs can be found in computations. Here and is atmost . Thus the reduction in Algorithm 3.1 has computations. Also, given a cover we can obtain and in linear time and this completes the proof. ∎
Lemma 2**.**
Consider any structural system , feedback matrix and cost vectors and the corresponding weighted set cover problem obtained using Algorithm 3.1. Let be a feasible solution to the weighted set cover problem and be the index set selected in Step 8. Then, all states are accessible in and .
Proof.
Given is a feasible solution to the weighted set cover problem. Thus . Hence, covers all the non-top linked SCCs in . By Corollary 1 this implies that all states are accessible in . Now steps 5, 7, 8 and 9 of Algorithm 3.1 proves . ∎∎
In the following lemma we show that an -approximation algorithm for the weighted set cover problem can be used to obtain an -approximate solution to Problem 2.
Lemma 3**.**
Consider any structural system , feedback matrix and cost vectors and the corresponding weighted set cover problem obtained using Algorithm 3.1. Then, for , if is an -optimal solution to the weighted set cover problem, then is an -optimal solution to the minimum cost accessibility problem.
Proof.
The proof of this lemma is twofold: (i) we show that an optimal solution to the weighted set cover problem gives an optimal solution to Problem 2, and (ii) we show that if , then .
Given is an optimal solution to the weighted set cover problem with cost . For (i) we show that input set selected under is a minimum cost input set that satisfy the accessibility of all states, i.e., all states are accessible in and . Since is a solution to the weighted set cover problem, using Lemma 2 all states are accessible in . Thus is a feasible solution to Problem 2. To prove minimality, we use a contradiction argument. Let us assume that is an optimal solution to the weighted set cover problem but is not a minimum cost input set that satisfy the accessibility condition. Then there exists such that all state nodes are accessible in and . Note that for , . Using Lemma 2, . This gives a contradiction to the assumption that is a minimal solution to the weighted set cover problem. This completes the proof of (i). Now (ii) follows from Lemma 2 and Step 5 of Algorithm 3.1 and this completes the proof. ∎
As an immediate consequence of the above result we can now show that approximation algorithm for minimum cost accessibility problem can be obtained from an approximation algorithm for the weighted set cover problem.
Theorem 2**.**
If there exists a polynomial time -optimal algorithm for solving the weighted set cover problem, then there exists a polynomial time -optimal algorithm for solving Problem 2. Thus, we can find a -optimal solution to Problem 2, where is the maximum number of non-top linked SCCs covered by a single input.
Proof.
From Lemma 3, a polynomial time -optimal algorithm for solving the weighted set cover problem gives a polynomial time -optimal algorithm for solving Problem 2. Now, using the greedy approximation algorithm for solving the weighted set cover problem given in [17, pp.234], we can obtain a -optimal solution to Problem 2. ∎
Note that through Algorithm 3.1 we have shown that any instance of Problem 2 can be reduced in polynomial time to an instance of the weighted set cover problem. Now, we prove constant factor inapproximability of Problem 2. That is, there does not exist any polynomial time algorithm that give -optimal solution to Problem 2 for any . To achieve this we give a polynomial time reduction of the weighted set cover problem to an instance of Problem 2 in Algorithm 3.2. Using this, we will show that any polynomial time -optimal algorithm for solving Problem 2 can be used to get polynomial time -optimal algorithm for the weighted set cover problem. Thus, since weighted set cover problem cannot be approximated up to constant factor, Problem 2 also cannot be approximated up to constant factor.
The pseudo-code showing a reduction of the weighted set cover problem to an instance of Problem 2 is presented in Algorithm 3.2. Given and , we reduce the weighted set cover problem to an instance of the minimum cost accessibility problem. Here, is a diagonal matrix with all diagonal entries ’s (see Step 2). Now, is defined in such a way that its column corresponds to the set (see Step 3) and cost of input is same as the weight of (see Step 4). Given a solution to the accessibility problem, we define the associated cost , the sets selected and its weight as shown in Steps 6,7 and 8 respectively. We denote an optimal solution to the set cover problem in Algorithm 3.2 as and its weight as . Now we prove the following preliminary results.
Lemma 4**.**
Consider any weighted set cover problem with universe , set and weight . Let . Then, Algorithm 3.2 reduces the weighted set cover problem to Problem 2 in computations. Moreover, for any set , the cover and weight given in Steps 7 and 8 respectively can be obtained in computations.
Proof.
Given any weighted set cover problem , matrices , can be found in , computations respectively. Also, cost vector can be found in linear time. Thus the reduction of the set cover problem to an instance of Problem 2 given in Algorithm 3.2 has computations. Also, given a set we can obtain and in linear time and this completes the proof. ∎
Lemma 5**.**
Consider any weighted set cover problem given by and the corresponding structural system obtained using Algorithm 3.2. Let be a feasible solution to Problem 2 and consists of the sets selected under . Then, covers and .
Proof.
Given is a feasible solution to Problem 2. Thus all states are accessible in . This implies for , . Thus by Corollary 1 covers . Now Steps 4, 6, 7 and 8 of Algorithm 3.2 gives . ∎
In the following lemma we show that an -approximation algorithm for Problem 2 can be used to obtain an -approximate solution to the weighted set cover problem.
Lemma 6**.**
Consider any weighted set cover problem and the corresponding structural system obtained using Algorithm 3.2. For , if is an -optimal solution to the minimum cost accessibility problem, then is an -optimal solution to the weighted set cover problem.
Proof.
The proof of this lemma is twofold: (i) we show that an optimal solution to Problem 2 gives an optimal solution to the weighted set cover problem, and (ii) we show that, if , then .
For proving (i) we assume that is an optimal solution to Problem 2 and then prove that is an optimal solution to the weighted set cover problem, i.e, and . Given is an optimal solution to Problem 2. Thus all states are accessible in . Hence, by Lemma 5, is a feasible solution to the weighted set cover problem. Now we prove optimality using a contradiction argument. Let is an optimal solution to Problem 2, but is not an optimal solution to the weighted set cover problem. Then there exists such that and . Then covers all the non-top linked SCCs in . Also, from Lemma 2, . This gives a contradiction to the assumption that is a minimum cost input set that satisfies accessibility condition. This completes the proof of (i). Now (ii) follows directly from Lemma 5 and Step 4 of Algorithm 3.2. This completes the proof. ∎
Lemmas 3 and 6 prove the equivalence of Problem 2 and the weighted set cover problem. There are no polynomial algorithms for solving weighted set cover problem unless P = NP. However, there exist various approximation algorithms that find approximate solution to the weighted set cover problem. Specifically, the greedy approximation algorithm given in [17] gives a log approximation, where is the cardinality of the largest set in . In addition to this, we also know strong negative approximability result for the set cover problem. The set cover problem is a special case of weighted set cover problem, where all weights are non-zero and uniform. Thus the inapproximability result of the set cover problem applies to the weighted set cover problem also.
Proposition 2**.**
[19, Theorem 4.4]** If there is some such that a polynomial time algorithm can approximate the set cover problem within , then , where denotes the number of items in the universe.
Using Lemma 6 and Proposition 2 we can now show that inapproximability result of the weighted set cover problem implies inapproximability result of Problem 2.
Theorem 3**.**
If there does not exist a polynomial time -optimal algorithm for solving the weighted set cover problem, then there does not exist a polynomial time -optimal algorithm for solving Problem 2. Moreover, there does not exist a polynomial time algorithm that can approximate Problem 2 to factor , where denotes the number of non-top linked SCCs in .
Proof.
From Lemma 6, a polynomial time -optimal algorithm for solving Problem 2 gives a polynomial time -optimal algorithm for solving the weighted set cover problem. Now, from Proposition 2 weighted set cover problem cannot be approximated up to factor , where is the cardinality of the universe. The weighted set cover reduction of Problem 2 has . Thus Problem 2 cannot be approximated to factor . ∎
This shows the hardness of the problem. The number of non-top linked SCCs is atmost . This happens when each state is decoupled. However, in practical cases the states are not decoupled. The more connected the graph is, the number of non-top linked SCCs are less. In such cases the above result gives a tighter bound. In the following sub-section we discuss briefly about the minimum cost sensability problem.
3-B Solving Minimum Cost Sensability Problem
In this section, we establish a relation between the sensability condition for structural observability and a set cover problem. Specifically, we show that when the outputs are constrained and each output is associated with a cost, then satisfying minimum cost sensability condition is equivalent to solving a weighted set cover problem defined on the structural system.
Consider a structural system () and a cost vector denoted as (). This system is said to satisfy the minimum cost sensability condition if all the non-bottom linked SCCs in are covered by the least cost output set possible. That is, we need to find a set of outputs such that all state nodes are sensable in and for any that satisfy sensability of all state nodes in . We refer to the above problem as the minimum cost sensability problem.
However, because of duality between controllability and observability solving minimum cost sensability problem is equivalent to solving minimum cost accessability problem of the structural system . Thus the weighted set cover reformulation of Problem 2 for solves the minimum cost sensability problem of . Hence the following result immediately follows from the analysis done in the previous sub-section.
Corollary 2**.**
Consider a structurally observable system (). We can find a -optimal solution to the minimum cost sensability problem, where is the maximum number of non-bottom linked SCCs covered by a single output. Also, there does not exist polynomial time algorithm that can approximate minimum cost sensability problem to factor , where is the number of non-bottom linked SCCs in .
Now we will find a relation between minimum cost disjoint cycle condition and a bipartite matching problem.
3-C Solving Minimum Cost Disjoint Cycle Problem
In this subsection we establish a relation between disjoint cycle condition and perfect matching problem. Specifically, we show that when the inputs and outputs are constrained and each input and output are associated with costs, then satisfying disjoint cycle condition using a minimum cost input-output set is equivalent to solving a minimum cost perfect matching problem on a bipartite graph defined on the structural system.
A structural system () with feedback matrix and cost vectors is said to satisfy the minimum cost disjoint cycle condition if all state vertices are spanned by disjoint union of cycles in the system digraph by using the least possible cost input-output set. That is, we need to find an input set and an output set such that all ’s are spanned by disjoint cycles in and for any and that satisfy disjoint cycle condition in . Specifically, we need to solve the following optimization problem.
Problem 3**.**
Given and cost vectors and , find
[TABLE]
such that all ’s lie in finite disjoint union of cycles in .
We refer to Problem 3 as the minimum cost disjoint cycle problem. Now we reduce the minimum cost disjoint cycle problem to a minimum cost perfect matching problem.
Pseudo-code for reducing the minimum cost disjoint cycle problem to a minimum cost perfect matching problem is presented in Algorithm 3.3. The bipartite graph constructed in [5] for a special case is used here to guarantee condition b) in Proposition 1 for a general case. Given the bipartite graph and the cost function defined as in Step 3, we find a perfect matching . On obtaining a perfect matching , we define the associated cost as the sum of the costs of edges that are present in (see Step 5). The input index set selected under defined as is the set of indices of ’s that are connected to some state vertices in (see Step 6) and its cost is defined as (see Step 7). Now, the output index set selected under defined as consists of indices of all outputs ’s that are connected to some state vertices in (see Step 8) and its cost is defined as (see Step 9).
We denote an optimal solution to the minimum cost perfect matching problem as and the optimal cost as . Also, an optimal solution to Problem 3.3 is denoted as and the optimal input-output cost is denoted as . We prove the following theorem to give a necessary and sufficient condition for condition b) in Proposition 1 for the sake of completeness.
Theorem 4**.**
Consider a structural system with feedback matrix . Then, the bipartite graph has a perfect matching if and only if all states are spanned by disjoint union of cycles in .
Proof.
Only-if part: We assume that the bipartite graph has a perfect matching and prove that all state nodes are spanned by disjoint union of cycles in . Let be a perfect matching in . Let for and . Thus edges in correspond to edges in such that there exist one incoming edge and one outgoing edge corresponding to every vertex in except nodes ’s and ’s that has edges in . Since corresponding to edges in every vertex has both in-degree and out-degree one, these edges corresponds to disjoint cycles in . Note that all state vertices lie in . Hence, all ’s are spanned by disjoint union of cycles. This completes the proof of only-if part.
If part: We assume that there exist disjoint union of cycles that span all state nodes in and prove that there exists a perfect matching in . Since the cycles are disjoint, each node in it has one incoming edge and one outgoing edge. Each edge in the cycle corresponds to an edge in the bipartite graph. Vertices in that are not covered by these cycles will belong to the set of input and output nodes only. For such nodes there exist edges for all and for all in . These edges along with the cycle edges results in a perfect matching. This completes the proof. ∎
Lemma 7**.**
Let be a perfect matching in and denote the index set of inputs and index set of outputs selected under respectively. Then, all ’s lie in disjoint cycles in and .
Proof.
Given is a perfect matching in the bipartite graph with cost function . Using Theorem 4, there exist disjoint cycles that cover all state nodes in . Now, Step 3 and Steps 6 to 9 in Algorithm 3.3 gives .∎∎
Now we prove that minimum cost perfect matching problem on with cost can be used to solve the minimum cost disjoint cycle problem.
Theorem 5**.**
Consider a structural system with feedback matrix and cost vectors . Let be an optimal solution to Problem 3 and be the optimal cost of Problem 3. Let is the optimal cost of the minimum cost perfect matching problem on . Then, . Moreover, the input index set and output index set selected under Algorithm 3.3 provide an optimal solution to Problem 3.
Proof.
Given is an optimal solution to Problem 3. Then, from Theorem 4 there exists a perfect matching in . Let be an optimum matching in . Then, . Note that is an optimum matching in . Also . Thus .
Now let is an optimal solution to the minimum cost perfect matching problem in . Then . By Theorem 4 there exists disjoint cycles whose union span all ’s in . Let the input-output set used in these cycles are . Now . Also, . Thus . Combining both, we get .
Now we assume that is an optimal solution to the minimum cost perfect matching problem with cost and then show that input-output set selected under is an optimal solution to Problem 3, i.e., all ’s lie in disjoint union of cycles in and .
Since is a solution to the minimum cost perfect matching problem, by Lemma 7 there are disjoint cycles in such that all state nodes lie in their union. Thus is a feasible solution to Problem 3. To prove minimality we use a contradiction argument. Let us assume that is an optimal matching but is not an optimal solution to Problem 3. Then there exists and that satisfy the disjoint cycle condition in and . Then by Theorem 4 there exists a perfect matching such that and . Using Lemma 7, . This gives a contradiction to the assumption that is an optimal matching. This completes the proof. ∎
Hence, an optimal solution to the minimum cost perfect matching problem gives a minimum cost input-output set that satisfies the disjoint cycle condition. There exist efficient polynomial time algorithms to solve the minimum cost perfect matching problem [16]. Thus using these algorithms we can solve Problem 3 optimally in polynomial time. In the next section we give an approximation algorithm to solve Problem 1.
4 Approximating Constrained Input-Output Selection for Generic Arbitrary Pole Placement
In this section we give a polynomial time approximation algorithm for solving Problem 1. We propose a three stage algorithm for solving Problem 1. The pseudo-code for the proposed algorithm is given in Algorithm 4.1. In the first stage of Algorithm 4.1 we solve a weighted set cover problem defined on the structural system using a greedy approximation algorithm given in [17] to obtain an approximate solution to the minimum cost accessibility problem. We define the input index set selected under its solution as (see Step 1). Subsequently, in stage two we solve a weighted set cover problem defined on the structural system to approximate the minimum cost sensability problem. We define the output index set selected under its solution as (see Step 2). In the third stage of the algorithm a minimum cost perfect matching problem is solved on with cost function . We define the input-output index set selected under solution to this problem as (see Step 3). In one of our main result we prove that is an approximate solution to Problem 1. Firstly, we prove the following preliminary result.
Lemma 8**.**
*Let denote the state digraph of a structural system. Then, either one of the following happens:
an SCC in is both non-top linked and non-bottom linked,
an SCC in lies in a path starting at some non-top linked SCC and ending at some non-bottom linked SCC.*
Proof.
Consider the Directed Acyclic Graph (DAG) whose vertices are the SCCs in and an edge exists between two nodes if and only if there exists an edge connecting two states in those respective SCCs in . The nodes in the DAG are of two types: (i) isolated, and (ii) has an incoming and/or outgoing edge. In case (i) the corresponding SCC is both non-top linked and non-bottom linked. In case (ii) it has either an incoming edge or an outgoing edge or both. Thus those SCCs lie in some path from some non-top linked SCC to some non-bottom linked SCC since the DAG is acyclic. This completes the proof. ∎
Now we prove our main result.
Proof of Theorem 1: Given is an output of Algorithm 4.1. Hence, all states are accessible in and states are sensable in . Thus, in all states are both accessible and sensable. Consider an arbitrary state which belongs to some SCC . By Lemma 8, lies on some path from a non-top linked SCC, say , to a non-bottom linked SCC, say , in the SCC DAG. Since are enough for accessibility, there exists such that covers . Similarly, since are enough for sensability there exists such that covers . Since is complete belong to . Thus in this digraph all states in all the SCCs of that lie in the path from to now belong to a single SCC in which has edge . Thus belongs to an SCC in with a edge. Since is arbitrary condition a) in Proposition 1 follows. Since is an output of Algorithm 4.1, by Theorem 4 there exists disjoint cycles that cover all state nodes using inputs whose indices are in and outputs whose indices are in . Thus satisfies condition b) in Proposition 1. Thus . This completes the proof of i).
Let and are optimal solutions to the minimum cost accessibility problem and minimum cost sensability problem respectively. Given is an output of Algorithm 4.1. Let , where is an -optimal solution to the minimum cost accessibility problem and is a minimum cost set that satisfy the disjoint cycle condition. Similarly, , where is an -optimal solution to the minimum cost sensability problem and is a minimum cost set that satisfy the disjoint cycle condition. Now by Theorem 2, and by Corollary 2, . Since is an optimal solution to Problem 1 its cost is atleast the cost of satisfying the two conditions in Proposition 1 separately. This give Equations (2) and (3).
[TABLE]
Equation (4) holds as and are approximate solutions to the minimum cost accessibility problem and the minimum cost sensability problem respectively, obtained using greedy approximation of their weighted set cover formulations. Equation (4) holds as . This proves (ii).
From Proposition 2 we know that the weighted set cover problem cannot be approximated to factor , where is the cardinality of the universe. Hence, there does not exist any polynomial algorithm that has approximation ratio for Problem 1. Note that . Thus there does not exist any polynomial algorithm that has approximation ratio for solving Problem 1. Thus the proposed algorithm is order optimal approximation algorithm for Problem 1.∎
In the following theorem we give the complexity of the proposed approximation algorithm.
Theorem 6**.**
Algorithm 4.1 which takes as input a structural system with complete feedback matrix and cost cost vectors and gives as output an approximate solution to Problem 1 has complexity , where denotes the number of states in the system.
Proof.
Given state digraph all the non-top linked SCCs can be found in computations. Here and is atmost . Thus set cover problems can be formulated in computations. The greedy selection scheme for finding the approximate solution to the set cover problem has complexity [17]. The minimum cost bipartite matching can be solved in computations. Thus Algorithm 4.1 has complexity. ∎
In the next section we discuss few special class of systems in the context of Problem 1.
5 Special Cases
In this section we consider few special cases. Using the approximation algorithm given in Section 4 we obtain the approximation results for these cases. In the following subsections we explain each of these cases briefly.
5-A Irreducible Systems
In this sub-section we consider systems whose digraph is irreducible, that is is a single SCC. Note that for this class of systems Problem 1 is not NP-hard [5]. Pequito.et al addressed Problem 1 along with costs for feedback edges in [5] and obtained a polynomial time optimal algorithm. In the following result we prove that the polynomial time algorithm given in this paper also gives an optimal solution to Problem 1.
Theorem 7**.**
Consider a structural system , complete feedback matrix and cost vectors . Let is irreducible. Then Algorithm 4.1 returns an optimal solution to Problem 1.
Proof.
Given is irreducible and is complete. Thus condition a) is satisfied by any edge. Hence Algorithm 4.1 solves only the minimum cost perfect matching problem for satisfying condition b) optimally. Without loss of generality, let be an input and be an output obtained in the solution, i.e, and . Then edge satisfies both conditions in Proposition 1. In case if has a perfect matching, then connecting the minimum cost input to the minimum cost output satisfies both the conditions in Proposition 1. Thus . Hence, Algorithm 4.1 gives an optimal solution to Problem 1. ∎
5-B Systems with Perfect matching in
In this sub-section we consider systems whose bipartite graph has a perfect matching. In this case condition b) in Proposition 1 is satisfied without using any input or output. Thus condition a) alone has to be considered. That is, only minimum cost accessibility and minimum cost sensability problems need to be solved. We have the following result for these class of systems.
Theorem 8**.**
Consider a structural system , complete feedback matrix and cost vectors . Let has a perfect matching. Then, Algorithm 4.1 gives a -optimal solution to Problem 1, where denotes the maximum number of non-top linked SCCs covered by a single input and denotes the maximum number of non-bottom linked SCCs covered by a single output.
Proof.
Given has a perfect matching. Thus condition b) is satisfied. Thus we need to solve only the minimum cost accessibility problem and the minimum cost sensability problem. Now following the similar lines given in the proof of Theorem 1, we get . Hence, Algorithm 4.1 gives a -optimal solution to Problem 1. ∎
5-C Systems with a Single non-top/non-bottom linked SCC
In this sub-section we consider systems that has a single non-top linked SCC or a single non-bottom linked SCC. For this class of systems we have the following result.
Theorem 9**.**
Consider a structural system , complete feedback matrix and cost vectors . Let has a single non-top linked SCC. Then, Algorithm 4.1 gives a -optimal solution to Problem 1, where denotes the maximum number of non-bottom linked SCCs covered by a single output.
Proof.
Given has a single non-top linked SCC. Thus . Thus . Hence, Algorithm 4.1 gives a -optimal solution to Problem 1. ∎
Note that if has a single non-bottom linked SCC using the same argument we will get a -optimal solution to Problem 1 using Algorithm 4.1.
5-D Discrete Systems
In this subsection we consider linear time invariant discrete control system given by, , . For discrete systems we have the following result.
Theorem 10**.**
Consider a discrete structural system , complete feedback matrix and cost vectors . Then, Algorithm 4.1 gives a -optimal solution to Problem 1.
Proof.
In discrete linear time invariant systems, only condition a) in Proposition 1 has to be satisfied, since uncontrollable and unobservable modes of the system at origin is not of concern. Thus Algorithm 4.1 need to solve only the minimum cost accessibility problem and the minimum cost sensability problem. Hence, we can get a -optimal solution to the minimum cost constrained input-output selection for generic arbitrary pole placement of discrete systems. ∎
This completes the discussion of the approximation results for various special classes of systems considered.
6 Conclusion
This paper deals with minimum cost constrained input-output selection problem for generic arbitrary pole placement when the input and output matrices are constrained and each input and output is associated with costs. Our aim is to find a minimum cost input-output set that generic arbitrary pole placement is possible. There do not exist polynomial time algorithms for solving this unless P = NP. To this end, we proposed a polynomial time algorithm for finding an approximate solution to the problem by splitting the problem in to three sub-problems: minimum cost accessibility, minimum cost sensability and minimum cost disjoint cycle. We proved that minimum cost accessibility and minimum cost sensability problems are equivalent to the weighted set cover problem. Further, we proved that the minimum cost disjoint cycle problem can be solved using a minimum cost perfect matching problem on a system bipartite graph with suitably defined cost function. Using these results we proposed a polynomial time algorithm for solving minimum cost constrained input-output selection problem for generic arbitrary pole placement. The proposed algorithm gives a -optimal solution. We also proved that there does not exist any polynomial time algorithm that that can give a -optimal solution. Thus the proposed algorithm gives an order optimal approximate solution to the minimum cost input-output selection for generic arbitrary pole placement problem.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S.-H. Wang and E. Davison, “On the stabilization of decentralized control systems,” IEEE Transactions on Automatic Control , vol. 18, no. 5, pp. 473–478, 1973.
- 2[2] V. Pichai, M. Sezer, and D. Šiljak, “A graph-theoretic characterization of structurally fixed modes,” Automatica , vol. 20, no. 2, pp. 247–250, 1984.
- 3[3] A. V. Aho and J. E. Hopcroft, The design and analysis of computer algorithms . Pearson Education: India, 1974.
- 4[4] C. H. Papadimitriou and J. Tsitsiklis, “A simple criterion for structurally fixed modes,” Systems & Control Letters , vol. 4, no. 6, pp. 333–337, 1984.
- 5[5] S. Pequito, S. Kar, and G. J. Pappas, “Minimum cost constrained input-output and control configuration co-design problem: A structural systems approach,” in Proceedings of IEEE American Control Conference , Chicago, USA, 2015, pp. 4099–4105.
- 6[6] C.-T. Lin, “Structural controllability,” IEEE Transactions on Automatic Control , vol. 19, no. 3, pp. 201–208, 1974.
- 7[7] K. Murota, Systems Analysis by Graphs and Matroids . Springer-Verlag Berlin Heidelberg: New York, 1987.
- 8[8] Y.-Y. Liu and A.-L. Barabási, “Control principles of complex systems,” Reviews of Modern Physics , vol. 88, no. 3, p. 035006, 2016.
