Bias estimation in sensor networks
Mingming Shi, Claudio De Persis, Pietro Tesi, Nima Monshizadeh

TL;DR
This paper studies how to accurately estimate constant biases in sensor networks by analyzing network topology and proposing algorithms, ensuring bias correction even with many biased sensors.
Contribution
It provides conditions under which biases can be uniquely estimated in different network topologies and introduces algorithms for bias estimation.
Findings
Biases are always identifiable in non-bipartite graphs.
More than half sensors must be unbiased in bipartite graphs for correct estimation.
Only two unbiased sensors are needed if biases are heterogeneous.
Abstract
This paper investigates the problem of estimating biases affecting relative state measurements in a sensor network. Each sensor measures the relative states of its neighbors and this measurement is corrupted by a constant bias. We analyse under what conditions on the network topology and the maximum number of biased sensors the biases can be correctly estimated. We show that for non-bipartite graphs the biases can always be determined even when all the sensors are corrupted, while for bipartite graphs more than half of the sensors should be unbiased to ensure the correctness of the bias estimation. If the biases are heterogeneous, then the number of unbiased sensors can be reduced to two. Based on these conditions, we propose some algorithms to estimate the biases.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDistributed Sensor Networks and Detection Algorithms · Energy Efficient Wireless Sensor Networks · Gene Regulatory Network Analysis
Bias estimation in sensor networks
Mingming Shi, Claudio De Persis, Pietro Tesi, Nima Monshizadeh
M. Shi, C. De Persis, P. Tesi and N. Monshizadeh are with ENTEG, University of Groningen, 9747 AG Groningen, The Netherlands. Email: [email protected], [email protected], [email protected], [email protected]. P. Tesi is also with DINFO, University of Florence, 50139 Firenze, Italy E-mail: [email protected].
Abstract
This paper investigates the problem of estimating biases affecting relative state measurements in a sensor network. Each sensor measures the relative states of its neighbors and this measurement is corrupted by a constant bias. We analyse under what conditions on the network topology and the maximum number of biased sensors the biases can be correctly estimated. We show that for non-bipartite graphs the biases can always be determined even when all the sensors are corrupted, while for bipartite graphs more than half of the sensors should be unbiased to ensure the correctness of the bias estimation. If the biases are heterogeneous, then the number of unbiased sensors can be reduced to two. Based on these conditions, we propose some algorithms to estimate the biases.
I Introduction
The normal operation of many large scale systems relies on networks of sensors that provide information using for the monitoring and management of the system operating conditions [1]-[6]. However, when measuring the variables of interest, sensors may generate unreliable results due to the low quality of the hardware, environmental variations or adversary attacks. This introduces measurement errors, which can degrade the system performance and even lead to major disruptions [5]-[11].
In this paper, we consider networks in which each sensor measures the difference between its state and that of its neighbors and aim to characterize the conditions under which the biases corrupting the measurements can be estimated and provide methods for their estimation
The problem in this paper is broadly linked to others studied in the literature. Given erroneous relative measurements, providing precise estimates of the relative states can be considered as a complementary problem to the one of estimating biases. Many papers [8, 12]-[18] have provided methods for estimating the states of the sensors from noisy relative measurements by solving linear or nonlinear least square problems. These methods can not precisely estimate the state since the least square approach has no robustness to the measurement error and any error can make the estimation of the unknown deviate from the actual value [19].
The formulation of the problem considered in this paper covers the situation where the biases are constant but with arbitrary magnitude, thus allowing for the presence of outliers. Similar problems have been addressed recently in [17, 18], where the focus is on the state estimation problem. However, neither one of the papers gives results on how the sparsity of the measurement errors affects the state estimation. On the other hand, computing biases from relative measurements received comparably less attention. The paper [20] proposed algorithms to estimate sensor offsets in wireless sensor networks. These methods only partially compensate the offsets. In problems that use the angle of arrival (AOA) measurements, if the local frame is unaligned with the global frame, then the unknown orientation of the local frame can be regarded as a bias. Ahn et al. [21, 22] use the consensus algorithm to estimate the orientation. However, similar to [20], the estimation error of their algorithms never vanish.
In this paper, we reduce the bias estimation problem to the solution of linear equations (LEs). Several algorithms have been devoted to the distributed solution of LEs, with focus on asynchronous implementations [23, 24], graph connectivity conditions [25], secure computing [26], to name a few. However, in these algorithms, each node needs to find all the entries of the vector of the unknowns, which, if employed in our problem, would require the nodes to know the network size. Instead, we exploit a suitable sparsity condition on the biases to ensure they can be uniquely determined, which is an important problem in compressive sensing [27]-[34], and is related to secure state estimation [5, 35]-[38].
A related problem, which several papers have studied, is the one of achieving consensus or a prescribed formation in the presence of inconsistent or biased measurements. In [11], the authors use estimators to counteract compass mismatches, while requiring each node to measure the relative positions of all the edges. The paper [10] addresses the rigid formation control problem where the agents disagree on the prescribed inter-agent distances. For the problem considered in our paper, this method would require that for each pair of adjacent nodes, at least one of the nodes is bias-free. A similar set-up is also adopted in [39]. For second-order consensus, [40] proposes an adaptive compensator to prevent the state unboundedness caused by the biases. The proposed compensator cannot make the system achieve exact consensus.
Our contribution. Given relative state measurements that are affected by biases, we find conditions under which the biases are identified so that the actual relative states can be exactly reconstructed. Similar to [1, 8, 13, 20, 21, 22, 41], we assume that biased measurements can be exchanged among the neighboring nodes. Differently from [17, 40], we assume that each node has one sensor, hence the relative measurements taken by the node are affected by the same bias. The form of the system of LEs to which we reduce the problem is different from the one formulated in papers involving range or AOA measurements [11, 20]-[22]. In our problem (see Section III) the biases affect the relative state measurements, whereas for problems involving range or AOA measurements the biases affect the absolute value of or the pointing of the vector of the relative measurements (distances or bearings). The LEs of the form considered in [11, 20]-[22] also appears in papers that studied problems of sensor synchronization [42] and multi-agent fault estimation [35].
We provide conditions under which the biases are uniquely determined from the proposed system of LEs. Our results answer the question: “what is the maximum number of sensor biases that can be estimated from erroneous relative state measurements?” For non-bipartite graphs, the answer is “all the nodes” and we provide a distributed algorithm to estimate the biases. In the algorithm, each sensor only needs to estimate its own bias, leading to a reduction of the computational resources and memory sizes required at each node, a solution that is different from those in [23]-[26].
For bipartite graphs, similar to secure state estimation problems [5, 35]-[38], we show that the biases can be correctly computed when less than half of the sensors is biased. Furthermore, we prove that the maximum number of biased sensors can be increased if the biases are heterogenous. This reduces the number of unbiased sensors to only two and improves the results in secure state estimation. We provide two algorithms to compute the biases. By exploiting the heterogeneous assumption and a coordinator to coordinate the sensors, the first algorithm we propose computes the biases in a finite number of steps. To remove the coordinator and make the estimation fully distributed, in the second algorithm we solve a relaxed -norm optimization problem as in [35, 37]. We show an interesting result that the actual vector of biases is the unique solution of the -norm optimization problem if less than half of the sensors are biased, which does not worsen the bound on the sparsity condition of the biases for the non-relaxed problem.
We also apply the bias estimation algorithms to a consensus problem. Different from [40], we can prove that the system achieves exact consensus. Our algorithms do not require each node to measure the relative states of all the edges, in contrast to [11].
The rest of the paper is organized as follows. In Section II, we introduce the notation, some general notions about graphs and and few specialized results on bipartite graphs. We formulate the problem and provide a useful lemma in Section III. Section IV deals with the bias estimation algorithm for non-bipartite graphs. In Section V, we introduce the sparsity condition on biases that ensures the correctness of the bias estimation, we provide two bias estimation algorithms and show consensus using one of the proposed algorithms. Section VI presents numerical experiments to validate the theoretical findings.
II Preliminaries
II-A Notation
For a vector , represents the diagonal matrix with the th diagonal entry equal to the th element of . We denote by the support of , which is the set of indices that correspond to the nonzero entries of , and by the [math]-norm of , which is the number of elements in . We let and denote the -dimensional vectors with all elements equal to and [math], respectively. Given a matrix , represents its th row and represents its element in the th row and th column. The cardinality of a set is denoted by . For two sets and , we let represent the complement of in .
II-B Graph-theoretic notions
For a network with nodes, let its topology be represented by an undirected and connected graph , with being the set of nodes and be the set of edges, where , or equivalently, node is a neighbour of node , means that node can receive information from node and vice versa. We denote the set of neighbors of node by , and let .
The adjacency matrix of is defined as if node is the neighbor of node and otherwise. For an undirected graph , we can assign arbitrary orientations to the edges such that each edge has a head and a tail. The edge-node incidence matrix of , with , is defined as if is the head node of the edge and if is the tail node. The Laplacian matrix of is an matrix given by for and . Since is undirected, it is well-known that . The incidence matrix can be decomposed as the head incidence matrix and the tail incidence matrix , which are given by
[TABLE]
We also let denote the signless edge-node incidence matrix with . It is easy to verify that and . Let and . The matrix is called the signless Laplacian matrix. When is undirected, . Hence, is positive semi-definite and all its eigenvalues are real and nonnegative.
A path from node to node is a sequence of nodes and edges such that each successive pair of nodes in the sequence is adjacent. The length of a path is the number of edges in the path. The distance between node and is the length of the shortest path from to . We denote by the diameter of , which is the maximum distance between any two nodes.
II-C Bipartite graphs
A graph is bipartite if the vertex set can be partitioned into two sets and in such a way that no two vertices from the same set are adjacent. The sets and are called the colour classes of and is a bipartition of . For a bipartite graph, the following result holds:
Theorem 1
[43]* A graph is bipartite if and only if has no cycle of odd length.*
An algebraic characterization of bipartite graphs is provided next.
Lemma 1
An undirected and connected graph is bipartite if and only if the signless incidence matrix does not have full column rank. Moreover, if is bipartite, then any columns of are linearly independent.
Proof. To prove the first part, suppose that for some nonzero vector . It is easy to see that for every , where . In fact, consider any path connecting nodes and . For every pair of adjacent nodes in this path we must have otherwise . Since the graph is connected and since must be nonzero, we obtain the claim. Thus there exists a bipartition of , where the nodes corresponding to the entries of with value and are assigned to and , respectively. Conversely if is bipartite, there exists a bipartition of . By letting the elements of corresponding to and be and , respectively, with , we have , which shows that does not have full column rank.
For the second part, we prove it by contradiction. Suppose there exist some dependent columns of and let the index set of these columns be , with , then there should exist a nonzero vector such that where is the matrix whose columns are those indexed by . The latter implies the existence of a nonzero vector , whose nonzero entries are given by , and satisfies . However, from the proof of the first part, the absolute values of all the elements of should be equal to each other. Hence, must be the zero vector, which is a contradiction.
The if and only if part of the statement above is also provided in [44, Lemma 2.17]. We provide the proof here, since it is used in proving the second part of the statement as well as in other parts of the paper.
For later use, by the proof of Lemma 1, we note that
[TABLE]
for a bipartite graph with bipartition .
Lemma 2
[45]* The smallest eigenvalue of the signless Laplacian matrix of an undirected and connected graph is equal to zero if and only if the graph is bipartite. In case the graph is bipartite, zero is a simple eigenvalue.*
II-D Compressed sensing
In the field of compressed sensing or sparse signal recovery, one of the most important problems is how to find the sparsest solution from the number-deficient measurements. Formally, consider the following linear equation
[TABLE]
where is the vector of unknown variables, is the vector of known values, and is a matrix defining the linear relation from to . It is assumed that , thus equation (8) is under-determined. It is then of interest to find solutions such that , and in particular to seek for the sparsest solution of (8). Let us define the set of -sparse vectors as
[TABLE]
The following result provides a sufficient condition under which the solution of (8) can be uniquely determined.
Lemma 3
Given an integer , let , and assume that any matrix made of columns of is full column rank. If is a solution of (8), then there exists no other solution of (8) in .
Remark 1
Under the assumptions of the lemma, the solution of (8) is also the solution to
[TABLE]
that is, the sparsest solution to (8). The proof of Lemma 3 descends from [28, Lemma 1].
However, solving from (8) under the assumption that is cumbersome when is not small, as it requires to combinatorially search for columns of whose span contains . A typical way to avoid this exhaustive search is to change the problem into the following -norm optimization problem
[TABLE]
where is the vector of known values in (8) and the objective function and the constraint are both convex. Problem (11) can be solved by linear programming [30]. The -norm minimization may return a solution different from the solution of (8).
The following definition and result characterize the relation between the matrix , the equation (8) and the -norm minimization problem.
Definition 1** **(Nullspace Property)
A matrix is said to satisfy the nullspace property of order , with being a positive integer, if for any set with and any nonzero vector in the null space of , the condition below holds
[TABLE]
where and are subvectors of whose elements are indexed by and , respectively, and .
The null space property is usually difficult to verify and a more restrictive but more conveniently checkable condition known as restricted isometry property is considered [30, p. 8]. Yet, in the special cases that are of interest to us the null space property can be easily confirmed (cf., Theorem 7), and we will persist with it in the sequel.
Theorem 2
[30, Theorem 2.3]* Every vector is the unique solution of the -norm minimization problem (11), with , if and only if satisfies the null space property of order .*
We highlight the role of this theorem explictly in connection with the equation (8). For a given , let be a solution of (8). Assume that and satisfies the null space property of order , with . By Theorem 2, is the unique solution of (11), with . Stated directly, there exists a unique solution of (11), with , and it satisfies . Hence, under the given condition of -sparsity of the vector solution of (8) and the null space property of order of the matrix , solving the optimization problem (11), with , univocally returns .
III Problem formulation – biases estimation in sensor networks
We consider a sensor network where each sensor is identified with a node in a graph with the set of nodes, and the set of edges. Throughout the paper, we assume that is connected and undirected. A state variable is associated to each node . Each sensor can measure the relative information for all .
We are interested in a scenario where the measurements taken by the sensor network may be subject to constant biases. As a result of the bias, the relative information read by the sensor , will be modified as
[TABLE]
where is an unknown constant term accounted for the bias of sensor . In case a sensor is bias free we set .
The presence of biases deteriorate the performance of the network, and may even raise stability issues. Thus it is of interest to estimate the biases, and possibly counteract their effect in the network.
To formulate the problem, we first rearrange the equalities in (13) in a suitable vector form. After assigning arbitrary orientation to , we collect in the vector all the measurements for which node is the head of the edge , which gives , with denoting the head incidence matrix. Similarly, we collect in the vector all the measurements for which node is the tail of the edge , and obtain , where is the tail incidence matrix. Hence,
[TABLE]
Note that, by construction, we have , where
[TABLE]
and denotes the column span of a matrix.
For a given measurement , we are interested in finding the bias vector in a set of admissible biases, which is defined more precisely later. To avoid ambiguity, we first introduce the definition of a solution of (18) with respect to .
Definition 2** **(Solution of (18) in )
Given and a set of admissible biases, the vector solves (18) if there exists such that (18) is satisfied with . In this case, we say solves (18) in , or is a solution of (18) in .
The uniqueness of the solution of (18) is defined below:
Definition 3** **(Unique solution of (18) in )
A solution of (18) in is unique if there exists no vector , with , which is a solution of (18) in . In this case, we say uniquely solves (18) in .
We then formulate the problem which is of interest in this paper.
*Problem formulation. * Given the vector of biased measurements and a set of admissible biases, find conditions under which the vector of actual sensor biases is the unique solution of (18) in , and design algorithms for estimating it.
Note that should always contain the bias vector and by construction at least one solution to (18) exists. Determining conditions under which the solution to (18) is unique implies we can correctly estimate the vector of actual biases affecting the measurements. To prove the uniqueness of the solution of (18) we will rely on a reduced form of (18) provided in the following result:
Lemma 4
Consider the vector of biased measurements and a set of admissible biases. Consider the equality
[TABLE]
where is the signless edge-node incidence matrix, , and is the left annihilator of the matrix . Then the following two statements hold:
- (i)
The vector is a solution of (18) in if and only if is a solution of (19). 2. (ii)
The vector is the unique solution of (18) in if and only if is the unique solution of (19) in .
Proof. . (Only if) If is a solution of (18) in , then pre-multiplying (18) by leads to . Hence is also a solution of (19).
(If) Since is a solution of (19) in , then , with . Since , there should exist a vector and such that
[TABLE]
Pre-multiplying the equality above by leads to . Combining this with , we have . We continue the proof considering the following two distinct cases.
Case 1. is not bipartite. Since is not bipartite, by Lemma 1 the matrix is full-column rank, which implies . Hence is a solution of (18).
Case 2. is bipartite. Since is bipartite, there should exist a bipartition . Let , label the nodes in such that , and define the orientations of the edges in such a way that the head node of each edge in belongs to . Bearing in mind the identity above, and noting (7) we have
[TABLE]
for some . Substituting this back to (24) yields
[TABLE]
To prove that is a solution of (18) in , in view of Definition 2, we need to show that
[TABLE]
which, by (26), reduces to
[TABLE]
Let and be decomposed as
[TABLE]
for some matrices and . Then (27) can be written as
[TABLE]
where we have used the fact that . Noting that , it is easy to verify that the above relationship is satisfied since
[TABLE]
This completes the proof of part (i).
. We only prove the “if” part since the converse implication can be shown similarly. Assume is a unique solution of (19) in , then by (i), we have is also a solution of (18) in . Now if there exists another vector , with is a solution of (18), it should also be a solution of (19) by the first statement. This contradicts the uniqueness assumption.
The result of Lemma 4 will be used in some of the derivations of the main results in the sequel.
To study the conditions guaranteeing the uniqueness of the solution of (18) in , we differentiate between bipartite and not bipartite graphs.
IV Non-bipartite graphs
In this section, we present the results for the case when the measurement graph is not bipartite.
IV-A Condition for correct bias estimation
The following result shows that can be determined uniquely from (18) if the graph is not bipartite.
Theorem 3
Consider a graph , let be the vector of biased measurements, and be the set of admissible biases. Then is the unique solution of (18) in if and only if is not bipartite.
Proof. In view of Lemma 4, we need to show that the bias vector is the unique solution of (19) if and only if is not bipartite. This holds since, by Lemma 1, the matrix has full column rank if and only if is not bipartite.
IV-B Distributed bias estimation
In this section we propose a distributed algorithm to estimate the biases. We assume the existence of a communication network, modeled by an undirected and connected graph , through which the nodes can communicate with each other without any imperfection. We let and .
We assign to each node a bias estimation variable of the bias affecting its sensor. For each node , we let the estimation variable evolve as follows:
[TABLE]
Node uses the biased measurements and , and the bias estimates and . Note that the values of and are communicated to node via the link .
The following result shows exponential convergence of the estimates to the actual biases.
Proposition 1
The estimate vector generated by (28) converges exponentially fast to the vector of the actual biases if the measurement graph G is not bipartite.
Proof. Denote the estimation error for the bias as . From (28), we have
[TABLE]
which in a matrix form can be expressed as
[TABLE]
By Lemma 2, the matrix is Hurwitz if and only if is not bipartite. The exponential convergence of the estimation error then follows immediately.
An alternative way to solve for in (19) is to use the block partition method of [46, 41, 17]. When applied to the problem under investigation in this paper, the method requires each node to estimate not only its own bias but also those of its neighbors. In contrast, the estimation algorithm (28) only requires each node to store and transmit it own estimate, hence it reduces the memory space and communication burden.
IV-C An example of use: rejecting biases in a consensus network
In this subsection, we investigate the possibility of removing the effect of relative state measurement biases from a consensus algorithm. By exploiting the bias estimation method provided in the previous subsection, we devise a compensator that asymptotically rejects the biases. To this end, let
[TABLE]
where is an additional control input available to the designer. Note that without a proper compensation, i.e., , solutions of (31) can be unbounded. Let be given by
[TABLE]
where is given by (28). This results in the closed-loop dynamics
[TABLE]
which can be written compactly as
[TABLE]
In case of a non bipartite graph, the vector of biases can be asymptotically rejected and consensus can be achieved:
Proposition 2
Let be a non-bipartite graph. Then, solutions of (30), (34), exponentially converge to the point , where and . If is initialized at zero, equivalently , then we have
[TABLE]
*for each . *
Proof. Equation (34) can be seen as the conventional consensus dynamics driven by the bias estimation error. Let be the eigenvalues of along with the basis of orthonormal eigenvectors . Define , with and apply the state transformation . In the new coordinates, we have
[TABLE]
where is the solution of
[TABLE]
and follows
[TABLE]
with . By Proposition 1, if is not bipartite then the estimation errors satisfy
[TABLE]
from which we have
[TABLE]
which implies
[TABLE]
Since , the vector converges to zero exponentially fast. Hence, we find that exponentially converges to for some . It is easy to see that
[TABLE]
If , then given by (35), for each , which completes the proof.
Although the system with bias compensation achieves consensus, the exact consensus value to which the agents converge is not predictable since it depends both on the initial state and the bias of the sensors. For those problems where it is of primary interest to converge to the average consensus, alternatively one can first run the algorithm (28) over a sufficiently large time horizon to obtain a sufficiently accurate estimate of the biases, and then directly remove the biases from the measurements used in the consensus algorithm.
V Bipartite graphs
In this section, we consider the case where the measurement graph is bipartite.
V-A Conditions for bias estimation
For bipartite graphs, the following result gives a general condition that ensures that the vector of biases can be correctly estimated from the measurement (18).
Theorem 4
Consider a bipartite graph , if a vector solves (18) in , with , then it uniquely solves (18) in .
Proof. Since is bipartite, by Lemma 1, any submatrix of with columns has full column rank. Hence, by Lemma 3, if there exists a solution of (19), then it is unique in . The proof ends by noticing that if is a unique solution of (19) in then it is the unique solution of (18) in (see Lemma 4).
To ensure uniqueness of the solution in (18), approximately half of the sensors are required to be bias free by Theorem 4. Next, we introduce rather mild restrictions on the admissible set of biases in order to obtain more relaxed conditions on the number of bias free sensors.
Definition 4
- (i)
The set , with , of heterogeneous -sparse bias vectors is the set of all vectors such that their nonzero entries are different from each other, namely for any with and . 2. (ii)
The set , with , of absolutely heterogeneous -sparse bias vectors is the set of all vectors such that their nonzero entries in absolute value are different from each other, namely for any with and .
Note that we have , for each .
Theorem 5
Consider a bipartite graph ,
- (i)
If there exists that solves (18) in , then it uniquely solves (18) in . 2. (ii)
If there exists that solves (18) in , then it uniquely solves (18) in .
Proof. Noting Lemma 4, we work with equation (19) to prove uniqueness of the solution.
We prove this part by contradiction. Suppose there exists another solution of (19), satisfying . Then
[TABLE]
By (7) this implies that , where is given by (25) and .
Let and be the support of and . If is nonempty, i.e, there exists at least one index such that , then . This implies and leads to a contradiction. If , we have that should have at least elements since111 Note the following two identities: and . Replacing the right-hand side of the second identity into the first one, we obtain , or . Since and , we obtain , as claimed.
. However, this would imply that there exist at least three distinct indices , such that each one of , , is either equal to or , with . Hence, at least two elements in the set must be the same, which contradicts the heterogeneity assumption . This completes the proof of uniqueness for part (i).
Suppose by contradiction that there exists another solution of (19), satisfying . Analogous to the proof of , if is nonempty, then , while if , the set has at least elements since . This would imply that there exist at least two distinct indices , such that each one of and is equal to either or , with . This results in , thus contradicting the absolute heterogeneity assumption . This completes the proof. of (18).
Thus, focusing the attention on the class of heterogeneous biases in the sense of Definition 4 considerably increases the number of allowable biased sensors.
V-B Distributed bias computation with coordinator
In this subsection we focus on algorithms for computing the actual vector of biases . We propose the use of a coordinator that delegates the computation of the biases to the nodes while organising the execution of their commands. Compared to a centralized solution, the distributed computation with a coordinator eases the analysis and does not require to know the network topology.
We consider the case when and use the result established in Theorem 5 (ii). When , there exist at least two (bias free) nodes , , satisfying . The essence of the algorithm here is to find such a bias free pair. To this end, some additional notation is needed. For a pair of nodes with , let be a path connecting them, namely , with , , and the length of the path. Moreover, we collect the measurements that are indexed by as
[TABLE]
Finally, we let
[TABLE]
We then have the following result:
Proposition 3
Consider a bipartite graph , let be the vector of biases and assume that . For a given pair of nodes , with , and a path connecting them, we have:
- (i)
* if and only if , i.e., the pair is bias-free.* 2. (ii)
*If , then . * 3. (iii)
* for , where are defined similarly to .*
Proof. (i) By (13), the vector equals
[TABLE]
from which
[TABLE]
Noting , we find that if and only if , as claimed.
(ii) By (45), we immediately obtain that if .
(iii) The conclusion is straightforward to obtain by the definition of and (43).
From Proposition 3 (i), no matter along which path the quantity is computed, the identity holds if and only if the pair is bias-free. Hence, is an indicator of whether or not a pair of nodes are bias free. In addition, by Proposition 3 (iii), if node knows , then it can compute . In turn, by Proposition 3 (ii), if , then the variable equals the bias . Based on Proposition 3, searching the bias free nodes and solving the bias can be concurrently carried out by the nodes in a distributed fashion coordinated by a coordinator. The idea is to let the coordinator make selections of a candidate bias-free node and let the other nodes compute the variables with respect to the selected node. As soon as a zero is observed at a node , then that node informs the coordinator to terminate the search. At this stage, every node has computed the value of its bias via the indicator variable, namely .
The commands executed by the coordinator are summarized in Algorithm 1, whereas the commands executed by the nodes are listed in Algorithm 2. Algorithm 2 comprises two stages, the node pair test stage, in which the coordinator and the nodes cooperate to check whether or not a given pair of nodes is bias free, and the bias computing stage during which the biases are explicitly computed. In Algorithm 2, we assume that each node has access to the data , which can be achieved by letting all the nodes collect the measurements from their neighbors, before running Algorithms 1 and 2.
To measure the number of executed instructions required by the algorithms to terminate the computation, we introduce counters that store integer values.
In Algorithm 1, the sequence of actions by the coordinator consisting of informing node that it has been selected, and asking nodes to calculate and send back the variable is considered as one instruction, which increases the counter by unit. The single action of informing all the nodes to start the Bias computing stage, is regarded as another instruction, and again results in an increase of by unit. In Algorithm 2, at each iteration , the variable , , stores the number of instructions executed from the moment that node is selected by the coordinator till when computes . The counters , , are communicated to the coordinator and used to update the counter , which therefore contains the total number of instructions executed before the bias free node pair is found. Note that the counters are only introduced to store the number of instructions needed for the computation of the solution, as formalized in Theorem 6, but do not play any role in the computation of the solution itself.
The following result summarizes the properties of the algorithms:
Theorem 6
Consider a bipartite graph , with its diameter given by , let be the vector of biases and assume that . If the coordinator uses Algorithm 1 and the nodes Algorithm 2, then a bias free node can be identified in instructions and the vector of biases can be reconstructed in instructions with .
Proof. At iteration , with , the coordinator selects node and informs all the nodes to start the node pair test stage (see Algorithm 1). We first focus on the node pair test stage.
According to Algorithm 1, if node is selected, the coordinator informs all the nodes , and is increased by . According to Algorithm 2, when node receives the message from the coordinator that it has been selected, it sets and , and sends them to all the neighbors . The instructions executed from the instant when node has been informed that it has been selected to the instant when nodes computes are regarded as one and it is set .
When the node receives , it computes and , then sends to the coordinator and its neighbors. Hence actions are executed from the instant when node is informed to have been selected to the instant when node computes . Let be the maximum of the distances of node to all other nodes in . Consequently, each node , which is at a distance from node , receives , with , from some neighbor , which is at a distance from node . The node computes and, in view of Proposition 3 (iii), we have
[TABLE]
All the nodes then send , with , to their neighbors and the coordinator. Hence instructions are executed from the instant when node is informed it has been selected to the instant when node computes . By this analysis, after node has been informed at iteration , instructions are executed before the coordinator receives from all . Hence at each iteration , is increased of at most to check where the extra comes from
Since and can be used interchangeably, the coordinator obtains all for , , in at most iterations. By the assumption and Proposition 3, there always exists an iteration and a node such that . Hence the bias free node pair should be found in steps.
We then consider the bias computing stage. This occurs if the coordinator received at iteration for some . Then each node enters this stage and it concludes that the computed quantity is the bias . As a matter of fact, since , then , by Proposition 3 (i), and this actually implies that if , by Proposition 3 (ii). For , we note that was set equal to zero in the node pair test stage, and therefore .
To complete the computation of the number of executed instructions, we note that by Algorithm 2 one more instruction is needed to let the coordinator inform all the nodes that is bias free and another instruction to let the nodes compute the biases.
A few remarks are in order:
In case , so that the assumption in Theorem 6 is not satisfied, then will not be observed at any node, and the coordinator infers that there is no pair of bias-free nodes. 2. -
In Algorithm 1, the coordinator is only responsible for coordinating the nodes, namely initializing each iteration, whereas all computations are performed at the nodes in a distributed fashion. Moreover, note that the coordinator does not need to know the topology of the network, apart from the node set . 3. -
Another method to compute the vector of biases when is to combinatorially search the pair of nodes that is bias-free, as in [5, 47]. Specifically, for each pair of indices , with , one could look for a solution of the modified equation , where is a vector whose entries and are set to zero. If a solution to this modified equation exists, then by construction it satisfies the sparsity condition , and by Theorem 5 (ii), it will be equal to the vector of actual biases. Hence, the determination of the vector of biases satisfying (18) is reduced to considering the systems of equations and check if each of these equations admit a solution. Note however that such an approach would require that the unit carrying out the combinatorial search has access to the network topology and possesses enough computational power.
V-C Distributed bias estimation without coordinator
In the previous section we assumed the existence of a coordinator that supervises the nodes checking the conditions of Proposition 3. In this section, we seek a method that estimates the biases in a distributed manner without resorting to a coordinator. We show that this is achievable provided that we restrict the class of admissible biases. To this end, by Subsection II-D and equation (19), we consider the following -norm minimization problem
[TABLE]
where is the vector of known values appearing in (19). As mentioned in Section II-D, solving the -norm minimization problem may yield a solution that is different from the vector of actual biases . The sparsity condition under which the solution of (47) coincides with is provided in the following theorem.
Theorem 7
For a bipartite graph , the vector of biases is the unique solution of the -norm minimization problem (47) if the number of biased sensors is not greater than , i.e., .
Proof. Since the graph is bipartite, then (7) holds. Hence, inequality (12) in this case is given by
[TABLE]
which is satisfied if and only if . Hence, the matrix satisfies the null space property of order , with .
Therefore, by (19), Theorem 2 and the discussion following it, if the vector of biases in (19) satisfies , then there exists a unique solution of the optimization problem (47), with , and it is equal to .
This theorem shows that for bipartite graphs, the -norm minimization does not decrease the maximum number of allowed biased sensors obtained in Theorem 4. On the other hand, in the case where the vector of biases belongs to the set of heterogeneous biases or considered in Theorem 5, examples can be found where the solution of the -norm minimization problem does not give the correct bias estimation. Hence, below, we only discuss the solution of (47) for the case of bipartite graphs with a number of biased sensors as characterized in Theorem 7.
The -norm optimization problem (47) can be solved directly in a distributed manner by the methods in [48, 34]. In this paper, we reformulate it as a linear programming problem as [33]
[TABLE]
where is the decision variable and
[TABLE]
Under the sparsity condition in Theorem 7, if is the solution of (49), the vector of biases can be computed as
[TABLE]
The linear programming problem above can be solved by various distributed methods available in the literature, see e.g. [49, 50, 51]. In particular, using the result of [51], the bias estimation algorithm takes the form
[TABLE]
with
[TABLE]
and where is the dual variable and the initial condition satisfies for all .
For this algorithm, we have the following result:
Proposition 4
*The estimate generated by the algorithm (V-C), (56) converges asymptotically to the vector of biases if is bipartite and . *
Proof. This result follows directly from [51, Proposition IV.4] noting that the linear program (49) has a unique solution.
Remark 2
Similarly to Subsection IV-C, one could use the estimate generated by the algorithm (V-C), (56) in the compensator (32) to reject the effect of the biases and achieve consensus. In fact, the consensus dynamics (34) driven by the estimation error continues to be valid and an analysis similar to the one in Proposition 2 can be carried out. In the case of bipartite graphs, however, we cannot provide the estimate of the new consensus value, due to the lack of the exponential convergence of the estimation error.
For the problem at hand, the algorithm (V-C) has some advantages when compared with possible alternatives, such as the one provided by the recent paper [48], where a new distributed algorithm for solving the -norm minimization problem with linear equality constraints is proposed. However, in this method each node needs to reconstruct all the elements of the solution of the -norm minimization problem, which implies that each node stores and communicates a vector with the same dimension as the (unknown) solution. Moreover, an implicit requirement for the method in [48] is that each agent must know the number of columns of the coefficient matrix, which translates to knowing the network size in our setting. In the method given by (V-C), on the other hand, each node reconstructs only one element of by communicating suitable variables with its neighbor. The latter is done without relying on any global information including the size of the network.
Remark 3
Resorting to different formulations of the -norm minimization problem, one can obtain variations of the algorithm (V-C) with different features. For instance, (47) can be reformulated as
[TABLE]
where is the signless Laplacian matrix (see Section II-B). We can transform the above into a linear program analogous to (49). Then, one can write a distributed algorithm similar to (V-C) for which the variable is now defined on the nodes, and thus has elements. However, in (50) becomes . The term in (56) requires each node to collect not only , for , but also , for , which is a two-hop information. On the other hand, in (V-C) each node only needs the decision variables and the dual variables of its neighbors.
VI Numerical Simulations
In this section, we provide numerical simulations to illustrate the results for bias estimation and compensation for both non-bipartite graph and bipartite graph.
VI-A Non-bipartite graphs
We consider a network with nodes and each node takes a sensor. The associated graph is non-bipartite and given by Fig. 1. The initial state and the bias of each node are generated randomly within the intervals and , respectively. A specific example is given as below
[TABLE]
We simulate the consensus dynamic (31) with the bias estimator (28) and the bias compensator (32), where the initial condition for the bias estimate is . The simulation result is provided in Fig. 2, where Fig. 2 and 2 show the system state evolution without bias compensation and with bias compensation, respectively, and Fig. 2 shows the bias estimation error . As can be seen in Fig. 2, if the biases are not compensated, the nodes will not achieve exact consensus and the state of each node drifts away under the influence of the measurement biases. On the contrary, using the bias estimator (28) and the compensator (32), the bias error vanishes and all variables converge to the same finite value.
VI-B Bipartite graphs
Now, we consider a bipartite graph, which is obtained from the graph in the last subsection removing the edge .The initial state of the system is the same as the one in the previous subsection.
We first show that if more than sensors of nodes are biased, the minimization (47) may fail to find the vector of the actual biases for bipartite graphs. We assume that the sensors of the first five nodes are biased and
[TABLE]
We simulate the consensus dynamics (31) with the bias estimator (V-C) and the bias compensator (32). The initial conditions for and are set to zero. The result is given in Fig. 3, from which one can see that the entries of the bias estimation error converge to two values with the same absolute value but opposite signs, thus the biases are not correctly estimated and consensus is not achieved.
We then let the sensor of the fifth node also to be unbiased, namely the last six entries of in (58) are all zero. The condition of Theorem 7 is now satisfied. The result is depicted in Fig. 4, which shows that the bias estimation error decays to zero and the system achieves consensus.
VII Conclusion
In this paper, we studied the problem of estimating the biases in sensor networks from relative state measurements, with an application to the problem of consensus with biased relative state measurement. Without any sparsity constraint on the biases, we show that the biases can be accurately estimated if and only if the graph is non-bipartite. For bipartite graphs, we show that the biases can be uniquely determined from the measurements if less than half of the sensors is biased. The number of biased sensors can be increased when the biases are heterogeneous, i.e., different from each other, or absolutely heterogeneous, i.e., with absolute values different from each other. For both non-bipartite and bipartite graphs, we propose distributed methods to compute the biases.
The problem considered in this paper can be further investigated. First, if the sensors are affected by noise in addition to biases, one could study how noise impacts the accuracy of the estimation of the biases [47]. Second, the result for bipartite graphs could be also used for problems where the range and angle of arrival measurements are affected by biases [11, 20]-[35].
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] V. Kekatos and G. B. Giannakis, “Distributed robust power system state estimation,” IEEE Transactions on Power Systems , vol. 28, no. 2, pp. 1617–1626, May 2013.
- 2[2] A. Mitra and S. Sundaram, “Distributed observers for lti systems,” IEEE Transactions on Automatic Control , vol. 63, pp. 3689–3704, 2018.
- 3[3] I. Coddington, W. C. Swann, L. Nenadovic, and N. R. Newbury, “Rapid and precise absolute distance measurements at long range,” Nature photonics , vol. 3, no. 6, p. 351, 2009.
- 4[4] F. Fagnani, S. Fosson, and C. Ravazzi, “A distributed classification/estimation algorithm for sensor networks,” SIAM J. Control and Optimization , vol. 52, pp. 189–218, 2014.
- 5[5] H. Fawzi, P. Tabuada, and S. N. Diggavi, “Secure estimation and control for cyber-physical systems under adversarial attacks,” IEEE Transactions on Automatic Control , vol. 59, pp. 1454–1467, 2014.
- 6[6] J. Cortés, “Global and robust formation-shape stabilization of relative sensing networks,” Automatica , vol. 45, pp. 2754–2762, 2009.
- 7[7] Y. Mo and B. Sinopoli, “On the performance degradation of cyber-physical systems under stealthy integrity attacks,” IEEE Transactions on Automatic Control , vol. 61, pp. 2618–2624, 2016.
- 8[8] S. Zhao and D. Zelazo, “Localizability and distributed protocols for bearing-based network localization in arbitrary dimensions,” Automatica , vol. 69, pp. 334–341, 2016.
