Output Average Consensus Over Heterogeneous Multi-Agent Systems via Two-Level Approach
Yutao Tang

TL;DR
This paper introduces a two-level hierarchical framework for achieving output average consensus in heterogeneous multi-agent systems, effectively decoupling agent complexity from coordination and communication challenges.
Contribution
It presents a novel two-level approach using system abstraction to solve consensus problems in heterogeneous multi-agent systems, simplifying complex dynamics.
Findings
Successfully applied the method to a multi-agent example
Decouples agent heterogeneity from coordination complexity
Demonstrates effectiveness through simulation results
Abstract
In this paper, a novel two-level framework was proposed and applied to solve the output average consensus problem over heterogeneous multi-agent systems. This approach is mainly based on the recent technique of system abstraction. For given multi-agent systems, we first constructed their abstractions as the upper level and solved their average consensus problem by leveraging well-known results for single integrators. Then the control protocols for physical agents in the lower level were synthesized in a hierarchical way by embedding the designed law for abstractions into an interface between two levels. In this way, the complexity coming from heterogeneous dynamics of agents is totally decoupled from that of the coordination task and the communication topologies. An example was given to show its effectiveness.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDistributed Control Multi-Agent Systems · Advanced Memory and Neural Computing · Neural Networks Stability and Synchronization
Output Average Consensus Over Heterogeneous Multi-Agent Systems via Two-Level Approach
Yutao Tang ***Yutao Tang is with the School of Automation, Beijing University of Posts and Telecommunications, Beijing 100876. P. R. China. Email: [email protected]
Abstract: In this paper, a novel two-level framework was proposed and applied to solve the output average consensus problem over heterogeneous multi-agent systems. This approach is mainly based on the recent technique of system abstraction. For given multi-agent systems, we first constructed their abstractions as the upper level and solved their average consensus problem by leveraging well-known results for single integrators. Then the control protocols for physical agents in the lower level were synthesized in a hierarchical way by embedding the designed law for abstractions into an interface between two levels. In this way, the complexity coming from heterogeneous dynamics of agents is totally decoupled from that of the coordination task and the communication topologies. An example was given to show its effectiveness.
Keywords: average consensus, system abstraction, two-level control, heterogeneous multi-agent system
1 Introduction
As a fundamental problem of multi-agent systems, consensus has been widely investigated due to its numerous applications such as cooperative control of unmanned aerial vehicles, communication among sensor networks, and formation of mobile robots [12, 13, 16, 24, 17].
While consensus only requires the agreement on some common signal, average consensus (i.e., consensus on the average of some individual signals) of multi-agent agents has been shown as an inevitable part of the solution for more complex problems in several applications, including distributed filtering [2] and multi-robot flocking [22]. Note that an extra condition has to be satisfied in average consensus, relating the limiting behavior of the whole system to the initial states, this problem is certainly more challenging especially when we expect average consensus of all outputs in a heterogeneous multi-agent network.
The main difficulty hurdling the output average consensus analysis over general multi-agent systems lies in the complexities due to the couplings between high-order heterogeneous dynamic and average task. In fact, existing results are relatively few, and most publications emphasize on only simple agents (e.g. single or double integrators) under a fixed graph. For example, a local averaging protocol for single integrators was employed in [12] from a control viewpoint to solve this problem under a strongly connected and balanced topology. Fast linear iterations were also proposed in [25] to solve the distributed averaging problem in a discrete-time version. A dynamic average consensus rule was proposed in [8] such that each agent can track the average of their dynamic inputs with some steady-state error. A similar design was also provided for integrator-type agents under general graphs in [1]. However, to our knowledge, there is no general output average consensus conclusion over high-order multi-agent systems even under fixed undirected graphs except [14]. The authors in [14] assumed that each agent shares its initial position and proposed an integral control rule to drive several identical high-order integrators to achieve an output average consensus. Nevertheless, the solvability of output average consensus over general (heterogeneous) linear multi-agent systems is still unclear.
Based on aforementioned observations, an intuitive idea to achieve average consensus over general multi-agent systems is to decouple those complexities brought by high-order dynamics and the average consensus task. If so, we can separately solve two simpler subproblems instead of the original difficult one. The aim of this paper is to show that the abstraction technique is possibly the right tool to achieve this goal.
Abstraction, frequently used in computer science [5] , has been shown as an effective approach to reduce the dynamic complexities of control systems. The authors in [3] proved that a given linear system, satisfying some linear matrix inequalities, can be abstracted into its -related system with a lower dimension while keeping the difference between their output trajectories within a computable bound. A hierarchical distributed control approach was later proposed for coordination of general linear multi-agent systems in [20]. Based on a simpler abstraction and proper interfaces under system-inclusion assumptions, the coordination protocol was synthesized by some embedding techniques according to difference tasks.
By formulating a two-level control framework via abstraction, we aim to solve the output average consensus problem over general linear multi-agent systems. The contribution of the work is at least twofold. Firstly, comparing with the output consensus or synchronization results in [13, 10, 15], we emphasized on the more challenging output average consensus problem. By this novel hierarchical control approach, output average consensus was achieved for a group of general linear agents under mild connectivity conditions, while most existing average consensus analysis and designs were only for special types of dynamics, e.g. single integrators [12]. Secondly, comparing with the abstraction and hierarchical design for a single system in [3], we provided a more precise characterization for linear abstraction problem and extended it to a distributed version for networked systems. Furthermore, those agents considered here are heterogeneous, while only the homogeneous case was considered in [20].
The rest of this paper is organized as follows. Problem statement is presented in Section 2. After introducing some basic results of system abstraction in Section 3, we provide a two-level control scheme with main results in Section 4. Finally, simulation examples and concluding remarks are presented at the end.
Notations: let be the -dimensional Euclidean space, be the set of real matrices. denotes an diagonal matrix with diagonal elements ; for any column vectors . For any vector , . A continuous function belongs to class if it is strictly increasing and ; It belongs to class if it belongs to class with and .
2 Problem Statement
Consider a group of (non-identical) linear agents of the form
[TABLE]
where are its state, input and output, respectively. are matrices with proper dimensions. We assume the pair is minimal and has no transmission zero at the origin of complex plane. Apparently, it includes minimum-phase linear systems and of course high-order integrators as its special cases. For simplicity, we take . The following arguments can be extended to multiple-input and multiple-output cases without difficulties.
Associated with these multi-agent systems, a digraph is defined with node set to describe the communication topology (see [11] for details). If agent can get access to the information of agent , there exists a directed edge in with weight . Define the neighbor set of agent as for and . To achieve a coordination of those agents, this graph should be connected to some degree. The following assumption has been widely in multi-agent systems [12, 13].
Assumption 1
The graph is undirected and connected.
Invoking the topology of these multi-agent systems, we consider distributed control laws of the following form.
[TABLE]
where with a nonnegative integer and smooth functions , to be designed later. When , the control law for agent is a static one. It becomes an output feedback control when only (not ) () is used.
Next, we formulate the output average consensus problem over these multi-agent systems as follows. Given multi-agent systems composed of (1) and a communication graph , find a distributed control law of the form (16), such that
[TABLE]
*where *
Remark 2.1
Instead of merely reaching a consensus, an extra condition, , has to be satisfied which relates the limiting behavior of those multi-agent systems to their initial states. In contrast to many publications on output consensus among several classes of multi-agent systems (e.g. [4, 10]), few results are obtained on average consensus for agents. Moveover, existing average consensus results are only derived for some special multi-agent systems, e.g. integrators [12], while heterogeneous multi-agent systems with general linear dynamics are considered here, which makes this problem much more challenging.
In the following sections, we first give a brief introduction to abstraction techniques, then present a novel hierarchical control approach for our multi-agent system to solve its output average consensus problem.
3 Abstraction and Simulation Function
In this section, preliminary knowledge on abstraction is given for the following analysis. For the sake of consistency, we emphasize on single-input and single-output linear system as follows.
[TABLE]
where . Suppose is minimal. In the following, we refer to (4) as the concrete system to be controlled in practice.
We adopt the simulation-based abstraction formulation [3] for our design and suppose the abstraction of (4) is also linear of the form:
[TABLE]
where . Typically, the dimension of system is much smaller than that of the concrete system, i.e., .
Throughout the paper and are supposed to be forward complete, namely, for every initial condition and every measurable locally essentially bounded input signal, the solution is defined for all , i.e., the maximal interval of existence is . Inspired by [3] and [20], we introduce simulation functions as follows to quantify the approximation relationship between concrete system and its abstraction.
Definition 3.1
Let be a smooth function with and be a continuous function. is a simulation function of by and is an associated interface if there exist two class functions and such that, for all ,
[TABLE]
and for all satisfying ,
[TABLE]
In Inequality (7), we impose a strict decreasing rate than that in [3], which benefits us with more precise characterization of the simulation relationship between those outputs of and .
Lemma 3.2
Let be a simulation function of by with an associated interface , be an admissible input of , , and satisfying
[TABLE]
Then, there exists a class function holding for
[TABLE]
Additionally, if vanishes when goes to infinity, then,
[TABLE]
Proof. The proof will follow the traditional technique of comparison functions and is split into two steps.
Step 1: Consider a set , where . We claim that, if there exists a such that , then for . We prove it by seeking a contradiction.
Assume there exist some and . Let , then , which implies . Combining with the definition of , it gives
[TABLE]
Thus, for some during , which contradicts to the minimality of . Hence the following argument holds as we claimed:
[TABLE]
Step 2: Let . It follows from the above argument for , i.e., . For any , , that is, . By the definition of simulation function, we have, for ,
[TABLE]
By a stand comparison principle [9], there exists some class function such that
[TABLE]
Combining these inequalities, one can safely conclude
[TABLE]
which is exactly the inequality (9).
Suppose vanishes as goes to infinity, then for any given , there exists a large enough satisfying for . We can apply the previous arguments to the composite system from a new initial time , and thus obtain,
[TABLE]
Note that the function , there exists a such that
[TABLE]
Taking , one can thus obtain that, for any ,
[TABLE]
That is as . We thus complete the proof.
A similar estimation was established in [3]:
[TABLE]
Under Definition 3.1, it allows the concrete system to asymptotically simulate its abstraction for some special design of , which is more proper for consensus coordination over complex multi-agent systems.
4 A Two-Level Design
In this section, we will provide a two-level framework to solve the output average consensus problem over heterogeneous multi-agent systems. The hierarchical structure and information flow of our abstraction-based distributed control approach is depicted in Figure 1. Details will be specified in the following subsections.
4.1 Abstraction Level: Protocol Design
First, a network of abstractions should be set up as the upper level according to given tasks. The following lemma for linear systems plays a key role in our design.
Lemma 4.1
If the triple is minimal with no zero at the origin, the system (4) takes an integrator as its abstraction with an interface of the form , where satisfy , is a matrix such that is Hurwitz and is freely selected.
Proof. To prove this lemma, we only have to find a simulation function and its associated interface. Since the plant has no zero at the origin, by the transmission zero condition in [7], there exists a pair satisfying . Taking a matrix such that is Hurwitz and letting give
[TABLE]
Next, we take a linear control law ,
[TABLE]
One can easily verify the conditions in Definition 3.1.
In fact, since is Hurwitz, there exists a positive definite matrix such that . Take , where . Apparently, .
[TABLE]
Let and
[TABLE]
the inequality (7) holds. Thus and are indeed the simulation function and associated interface between and the integrator under Definition 3.1.
By Lemma 4.1, we select the abstraction of agent to achieve average consensus in the upper level as follows:
[TABLE]
Then, proper protocols to complete the average consensus goal in the upper level for those abstractions should be proposed, which has been well-studied in literature [12].
A neighbor-based protocol is used here for average consensus of abstractions:
[TABLE]
Remark 4.2
Although we only consider output average consensus for agents of the form (1), it is remarkable that output weighted consensus problem on with can also be solved when weighted consensus is achieved in the upper level. In fact, letting and recalling Corollary 3 in [12], we can solve it easily by following the same procedure.
4.2 Agent Level: Interface Embedding
After designing controllers for the abstraction level, we synthesis the control protocol for (1) to solve our original multi-agent systems.
Note that, the abstraction is locally set up as a virtual reference, it is reasonable to choose its initial conditions and use its state and input in our control as well. Thus the distributed coordination is transformed into decentralized interface constructing and reference embedding problems.
Combined with Lemma 4.1, a state-feedback interface candidate would be . by embedding (14) into this interface, a control candidate to achieve output average consensus of our multi-agent systems is
[TABLE]
When only output information is available, it is possible to provide a dynamic output-feedback interface as follows
[TABLE]
where is a chosen matrix such that Hurwitz.
It is interesting to remark that an initialization is employed in our design, which can be taken as an information-sharing mechanism to achieve a cooperative task. Similar ideas have been used in many publications for integrators, e.g. [8] and [14].
4.3 Performance Evaluation and Convergence
In this subsection, we shall prove the solvability of output average consensus problem over these heterogeneous multi-agent systems under proposed controls (15) and (16).
It is time to give our first main theorem.
Theorem 4.3
Under Assumption 1, the output average consensus of multi-agent systems (1) can be achieved by a state-feedback control law of the form (15).
Proof. To prove this theorem, we rewrite the composite system as follows.
[TABLE]
where . It is of the cascaded form while -subsystem is the driven one. Letting gives
[TABLE]
By Theorem 5 in [12], it solves the average consensus of , that is, .
Apparently, it happens that . By Lemma 4.1, we have
[TABLE]
as and thus complete the proof.
This result can be extended to a class of digraphs as follows.
Corollary 4.4
For given multi-agent systems composed of (1) with a fixed digraph topology . The output average consensus problem is solvable if and only if is strongly connected and balanced.
The proof is not hard, since the average consensus in the upper level under (14) is solved if and only if is strongly connected and balanced by Theorems 3 and 5 in [12]
There might be some cases when only is available through measurement. We then present the second main theorem for these multi-agent systems under output feedback law (16).
Theorem 4.5
Under Assumption 1, the output average consensus of multi-agent systems composed of (1) can be solved by a dynamic output-feedback control law of the form (16).
Proof. As that in Theorem 4.3, the composite system under (16) is as follows.
[TABLE]
Letting , and gives
[TABLE]
Since and are both Hurwitz by selections and , we thus obtain as goes to infinity by Theorem 9.1 in [9]. Recalling in Theorem 4.3, we thus complete the proof.
For agents of special dynamics, static output feedback interfaces might be constructed, which brings reduced-order output feedback controls to achieve output average consensus of those heterogeneous multi-agent systems.
Theorem 4.6
Consider the multi-agent systems composed of (1) with a fixed topology satisfying Assumption 1. Suppose for any , there exists a constant satisfying
[TABLE]
where is positive definite and satisfies the following linear matrix inequality
[TABLE]
Then, a reduced-order output feedback of the form
[TABLE]
can be employed to solve the average consensus problem for these multi-agent systems.
Proof. Following the procedure of our hierarchical control approach, we have . The composite system is then as follows.
[TABLE]
Again, letting and gives
[TABLE]
We claim that there exists a matrix such that is Hurwitz. If so, the proof can be completed without difficulties by following the procedure in Theorem 4.3.
In fact, from (17), we have . Letting gives
[TABLE]
Recalling (20) and letting gives
[TABLE]
Since is positive definite, is Hurwitz by Theorem 4.6 in [9]. The proof is complete.
This result can be extended to multiple input and multiple-output systems by assuming
[TABLE]
Remark 4.7
Although we only consider multi-agent systems under a fixed topology, these conclusions still hold when the communication topology varies and switches among a finite number of strongly connected and balanced graphs by employing common Lyapunov techniques as that in [12].
Remark 4.8
In contrast to many existing average consensus results on single integrators [1, 12, 13], this abstraction-based framework can handle heterogeneous general multi-agent systems with possible general graphs by a two-level design. In fact, through such an abstraction process, the heterogeneous linear multi-agent agents are homogenized and further converted to well-studied integrator-type systems. That is, the complexity from dynamics is decoupled from that of the average consensus goal and communication topology. In this sense, this two-level approach might provide a promising framework to handle multi-agent systems with both complex dynamics and sophisticated tasks.
5 Simulations
For illustrations, we present an example and consider four agents with following system matrices
[TABLE]
[TABLE]
[TABLE]
[TABLE]
We assume the topology is switching between two strongly connected and balanced graphs described by Figure 2 with unity weights. The switchings are periodically carried out in the following order with a period .
It can be verified the systems are minimal with no transmission zero at the origin. By Remark 4.7 and some further manipulations, the output average consensus problem of them can be solved by the controllers (15) and (16). The effectiveness is also verified by the simulation results with selected gain matrices depicted in Figure 3.
6 Conclusions
A two-level approach was proposed to solve the output average consensus problem over heterogeneous multi-agent systems. In conjunction with abstraction techniques, two different protocols were derived for those agents. Future work includes extensions to more general graphs and nonlinear cases.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] K. Cai and H. Ishii: Average consensus on general strongly connected digraphs. Automatica 48 (2012), 2750–2761.
- 2[2] R. Carli, A. Chiuso, L. Schenato, and S. Zampieri: Distributed Kalman filtering based on consensus strategies. IEEE J. Sel. Areas Commun. 26 (2008), 622–633.
- 3[3] A. Girard and G. Pappas: Hierarchical control system design using approximate simulation. Automatica 45 (2009), 566–571.
- 4[4] Y. Hong, J. Hu, and L. Gao: Tracking control for multi-agent consensus with an active leader and variable topology. Automatica 42 (2006), 1177–1182.
- 5[5] D. Hristu-Varsakelis and W. S. Levine: Handbook of Networked and Embedded Control Systems. Birkhäuser, Boston 2005.
- 6[6] J. Hu and G. Feng: Distributed tracking control of leader-follower multi-agent systems under noisy measurement. Automatica 46 (2010), 1382–1387.
- 7[7] J. Huang: Nonlinear Output Regulation: Theory and Applications. SIAM, Philadelphia 2004.
- 8[8] S. S. Kia, J. Cortés, and S. Martinez: Dynamic average consensus under limited control authority and privacy requirements. Internat. J. Robust Nonlinear Control 25 (2015), 1941–1966.
