On Existence of Separable Contraction Metrics for Monotone Nonlinear Systems
Ian R. Manchester, Jean-Jacques E. Slotine

TL;DR
This paper investigates conditions under which contracting nonlinear systems admit separable metrics, facilitating scalable stability analysis and control design through convex optimization techniques.
Contribution
It provides new theoretical results on the existence of separable contraction metrics for monotone nonlinear systems, linking positive linear systems theory with nonlinear stability analysis.
Findings
Established conditions for separable contraction metrics in monotone systems
Connected positive linear systems theory with nonlinear stability analysis
Discussed applications to distributed control design via convex optimization
Abstract
Finding separable certificates of stability is important for tractability of analysis methods for large-scale networked systems. In this paper we consider the question of when a nonlinear system which is contracting, i.e. all solutions are exponentially stable, can have that property verified by a separable metric. Making use of recent results in the theory of positive linear systems and separable Lyapunov functions, we prove several new results showing when this is possible, and discuss the application of to nonlinear distributed control design via convex optimization.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
On Existence of Separable Contraction Metrics
for Monotone Nonlinear Systems
Ian R. Manchester
Jean-Jacques E. Slotine
Australian Centre for Field Robotics, School of Aerospace, Mechanical and Mechatronic Engineering, University of Sydney (e-mail:[email protected]).
Nonlinear Systems Laboratory, Massachusetts Institute of Technology (e-mail:[email protected])
Abstract
Finding separable certificates of stability is important for tractability of analysis methods for large-scale networked systems. In this paper we consider the question of when a nonlinear system which is contracting, i.e. all solutions are exponentially stable, can have that property verified by a separable metric. Making use of recent results in the theory of positive linear systems and separable Lyapunov functions, we prove several new results showing when this is possible, and discuss the application of to nonlinear distributed control design via convex optimization.
keywords:
Distributed control, Nonlinear systems, Convex optimization.
††thanks: This work was supported by the Australian Research Council.
1 Introduction
Many emerging applications of system analysis and control involve large networks of interconnected nonlinear dynamic systems: smart-grid power systems, traffic management with autonomous vehicles, internet congestion control, and analysis of biological signalling networks, to name but a few. In order to make analysis methods scalable to large networks and robust to node dropouts or additions, it is crucial to be able to understand the overall network behaviour by way of conditions on just the local node dynamics and their interactions with immediate neighbours.
The traditional method for stability analysis makes use of a Lyapunov function: a positive-definite function of the system’s state that decreases under flows of the system. Finding Lyapunov functions for arbitrary large-scale systems is generally intractable, but can be greatly simplified if one restricts the search to separable Lyapunov functions, in particular sum-separable, i.e. , or max-separable, i.e. , where denotes the state of the subsystem, and denotes the concatenation of all subsystem states (Dirr et al., 2015).
There has been substantial work recently on establishing when such separable Lyapunov functions should exist. In the case of linear positive systems, i.e. linear systems for which the non-negative orthant is flow-invariant, the Perron-Frobenius theory gives separable Lyapunov functions (Berman and Plemmons, 1994). More recently, several researchers have taken advantage of these properties to dramatically simplify problems of decentralized control design and system identification (Tanaka and Langbort, 2011), (Tanaka and Langbort, 2013), (Colombino et al., 2015), (Rantzer, 2015), (Umenberger and Manchester, 2016). In a recent paper, fundamental results about separable Lyapunov functions for positive systems have been extended to linear time-varying systems (Khong and Rantzer, 2016).
For nonlinear systems . Recent work has focused on establishing conditions on existence of separable Lyapunov functions, especially in connection with input-to-state stability properties Dashkovskiy et al. (2010), Ito et al. (2012) and monotone systems Dirr et al. (2015), the natural nonlinear generalization of a linear positive system Smith (1995)
Contraction analysis generalizes techniques from linear systems to nonlinear systems. Roughly speaking, a system is contracting if the linearization along every solution is exponentially stable Lohmiller and Slotine (1998). This property is verified by the existence of a metric, which can be taken to be of Riemannian form though others are possible. This idea can be traced back to Lewis (1949) and has been explored in more detail recently by Forni and Sepulchre (2014) and extended to analysis of limit cycles by Manchester and Slotine (2013). Advantages of contraction analysis include the fact that questions of stability are decoupled from knowledge of a particular solution, unlike Lyapunov theory, and because the object of study is a family of linear time-varying systems, many familiar results can be extended to nonlinear systems.
A natural question to ask is when these contraction conditions can be verified in a scalable way. It was noted in Coogan (2016) that some commonly used metrics based on and norm are naturally separable, a property which was used implicitly in several papers on networked system analysis and control, e.g. (Russo et al., 2011; Como et al., 2015). However, this does not answer the question when such a separable metric exists for systems which are known to be contracting with respect to a (not necessarily separable) metric, as in the case of linear positive systems.
Recently, the technique of control contraction metrics has been introduced, which extends contraction analysis to constructive control design (Manchester and Slotine, 2017). In fact, synthesis conditions can be transformed to a convex problem: a set of pointwise linear matrix inequalities, which can be verified using sum-of-squares programming (see e.g. Aylward et al. (2008)). Despite being convex, these conditions do not generally scale to very large systems.
It was recently shown by Stein Shiromoto and Manchester (2016) that if one restricts the search to sum-separable control contraction metrics, then the problem of distributed control synthesis can be made convex. This can be considered an extension of the results of Tanaka and Langbort (2011) to a class of nonlinear systems.
Another motivating application is nonlinear system identification with guaranteed model stability, building on the results of Tobenkin et al. (2017). Recent results allow scalable computation for linear systems (Umenberger and Manchester, 2016). With separable contraction metrics, these could be extended to identification of large-scale nonlinear systems.
2 Notation and Preliminaries
For symmetric matrices the notation () means that is positive semidefinite (positive definite), whereas for vectors , the notation denotes element-wise inequality. The non-negative reals are denoted , and the natural numbers from 1 to are denoted . A smooth matrix function is called uniformly bounded if there exists such that for all . Given a vector field defined for , we use the following notation for directional derivative of a matrix function: .
In this paper we consider time-varying nonlinear systems:
[TABLE]
where is the state vector at time , and is a smooth function of and at least piecewise-continuous in , though these can be relaxed somewhat. Note that this system representation can include systems with external control or disturbance inputs , where for our purposes we absorb these into the time-variation in (1).
A dynamical system is monotone if for any pair of solutions and , implies for all , where denotes component-wise inequality. This property can be generalized to partial-orderings based on arbitrary cones, however the positive orthant is the natural cone for the purposes of studying separability. A differential characterization of monotonicity is that the off-diagonal elements of are non-negative – this is implied by the Kamke-Müller conditions (Smith, 1995).
Internally positive linear systems form an important subset of monotone systems. A continuous-time linear system
[TABLE]
is positive (and hence monotone) if for all and for all . In the case of time-invariant systems, the following result is well-known (see e.g. Berman and Plemmons (1994), Rantzer (2015)).
Theorem 1
If is positive and Hurwitz, then there exists , and , such that the following functions
[TABLE]
are Lyapunov functions for the system . Moreover, one can take .
Note that is a quadratic Lyapunov function for which is diagonal and , and is linear on the non-negative orthant.
A recent paper partially extends these results to linear time-varying (LTV) systems:
Theorem 2** **(Khong and Rantzer (2016))
A linear positive system , with piecewise continuous and uniformly bounded for all , is exponentially stable if and only if there exists a Lyapunov function with diagonal such that and for all and some .
We utilize the following standard results of Riemannian geometry, see, e.g., Do Carmo (1992) for details. A Riemannian metric is a smoothly-varying inner product on the tangent space of a state manifold ; this defines local notions of length, angle, and orthogonality. In this paper and the tangent space can also be identified with . We allow metrics to be smoothly time-varying, and use the following notation: and . We call a metric uniformly bounded if such that for all . For a smooth curve we use the notation , and define the Riemannian length and energy functionals as
[TABLE]
respectively, with integration interpreted as the summation of integrals for each smooth piece. Let be the set of piecewise-smooth curves , and for a pair of points , let be the subset of connecting to , i.e. curves if , and . A smooth curve is regular if for all . The Riemannian distance , and we define . Under the conditions of the Hopf-Rinow theorem a smooth, regular minimum-length curve (a geodesic) exists connecting every such pair, and the energy and length satisfy the following inequalities: where is any curve joining and . For time-varying paths , we also write .
A nonlinear system (1) is called contracting if all solutions are exponentially stable. A central result of Lohmiller and Slotine (1998) is that if there exists a uniformly bounded metric such that
[TABLE]
where , then the system is contracting with rate . This inequality states that where . From this, it is straightforward to establish that the Riemannian distance (and energy) between any pair of points decreases exponentially, and thus can serve as incremental Lyapunov functions.
Non-Riemannian contraction metrics, e.g. based on and norms, can also be used (Lohmiller and Slotine, 1998) and offer simplified tests of contraction for certain applications, see, e.g. Russo et al. (2011).
3 Problem Statement
Let the state vector of (1) be partitioned into node states where and . The objective is to determine when contraction can be established using a set of local node metrics. In general, local nodes may have vector states although our main result will relate the the situation where for all , i.e. the state of each node is a scalar.
Following the terminology from Lyapunov functions (Dirr et al., 2015), a contraction metric is called sum-separable if it can be decomposed as
[TABLE]
and max-separable if
[TABLE]
We will focus on the above (sum-type) notion of separability, but will also briefly discuss max-separable contraction metrics.
The following problem is, to the authors’ knowledge, open:
Problem 3
Suppose a dynamical system of the form (1) is both contracting and monotone. Characterize the additional conditions (if any) that imply the existence of a separable contraction metric.
For the case of linear systems, it is known that no further conditions are required beyond contraction (exponential stability) and monotonicity (positivity). In this paper, we do not solve this problem, but rather present some partial results towards this goal.
4 Motivation: distributed control design
As well as producing scalable analysis conditions, a major motivation for separable contraction metrics is that they convexify the problem of distributed control design for nonlinear systems (Stein Shiromoto and Manchester, 2016). Here we briefly recap these results and provide new results.
Consider a control system of the form
[TABLE]
In Manchester and Slotine (2017) it was shown that if a metric exists such that the following implication is true:
[TABLE]
then all solutions of (5) are exponentially stabilizable by state feedback. Furthermore, the Riemannian energy to a target solution is a control Lyapunov function which verifies this. By the formula for first variation, rate of change of Riemannian energy is
[TABLE]
To be precise, (6) implies that the set of for which (7) is satisfied is non-empty. Such a can be found either by a path integral construction, or by solving e.g. a linear or quadratic program with the constraint (7).
As was demonstrated by Stein Shiromoto and Manchester (2016), when the metric is sum-separable the computation of the controller depends only on information from the local state information and neighbours. In this case, computation of the Riemannian energy (by way of finding a minimal geodesic between and ) can be done a completely decentralized way, using only local node information, and a stabilizing feedback control can be constructed using only local and neighbor information.
For systems with vector nodes, i.e. for at least one , computing the minimal geodesic will require solving an online path optimization. Here we note in the case when nodes have scalar states this can be eliminated.
Proposition 4
Consider a system of the form (5). Suppose a sum-separable control contraction metric exists with for all . Then under the change of coordinates
[TABLE]
where , squared Euclidean distance to any target solution is a control Lyapunov function.
{pf}
Under this coordinate change, tangent vectors transform as
[TABLE]
and hence
[TABLE]
hence the CCM is Euclidean distance in . Now, it was proven by Manchester and Slotine (2017) that the CCM conditions implying that energy is a CLF are invariant under smooth changes of coordinates, hence is a CLF.
Remark 5
In the general case of vector nodes, one can still construct the differential change of coordinate by factoring so that . However In general is not integrable, so we may not be able to construct with .
5 Main Result
An important sub-class of nonlinear networked systems is those with nonlinear local (node) dynamics, but positive (cooperative) linear coupling between nodes. The main result of this paper is to extend the result of Khong and Rantzer (2016) to this class of systems.
To be precise, consider a system with state and dynamics that decomposes as
[TABLE]
where are piecewise-continuous in , and is uniformly bounded above (in and ) for each , and for .
Theorem 6
Suppose a system of the form (8) is contracting with respect to a metric of the form . Then it is contracting with respect to a sum-separable metric of the form
[TABLE]
{pf}
For each , define
[TABLE]
which, by assumption on is a piecewise-continuous function of . Now, construct the diagonal matrix with each as the diagonal elements, and consider the linear time-varying system
[TABLE]
where is a matrix with element given by .
By assumption that for , this system is positive. We will now show that it is also exponentially stable.
By definition, for each and there exists a sequence such that as . Now, construct the sequence of states . By construction as .
Now, by assumption that the system is contracting, for every and and for some and some uniformly bounded , the following inequality holds
[TABLE]
By continuity of , we therefore have the same condition with replaced by . This implies that the LTV system (9) is exponentially stable and meets the conditions of Theorem 2, and therefore has a diagonal Lyapunov function.
Hence there exists a separable Lyapunov function with diagonal and
[TABLE]
for all , and hence by uniform boundedness
[TABLE]
for some .
Denote by the diagonal element of . By construction of and the fact that we have
[TABLE]
from which it follows that
[TABLE]
This completes the proof of the theorem.
6 Additional Results
In this section, we present some other conditions under which it is straightforward to show existence of a separable Lyapunov function.
6.1 Local Existence Along Trajectories
It is known that if a monotone system is exponentially stable at the origin (i.e. is Hurwitz), then there exists sum and max separable Lyapunov functions in a neighbourhood of the origin (Dirr et al., 2015). These results extend easily to contraction metrics, and in fact the following stronger condition is available.
Theorem 7
Assume system (1) is contracting and monotone. Then in a neighbourhood of any bounded solution of (1) there exists a sum-separable contraction metric.
{pf}
For any bounded solution we can construct a compact set such that for all . furthermore, by continuity inside this set the elements of are uniformly bounded.
Since the system is contracting and monotone, the LTV differential dynamics are exponentially stable and positive along any solution. Therefore, by Theorem 2 there exists a diagonal Lyapunov function for the differential dynamics, which therefore satisfies the condition
[TABLE]
for all .
Now, since is uniformly bounded, by choosing some we have that for all ,
[TABLE]
for all in some neighbourhood of . This completes the proof of the theorem.
Remark 8
This does not imply that the neighbourhood on which the contraction condition holds is forward invariant, however as long as the diameter of the neighbourhood does not shrink to zero as time goes to infinity, such a set can be easily constructed.
Remark 9
Unlike the results of (Dirr et al., 2015), this theorem applies even to systems with no equilibria, e.g. systems with periodic forcing.
Remark 10
Note that by applying this result along all solutions we can construct lead to a diagonal metric of the form
[TABLE]
However, it is not guaranteed that depends only on , which is the condition for true sum-separability of the metric.
6.2 Networks with Weakly Nonlinear Coupling: Small Gain Condition
He we briefly remark that a well-known construction of separable Lyapunov functions based on small-gain type coupling can be extended to the case of contraction and time-varying systems. The conditions we discuss date back to early results in decentralized control and vector Lyapunov functions (Moylan and Hill, 1978; Sandell et al., 1978), and have been substantially generalized recently, e.g.Rüffer (2010); Ito et al. (2012). A similar construction was considered in Russo et al. (2013).
For the results of this section, the node states can have arbitrary dimensions. Additionally, there is no assumption that the original system is monotone, though a linear time-varying comparison system is.
Suppose for some system of the form (1) with nodes of dimension , one constructs local differential storage functions , e.g. of the form . Suppose it can be verified that
[TABLE]
where and . Note that unlike Russo et al. (2013) this allows nonlinear and time-varying gains between subsystems, due to the possible state-dependence of .
Now, consider the matrix
[TABLE]
and the the system
[TABLE]
is a positive LTI system. Hence, if this system is exponentially stable, there exists a linear Lyapunov function on the positive orthant
[TABLE]
which verifies exponential decrease. So, constructing the metric
[TABLE]
it is clear that this is a sum-separable contraction metric for the original system.
Remark 11
There also exists max-type Lyapunov function for the linear comparison system, which could be used to construct a max-separable contraction metric.
6.3 Networks with Weakly Nonlinear Coupling using the S-Procedure
A disadvantage of the results of the previous section is that they depend heavily on knowing a good construction of the local storage functions . In this section, we give results that are based only on explicit bounds on the vector field.
The key result can be considered a differential version of the results in Colombino et al. (2015), based on the losslessness of the S-Procedure for positive systems. Related results were established in Tanaka and Langbort (2013).
In particular, consider systems with scalar nodes of the form
[TABLE]
where and is uniformly bounded, and the functions satisfy
[TABLE]
for all , for some non-negative matrix and some .
Theorem 12
Suppose the system is contracting for all nonlinear functions satisfying (10) as verified by a metric , then can be taken to be diagonal.
{pf}
We skip some details since they are similar to Theorem 6 and (Colombino et al., 2015, Theorem 4).
Construct the matrix as in the proof of Theorem 6 and consider the system
[TABLE]
where is a vector function with elements . As in Theorem 6, a metric proving contraction for this system also proves contraction for the true nonlinear system.
Now, by (Colombino et al., 2015, Theorem 4), stability of this system for all satisfying (10) is equivalent to the existence of a diagonal matrix for which
[TABLE]
It is straightforward to show that this same leads to a sum-separable contraction metric.
6.4 Stability verification via a virtual system
Given a system (1), a virtual system is another system driven by :
[TABLE]
with the special property that for all . Analysing such systems is common in observer design and synchronisation problems, but can also be used to establish stability of other classes of systems (Wang and Slotine, 2005; Jouffroy and Slotine, 2004).
Let us detail a particular example of this application which can make use of positive systems theory. Many networked dynamical systems can be factored as
[TABLE]
where is a positive matrix for all . This system has the origin () as a solution. To establish stability of this solution we can introduce the virtual system
[TABLE]
where is the solution of the true system but considered as time-variation for the virtual system. Suppose this system is exponentially stable for all , and note that a particular solution of (12) is for all . and hence solutions of (11) converge to zero exponentially.
Now, since (12) represents a family of positive LTV systems parameterized by the initial condition for each solution , it follows from Khong and Rantzer (2016) that there exists a family of diagonal Lyapunov function
[TABLE]
verifying stability of all solutions of (12). Therefore, establishing stability by way of a positive virtual system is simplified compared to the general case.
7 Conclusions
In this paper we have investigated the problem of when a contracting system has a separable contraction metric. This problem is motivated by the need to find simplified stability conditions for large-scale nonlinear systems, and also be recent work that shows that nonlinear distributed control design problems can be made convex if a sum-separable contraction metric exists.
To our knowledge a complete characterisation remains unknown, however in this paper we have demonstrated a number of simple cases cases in which it can be established.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Aylward et al. (2008) Aylward, E.M., Parrilo, P.A., and Slotine, J.J.E. (2008). Stability and robustness analysis of nonlinear systems via contraction metrics and SOS programming. Automatica , 44(8), 2163–2170.
- 2Berman and Plemmons (1994) Berman, A. and Plemmons, R.J. (1994). Nonnegative Matrices in the Mathematical Sciences . SIAM.
- 3Colombino et al. (2015) Colombino, M., Hempel, A.B., and Smith, R.S. (2015). Robust Stability of a Class of Interconnected Nonlinear Positive Systems. In American Control Conference. Chicago, IL , 5312–5317.
- 4Como et al. (2015) Como, G., Lovisari, E., and Savla, K. (2015). Throughput optimality and overload behavior of dynamical flow networks under monotone distributed routing. IEEE Transactions on Control of Network Systems , 2(1), 57–67.
- 5Coogan (2016) Coogan, S. (2016). Separability of Lyapunov Functions for Contractive Monotone Systems. ar Xiv:1609.06258 [cs] .
- 6Dashkovskiy et al. (2010) Dashkovskiy, S., Rüffer, B., and Wirth, F. (2010). Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions. SIAM Journal on Control and Optimization , 48(6), 4089–4118.
- 7Dirr et al. (2015) Dirr, G., Ito, H., Rantzer, A., and Rüffer, B. (2015). Separable lyapunov functions for monotone systems: constructions and limitations. Discrete Contin. Dyn. Syst. Ser. B .
- 8Do Carmo (1992) Do Carmo, M.P. (1992). Riemannian geometry . Springer.
