Sparse Control of Kinetic Cooperative Systems to Approximate Alignment
Beno\^it Bonnet, Francesco Rossi

TL;DR
This paper introduces a simple, robust, and sparse control strategy for kinetic cooperative systems that guides the system towards approximate alignment, relying only on minimal information and applicable regardless of the number of agents.
Contribution
The authors develop a novel control method for kinetic cooperative systems that is sparse, constructive, and independent of the number of agents, facilitating practical applications.
Findings
Control strategy effectively steers systems towards alignment
Method requires only support size and Lipschitz constant
Applicable to large-scale and infinite-agent systems
Abstract
Cooperative systems are systems in which the forces among agents are non-repulsive. The free evolution of such systems can tend to the formation of patterns, such as consensus or clustering, depending on the properties and intensity of the interaction forces between agents. The kinetic cooperative systems are obtained as the mean field limits of these systems when the number of agents goes to infinity. These limit dynamics are described by transport partial differential equations involving non-local terms. In this article, we design a simple and robust control strategy steering any kinetic cooperative system to approximate alignment. The computation of the control at each instant will only require knowledge of the size of the support of the crowd in the phase space and of the Lipschitz constant of the interaction forces. Besides, the control we apply to our system is sparse, in the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMathematical Biology Tumor Growth · Slime Mold and Myxomycetes Research · Micro and Nano Robotics
Sparse control of kinetic cooperative systems to approximate alignment
Benoît Bonnet
Francesco Rossi
Aix Marseille Université, CNRS, ENSAM, Université de Toulon, LSIS, Marseille, France
[email protected] , [email protected]
Abstract
Cooperative systems are systems in which the forces among agents are non-repulsive. The free evolution of such systems can tend to the formation of patterns, such as consensus or clustering, depending on the properties and intensity of the interaction forces between agents.
The kinetic cooperative systems are obtained as the mean field limits of these systems when the number of agents goes to infinity. These limit dynamics are described by transport partial differential equations involving non-local terms.
In this article, we design a simple and robust control strategy steering any kinetic cooperative system to approximate alignment. The computation of the control at each instant will only require knowledge of the size of the support of the crowd in the phase space and of the Lipschitz constant of the interaction forces. Besides, the control we apply to our system is sparse, in the sense that it acts only on a small portion of the total population at each time. It also presents the features of being obtained through a constructive procedure and to be independent on the number of agents, making it convenient for applications.
keywords:
Cooperative systems, Sparse control, Transport PDE with non-local terms
††thanks: This work has been carried out in the framework of Archimède Labex (ANR-11-LABX-0033) and of the A*MIDEX project (ANR-11-IDEX-0001-02), funded by the “Investissements d’Avenir” French Government programme managed by the French National Research Agency (ANR).
The authors acknowledge the support of the Grant ANR-16-CE33-0008-01 by ANR.
1 Introduction
The study of collective behaviour in systems of interacting agents has been the focus of a growing interest from several scientific communities during the past decades, e.g. in robotics (coordination of robots or drone swarms), in biology (crowds of animals), in sociology (information formation process) or in civil engineering (dynamical study of crowds of pedestrians, see e.g. Cristiani et al. (2014)). In particular, it is well known that simple interaction rules between agents can promote the formation of global patterns. This phenomenom is usually referred to as self-organization (see e.g. Camazine et al. (2001)).
However, the emergence of such patterns may be conditional to a certain number of hypotheses. For instance, a crowd with weak interactions will admit initial configurations for which no global self-organization can hope to arise. It is then natural to study whether it may be possible for an external action (e.g. a regulator) to enforce the formation of a pattern even in an unfavorable situation. This is the problem of control of crowds, which we shall address here in the particular case of kinetic cooperative systems.
We recall the mathematical definition of cooperative models in the finite-dimensional case, a well-known family of models used to describe crowds of interacting agents (see, e.g., Angeli and Sontag (2003); Smith (1995)). Let us consider a set of interacting agents. In our case, the agents are supposed to be all identical and the dynamics of the -th agent is given by
[TABLE]
where is supposed to be non-negatively collinear to the velocity, namely
[TABLE]
We also assume that
[TABLE]
In this article, we are interested in designing a control strategy for kinetic cooperative systems. These systems are obtained as the mean field limits of the finite-dimensional cooperative systems of the form (1) when the number of agents goes to infinity. In this formalism, the crowd is represented at each time by its density . The time evolution of is described by the following transport Partial Differential Equation (PDE) with non-local terms
[TABLE]
where . This limit dynamics leads naturally to the design of control strategies that are independent on the number of agents. In practice these strategies can be applied to approximately control a finite-dimensional system containing a large number of agents, with an error that can easily be estimated as a function of .
In the kinetic approach, the density of the crowd is modeled as a probability measure. We introduce in this scope the definition of the functional spaces and , that are the natural setting to study our control problem (see e.g. Evans and Gariepy (1992)).
Definition 1
*The space is the set of all probability measures on with compact support, endowed with the weak topology of measures.
The space is the subset of of all probability measures absolutely continuous with respect to the Lebesgue measure, i.e. the set of probability measures for which there exists a Lebesgue-integrable function such that where is the Lebesgue measure on . The function is called the density of with respect to the Lebesgue measure.*
The definition of solutions for equations of the form (4) is then stated in terms of time-dependent curves in the space of probability measures.
Definition 2
A solution of (4) with initial datum is a curve in the space continuous with respect to time, satisfying (4) in the weak sense and such that .
A natural idea to control (1) is to add a control term to the dynamics of the ’s for all (see Caponigro et al. (2014)). Yet, for the mean field limit, all the agents of the crowd are supposed to be identical, thus, one cannot impose a control localized specifically on one or several of these agents.
We are then compelled to introduce a space-dependent control of the form where is the indicator function of the time-dependent control set . The controlled version of (4) then writes
[TABLE]
where defines a Lipschitz vector field at all times . Furthermore, we impose our control to be sparse and bounded, i.e. that it can only act on a small portion of the crowd with limited amplitude at all times. These constraints write
Population sparsity constraint
[TABLE]
Boundedness constraint
[TABLE]
In the sequel, we will be interested in the notion of approximate alignment, which is defined as follows.
Definition 3
A solution to (4) or (5) is said to be -approximately aligned around starting from time if for any .
Our goal in this framework is to prove the following result.
Theorem 1
Let be a given initial data for (5). For any constant , limit velocity and precision , there exists a time and a Lipschitz-in-space control with support satisfying the constraints (6) and (7) such that the corresponding solution of (5) is approximately aligned around with precision starting from time .
The structure of the paper is the following. We present in Section 2 general notions concerning transport PDEs with non-local terms. We then prove Theorem 1 in Section 3 as follows: we introduce in Section 3.1 the fundamental step of our control strategy and show in Section 3.2 how its iteration steers the dynamics (5) to approximate alignment.
2 Kinetic cooperative systems
2.1 Transport PDEs with non-local velocities
In this section we briefly introduce some notions and results concerning transport PDEs with non-local interactions of the form (4) and (5). We first recall the definition of pushforward of a measure by a Borel map and Wasserstein distance (see more details in Villani (2003)).
Definition 4
Given a Borel map , the pushforward of a probability measure defined on through is the measure satisfying:
[TABLE]
for any measurable subset .
Definition 5
A transference plan between two probability measures is a probability measure in which first and second marginals are respectively and , namely, . We denote by the set of all transference plans between and . The Wasserstein distance of order between and is then defined by
[TABLE]
Due to its high convenience for computations and its numerous properties, the Wasserstein distance is a canonical object to study dynamics of probability measures. The fundamental result of existence and uniqueness for the general transport PDE with non-local terms
[TABLE]
is stated in terms of the Wasserstein distance (see Ambrosio and Gangbo (2008),Piccoli and Rossi (2013)).
Theorem 2
Assume that satisfies the following properties:
* is uniformly Lipschitz and with sublinear growth, i.e. there exist , not depending on and such that and for any .
is a Lipschitz function with respect to , i.e. there exists such that for any .
is measurable with respect to .*
*Then for any , there exists a unique solution of (9). Furthermore, the solutions of (9) depend continuously on their initial datum.
Let be the flow of diffeomorphisms of generated by the time-dependent vector field , defined as the unique solution of the Cauchy problem . Then, the solution of (9) with initial datum writes for any .
In particular, implies that for all times .*
Remark 1
Theorem 2 implies that describes the evoultion of the support of the measure . Indeed, for all times , any point is the image of a corresponding point by the diffeomorphism .
In (4), the vector field is . It can be easily checked that this vector field satisfies the hypotheses of Theorem 2, see e.g. Ha and Liu (2009). For this reason, we will define and such that our control in (5) defines a Lipschitz vector field at all times, which ensures that the vector field satisfies the hypotheses of Theorem 2.
We end this section by the statement of an estimate on the time evolution of the -norm of the density of a probability measure following the dynamics (5).
Proposition 3
Let be a solution of (5) with initial datum and be its density with respect to the Lebesgue measure. Then there holds for any times :
[TABLE]
Proof: See (Piccoli et al., 2015, Section 4.2).
2.2 Invariance properties of kinetic cooperative systems
We recall in this section the invariance properties of kinetic cooperative systems. One of the fundamental properties of (1) is its invariance with respect to translations. Such properties are inherited by (4) and are stated as follows.
Proposition 4
Let be a solution of (4) with initial datum , and a vector representing a translation. Define the curve . Then is the unique solution of (4) with initial datum , image of by the translation along .
Moreover, the attractivity of the interaction forces of (1) allows us to establish an easy estimate of the evolution through time of the support of a solution of (4).
Proposition 5
Let be a solution of (4) with initial datum . Then one has the following support invariance property: if then for any .
Proof: This invariance is a direct consequence of Remark 1 and of the fact that always points inward along , for each .
We assume from now on that is contained within the box . The invariance properties given in Proposition 4 allow us to restrict the proof of Theorem 1 to the case where , , and , for any , without loss of generality. Indeed, one can always achieve approximate alignment in the sense of Definition 3 in dimension with by applying the following strategy.
Define (where stands for the -th unitary vector of ) and notice that it follows the dynamics (4) by Proposition 4. Perform approximate alignment around [math] with precison . The velocity support of the orignal system in dimension is now .
Define and notice that it satisfies the dynamics (4) with . Perform approximate alignment around [math] with precision . The velocity support for the initial measure is included in and approximate alignment is achevied for the -th component.
3 Proof of Theorem 1
In this section we prove our main result Theorem 1, using a constructive algorithmic approach, in the spirit of Piccoli et al. (2015) and Piccoli et al. (2016). We assume henceforth that the dynamics (5) is unidimensional, i.e. . The case can be treated with a very similar technique, see e.g. (Piccoli et al., 2015, Section 4.4). We define in Section 3.1 the fundamental step of our control strategy, and then show in Section 3.2 how its iteration steers the dynamics to approximate alignment in the sense of Definition 3.
3.1 Fundamental step in 1D
Assume that . Our aim in this section is to build a Lipschitz control and a time such that the control satisfies the constraints (6) and (7) at all times in and such that it reduces the size of along the velocity component.
To this end, we define a partition of our initial domain into rectangles . The points are defined recursively to be the minimal values such that starting from . We also define .
Note that and that the points are well defined, since , ensuring that is a continuous function. We further define the parameter as the biggest real number such that
[TABLE]
We fix a parameter and a time , which precise choices shall be detailed in Section 3.2. We define the control sets by
[TABLE]
We introduce the corresponding controls defined by with given by
[TABLE]
A picture of this domain decomposition along with the definition of for a given is given in Figure 1.
We consider the time partition and apply each control on the set for . This control design ensures the following properties.
The control is Lipschitz and satisfies (7) at all times by definition of the functions .
By Proposition 5, one can easily check that for all times , yielding
[TABLE]
for all times . Moreover, choosing , we have by Remark 1 that all points in will locally undergo a displacement of amplitude at most equal to in the variable .
The population constraint (6) is respected at all times. Indeed, for any one has
[TABLE]
After having defined a proper control satisfying our constraints, we are interested in building estimates for the size of . To do so, we monitor the evolution through time of the points such that realizes the maximum of velocity in (similar estimates were given in Piccoli et al. (2016)). Here for and , we define as the image of through the flow generated by as described in Theorem 2.
We define the functions . They satisfy the following properties.
If for all , then using (5), Remark 1 and the Lipschitzianity of one has that
[TABLE]
Applying Gronwall lemma to , noticing that and taking , we have
[TABLE]
By construction of the set and of the control , the fact that on implies that is equal to (-1) on and to 0 on , leading to
[TABLE]
If , define to be the biggest time for which . Notice then that for all and . By a similar argument as in the previous point, one gets
[TABLE]
This holds in particular if , i.e. if .
Since defines a covering of for all , these estimates together with (14) yield with
[TABLE]
3.2 Proof of Theorem 1 in 1D
In this section, we show how a sequence of fundamental steps as defined in Section 3.1 (namely a sequence of choices of ) steers the system to approximate alignment.
To this end, we will apply the following algorithm.
Initialization :
Let , be given.
Fix . We define for any the measure . The estimate (19) shows us that where:
[TABLE]
We build the corresponding partition of and define the corresponding as in (11). We also define the sets , along with the corresponding controls as in Section 3.1. We set and choose
[TABLE]
We now want to show that the sequence defined above becomes smaller than within a finite number of iterations of our fundamental step. To do so, we prove the slightly stronger result that converges to a limit . This implies that there exists such that for all , hence that our algorithm stops.
We first prove the following useful estimate.
Lemma 6
Let be the density of with respect to the Lebesgue measure for a given . Then, it holds
[TABLE]
where is the size of the support of along the velocity component and is defined as in (11).
Proof: The proof follows from a simple geometric argument. Consider a given positive number . Since the mass inside a set of the form is less or equal to for any and , then the mass contained in is less than . Besides, the mass of one of the sets is equal to , by definition of . Taking yields the desired estimate.
We observe the following properties of our algorithm.
Choosing with ensures that is strictly positive as long as .
Choosing and as in (21) ensures that
[TABLE]
hence proving that as long as . This implies in particular that strictly decreases as long as .
Since , then for any such that . This implies that for any such that one has
[TABLE]
**We now prove that our algorithm terminates in a finite number of iterations. **
We prove it by contradiction. Assume that for all . Then is strictly decreasing, bounded from below, and thus converges to a limit .
This implies by (23) that . Hence by (21). Thus we infer that there exists a constant such that for any .
By definition of one has for any :
[TABLE]
Moreover, one has for any
[TABLE]
by Lipschitzianity of . This leads to the following estimate for all :
[TABLE]
where .
Recall that is finite as a consequence of (23). Then, combining (24) with (10) one has
[TABLE]
This, together with (22) yields
[TABLE]
Finally, one has
[TABLE]
for all . This implies that diverges to infinity, since is uniformly bounded from below by a positive constant. This contradicts (23). Hence, one concludes that . Since the sequence is decreasing, we conclude that there exists such that for all . Thus, the algorithm stops. We have proved that our control strategy steers the system to -approximate alignment around 0 starting from time for any given precision .
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Ambrosio and Gangbo (2008) Ambrosio, L. and Gangbo, W. (2008). Hamiltonian OD Es in the Wasserstein space of probability measures. Comm. Pure Appl. Math. , 61(1), 18–53.
- 2Angeli and Sontag (2003) Angeli, D. and Sontag, E. (2003). Monotone control systems. TAC, IEEE , 48(10), 1684–1698.
- 3Camazine et al. (2001) Camazine, S., Deneubourg, J.L., Franks, N.R., Sneyd, J., Theraulaz, G., and Bonabeau, E. (2001). Self-Organization in Biological Systems . Princeton University Press.
- 4Caponigro et al. (2014) Caponigro, M., Fornasier, M., et al. (2014). Sparse Stabilization and Control of Alignment Models. Mathematical Models and Methods in Applied Sciences , (25).
- 5Cristiani et al. (2014) Cristiani, E., Piccoli, B., and Tosin, A. (2014). Multiscale Modeling of Pedestrian Dynamics. Modeling, Simulation and Applications , (12).
- 6Evans and Gariepy (1992) Evans, L. and Gariepy, R. (1992). Measure Theory and Fine Properties of Functions . CRC Press.
- 7Ha and Liu (2009) Ha, S.Y. and Liu, J.G. (2009). A simple proof of the Cucker-Smale flocking dynamics and mean-field limit. Commun. Math. Sci. 7 , (2), 297–325.
- 8Piccoli and Rossi (2013) Piccoli, B. and Rossi, F. (2013). Transport equation with non-local velocity in Wasserstein spaces: Convergence of numerical schemes. Acta applicandae mathematicae , 124(1), 73–105.
