The vanishing discount problem for monotone systems of Hamilton-Jacobi equations. Part 1: linear coupling

TL;DR

This paper proves a convergence theorem for the vanishing discount problem in weakly coupled Hamilton-Jacobi systems, introducing new measure concepts to handle linear coupling.

Contribution

It introduces viscosity Mather and Green-Poisson measures for systems, advancing the analysis of the vanishing discount problem with linear coupling.

Findings

Established convergence theorem for linear coupling systems

Introduced viscosity Mather and Green-Poisson measures

Utilized convex duality in the analysis

Abstract

We establish a convergence theorem for the vanishing discount problem for a weakly coupled system of Hamilton-Jacobi equations. The crucial step is the introduction of Mather measures and their relatives for the system, which we call respectively viscosity Mather and Green-Poisson measures. This is done by the convex duality and the duality between the space of continuous functions on a compact set and the space of Borel measures on it. This is part 1 of our study of the vanishing discount problem for systems, which focuses on the linear coupling, while part 2 will be concerned with nonlinear coupling.

Equations

$$\lambda v^{\lambda }+B{v}^{\lambda }+H[v^{\lambda }]=0\text{ in }{\mathbb{T}}^n,$$

$$H_i(x,p)=\underset{\xi \in \Xi }{\max }[-g_i(x,\xi )\cdot p-L_i(x,\xi )],$$

$$(Bu{)}_i(x)=(B(x)u(x){)}_i:=\sum _{j\in \mathbb{I}}{b}_{ij}(x)u_j(x)\text{ for }(x,i)\in {\mathbb{T}}^n\times \mathbb{I}.$$

$$\lambda v_i^{\lambda }+\sum _{j\in \mathbb{I}}{b}_{ij}(x)v_j^{\lambda }+H_i(x,D{v}_i^{\lambda })=0\text{ in }{\mathbb{T}}^n,i\in \mathbb{I}.$$

$$\underset{|p|\to \infty }{\lim }\underset{x\in {\mathbb{T}}^n}{\min }{H}_i(x,p)=\infty .$$

$$\left\{\begin{minipage}{386.95894pt} for any $x\in\mathbb{T}^{n}$,\ if \ $u=(u_{i})_{i\in\mathbb{I}}\in\mathbb{R}^{m}$ \ and \ $u_{k}=\max_{i\in\mathbb{I}}u_{i}\geq 0$, \ then \ $(B(x)u)_{k}\geq 0$. \end{minipage}\right.$$

$$B^{\lambda }=\lambda I+B,$$

$$B^{\lambda }{v}^{\lambda }+H[v^{\lambda }]=0\text{ in }{\mathbb{T}}^n.$$

$$\underset{(x,\xi ,i)\in {\mathbb{T}}^n\times \Xi \times \mathbb{I}}{\max }|g_i(x,\xi )|<M,$$

$$H_i(x,p)\ge M|p|-N\text{ for }(x,p,i)\in {\mathbb{T}}^n\times B_{R_1}\times \mathbb{I},$$

$$H_i(x,p)\le M|p|-N\text{ for }(x,p,i)\in {\mathbb{T}}^n\times B_{R_2}\times \mathbb{I}.$$

$$G_i(x,p)=H_i(x,p)\vee (M|p|-N).$$

$$\lambda u+Bu+G[u]=0{\mathbb{T}}^n.$$

$$G_i(x,p)=M|p|-N\text{ for }(x,i)\in {\mathbb{T}}^n\times \mathbb{I},$$

$$|G_i(x,p)-G_i(y,p)|\le \omega (|x-y|)\text{ for }(x,y,p)\in ({\mathbb{T}}^n{)}^2\times {\mathbb{R}}^n,i\in \mathbb{I}.$$

$$B_{\delta }\subset \mathrm{co}\{g_i(x,\xi ):\xi \in \Xi \}\text{ for }(x,i)\in {\mathbb{T}}^n\times \mathbb{I},$$

$$H_i(x,p,u)$$

$$=\underset{q\in C(x,i)}{\max }-q\cdot p-\underset{(x,i,\xi )\in {\mathbb{T}}^n\times \mathbb{I}\times \Xi }{\max }{L}_i(x,\xi )\ge \underset{q\in B_{\delta }}{\sup }-q\cdot p-\underset{(x,i,\xi )\in {\mathbb{T}}^n\times \mathbb{I}\times \Xi }{\max }{L}_i(x,\xi )$$

$$=\delta |p|-\underset{(x,i,\xi )\in {\mathbb{T}}^n\times \mathbb{I}\times \Xi }{\max }{L}_i(x,\xi ),$$

$$B_{1/k}\setminus C(x_k,i_k)\ne \varnothing .$$

$${\nu }_k\cdot (q-r_k)\le 0\text{ for }q\in C(x_k,i_k).$$

$$r\in C(x,i)\text{ and }\nu \cdot (q-r)\le 0\text{ for }q\in C(x,i).$$

$$\nu \cdot q\le -|r|<0\text{ for }q\in C(x,i).$$

$$H_i(x,-t\nu )=\underset{\xi \in \Xi }{\max }t{g}_i(x,\xi )\cdot \nu -\underset{\xi \in \Xi }{\min }{L}_i(x,\xi )\le -\underset{\xi \in \Xi }{\min }{L}_i(x,\xi ),$$

$$b_{ij}\le 0\text{ if }i\ne j\text{ and }\sum _{j\in \mathbb{I}}{b}_{ij}\ge 0\text{ for }i\in \mathbb{I}.$$

$$b_{ii}=\sum _{j\in \mathbb{I}}{b}_{ij}-\sum _{j\ne i}{b}_{ij}\ge 0.$$

$$1_i=1=\underset{j}{\max }{1}_j>0,$$

$$0\le (B1{)}_i=\sum _{j=1}^m{b}_{ij}{1}_j=\sum _{j=1}^m{b}_{ij}\text{ for }i\in \mathbb{I}.$$

$$0\le (B(e_i-t{e}_j){)}_i=b_{ii}-t{b}_{ij},$$

$$b_{ij}\le 0.$$

$$u_k=\underset{i\in \mathbb{I}}{\max }{u}_i\ge 0.$$

Full text

1. Introduction

We consider the weakly coupled $m$-system of Hamilton-Jacobi equations

[TABLE]

where $m\in\mathbb{N}$, $\lambda$ is a nonnegative constant, called the discount factor in terms of optimal control. Here $\mathbb{T}^{n}$ denotes the $n$-dimensional flat torus, $H=(H_{i})_{i\in\mathbb{I}}$ is a family of Hamiltonians given by

[TABLE]

where $\mathbb{I}=\{1,\ldots,m\}$, $\Xi$ is a given compact metric space, $g=(g_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n}\times\Xi,\mathbb{R}^{n})^{m}$ and $L=(L_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n}\times\Xi)^{m}$. The unknown in (1) is an $\mathbb{R}^{m}$-valued function $v^{\lambda}=(v^{\lambda}_{i})_{i\in\mathbb{I}}$ on $\mathbb{T}^{n}$, $B\,:\,C(\mathbb{T}^{n})^{m}\to C(\mathbb{T}^{n})^{m}$ is a linear map represented by a matrix $B=(b_{ij})_{i,j\in\mathbb{I}}\in C(\mathbb{T}^{n})^{m\times m}$, that is,

[TABLE]

We use the abbreviated notation $H[v^{\lambda}]$ to denote $(H_{i}(x,Dv_{i}^{\lambda}(x))_{i\in\mathbb{I}}$. The system is called weakly coupled since the $i$-th equation depends on $Dv^{\lambda}$ only through $Dv_{i}^{\lambda}$ but not on $Dv_{j}^{\lambda}$, with $j\not=i$. Problem (1) can be stated in the component-wise style as

[TABLE]

We are mainly concerned with the asymptotic behavior of the solution $v^{\lambda}$ of (1) as $\lambda\to 0+$. Asymptotic problems in this class are called the vanishing discount problem, in view that the constant $\lambda$ in (1) appears as a discount factor in the dynamic programming PDE in optimal control.

Recently, there has been a keen interest in the vanishing discount problem concerned with Hamilton-Jacobi equations and, furthermore, fully nonlinear degenerate elliptic PDEs. We refer to [DFIZ, AAIY, IJ, MT, IMT1, IMT2, GMT, CCIZ, DZ2, IS] for relevant work. The asymptotic analysis in these papers relies heavily on Mather measures or their generalizations and, thus, it is considered part of the Aubry-Mather and weak KAM theories. For the development of these theories we refer to [Fa1, Fa2, Ev1] and the references therein.

We are here interested in the case of systems of Hamilton-Jacobi equations and, indeed, Davini and Zavidovique in [DZ2] have established a general convergence result for the vanishing discount problem for (1). We establish a result (Theorem 9 below) similar to the main result of [DZ2]. In establishing our convergence result, we adapt the argument in [IMT1] (see also [Go]) to the case of systems, especially, to construct generalized Mather measures for (1). Regarding the recent developments of the weak KAM theory and asymptotic analysis in its influence for systems, we refer to [CGT, CLLN, MSTY, MT1, MT2, MT3, Ter].

The new argument, which is different from that of [DZ2], makes it fairly easy to build a generalized Mather measure for systems in a wide class. One advantage of our argument is that it allows us to treat the case where the coupling matrix $B$ in (1) depends on the space variable $x\in\mathbb{T}^{n}$. As in [IJ, IMT1], our approach is applicable to the system with nonlinear coupling of fully nonlinear second-order elliptic PDEs, but we restrict ourselves in this paper to the case of the linearly coupled system of first-order Hamilton-Jacobi equations. Another possible approach for constructing generalized Mather measures is the so-called adjoint method (see [Ev2, MT, GMT, CGT, Ter]).

This paper is part 1 of our study of the vanishing discount problem for weakly coupled systems of Hamilton-Jacobi equations and deals only with the linear coupling and with compact control sets $\Xi$. These restrictions make the presentation of our results clear and transparent. In part 2 [IJ], we remove these restrictions and establish a general convergence result extending Theorem 9 below. Sections 5 and 6 are devoted to the study of ergodic problems of the form $Bu+H[u]=c$, where $c\in\mathbb{R}^{m}$ is an unknown as well. Also, thanks to the linearity of the coupling, our results on the ergodic problems are applied to extend the scope of Theorem 9. On the other hand, the role of the ergodic problem, with general right-hand side $c$, is not clear at least for the author in the vanishing discount problem for the systems with the nonlinear coupling.

In this paper, we adopt the notion of viscosity solution to (1), for which the reader may consult [BaCa, BarB, CIL, PLL].

To proceed, we give our main assumptions on the system (1).

We assume that $H$ is coercive, that is, for any $i\in\mathbb{I}$,

[TABLE]

This is a convenient assumption, under which any upper semicontinuous subsolution of (1) is Lipschitz continuous on $\mathbb{T}^{n}$.

We assume that $B(x)=(b_{ij}(x))$ is a monotone matrix for every $x\in\mathbb{T}^{n}$, that is, it satisfies

[TABLE]

This is a natural assumption that (1) should possess the comparison principle between a subsolution and a supersolution.

In what follows we set, for $\lambda\geq 0$,

[TABLE]

and (1) can be written as

[TABLE]

We use the symbol $u\leq v$ (resp., $u\geq v$) for $m$-vectors $u,v\in\mathbb{R}^{n}$ to indicate $u_{i}\leq v_{i}$ (resp., $u_{i}\geq v_{i}$) for all $i\in\mathbb{I}$.

The following theorem is well-known: see [EL, IK] for instance.

Theorem 1**.**

Assume (C) and (M). Let $\lambda>0$. Then the exists a unique solution $v^{\lambda}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ of (1). Also, if $v=(v_{i}),w=(w_{i})$ are, respectively, upper and lower semicontinuous on $\mathbb{T}^{n}$ and a subsolution and a supersolution of (1), then $v\leq w$ on $\mathbb{T}^{n}$.

Henceforth, let $\mathbf{1}$ denote the vector $(1,\ldots,1)\in\mathbb{R}^{m}$.

Outline of proof.

We follow the line of the arguments in [IK]. Although [IK] is concerned with the case when the domain is an open subset of a Euclidean space, the results in [IK] is valid in the case when the domain is $\mathbb{T}^{n}$.

Choose a large constant $C>0$ so that the constant functions $\pm C\mathbf{1}$ are a supersolution and a subsolution of (1), respectively. (See also (6) below.) According to [IK, Theorems 3.3, Lemma 4.8], there is a function $v^{\lambda}=(v_{i}^{\lambda})_{i\in\mathbb{I}}\,:\,\mathbb{T}^{n}\to\mathbb{R}^{m}$ such that the upper and lower semicontinuous envelopes $(v^{\lambda})^{*}$ and $v^{\lambda}_{*}$ are a subsolution and a supersolution of (1), respectively. By the coercivity assumption (C), we find (see [CL, Theorem I.14], [IPerron, Example 1]) that the functions $(v_{i}^{\lambda})^{*}$ are Lipschitz continuous on $T^{n}$. Let $R_{1}>0$ be a Lipschitz bound of the functions $(v_{i}^{\lambda})^{*}$. To take into account the Lipschitz property of $(v_{i}^{\lambda})^{*}$, we modify the Hamiltonian $H$. Fix any $M>0$ so that

[TABLE]

and choose constants $N>0$ and $R_{2}>0$ so that

[TABLE]

and, in view of (1),

[TABLE]

Define $G=(G_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n}\times\mathbb{R}^{n})^{m}$ by

[TABLE]

By the choice of $R_{1}$, it is easy to see that $(v^{\lambda})^{*}$ is a subsolution of

[TABLE]

Also, since $G\geq H$, $v_{*}^{\lambda}$ is a supersolution of (2). Observe furthermore that, if $|p|\geq R_{2}$, then

[TABLE]

the functions $G_{i}$ are uniformly continuous on $\mathbb{T}^{n}\times B_{R_{2}}$, and hence, for some continuous function $\omega$ on $[0,\,\infty)$, with $\omega(0)=0$,

[TABLE]

The last inequality above shows that $G$ satisfies [IK, (A.2)], which allows us to apply [IK, Theorem 4.7], to conclude that $(v^{\lambda})^{*}\leq v^{\lambda}_{*}$ on $\mathbb{T}^{n}$ and, moreover, that $v^{\lambda}\in\operatorname{Lip}(\mathbb{T}^{n})^{*}$. Similarly, we deduce that the comparison assertion is valid. Thus, $v^{\lambda}$ is a unique solution of (1). ∎

Regarding the coercivity (C), the following proposition is well-knwon.

Proposition 2**.**

The function given by (H) satisfies (C) if and only if there exists $\delta>0$ such that

[TABLE]

where $\,\operatorname{co}$ designates “convex hull” and $B_{\delta}$ denotes the open ball with origin at the origin and radius $\delta$.

Outline of proof.

Set $C(x,i)=\operatorname{co}\{g_{i}(x,\xi)\,:\,\xi\in\Xi\}.$ Assume that (3) is valid for some $\delta>0$ and observe that

[TABLE]

which shows that $\eqref{C}$ holds.

Next, assume that (3) does not hold for any $\delta>0$. Then there exists $(x_{k},i_{k})\in\mathbb{T}^{n}\times\mathbb{I}$ for each $k\in\mathbb{N}$ such that

[TABLE]

For each $k\in\mathbb{N}$ select $q_{k}\in B_{1/k}\setminus C(x_{k},i_{k})$ and $r_{k}\in C(x_{k},i_{k})$ so that $r_{k}$ is the point of $C(x_{k},i_{k})$ closest to $q_{k}$. (Notice that $C(x_{k},i_{k})$ is a compact convex set.) Setting $\nu_{k}=(q_{k}-r_{k})/|q_{k}-r_{k}|$, we find that

[TABLE]

Sending $k\to\infty$ along an appropriate subsequence, say $(k_{j})_{j\in\mathbb{N}}$, we find that there are a unit vector $\nu=\lim_{j\to\infty}\nu_{k_{j}}$ of $\mathbb{R}^{n}$, $r=\lim_{j\to\infty}r_{k_{j}}\in\mathbb{R}^{n}$ and $(x,i)\in\mathbb{T}^{n}\times\mathbb{I}$ such that

[TABLE]

If $r\not=0$, then we have $\nu=-r/|r|$, since $\lim_{k\to\infty}q_{k}=0$, and the inequality above reads

[TABLE]

These observations imply that for $t>0$,

[TABLE]

which shows that (C) does not hold. This completes the proof. ∎

The rest of this paper is organized as follows. In Section 2, we recall some basic facts concerning monotone matrices. In Section 3, we study viscosity Green-Poisson measures for our system, which are crucial in our asymptotic analysis. We establish the main result for the vanishing discount problem in Section 4. We study the ergodic problem (P0) in the cases when $B$ is irreducible, and $B$ is a constant matrix, respectively, in Sections 5 and 6, and combine the results with the analysis on the vanishing discount problem of Section 4.

2. Monotone matrices

Here we are concerned with $m\times m$ real matrix $B=(b_{ij})_{i,j\in\mathbb{I}}$.

Let $e_{i}$ denote the vector $(e_{i1},\ldots,e_{im})$, with $e_{ii}=1$ and $e_{ij}=0$ if $i\not=j$.

Lemma 3**.**

Let $B=(b_{ij})$ be a real $m\times m$ matrix. It is monotone if and only if

[TABLE]

We remark that if $B$ satisfies (4), then

[TABLE]

Proof.

We assume first that $B$ is monotone. Since

[TABLE]

By the monotonicity of $B$, we have

[TABLE]

Similarly, if $i\not=j$ and $t\geq 0$, then we have $1=(e_{i}-te_{j})_{i}=\max_{k\in\mathbb{I}}(e_{i}-te_{j})_{k}$ and hence,

[TABLE]

from which we find by sending $t\to\infty$ that

[TABLE]

Hence, (4) is satisfied.

Next, we assume that (4) holds. Let $u\in\mathbb{R}^{m}$ satisfy

[TABLE]

Then we observe that, since $u_{k}\geq u_{j}$ for all $j\in\mathbb{I}$,

[TABLE]

Thus, $B$ is monotone. ∎

Lemma 4**.**

Let $u\in\mathbb{R}^{m}$ and $C\geq 0$ be a constant. Let $B$ be an $m\times m$ real monotone matrix. Then we have

[TABLE]

Proof.

Using Lemma 3, we see that

[TABLE]

which states that $B\mathbf{1}\geq 0$. It is then obvious to compute that

[TABLE]

and therefore,

[TABLE]

3. Viscosity Green-Poisson measures

For $\lambda\geq 0$ we write $\mathcal{F}(\lambda)$ for the set of all $(\phi,u)\in C(\mathbb{T}^{n}\times\Xi)^{m}\times C(\mathbb{T}^{n})^{m}$ such that $u$ is a subsolution of

[TABLE]

where $H_{\phi}=(H_{\phi,i})_{i\in\mathbb{I}}$ and

[TABLE]

In the above, since $\phi$ is bounded on $\mathbb{T}^{n}\times\Xi$, if $H$ satisfies (C), then $H_{\phi}$ satisfies (C).

Lemma 5**.**

The set $\mathcal{F}(\lambda)$ is a convex cone in $C(\mathbb{T}^{n}\times\Xi)^{m}\times C(\mathbb{T}^{n})^{m}$ with vertex at the origin.

Proof.

Recall [Bar, Remark 2.5] that for any $u\in Lip(\mathbb{T}^{n})^{m}$, $u$ is a subsolution of

[TABLE]

if and only if for any $i\in\mathbb{I}$,

[TABLE]

and by the coercivity (C) that for any $(\phi,u)\in\mathcal{F}(\lambda)$, we have $u\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$.

Fix $(\phi,u),(\psi,v)\in\mathcal{F}(\lambda)$ and $t,s\in[0,\infty)$. Fix $i\in\mathbb{I}$ and observe that

[TABLE]

which imply that there is a set $N\subset\mathbb{T}^{n}$ of Lebesgue measure zero such that

[TABLE]

Multiplying the first and second by $t$ and $s$, respectively, adding the resulting inequalities and setting $w=tu+sv$, we obtain

[TABLE]

which readily implies that $t(\phi,u)+s(\psi,v)\in\mathcal{F}(\lambda)$. ∎

We refer the reader to [IMT1, Lemma 2.2] for another proof of the above lemma.

We establish a representation formula for the solution of (1), with $\lambda>0$, by modifying the argument in [IMT1] (see also [Go]).

For any nonnegative Borel measure $\nu$ on $\mathbb{T}^{n}\times\Xi$ and $\phi\in C(\mathbb{T}^{n}\times\Xi)$, we write

[TABLE]

Similarly, for any collection $\nu=(\nu_{i})_{i\in\mathbb{I}}$ of nonnegative Borel measures on $\mathbb{T}^{n}\times\Xi$ and $\phi=(\phi_{i})\in C(\mathbb{T}^{n}\times\Xi)^{m}$, we write

[TABLE]

Note that any collection $\nu=(\nu_{i})_{i\in\mathbb{I}}$ of nonnegative Borel measures on $\mathbb{T}^{n}\times\Xi$ is regarded as a nonnegative Borel measure on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$ and vice versa.

We set

[TABLE]

Note that

[TABLE]

By assumption (M) and Lemma 3, we have $\rho_{i}\geq 0$ on $\mathbb{T}^{n}$ for all $i\in\mathbb{I}$.

Given a constant $\lambda>0$, let $\operatorname{\mathbb{P}}_{B^{\lambda}}$ denote the set of of nonnegative Borel measures $\nu=(\nu_{i})_{i\in\mathbb{I}}$ on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$ such that

[TABLE]

The last condition reads

[TABLE]

where $|\nu_{i}|$ denotes the total mass of $\nu_{i}$ on $\mathbb{T}^{n}\times\Xi$. Note as well that $\operatorname{\mathbb{P}}_{B^{\lambda}}$ can be identified with the space of Borel probability measures on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$ by the correspondence between $\nu=(\nu_{i})_{i\in\mathbb{I}}$ and $\sum_{i\in\mathbb{I}}(\lambda+\rho_{i})\nu_{i}\otimes\delta_{i}$, where $\otimes$ indicates the product of two measures and $\delta_{i}$ denotes the Dirac measure at $i$. If we set $\mu:=\sum_{i\in\mathbb{I}}(\lambda+\rho_{i})\nu_{i}\otimes\delta_{i}$ and consider $\mu$ as a collection $(\mu_{i})$ of measures on $\mathbb{T}^{n}\times\Xi$, then $\nu_{i}=(\lambda+\rho_{i})^{-1}\mu_{i}$. We denote simply by $\operatorname{\mathbb{P}}$ the space of Borel probability measures on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$.

For $\lambda\geq 0$ and $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$ we set

[TABLE]

and

[TABLE]

Theorem 6**.**

Assume (H), (C) and (M). Let $\lambda>0$ and $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. Let $v^{\lambda}\in C(\mathbb{T}^{n}\times\mathbb{I})$ be the unique solution of (1). Then there exists a $\nu^{z,k,\lambda}=(\nu^{z,k,\lambda}_{i})_{i\in\mathbb{I}}\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ such that

[TABLE]

We remark that for any $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ we have $\langle\nu,L\rangle\geq v_{k}^{\lambda}(z)\langle\nu,B^{\lambda}\mathbf{1}\rangle=v_{k}^{\lambda}(z)$ and, accordingly, in the theorem above, the measures $\nu^{z,k,\lambda}$ has the minimizing property:

[TABLE]

We call any minimizing family $(\nu_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}_{B^{\lambda}}$ of the optimization problem above a viscosity Green-Poisson measure for (1).

Proof.

Note first that $(L,v^{\lambda})\in\mathcal{F}(\lambda)$ and hence, for any $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$,

[TABLE]

Next, we show that

[TABLE]

Note that for $z\in\mathbb{T}^{n}$,

[TABLE]

Hence, in order to prove (11), we only need to show that

[TABLE]

We postpone the proof of (12) and, assuming temporarily that (11) is valid, we prove that there exists $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ such that

[TABLE]

which, together with (10), completes the proof.

To prove (13), we observe that $\operatorname{\mathbb{P}}_{B^{\lambda}}$ and, by Lemma 5, $\mathcal{F}(\lambda)$ are convex,

[TABLE]

is convex and continuous, in the topology of weak convergence of measures, for any $(\phi,u)\in\mathcal{F}(\lambda)$ and

[TABLE]

is concave and continuous for any $\nu\in\operatorname{\mathbb{P}}_{B^{\lambda}}$. Hence, noting moreover that $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$ is a compact set, we apply the minimax theorem ([Te, Si]), to find from (11) that

[TABLE]

Observe by using the cone property of $\mathcal{F}(\lambda)$ that

[TABLE]

This and (14) yield

[TABLE]

which proves (13).

It remains to show (12). For this, we argue by contradiction and thus suppose that (12) does not hold. Accordingly, we have

[TABLE]

for some $\varepsilon>0$. We may select $(\phi,u)\in\mathcal{F}(\lambda)$ so that

[TABLE]

That is, for any $\nu\in\operatorname{\mathbb{P}}_{B^{\lambda}}$, we have

[TABLE]

Plugging $\nu=(\lambda+\rho_{i})^{-1}\delta_{(x,\xi,i)}\in\operatorname{\mathbb{P}}_{B^{\lambda}}$, with any $(x,\xi,i)\in\mathbb{T}^{n}\times\Xi\times\mathbb{I}$, into the above, we find that

[TABLE]

Hence, we have

[TABLE]

This ensures that $u$ is a subsolution of

[TABLE]

which implies that $u-(u_{k}(z)-v_{k}^{\lambda}(z)-\varepsilon)\mathbf{1}$ is a subsolution of (1). By comparison (Theorem 1), we get

[TABLE]

The $k$-th component of the above, evaluated at $x=z$, yields an obvious contradiction. Thus we conclude that (12) holds. ∎

We have the following characterization of $\mathcal{G}\,^{\prime}(z,k,\lambda)$.

Proposition 7**.**

Assume (H), (C) and (M) hold. Let $\nu=(\nu_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}_{B^{\lambda}}$ and $(z,k,\lambda)\in\mathbb{T}^{n}\times\mathbb{I}\times(0,\infty)$. Then we have $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ if and only if

[TABLE]

Proof.

Assume first that $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$. Fix any $\psi=(\psi_{i})_{i\in\mathbb{I}}\in C^{1}(\mathbb{T}^{n})^{m}$ and define $\phi=(\phi_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n}\times\mathbb{I})^{m}$ by

[TABLE]

Observe that $u:=\pm\psi$ satisfy, respectively,

[TABLE]

and, hence,

[TABLE]

Since $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$, we have

[TABLE]

respectively, which shows that (15) is valid.

Now, assume that (15) is satisfied. Fix any $(u,\phi)\in\mathcal{F}(\lambda)$. As noted in the proof of Theorem 1, we have $u\in\operatorname{Lip}(\mathbb{T}^{n})$. By the standard mollification technique, given a positive constant $\varepsilon>0$, we can approximate $u$ by a smooth function $u^{\varepsilon}$ so that

[TABLE]

The last inequality reads

[TABLE]

Integrating the above by $\nu_{i}$, summing up in $i\in\mathbb{I}$ and using (15), we get

[TABLE]

Sending $\varepsilon\to 0$ shows that $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$. ∎

It is convenient to restate the theorem above as follows. For $\mu=(\mu_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}$ and $\lambda>0$, consider $\nu=(\nu_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}_{B^{\lambda}}$ given by

[TABLE]

(Notice by the above definition that $\langle\nu,B^{\lambda}\mathbf{1}\rangle=\langle\mu,\mathbf{1}\rangle=1$.) Observe that for $\phi=(\phi_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n}\times\Xi)^{m}$,

[TABLE]

and that for any $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$, we have $\nu\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ if and only if

[TABLE]

The condition above is stated in the spirit of Proposition 7 as

[TABLE]

We define

[TABLE]

The following proposition is an immediate consequence of Theorem 6.

Corollary 8**.**

Assume (H), (C) and (M). Let $\lambda>0$ and $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. Let $v^{\lambda}\in C(\mathbb{T}^{n}\times\mathbb{I})$ be the unique solution of (1). Then there exists a $\mu^{z,k,\lambda}=(\mu^{z,k,\lambda}_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}(z,k,\lambda)$ such that

[TABLE]

4. A convergence result for the vanishing discount problem

We study the asymptotic behavior of the solution $v^{\lambda}$ of (1), with $\lambda>0$, as $\lambda\to 0$.

We make a convenient assumption on the system (P0):

[TABLE]

If $\rho_{i}>0$ for all $i\in\mathbb{I}$, then Theorem 1 assures that there exists a unique solution $v_{0}$ of (4). In this situation, it is not difficult to show that the uniform convergence, as $\lambda\to 0+$, of $v^{\lambda}$ to the unique solution $v_{0}$ on $\mathbb{T}^{n}$. In general, existence and uniqueness of a solution of (P0) may fail. In fact, one can prove at least in the case when the $b_{ij}$ are constants (see Theorem 18) that there exists $c\in\mathbb{R}^{m}$ such that

[TABLE]

has a solution $v_{0}\in\operatorname{Lip}(\mathbb{T}^{n})$ and possibly multiple solutions. If such a $c=(c_{i})$ exists, then the introduction of a new family of Hamiltonians,

[TABLE]

allows us to view (17) as in the form of (P0). The link between two vanishing discount problems for the original (1) and for (1), with $\widetilde{H}$ in place of $H$, is discussed in Sections 5 and 6.

Theorem 9**.**

Assume (H), (C), (M) and (4). Let $v^{\lambda}$ be the unique solution of (1) for $\lambda>0$. Then there exists a solution $v^{0}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ of (P0) such that the functions $v_{i}^{\lambda}$ converge to $v_{i}^{0}$ uniformly on $\mathbb{T}^{n}$ as $\lambda\to 0$ for all $i\in\mathbb{I}$.

Lemma 10**.**

Under the hypotheses of Theorem 9, there exists a constant $C_{0}>0$ such that for any $\lambda>0$,

[TABLE]

Proof.

Let $v_{0}=(v_{0,i})_{i\in\mathbb{I}}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ be the solution of (P0). Choose a constant $C_{0}>0$ so that

[TABLE]

and observe by the monotonicity of $B$ (Lemma 4) that $v_{0}+C_{1}\mathbf{1}$ and $v_{0}-C_{1}\mathbf{1}$ are a supersolution and a subsolution of (P0), respectively. Noting that $v_{0}+C_{1}\mathbf{1}\geq 0$ and $v_{0}-C_{1}\mathbf{1}\leq 0$, we deduce that $v_{0}+C_{1}\mathbf{1}\geq 0$ and $v_{0}-C_{1}\mathbf{1}\leq 0$ are a supersolution and a subsolution of (1) for any $\lambda>0$, respectively. By comaprison (Theorem 1), we see that, for any $\lambda>0$, $v_{0}-C_{1}\mathbf{1}\leq v^{\lambda}\leq v_{0}+C_{1}\mathbf{1}$ on $\mathbb{T}^{n}$ and, moreover, $-2C_{1}\mathbf{1}\leq v^{\lambda}\leq 2C_{1}\mathbf{1}$ on $\mathbb{T}^{n}$. Thus, (18) holds with $C_{0}=2C_{1}$. ∎

Lemma 11**.**

Under the hypotheses of Theorem 9, the family $(v^{\lambda})_{\lambda\in(0,\,1)}$ is equi-Lipschitz continuous on $\mathbb{T}^{n}$.

Indeed, the family $(v^{\lambda})_{\lambda>0}$ is equi-Lipschitz continuous on $\mathbb{T}^{n}$, which we do not need here.

Proof.

By Lemma 10, there is a constant $C_{0}>0$ such that

[TABLE]

Hence, as $v^{\lambda}$ is a solution of (1), we deduce by (C) that there exists a constant $C_{1}>0$ such that the $v_{i}^{\lambda}$ are subsolutions of $|Du|\leq C_{1}$ in $\mathbb{T}^{n}$. It is a standard fact that the $v_{i}^{\lambda}$ are Lipschitz continuous on $\mathbb{T}^{n}$ with $C_{1}$ as their Lipschitz bound. ∎

In the proof of Theorem 9, Corollary 8 has a crucial role. We need also results for $\lambda=0$ similar to the corollary.

We consider the condition for $\mu\in\operatorname{\mathbb{P}}$,

[TABLE]

We denote by $\operatorname{\mathbb{P}}(0)$ the subset of $\operatorname{\mathbb{P}}$ consisting of those $\mu$ which satisfy (19).

Theorem 12**.**

Assume (H), (C), (M) and (4). Assume that $\rho_{i}=0$ on $\mathbb{T}^{n}$ for every $i\in\mathbb{I}$. Then there exists a $\mu^{0}=(\mu_{i}^{0})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}(0)$ such that

[TABLE]

Proof.

We fix a $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. By Corollary 8, for each $\lambda>0$ there exists $\mu^{\lambda}=(\mu_{i}^{\lambda})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}(z,k,\lambda)$ such that

[TABLE]

Since $(\mu^{\lambda})_{\lambda>0}$ is a family of Borel probability measures on a compact space $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$, there exists a sequence $(\lambda_{j})_{j\in\mathbb{N}}\subset(0,\,1)$ converging to zero such that the sequence $(\mu^{\lambda_{j}})_{j\in\mathbb{N}}$ converges weakly in the sense of measures to a Borel probability measure $\mu^{0}$ on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$. It follows from (21) and Lemma 10 that

[TABLE]

Observe that if $(\phi,u)\in\mathcal{F}(0)$, then, for any $\lambda>0$, $u$ is a subsolution of

[TABLE]

and hence, $(\psi,u)\in\mathcal{F}(\lambda)$, with $\psi(x,\xi)=\phi(x,\xi)+\lambda u(x)$. Hence, the inclusion $\mu^{\lambda}\in\mathcal{G}\,^{\prime}(z,k,\lambda)$ yields

[TABLE]

Multiplying the above by $\lambda$ and sending $\lambda=\lambda_{j}\to 0$, in view of Lemma 10, we get

[TABLE]

This shows that $\mu^{0}\in\operatorname{\mathbb{P}}(0)$. These observations together with (19) for $\mu\in\operatorname{\mathbb{P}}(0)$ guarantee that

[TABLE]

We state a characterization of $\operatorname{\mathbb{P}}(0)$ in the next, similar to Proposition 7, which we leave to the reader to verify.

Proposition 13**.**

Assume (H), (C) and (M). Let $\mu=(\mu_{i})_{i\in\mathbb{I}}\in\operatorname{\mathbb{P}}$. We have $\mu\in\operatorname{\mathbb{P}}(0)$ if and only if

[TABLE]

We call any minimizer $\mu\in\operatorname{\mathbb{P}}(0)$ of the optimization problem (20) a viscosity Mather measure.

We denote by $\mathbb{M}_{+}$ the set of all Borel nonnegative measures $\mu=(\mu_{i})_{i\in\mathbb{I}}$ on $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$. We set

[TABLE]

Theorem 14**.**

Let $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. Assume (H), (C), (M) and (4). For any $\lambda>0$, let $v^{\lambda}$ be the unique solution of (1) and $\mu^{\lambda}\in\operatorname{\mathbb{P}}(z,k,\lambda)$ be a minimizer of (17). Then there exists a subsequence of $(\lambda_{j})$, which is denoted again by the same symbol, such that, as $j\to\infty$,

[TABLE]

weakly in the sense of measures for some $\mu^{0}=(\mu^{0}_{i})_{i\in\mathbb{I}}\in\mathbb{M}_{+}(0)$, and $\mu^{0}$ satisfies

[TABLE]

In particular,

[TABLE]

Notice that the minimization problem (23) is trivial since $\mu^{0}=0$ is a minimizer.

Proof.

The proof is similar to that of Theorem 12.

We fix a $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. For each $\lambda>0$, we have

[TABLE]

Observe that

[TABLE]

Accordingly, since $\mathbb{T}^{n}\times\Xi\times\mathbb{I}$ is a compact metric space, the families $(\lambda(\lambda+\rho_{i})^{-1}\mu_{i}^{\lambda})_{\lambda=\lambda_{j},j\in\mathbb{N}}$ have a common subsequence, along which all the families converge to some Borel nonnegative measures $\mu^{0}_{i}$ weakly in the sense of measures. We may assume by replacing the original sequence $(\lambda_{j})$ by its subsequence that

[TABLE]

weakly in the sense of measures. Combine this with (24) yields

[TABLE]

It is obvious to see that $\mu^{0}\in\mathbb{M}_{+}$.

Let $(\phi,u)\in\mathcal{F}(0)$. As before, we have $(\psi,u)\in\mathcal{F}(\lambda)$, with $\psi(x,\xi)=\phi(x,\xi)+\lambda u(x)$ and moreover

[TABLE]

Multiplying the above by $\lambda$ and sending $\lambda=\lambda_{j}\to 0$, we get

[TABLE]

This shows that $\mu^{0}\in\mathbb{M}_{+}(0)$. ∎

Proof of Theorem 9.

Let $\mathcal{V}$ denote the set of accumulation points $v=(v_{i})\in C(\mathbb{T}^{n})^{m}$ in the space $C(\mathbb{T}^{n})^{m}$ of $v^{\lambda}$ as $\lambda\to 0$. In view of the Ascoli-Arzela theorem, Lemmas 10 and 11 guarantee that the family $(v^{\lambda})_{\lambda\in(0,\,1)}$ is relatively compact in $C(\mathbb{T}^{n})^{m}$. In particular, the set $\mathcal{V}$ is nonempty. Note by the stability of the viscosity property under uniform convergence that any $v\in\mathcal{V}$ is a solution of (P0).

If $\mathcal{V}$ is a singleton, then it is obvious that the whole family $(v^{\lambda})_{\lambda>0}$ converges to the unique element of $\mathcal{V}$ in $C(\mathbb{T}^{n})^{m}$ as $\lambda\to 0$.

We need only to show that $\mathcal{V}$ is a singleton. It is enough to show that for any $v,w\in\mathcal{V}$ and $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$, the inequality $w_{k}(z)\leq v_{k}(z)$ holds.

Fix any $v,w\in\mathcal{V}$ and $(z,k)\in\mathbb{T}^{n}\times\mathbb{I}$. Select sequences $(\lambda_{j})$ and $(\delta_{j})$ converging to zero so that

[TABLE]

By Corollary 8, there exists a sequence $(\mu^{j})_{j\in\mathbb{N}}$ such that

[TABLE]

In view of Theorem 14, we may assume by passing to a subsequence if necessary that, as $j\to\infty$,

[TABLE]

for all $i\in\mathbb{I}$ and for some $\mu^{0}=(\mu^{0}_{i})_{i\in\mathbb{I}}\in\mathbb{M}_{+}(0)$ and, moreover,

[TABLE]

Since $(L-\lambda v^{\lambda},v^{\lambda})\in\mathcal{F}(0)$ and $\mu^{0}\in\mathbb{M}_{+}(0)$, in view of (26), we have

[TABLE]

which yields after dividing by $\lambda>0$ and then sending $\lambda\to 0$ along $\lambda=\delta_{j}$

[TABLE]

Now, note that $w$ is a solution of

[TABLE]

and thus, $(L+\lambda w,w)\in\mathcal{F}(\lambda)$ and infer by (25) that

[TABLE]

Sending $j\to\infty$ now yields

[TABLE]

This together with (27) shows that $w_{k}(z)\leq v_{k}(z)$, which completes the proof. ∎

5. The ergodic problem for irreducible matrix $B$

We consider the problem of finding $c=(c_{i})_{i\in\mathbb{I}}\in\mathbb{R}^{m}$ and $v=(v_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n})^{m}$ such that $v$ is a solution of

[TABLE]

The pair of such $c$ and $v$ is also called a solution of (28). This problem is called the ergodic problem in this paper although the term, ergodic problem, should be used only when the condition that $\sum_{j\in\mathbb{I}}b_{ij}(x)=0$ holds for some $(i,x)\in\mathbb{I}\times\mathbb{T}^{n}$.

Henceforth, $D(x)$ denotes the diagonal matrix

[TABLE]

where, as before, $\rho_{i}(x)=\sum_{j\in\mathbb{I}}b_{ij}(x)$.

Throughout this section, we treat the case when

[TABLE]

The irreducibility of $B(x)$ is stated as follows: for any nonempty subset $I$ of $\mathbb{I}$, which is not identical to $\mathbb{I}$, there exists a pair of $i\in I$ and $j\in\mathbb{I}\setminus I$ such that $b_{ij}(x)\not=0$.

The following result has been established in Davini-Zavidovique [DZ1, Theorem 2.10] (see also [CLLN, MT3]).

Proposition 15**.**

Assume (H), (C), (M), (29), and that

[TABLE]

Then there exist $c_{0}\in\mathbb{R}$ and $v_{0}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ such that the pair $(c_{0}\mathbf{1},v_{0})$ is a solution of (28).

We remark that (30) is satisfied if and only if $B(x)\mathbf{1}=0$ for all $x\in\mathbb{T}^{n}$, which holds if and only if $\rho_{i}(x)=0$ for all $(i,x)\in\mathbb{I}\times\mathbb{T}^{n}$.

The next theorem states the central result of this section.

Theorem 16**.**

Assume (H), (C), (M), (29), and (30). Let $v^{\lambda}$ be the unique solution of (1) for $\lambda>0$. Then there exists a constant $c^{0}\in\mathbb{R}$ and a function $v^{0}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ such that the functions $v^{\lambda}+\lambda^{-1}c^{0}\mathbf{1}$ converge to $v^{0}$ uniformly on $\mathbb{T}^{n}$ as $\lambda\to 0$. Moreover, the pair $(c^{0}\mathbf{1},v^{0})$ is a solution of (28).

Proof.

Thanks to Proposition 15, there exists a solution $(c_{0},v_{0})\in\mathbb{R}^{m}\times C(\mathbb{T}^{n})^{m}$ of (28). We set $\widetilde{H}=H-c_{0}\mathbf{1}$, and note that, since $B(x)\mathbf{1}=0$ for all $x\in\mathbb{T}^{n}$, the function $w^{\lambda}:=v^{\lambda}+\lambda^{-1}c_{0}\mathbf{1}$ satisfies, in the viscosity sense,

[TABLE]

By Theorem 9, there exists a solution $v^{0}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ of $Bv^{0}+\widetilde{H}[v^{0}]=0$ in $\mathbb{T}^{n}$ such that, as $\lambda\to 0+$, $w^{\lambda}\to v^{0}$ in $C(\mathbb{T}^{n})^{m}$. Noting that $(c_{0}\mathbf{1},v^{0})$ is a solution of (28), we finish the proof. ∎

The condition (30) in Proposition 15 can be removed and the following theorem is valid.

Theorem 17**.**

Assume (H), (C), (M), and (29). Then there exist $c^{0}\in\mathbb{R}$ and $v^{0}=(v^{0}_{i})_{i\in\mathbb{I}}\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ such that the pair $(c^{0}\mathbf{1},v^{0})$ is a solution of (28).

Proof.

For $x\in\mathbb{I}\times\mathbb{T}^{n}$, we set

[TABLE]

and note that $B^{0}(x)$ is irreducible and (30) holds with $b_{ij}(x)$ replaced by $b^{0}_{ij}(x)$. Note also that $\rho_{i}(x)\geq 0$ for all $(i,x)\in\mathbb{I}\times\mathbb{T}^{n}$.

Thanks to Proposition 15, there exist $c^{0}\in\mathbb{R}$ and $v=(v_{i})\in\operatorname{Lip}(\mathbb{T}^{n})^{m}$ which solve

[TABLE]

We choose a constant $C>0$ so that $\max_{(i,x)\in\mathbb{I}\times\mathbb{T}^{n}}|v_{i}(x)|\leq C$ and set $v^{\pm}(x)=v(x)\pm C\mathbf{1}$, respectively. Observe that, since $v^{+}_{i}(x)\geq 0$ and $v^{-}_{i}(x)\leq 0$ for all $(i,x)\in\mathbb{I}\times\mathbb{T}^{n}$, the functions $u=v^{+}$ and $u=v^{-}$ are a supersolution and subsolution of

[TABLE]

that is, $Bu+H[u]=c^{0}\mathbf{1}\ \ \text{ in }\mathbb{T}^{n}$, respectively. In view of the Perron method, the function $v^{0}=(v^{0}_{i})_{i\in\mathbb{I}}\in\operatorname{Lip}(\mathbb{T}^{n})$ given by

[TABLE]

is a solution of (28), with $c=c^{0}\mathbf{1}$. ∎

Even without the assumption (30), it is immediate from Theorem 9 that, under the hypotheses of Theorem 17, if $c^{0}=0$, then the convergence holds for the whole family of the solutions $v^{\lambda}$ of (1), with $\lambda>0$. A typical case when $c^{0}=0$ is realized is given by [CLLN, Theorem 4.2](see also [DZ1, MT1]).

6. The ergodic problem for constant matrix $B$

Throughout this section we assume that $B$ is a constant matrix, that is, independent of $x\in\mathbb{T}^{n}$.

The main results in this section are as follows.

Theorem 18**.**

Assume (H), (C), (M), and that $B$ is a constant matrix. Then (28) has a solution $(c,v)\in\mathbb{R}^{m}\times C(\mathbb{T}^{n})^{m}$.

Theorem 19**.**

Under the same hypotheses of Theorem 18, let $(c,v_{0})\in\mathbb{R}^{m}\times C(\mathbb{T}^{n})^{m}$ be a solution of (28) and let $v^{\lambda}$ be the unique solution of (1) for $\lambda>0$. Then there exists a function $v^{0}\in C(\mathbb{T}^{n})^{m}$ such that the functions $v^{\lambda}+(\lambda I+B)^{-1}c$ converge to $v^{0}$ uniformly on $\mathbb{T}^{n}$ as $\lambda\to 0$. Moreover, the pair $(c,v^{0})$ is a solution of (28).

Proof.

It is well-known (and easily checked) that due to the monotonicity of $B$, $(\lambda I+B)$ is invertible for any $\lambda>0$. We set $\widetilde{H}(x,p)=H(x,p)-c$  for $(x,p)\in\mathbb{T}^{n}\times\mathbb{R}^{n}$ and also $w^{\lambda}(x)=v^{\lambda}(x)+(\lambda I+B)^{-1}c$  for $x\in\mathbb{T}^{n}$. Observe that, in the viscosity sense,

[TABLE]

It is clear that $\widetilde{H}$ satisfies (H) and (C) and that $v_{0}$ is a solution of $Bu+\widetilde{H}[u]=0$ in $\mathbb{T}^{n}$. By Theorem 9, we conclude that there exists a solution $v^{0}\in C(\mathbb{T}^{n})^{m}$ of $Bu+\widetilde{H}[u]=0$ in $\mathbb{T}^{n}$ such that $w^{\lambda}\to v^{0}$ in $C(\mathbb{T}^{n})^{m}$ as $\lambda\to 0+$. Noting that $(c,v^{0})$ is a solution of (28), we finish the proof. ∎

For the proof of Theorem 18, we begin with a preliminary remark on the permutations.

For a given permutation $\pi\,:\,\mathbb{I}\to\mathbb{I}$, we define the $m\times m$ matrix $P$ by

[TABLE]

where $\delta_{ij}=\delta_{i,j}:=1$ if $i=j$ and $=0$ otherwise. Note that $P^{-1}=(\delta_{i,\pi(j)})_{i,j\in\mathbb{I}}=P^{\mathrm{T}}$ and that for any $u=(u_{i})_{i\in\mathbb{I}}$,

[TABLE]

The system of Hamilton-Jacobi equations

[TABLE]

can be written component-wise as

[TABLE]

By the use of $P$, the system above is expressed as

[TABLE]

and furthermore, if $v=Pu$,

[TABLE]

Set $A=(a_{ij})_{i,j\in\mathbb{I}}=PBP^{\mathrm{T}}$ and observe that if $B$ is monotone, then

[TABLE]

and

[TABLE]

Consequently, if $B$ is monotone, then $PBP^{\mathrm{T}}$ is monotone as well, and the system (32), by using the permutation matrix $P$, is converted to (33).

Proof of Theorem 18.

It is well-known (see for instance [Var, Section 2.3]) that, given a monotone matrix $B$, one can find a permutation $\pi\,:\,\mathbb{I}\to\mathbb{I}$ such that

[TABLE]

where, $P$ is given by (31), $B^{(1)}$ is a diagonal matrix of order $r_{1}$ and, for $1<i\leq p$, $B^{(i)}$ are irreducible matrices of order $r_{i}$. In view of the preliminary remark before this proof, to seek for a solution of (28), we may and do assume henceforth $B$ has the normal form of the right hand side of (34).

Set

[TABLE]

Notice that $s_{1}=0$. If $r_{1}\geq 1$, then we first show that there exist an $r_{1}$-vector $c^{(1)}=(c^{(1)}_{i})_{i\in\mathbb{I}_{1}}\in\mathbb{R}^{r_{1}}$ and a function $v^{(1)}=(v^{(1)}_{i})_{i\in\mathbb{I}_{1}}\in C(\mathbb{T}^{n})^{r_{1}}$ such that $v^{(1)}$ is a solution of

[TABLE]

where $H^{(1)}=(H_{i})_{i\in\mathbb{I}_{1}}$. The system is, in fact, a collection of single equations

[TABLE]

and thus the existence of a solution $(c^{(1)},v^{(1)})$ of (35) is a classical result. Indeed, for each $i\in\mathbb{I}_{1}$, if $b_{ii}^{(1)}>0$, then (36) has a (unique) solution $v_{i}^{(1)}\in\operatorname{Lip}(\mathbb{T}^{n})$ for any choice of $c_{i}^{(1)}$. If $b_{ii}^{(1)}=0$, then (36) has a solution $(c_{i}^{(1)},v_{i}^{(1)})\in\mathbb{R}\times\operatorname{Lip}(\mathbb{T}^{n})$ (see [LPV]). If $r_{1}=m$, then we are done.

Next, assume that $r_{1}<m$ (and equivalently, $1<p$) and we show that there exist a vector $c^{(2)}=(c^{(2)}_{i})_{i\in\mathbb{I}_{2}}\in\mathbb{R}^{r_{2}}$ and a function $v^{(2)}=(v^{(2)}_{i})_{i\in\mathbb{I}_{2}}\in C(\mathbb{T}^{n})^{r_{2}}$ such that $v^{(2)}$ is a solution of the system

[TABLE]

where

[TABLE]

According to Proposition 15, there exist $c^{(2)}=(c^{(2)}_{i})_{i\in\mathbb{I}_{2}}\in\mathbb{R}^{r_{2}}$ and $v^{(2)}=(v^{(2)}_{i})_{i\in\mathbb{I}_{2}}\in C(\mathbb{T}^{n})^{r_{2}}$ which satisfy (37). This way (by induction), we find $c^{(1)},\ldots,c^{(p)}$ and $v^{(1)},\ldots,v^{(p)}$ such that

[TABLE]

and $v^{(k)}$ satisfies

[TABLE]

where

[TABLE]

We define $c=(c_{i})_{i\in\mathbb{I}}\in\mathbb{R}^{m}$ and $v=(v_{i})_{i\in\mathbb{I}}\in C(\mathbb{T}^{n})^{m}$ by setting

[TABLE]

and observe that

[TABLE]

This completes the proof. ∎

Acknowledgements

The author would like to thank the anonymous referee for useful and critical comments on the original version of this paper, which have helped significantly to improve the presentation. This work was partially supported by the KAKENHI #16H03948, #18H00833, #20H03688, JSPS.