The existence and global exponential stability of almost periodic solutions for neutral type CNNs on time scales
Bing Li, Yongkun Li, Xiaofang Meng

TL;DR
This paper establishes conditions for the existence and stability of almost periodic solutions in neutral type competitive neural networks on time scales, unifying continuous and discrete cases.
Contribution
It introduces new sufficient conditions for stability that are independent of the time scale's graininess, covering both continuous and discrete neural networks.
Findings
Existence of almost periodic solutions under new conditions
Global exponential stability demonstrated for the solutions
Unified results applicable to continuous and discrete time networks
Abstract
In this paper, a class of neutral type competitive neural networks with mixed time-varying delays and leakage delays on time scales is proposed. Based on the exponential dichotomy of linear dynamic equations on time scales, Banach's fixed point theorem and the theory of calculus on time scales, some sufficient conditions that are independent of the backwards graininess function of the time scale are obtained for the existence and global exponential stability of almost periodic solutions for this class of neural networks. The obtained results are completely new and indicate that both the continuous time and the discrete time cases of the networks share the same dynamical behavior. Finally, an examples is given to show the effectiveness of the obtained results.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The existence and global exponential stability of almost periodic solutions for neutral type CNNs on time scales††thanks: This work is supported by the National Natural Sciences Foundation of People’s Republic of China under Grant 11361072.
Bing Lia, Yongkun Lib and Xiaofang Mengb
aSchool of Mathematics and Computer Science
Yunnan Minzu University
Kunming, Yunnan 650500
People’s Republic of China
bDepartment of Mathematics, Yunnan University
Kunming, Yunnan 650091
People’s Republic of China The corresponding author.
Abstract
In this paper, a class of neutral type competitive neural networks with mixed time-varying delays and leakage delays on time scales is proposed. Based on the exponential dichotomy of linear dynamic equations on time scales, Banach’s fixed point theorem and the theory of calculus on time scales, some sufficient conditions that are independent of the backwards graininess function of the time scale are obtained for the existence and global exponential stability of almost periodic solutions for this class of neural networks. The obtained results are completely new and indicate that both the continuous time and the discrete time cases of the networks share the same dynamical behavior. Finally, an examples is given to show the effectiveness of the obtained results.
Key words: Competitive neural networks; Leakage delays; Almost periodic solutions; Time scales.
1 Introduction
The competitive neural networks (CNNs), which was first proposed by Cohen and Grossberg in [1], model the dynamics of cortical cognitive maps with unsupervised synaptic modifications. In this model, there are two types of state variables, the short-term memory variables (STM) describing the fast neural activity and the long-term memory (LTM) variables describing the slow unsupervised synaptic modifications. Thus, there are two time scales in these neural networks, one corresponds to the fast changes of the neural network states, another corresponds to the slow changes of the synapses by external stimuli. Since they are widely applied in the image processing, pattern recognition, signal processing, optimization and control theory and so on [1, 2, 3, 4], recently, many researchers paid attention to the dynamics analysis of CNNs [2-7]. For example, authors of [5, 6, 7, 8, 9, 10] studied the global stability for CNNs; authors of [11] investigate the multistability for CNNs; authors of [12] investigated multistability and multiperiodicity of CNNs; authors of [13] studied the existence and global exponential stability of anti-periodic solutions for CNNs; authors of [14, 15] studied the synchronization for CNNs with mixed delays. In reality, almost periodicity is much universal than periodicity. However, to the best of our knowledge, up to now, there are few papers published on the existence of almost periodic solutions for CNNs, especially, for discrete time CNNs.
In fact, it is natural and important that systems will contain some information about the derivative of the past state to further describe and model the dynamics for such complex neural reactions [16], many authors investigated the dynamical behaviors of neutral type neural networks [16, 17, 18, 19, 20]. In reality, the mixed time-varying delay and leakage delay should be taken into account when modeling realistic neural networks [21, 22, 23].
In addition, it is well known that both continuous and discrete neural network systems are very important in implementation and applications. The theory of time scales, which was initialed by Hilger [24] in his Ph.D. thesis, has recently received a lot of attention from many scholars. It not only unifies the continuous-time and discrete-time domains but also ”between” them [24, 25, 26]. Therefore, it is necessary to study neural network systems on time scales.
On one hand, to the best of our knowledge, there is no published paper considering the global exponential stability of almost periodic solutions for CNNs with mixed time-varying delays and leakage delays on time scales. Therefore, it is a challenging and important problem in theories and applications.
On the other hand, in order to study the almost periodic dynamic equations on time scales, a concept of almost periodic time scales was proposed in [27]. Based on this concept, almost periodic functions [27], pseudo almost periodic functions [28], almost automorphic functions [29], weighted pseudo almost automorphic functions [30], almost periodic set-valued functions [31], almost periodic functions in the sense of Stepanov on time scales [32] and so on were defined successively. Also, some works have been done under the concept of almost periodic time scales (see [33, 34, 35, 36, 37, 38, 39, 40]). Although the concept of almost periodic time scales in [27] can unify the continuous and discrete situations effectively, it is very restrictive because it requires the time scale with some global additivity. This excludes many interesting time scales. Therefore, it is a challenging and important problem in theories and applications to study almost periodic problems on the time scale that does not require such global additivity.
Motivated by above, in this paper, we propose the following competitive neural networks with mixed time-varying delays and leakage delays on time scales:
[TABLE]
where , is an almost periodic time scale, is the neuron current activity level, are the time variable of the neuron, is the output of neurons, is the synaptic efficiency, is the constant external stimulus, and , , represent the connection weight and the synaptic weight of delayed feedback between the th neuron and the th neuron respectively, is the strength of the external stimulus, denotes disposable scale, , denote the external inputs on the th neuron at time , and are leakage delays and satisfy , for , , and are transmission delays and satisfy , , for .
Setting , where and, without loss of generality, the input stimulus is assumed to be normalized with unit magnitude , summing up the LTM over , then the above networks are simplified as the networks:
[TABLE]
For convenience, for almost periodic functions on time scales, we introduce the following notations:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
We denote . The initial condition associated with system (1.6) is of the form
[TABLE]
where , , , , , , , , , are real-valued bounded -differentiable functions defined on .
Our main purpose of this paper is to study the the existence and stability of almost periodic solutions of on a new almost periodic time scale which will be defined in the next section.
This paper is organized as follows. In Section 2, we introduce some definitions and make some preparations for later sections and we extend the almost-periodic theory on time scales with the delta derivative in [41] to that with the nabla derivative. In Section 3, by utilizing Banach’s fixed point theorem and the theory of calculus on time scales, we present some sufficient conditions for the existence of almost periodic solutions of . In Section 4, we prove that the almost periodic solution obtained in Section 3 is globally exponentially stable. In Section 5, an examples are given to illustrate the effectiveness of the theoretical results. Finally, we draw a conclusion in Section 6.
2 Preliminaries
In this section, we shall first recall some fundamental definitions and lemmas in [25, 26]. Also, we extend the almost periodic theory on time scales with the delta derivative to that with the nabla derivative.
A time scale is an arbitrary nonempty closed subset of the real set with the topology and ordering inherited from . The forward jump operator is defined by \sigma(t)=\inf\big{\{}s\in\mathbb{T},s>t\big{\}} for all , while the backward jump operator is defined by \rho(t)=\sup\big{\{}s\in\mathbb{T},s<t\big{\}} for all .
A point is called left-dense if and , left-scattered if , right-dense if and , and right-scattered if . If has a left-scattered maximum , then ; otherwise . If has a right-scattered minimum , then ; otherwise . Finally, the backwards graininess function is defined by .
A function is ld-continuous provided it is continuous at left-dense point in and its right-side limits exist at right-dense points in .
Definition 2.1**.**
[26]** Let be a function and . Then we define to be the number (provided its exists) with the property that given any , there is a neighborhood of (i.e, for some ) such that
[TABLE]
for all , we call the nabla derivative of at .
Let be ld-continuous. If , then we define the nabla integral by .
A function is called -regressive if for all . The set of all -regressive and left-dense continuous functions will be denoted by . We define the set .
If , then we define the nabla exponential function by
[TABLE]
with the -cylinder transformation
[TABLE]
Definition 2.2**.**
* Let , then we define a circle plus addition by , for all . For , define a circle minus by .*
Lemma 2.1**.**
* Let , and . Then*
* and ;*
;
;
;
.
Lemma 2.2**.**
* Let be nabla differentiable functions on , then*
, for any constants ;
;
If and are continuous, then
Lemma 2.3**.**
* Assume and . If for , then for all .*
Definition 2.3**.**
[27]** A time scale is called an almost periodic time scale if
[TABLE]
Definition 2.4**.**
* A time scale is called an almost periodic time scale if the set*
[TABLE]
where , and there exists a set satisfying
,
,
,
where .
Obviously, if , then If , then for .
Lemma 2.4**.**
* If is an almost periodic time scales under Definition 2.4, then is an almost periodic time scale under Definition 2.3.*
In the following, we restrict our discussion on an almost periodic time scale that is defined by Definition 2.4.
Lemma 2.5**.**
* If is a right-dense point of , then is also a right-dense point of .*
Lemma 2.6**.**
* If is a left-dense point of , then is also a left-dense point of .*
For each , we define by for . From Lemmas 2.5 and 2.6, we can get that . Therefore, defined by
[TABLE]
is an antiderivative of on , where denotes the -derivative on .
Let denote the collection of all bounded uniformly continuous functions from to , where is any compact set. We introduce the following definition of almost periodic functions on time scales as follows.
Definition 2.5**.**
* Let be an almost periodic time scale under sense of Definition 2.4. A function is called an almost periodic function in uniformly for if the -translation set of *
[TABLE]
is relatively dense for all and for each compact subset of ; that is, for any given and each compact subset of , there exists a constant such that each interval of length contains a such that
[TABLE]
This is called the -translation number of .
Definition 2.6**.**
* Let be an matrix-valued function on . Then the linear system*
[TABLE]
is said to admit an exponential dichotomy on if there exist positive constant , projection and the fundamental solution matrix of (2.1), satisfying
[TABLE]
where is a matrix norm on say, for example, if , then we can take .
Consider the following almost periodic system
[TABLE]
where is an almost periodic matrix function, is an almost periodic vector function.
Lemma 2.7**.**
* If the linear system (2.1) admits exponential dichotomy, then system (2.2) has a bounded solution as follows:*
[TABLE]
where is the fundamental solution matrix of (2.1).
Lemma 2.8**.**
* Let be an almost periodic function on , where , and , then the linear system*
[TABLE]
admits an exponential dichotomy on .
By Lemma 2.7 in [43], we have
Lemma 2.9**.**
Let be an almost periodic matrix function and be an almost periodic vector function. If (2.1) admits an exponential dichotomy, then (2.2) has a unique almost periodic solution:
[TABLE]
where is the restriction of the fundamental solution matrix of (2.1) on .
From Definition 2.5 and Lemmas 2.7 and 2.9, one can easily get the following lemma.
Lemma 2.10**.**
If linear system admits an exponential dichotomy, then system has an almost periodic solution can be expressed as:
[TABLE]
where is the fundamental solution matrix of .
3 The existence of almost periodic solution
In this section, we will state and prove the sufficient conditions for the existence of almost periodic solutions of (1.6).
Let
[TABLE]
with the norm for , then is a Banach space.
Throughout the rest of this paper, we assume that the following conditions hold:
are continuous almost periodic functions for ;
The function and there exists positive constant such that for all
[TABLE]
Theorem 3.1**.**
Let - hold. Suppose that
there exists a constant such that
[TABLE]
where
[TABLE]
Then system (1.6) has has a unique almost-periodic solution in the region .
Proof.
Rewrite (1.6) in the form
[TABLE]
For every , we consider the following system
[TABLE]
where
[TABLE]
Since \min\limits_{1\leq i\leq n}\big{\{}\inf\limits_{t\in\mathbb{T}}\alpha_{i}(t),\inf\limits_{t\in\mathbb{T}}c_{i}(t)\big{\}}>0, it follows from Lemma 2.8 that the linear system
[TABLE]
admits an exponential dichotomy on . Thus, by Lemma 2.10, we know that system (3) has exactly one almost periodic solution which can be expressed as follows:
[TABLE]
where
[TABLE]
Define the following operator by
[TABLE]
We will show that is a contraction.
First, we show that for any , . Note that for ,
[TABLE]
and
[TABLE]
Therefore, we can get for ,
[TABLE]
and
[TABLE]
On the other hand, for , we have
[TABLE]
and
[TABLE]
In view of , we have
[TABLE]
which implies that , so the mapping is a self-mapping from to .
Next, we shall prove that is a contraction mapping. For any , we have for ,
[TABLE]
and
[TABLE]
In a similar way, we have for ,
[TABLE]
and
[TABLE]
By , we have
[TABLE]
Hence, we obtain that is a contraction mapping. Then, system (1.6) has a unique almost periodic solution in the region . This completes the proof of Theorem 3.1.
4 Global exponential stability of almost periodic solution
In this section, we will study the exponential stability of almost periodic solutions of (1.6).
Definition 4.1**.**
The almost periodic solution of system (1.6) with initial value is said to be globally exponentially stable if there exist positive constants with and such that every solution of system (1.6) with initial value satisfies
[TABLE]
where \|Z(t)-Z^{\ast}(t)\|=\max\limits_{1\leq i\leq n}\big{\{}|x_{i}(t)-x_{i}^{\ast}(t)|,S_{i}(t)-S_{i}^{\ast}(t)|,|(x_{i}(t)-x_{i}^{\ast}(t))^{\nabla}|,|(S_{i}(t)-S_{i}^{\ast}(t)|)^{\nabla}\big{\}}, \|\psi-\psi^{\ast}\|_{0}=\max\limits_{1\leq i\leq n}\bigg{\{}\sup\limits_{s\in[-\theta,0]_{\mathbb{T}}}|\varphi_{i}(s)-\varphi_{i}^{\ast}(s)|,\sup\limits_{s\in[-\theta,0]_{\mathbb{T}}}|\phi_{i}(s)-\phi_{i}^{\ast}(s)|,\sup\limits_{s\in[-\theta,0]_{\mathbb{T}}}|(\varphi_{i}(s)-\varphi_{i}^{\ast}(s))^{\nabla}|,\\ \sup\limits_{s\in[-\theta,0]_{\mathbb{T}}}|(\phi_{i}(s)-\phi_{i}^{\ast}(s))^{\nabla}|\bigg{\}} .
Theorem 4.1**.**
Assume that and - hold, then system (1.6) has a unique almost periodic solution which is globally exponentially stable.
Proof.
From Theorem 3.1, we see that system (1.6) has an almost periodic solution with the initial value . Suppose that is an arbitrary solution of (1.6) with the initial value .
Then it follows from system (1.6) that
[TABLE]
where , , and .
The initial condition of (4.5) is
[TABLE]
where .
Multiplying both sides of (4.5) by and , respectively, and integrating over , where , we have
[TABLE]
where .
For , let , and be defined as follows:
[TABLE]
and
[TABLE]
By , we get for ,
[TABLE]
and
[TABLE]
Since and are continuous on and , as , there exist such that and for , for , for , for . Take a=\min\limits_{1\leq i\leq n}\big{\{}\xi_{i},\overline{\xi_{i}},\gamma_{i},\overline{\gamma_{i}}\big{\}}, we have . So, we can choose a positive constant 0<\lambda<\min\big{\{}a,\min\limits_{1\leq i\leq n}\{\alpha^{-}_{i},c_{i}^{-}\}\big{\}} such that
[TABLE]
which imply that for
[TABLE]
[TABLE]
[TABLE]
and
[TABLE]
Let
[TABLE]
then by we have .
It is obvious that
[TABLE]
where and satisfies (4.11). We claim that
[TABLE]
To prove (4.12), we show that for any , the following inequality holds:
[TABLE]
If (4.13) is not true, then there must be some , such that
[TABLE]
and
[TABLE]
By (4.10), (4.14), (4.15) and -, we obtain for ,
[TABLE]
and
[TABLE]
Similarly, in view of (4.10), we have for ,
[TABLE]
and
[TABLE]
In view of (4.16)-(4.19), we have
[TABLE]
which contradicts (4.14), and so (4.13) holds. Letting , then (4.12) holds. Hence, the almost periodic solution of system (1.6) is globally exponentially stable. The proof is complete.
Remark 4.1**.**
Since conditions - are independent of the backwards graininess function of the time scale, according to Theorems 3.1 and 4.1, both the continuous time and the discrete time cases of system (1.6) share the same dynamical behavior.
5 An example
In this section, we present an example to illustrate the feasibility of our results obtained in previous sections.
Example 5.1**.**
In system (1.6), suppose , let and take coefficients as follows:
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
By calculating, we have
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Take and we have
[TABLE]
Obviously, conditions and hold. Since
[TABLE]
that is,
[TABLE]
so, condition holds. Thus, all the conditions in Theorem 4.1 are satisfied. Therefore, according to Theorem 4.1, system (1.6) has a unique almost periodic solution which is globally exponentially stable. Especially, for both the discrete time and continuous time cases, system (1.6) has a unique almost periodic solution which is globally exponentially stable (see Figures 1-4).
6 Conclusion
In this paper, we propose a class of neutral type competitive neural networks with mixed time-varying delays and leakage delays on a new type of almost periodic time scales. Based on the exponential dichotomy of linear dynamic equations on time scales, Banach’s fixed point theorem and the theory of calculus on time scales, we obtain the existence and uniqueness of almost periodic solutions for this class of neural networks without assuming the boundedness of the activation functions and under the same assumptions we also obtain the global exponential stability of the almost periodic solutions. Our approaches of this paper maybe further be used for other dynamical systems. But, if we modify Definition 2.4 to be the following form:
Definition 6.1**.**
A time scale is called an almost periodic time scale if the set
[TABLE]
where , and there exists a set satisfying
,
,
,
where .
Then, how to study the almost periodic problem for dynamic equations on the almost periodic time scale defined by Definition 6.1 with or without condition is a more challenge task. This is our future goals.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M.A. Cohen, S. Grossberg, Absolute stability of global pattern formation and parallel memory storage by competitive neural networks, IEEE Trans. Syst. Man Cybern. 13 (1983) 815-826.
- 2[2] P.M. Engel, R.F. Molz, A new proposal for implementation of competitive neural networks in analog hardware, in: Proceedings of the 5th Brazilian Symposium on Neural Networks, 1998, pp.186-191.
- 3[3] B. Sowmya, B. Sheela Rani, Colour image segmentation using fuzzy clustering techniques and competitive neural network, Appl. Soft Comput. 11 (2011) 3170-3178.
- 4[4] S. Amari, Competitive and cooperator aspects in dynamics of neural exciton and self-organization, Springer Lecture Notes in Biomathematics, vol.45, 1982, pp. 1-28.
- 5[5] A. Meyer-Baese, S. Pilyugin, Y. Chen, Global exponential stability of competitive neural networks with different time scales, IEEE Trans. Neural Netw. 14 (2003) 716-719.
- 6[6] X.B. Nie, J.D. Cao, Existence and global stability of equilibrium point for delayed competitive neural networks with discontinuous activation functions, Int. J. Syst. Sci. 43(3) (2012) 459-474.
- 7[7] H.B. Gu, H.J. Jiang, Z.D. Teng, Existence and global exponential stability of equilibrium of competitive neural networks with different time scales and multiple delays, J. Frankl. Inst. 347 (2010) 719-731.
- 8[8] L. Duan, L.H. Huang, Global dynamics of equilibrium point for delayed competitive neural networks with different time scales and discontinuous activations, Neurocomputing 123 (2014) 318-327.
