Abstract
This paper is concerned with the general decay lag synchronization problem for a class of competitive neural networks with constant delays via designing a novel nonlinear feedback controller. Based on the useful lemma, which guarantee the general decay synchronization of chaotic systems, some simple sufficient criteria ensuring the general decay lag synchronization of addressed competitive neural networks are obtained via constructing a novel Lyapunov–Krasovskii functional and using some inequality techniques. Finally, one numerical example is provide to demonstrate the feasibility of the established theoretical results. The results of this paper are general since the classical polynomial synchronization and exponential synchronization can be seen the special cases of general decay synchronization.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Competitive neural networks (CNNs), as the generalization of the classical Hopfield neural networks (HNNs) and Cohen–Grossberg neural networks (CGNNs), was first introduced by Meyer-Baese to model the dynamics of cortical cognitive maps with unsupervised synaptic modifications. CNNs different from the traditional neural networks (NNs) with first-order interactions due to consideration of long-term memory and short-term memory variables [1,2,3]. In implementation of NNs, owing to the finite switching speed of neurons and amplifiers, time delays are inevitable in the signal transmission among the neurons, which will affect the stability of the neural system and may lead to some complex dynamic behaviors such as instability, chaos, oscillation or other performance of the NNs. Therefore, the dynamic analysis of NNs, especially CNNs with delays received much more attention [4,5,6,7].
Since it was first proposed by Pecora and Carrol to synchronize two identical systems with two different initial values [8], synchronization has been comprehensively studied over the past few decades due to their potential applications in a wide variety of areas, ranging from secure communications to pattern recognition, even to modeling the human brain’s activity [9,10,11,12,13]. In the meantime, a large number of synchronization problems have been introduced and studied, such as complete synchronization [8], lag synchronization [14,15,16], impulsive synchronization [17], projective synchronization [18], function projective synchronization [19]. Among them, lag synchronization have received much more attention due to its amazing applications in practice. For example, in the communication of telephone system, the voice one hears on the receiver side at time \(t+\delta \) is the voice from the transmitter side at time t. Hence, it is reasonable to require the states of response system to synchronize the states of drive system at a constant time lag [20]. Compared with other types of synchronization such as complete synchronization or projective synchronization, lag synchronization means that the drive and response systems could be synchronized with a propagation delay. Because the lag synchronization can clearly indicate the fragile nature of neuron systems, it has attracted the concerns of many researchers in various fields and some excellent results have been reported in this research area [20,21,22,23,24,25].
In [20], the exponential lag synchronization for CGNNs with discrete time-delays and distributed delays was investigated via using the intermittent control strategy. By using the analysis method, Lyapunov functional theory and inequality technique, the lag synchronization problem of fuzzy cellular networks (FCNs) with delays was studied in [22]. In [23], an intermittent control scheme was used to investigate the lag synchronization for a type of fractional-order memristive neural networks (FMNNs) with switching jumps. In [24], the authors studied the problem of global exponential lag synchronization of a class of switched NNs with time-varying delays. Very recently, the exponential lag synchronization for a class of neural networks with mixed delays including discrete and distributed delays was concerned by adaptive intermittent control in [25].
When studying the synchronization of chaotic systems, it is a very important topic to find estimate of the convergent rate of synchronization [26]. However, in some special cases, the convergence rate of the synchronization can not be shown or it is not easy to estimate. For example, consider the differential equation \( {\dot{y}}(x)=-\frac{1}{2}y^{3}, \ x\ge 0\). Even though we know that this equation is asymptotically stable, we can not able to estimate the convergent rat of the solution of it. This motivate us to define a new type of convergence rate, such as convergence with general decay. Recently, authors in [27] investigated the general decay synchronization (GDS) of NNs with discontinuous activation functions by nonlinear feedback controller. In [28], the author investigated the GDS of a class of NNs with general neuron activation functions and time-varying delays by constructing suitable Lyapunov functional and using useful inequality techniques. The problem of GDS for memristor-based CGNNs with mixed time-delays and discontinuous activations was considered in [29]. However, to the best of our knowledge, there are few or even no results on general decay lag synchronization (GDLS) of CNNs with constant delays.
Inspired by the above discussions, the aim of the paper is to study the GDLS problem for a class of CNNs with constant delays. By designing a type of nonlinear feedback controller, some simple sufficient criteria ensuring the GDLS of addressed CNNs are obtained by designing a novel nonlinear feedback controller and employing some inequality techniques. Finally, one numerical example is provided to demonstrate the feasibility of the established theoretical results. The results of this paper generalize the classical polynomial synchronization and exponential synchronization via introducing more general convergent rate.
The rest of the paper is organized as follows. In Sect. 1, some useful assumptions, definitions, and lemmas are introduced. In Sect. 2, a class of CNNs model is introduced, and some relative definitions are given. In Sect. 3, we investigated the GDLS of the addressed competitive neural networks with constant delays via designing a novel nonlinear feedback controller. In Sect. 4, two numerical examples and their Matlab simulations are presented. Final section ends up with some general conclusions.
2 Preliminaries
The CNNs with delays in this paper are modeled as follows:
where \(i, j \in {\mathcal {J}}\triangleq \{1,2,\ldots ,n\}\) and \(n\ge 2\); \(x_i(t)\) is the neuron current activity level; \(f_j(\cdot )\) is the output of neurons; \(c_i\) represents the time constant of the neuron; \(m_{ij}(t)\) is the synaptic efficiency; \(h_j\) is the constant external stimulus; \(a_{ij},\ b_{ij}\) represent, respectively, the connection weight and the synaptic weight of delayed feedback between the ith and jth neurons; \(B_i\) is the strength of the external stimulus; \(I_i\) denotes the external inputs on the ith neuron at time t; \(d_i>0\) and \(E_i\) denote disposable scaling constants; \(\tau _{ij}>0\) represents constant delay of the jth unit from the ith unit.
In the paper, without loss of generality, we assume that the input stimulus H can be normalized with unit magnitude \(|H|^2 = 1\), where \(H = (h_1, h_2, \ldots , h_n)^T\). By setting \(S_i =\sum _{j=1}^{n}m_{ij}(t)h_j = H^T m_i(t)\), where \(m_i = (m_{i1}, m_{i2}, \ldots , m_{in})^T\) and summing up the LTM over j, then the drive system (1) can be modified as follows
For a positive integer k, let \(R^k \) be a k-dimentional vector space, then the initial values of system (2) are given as
where \(\tau =\max _{i,j\in {\mathcal {J}} } \{ \tau _{ij}\},\ \varphi ^x= \big (\varphi ^x_{1}(\theta ),\varphi ^x_{2}(\theta ), \ldots ,\varphi ^x_{n}(\theta )\big )^T \in C([-\tau ,0],R^n)\), \(\varphi ^S=\big (\varphi ^S_{1} (\theta ),\varphi ^S_{2}(\theta ),\ldots \), \(\varphi ^S_{n}(\theta )\big )^T \in C([-\tau ,0],R^n)\). Here, \(C([\theta _1,\theta _2],R^k)\) for \(\theta _1<\theta _2\ ( \theta _1,\theta _2\in R\)) denotes the Banach space of all continuous functions mapping from \([\theta _1,\theta _2]\) to \(R^k\) with a appropriate norm.
Throughout the paper, we assume that the neuron activation functions \(f_j(v)\) satisfy the following assumptions
\({\mathbf {A}}_1\): For any \(j\in {\mathcal {J}}\), there exist constants \(L_j\) such that,
In the paper, the system (2) is assumed to be drive system, and its response system is given by
where \(c_i,\ d_i,\ a_{ij}, \ b_{ij},\ B_i,\ E_i\) are given system (2), \(u_i(t)\) and \({\tilde{u}}_i(t)\) are controllers to be designed.
The initial values of system (3) are given by
where \(\phi ^y=(\phi ^y_{1}(\theta ),\phi ^y_{2}(\theta ), \ldots ,\phi ^y_{n}(\theta ))^T \in C([-\tau ,0],R^n)\), \(\phi ^W=(\phi ^W_{1}(\theta ),\phi ^W_{2}(\theta ), \ldots ,\phi ^W_{n}(\theta ))^T \in C([-\tau ,0],R^n)\).
Let \(e_{i}(t)=y_i(t)-x_i(t-\sigma )\) and \(z_{i}(t)=W_i(t)-S_i(t-\sigma )\), then the corresponding error system between drive system (2) and response system (3) can be written as
where \(g_j(e_j(t))=f_j(y_j(t))-f_j(x_j(t-\sigma ))\) and \(g_j(e_j(t-\tau _{ij}))= f_j(y_j(t-\tau _{ij})) -f_j(x_j(t-\tau _{ij}-\sigma ))\).
In order to define the initial condition of error system (4), we supplement the initial condition of \(x_i(t)\) and \(S_i(t)\) as following
then the initial condition of system (4) can be given by \(e_i(\theta )=\phi ^y_i(\theta )-{\bar{\varphi }}^x_i(\theta -\sigma ),\ z_i(\theta )=\phi ^W_i(\theta )-{\bar{\varphi }}^S_i(\theta -\sigma )\) for \(-\tau \le \theta \le 0\) and \( i\in {\mathcal {J}}\).
Now, similar to the [28, 30], we introduce the definitions of \(\psi \)-type function and GDS as follows.
Definition 1
[28, 30]. Let \(R^+ \triangleq [0,+\infty )\), then a function \(\psi :R^{+}\rightarrow [1,+\infty )\) is said to be \(\psi \)-type function if it satisfies the following four conditions:
-
(1)
It is differentiable and nondecreasing;
-
(2)
\(\psi (0)=1\) and \(\psi (+\infty )=+\infty \);
-
(3)
\({\tilde{\psi }}(t)={\dot{\psi }}(t)/\psi (t)\) is nonincreasing and \(\psi ^*=\sup _{t\ge 0}{\tilde{\psi }}(t)<+\infty \);
-
(4)
For any \(t,\ s \ge 0,\ \psi (t+s)\le \psi (t) \psi (s)\).
For example, the functions \(\psi (t)=e^{\alpha t}\) and \(\psi (t)=(1+t)^\alpha \) for any \(\alpha > 0\) satisfy the above four conditions, thus can be seen as \(\psi \)-type functions.
Definition 2
[26, 29]. The drive-response systems (2) and (3) are said to be general decay synchronized if there exist a scalar \(\varepsilon >0\) such that
where \( e(t)=(e_1(t),e_2(t),\ldots ,e_m(t))^T,\ z(t)=(z_1(t),z_2(t),\ldots ,z_n(t))^T\), \(\varepsilon >0\) can be seen the convergence rate as synchronization error approaches zero.
\({\mathbf {A}}_2\): There exist a function \(\varrho (t)\in C(R,R^+)\) and a scaler \(\varepsilon >0\) such that
where the functions \(\psi (t), {\tilde{\psi }}(t)\) are defined in the Definition 1.
Following lemma plays a vital role in our later study.
Lemma 1
[31]. Suppose that assumption \({\mathbf {A}}_2\) hold, and synchronization errors e(t) and z(t) between the drive-response systems (2) and (3) satisfied the differential equations \( {\dot{e}}(t)={F}(t,e(t),z(t)) \) and \( {\dot{z}}(t)={G}(t,e(t),z(t)) \), respectively, where the functions F(t, e(t), z(t)) and G(t, e(t), z(t)) are locally bounded. If there exist a Lyapunov functional \(V(t,e(t), z(t)):R^+\times R^n\times R^n \rightarrow R^+\), and positive constants \(\lambda _1, \lambda _2\) such that for any \((t,e(t),z(t))\in R^+\times R^n\times R^n \),
where \(\varepsilon \) and \(\varrho (t)\) are defined in \({\mathbf {A}}_2\). Then the drive-response systems (2) and (3) will realize GDS in the sense of Definition 2, and the convergence rate of GDS is \(\varepsilon \).
Proof
The proof of Lemma 1 is similar to Proof of Lemma 1 given in [31], so we have omitted in here. \(\square \)
3 Main Results
In this section, we will derive some sufficient criteria for the GDS of drive-response systems (2) and (3). First letting \(\omega _{ij}\) be any numbers greater that zero, \(\mu _{ij}=\frac{L_j|b_{ij}|}{2}\), and designing the controllers \(u_i(t) \) and \(\ {\tilde{u}}_i(t)\) of response system (3) as follows:
where \(\eta _i\) for \(i\in {\mathcal {J}}\) and \(\xi _i\) for \(i\in {\mathcal {J}}\) are positive control gains satisfying
Then by using the nonlinear feedback controller (8), the following theorem can be obtained.
Theorem 1
Suppose \(\mathbf {A_1}\)–\(\mathbf {A_2}\) hold, then the response network (3) can achieve GDS with the derive network (2) under the nonlinear feedback controller (8) if, the control gains \(\eta _i\) and \(\xi _i\) satisfy the inequality (9).
Proof
Construct the following Lyapunov–Krasovskii type functional:
where \(\mu _{ij}=\frac{L_j|b_{ij}|}{2}\) and \(\omega _{ij}\) be any numbers greater that zero. Then, there exist positive scalars \(\kappa> 1,\ \gamma > 1 \) such that
where \(\alpha =\min _{i\in {\mathcal {J}}}\{\alpha _i \}, \ \beta =\min _{i\in {\mathcal {J}}}\{\beta _i \} \) with
Now, calculating the time derivative of V(t), we get
In view of the assumption \(\mathbf {A_1}\) and inequality \(2ab\le a^2+b^2\) for any \(a> 0,b> 0\), one has
Similarly, we have
Introducing above four inequalities to the derivative of V(t), we have
Also by letting \({\eta }=\max _{i\in {\mathcal {J}}}\{\eta _i\}>0, \ {\xi }=\max _{i\in {\mathcal {J}}}\{\xi _i\}>0\) and using the inequality \(0 \le ab/(a + b) \le a \) for any \(a> 0,b> 0\), we have
Now taking a small enough \(\delta \) such that \(\delta \kappa \le \alpha ,\ \delta \gamma \le \beta \), then from the inequalities (11) and (12), we get
which means that
Thus, from Lemma 1, the drive-response systems (2) and (3) achieved GDLS under the nonlinear feedback controller (8). The convergence rate of e(t) and z(t) approaching zero is \(\delta \). The proof is completed. \(\square \)
When there is no delay in system (2), then it is degenerated to
Accordingly, the corresponding response system becomes to the following form
where \(u_i(t)\) and \({\tilde{u}}_i(t)\) are nonlinear controllers.
In this case, for GDS of drive-response systems (14) and (15), we have a following corollary from Theorem 1.
Corollary 1
Suppose assumptions \(\mathbf {A_1}\)–\(\mathbf {A_2}\) hold, then the response network (15) can achieve GDS with the drive network (14) under the following nonlinear feedback controller
where \({\bar{\eta }}_i\) for \(i\in {\mathcal {J}}\) and \({\bar{\xi }}_i\) for \(i\in {\mathcal {J}}\) are positive control gains satisfying
Remark 1
Even though there are some previously published results on the exponential or asymptotically lag synchronization for CNNs with or without time delays [2, 6, 7], there are still no any results on GDLS for CNNs. As we mentioned earlier in the paper, GDS enable us to estimate to convergence rate of synchronization error via defining a more general convergence rate. In this paper, we firstly studied the GDLS of CNNs with constant delay by introducing a novel nonlinear controller and using some inequality techniques. It it not difficult to see that the results obtained in [2, 6, 7, 20,21,22] can be seen the special cases of our results when the general decay function chosen as \(\psi (t) = e^{\alpha t} \) and \(\psi (t) = (1 + t)^\alpha \) for any \(\alpha > 0\). From this point, our results are more general and have better applicability.
4 Numerical Simulations
In this section, two numerical examples are presented to validate the feasibility of the established results in the paper.
Example 1
For \(n=2\), consider the following delayed CNNs system
where \(f_1(u)=f_2(u)=\tanh (u)\). The parameters of system (18) are chosen that \(c_1=c_2=0.8,\ d_1=0.4,\ d_2=0.3,\ a_{11}=1, \ a_{12}=1, \ a_{21}=-\,3, \ a_{22}=-\,3,\ \ b_{11}=-\,1.5, \ b_{12}=2, \ b_{21}=3, \ b_{22}=3.5,\ E_{1}=E_{2}=1, \ B_{1}=B_{2}=1,\ \tau _{ij}= 1\) and \(I_i=0\) for \(i=1,2\).
The Matlab simulation of drive system (18) under the initial conditions \(x_1(\theta )=0.2,\ x_2(\theta )=0.6,\ S_1(\theta )=-\,0.1\) and \( S_2(\theta )=0.2\) for \(\theta \in [-\,1,0]\) is shown in Fig. 1, we can see that drive system (18) has a chaotic attractor.
The corresponding response system is given by
where \(c_i,\ a_{ij},\ b_{ij},\ f_j,\ \tau _{ij}\) and \(I_i\) are the same as in system (18), and the nonlinear feedback controller \(u_i(t)\) is designed as follows
where \(e_{i}(t)=y_i(t)-x_i(t-\sigma )\) and \(z_{i}(t)=W_i(t)-S_i(t-\sigma )\) for \(i=1,2.\)
Choosing the time lag \(\sigma =2\), then it is not difficult to estimate that \( {L}_1=L_2=1\) and \(\tau _{ij}=1\). Thus, the assumption \(\mathbf {{A}_1}\) is satisfied. Letting \(\varrho (t)=e^{-0.1 t},\ \psi (t) = e^{ t}\) and choosing \(\eta _1=7.2,\ \eta _2=8.4,\ \xi _1=0.7\) and \( \xi _2=0.8\), then the assumption \(\mathbf {A_2}\) and inequality (9) can also be satisfied. Therefore, according to the Theorem 1, the drive-response systems (18) and (19) can be achieved GDLS under the controller (20). The time evolution of synchronization errors between drive-response systems (18) and (19) are showmen in Figs. 2 and 3, where the initial values of response system (19) are chosen as \(y_1(\theta )=0.460,\ y_2(\theta )=0.310,\ W_1(\theta )= 0.281\) and \(W_2(\theta )=-0.086\) for \(\theta \in [-1,0]\). The synchronization curves between systems (18) and (19) are demonstrated in Figs. 4 and 5.
5 Conclusion
In this work, we studied the GDLS problem for a type of chaotic CNNs with constant delays. By employing useful analysis technique and introducing a Lyapunov-Krasovskii functional, we proposed novel nonlinear feedback control strategies to guarantee the GDLS of considered drive-response systems. Finally, one numerical example and its Matlab simulations are provide to demonstrate the feasibility of the established theoretical results. The results of this can be seen improvement and extension of the previous synchronization studies on CNNs since the GDLS includes the classical polynomial synchronization and exponential synchronization as its special cases.
References
Nie X, Cao J (2012) Existence and global stability of equilibrium point for delayed competitive neural networks with discontinuous activation functions. Int J Syst Sci 43(3):459–474
Nie X, Cao J, Fei S (2013) Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions. Neurocomputing 119(16):281–291
Yang X, Cao J (2016) Adaptive lag synchronization for competitive neural networks with mixed delays and uncertain hybrid perturbations. IEEE Trans Neural Netw Learn Syst 185(10):242–253
Li X, Cao J (2006) Adaptive synchronization for delayed neural networks with stochastic perturbation. Phys Lett A 353(4):318–325
Cao J, Lu J (2006) Adaptive synchronization of neural networks with or without timevarying delay. Chaos 16(1):037203
Yang X, Cao J, Long Y, Rui W (2016) Adaptive lag synchronization for competitive neural networks with mixed delays and uncertain hybrid perturbations. IEEE Trans Neural Netw Learn Syst 185(10):242–253
Nie X, Huang Z (2012) Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions. Neurocomputing 82(1):1–13
Pecora LM, Carroll TL (1996) Synchronization in chaotic systems. Phys Rev Lett 06(08):142–145
Lu J, Ho DW, Wu L (2009) Exponential stabilization of switched stochastic dynamical networks. Nonlinearity 22:889–911
Garcia-Ojalvo J, Roy R (2001) Spatiotemporal communication with synchronized optical chaos. Phys Rev Lett 86(22):5204–5207
Lu J, Ho DW (2011) Stabilization of complex dynamical networks with noise disturbance under performance constraint. Nonlinear Anal Real World Appl 12:1974–1984
Li Y, Lou J, Wang Z, Alsaadi FE (2018) Synchronization of nonlinearly coupled dynamical networks under hybrid pinning impulsive controllers. J Frankl Inst 355:6520–6530
Lu J, Ding C, Lou J, Cao J (2015) Outer synchronization of partially coupled dynamical networks via pinning impulsive controllers. J Frankl Inst 352:5024–5041
Shahverdiev EM, Shore KA (2002) Generalized synchronization in time-delayed systems. Phys Lett A 292(6):320–324
Liang J, Li P, Yang Y (2007) Adaptive lag synchronization ounknown chaotic delayed neural networks with noise perturbation. Phys Lett A 364(3):277–285
Cao Y, Wen S, Huang T (2017) New criteria on exponential lag synchronization of switched neural networks with time-varying delays. Neural Process Lett 46:451–466
Tao Y, Chua LO (2011) Impulsive control and synchronization of nonlinear dynamical systems and application to secure communication. Int J Bifurc Chaos 7(3):645–664
Mainieri R, Rehacek J (1999) Projective synchronization in three-dimensional chaotic systems. Phys Rev Lett 82(82):3042–3045
Abdurahman A, Jiang H, Teng Z (2014) Function projective synchronization of impulsive neural networks with mixed time-varying delays. Nonlinear Dyn 78(4):2627–2638
Hu C, Yu J, Jiang H, Teng Z (2010) Exponential lag synchronization for neural networks with mixed delays via periodically intermittent control. Chaos 20(2):023108
Abdurahman A, Jiang H, Teng Z (2017) Lag synchronization for Cohen–Grossberg neural networks with mixed time-delays via periodically intermittent control. Int J Comput Math 94(2):275–295
Yu J, Hu C, Jiang H, Teng Z (2012) Exponential lag synchronization for delayed fuzzy cellular neural networks via periodically intermittent control. Math Comput Simul 82(5):895–908
Zhang L, Yang Y, Wang F (2017) Lag synchronization for fractional-order memristive neural networks via period intermittent control. Nonlinear Dyn 3:1–15
Wen S, Zeng Z, Huang T, Meng Q, Yao W (2015) Lag synchronization of switched neural networks via neural activation function and applications in image encryption. IEEE Trans Neural Netw Learn Syst 26(7):1493–1502
Zhou P, Cai S (2018) Adaptive exponential lag synchronization for neural networks with mixed delays via intermittent control. Adv Differ Equ 2018(1):40
Hien LV, Phat VN, Trinh H (2015) New generalized halanay inequalities with applications to stability of nonlinear non-autonomous time-delay systems. Nonlinear Dyn 82:1–13
Wang L, Shen Y, Zhang G (2016) General decay synchronization stability for a class of delayed chaotic neural networks with discontinuous activations. Neurocomputing 179:169–175
Abdurahman A (2018) New results on the general decay synchronization of delayed neural networks with general activation functions. Neurocomputing 275:2505–2511
Abdurahman A, Jiang H, Hu C (2017) General decay synchronization of memristorbased Cohen–Grossberg neural networks with mixed time-delays and discontinuous activations. J Frankl Inst 354(15):7028–7052
Wang L, Shen Y, Zhang G (2016) Synchronization of a class of switched neural networks with time-varying delays via nonlinear feedback control. IEEE Trans Cybern 46(10):2300–2310
Sader M, Abdurahman A, Jiang H (2018) General decay synchronization of delayed BAM neural networks via nonlinear feedback control. Appl Math Comput 337:302–314
Acknowledgements
This work was supported by the Natural Science Foundation of the Xinjiang (Grant No. 2017D01C083).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sader, M., Abdurahman, A. & Jiang, H. General Decay Lag Synchronization for Competitive Neural Networks with Constant Delays. Neural Process Lett 50, 445–457 (2019). https://doi.org/10.1007/s11063-019-09984-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-019-09984-w