Abstract
This paper discusses the problem of bifurcations for a delayed fractional-order neural networks (FONNs) with multiple neurons. Self-connection delay is carefully viewed as a bifurcation parameter, stability zones and bifurcation conditions are nicely established, respectively. It declares that self-connection delay immensely affects the stability and bifurcation of the developed FONNs. The explored FONNs illustrate preferable stability performance if selecting a lesser self-connection delay, and Hopf bifurcation generates once they overstep the critical values. Moreover, the effects of fractional order on the bifurcation points are fully studied. It detects that the emergence of bifurcation can be lagged as fractional order amplifies. The verification of the feasibility of the developed theory is implemented via numerical experiments.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Due to the remarkable benefits of fractional calculus in delineating the dynamical properties of nonlinear systems, it has been broadly used in numerous areas such as disease treatment [1], fluid mechanics [2], formation control [3], etc. Fractional-order derivatives possess the infinite memory and hereditary properties compared with integer-order ones, and these superior aspects make differential equations with fractional calculus are capable of describing precisely the dynamical behaviors of complex systems and further reinforce the potentiality of representation, formulation and control [4, 5]. Fractional calculus has been currently emerged into neural networks (NNs) and formed fractional-order neural networks (FONNs) to research the intricate features of NNs [6]. Some delightful results and essential applications have been detected of FONNs, such as network approximation [7], parameter estimation [8], system identification [9]. Therefore, it is imperative to explore the dynamics of FONNs. Nowadays, FONNs have shown strong interest and concern, and some essential results were obtained [10,11,12].
After the distinguished work of merging a single time delay into NNs in [13], some researchers detected that multiple delays can be introduced into NNs to reflect more real, color and complex behaviors of dynamical systems [14,15,16]. In [17], the authors further highlighted that time delay may be inconsistent for the communication among different adjacent neurons as a result of finite signal propagation speeds and finite processing times in synapses. Therefore it is more realistic and meaningful to introduce different time delays between the connected neurons in NNs. Recently, some remarkable results on the dynamics of FONNs with multiple delays have been researched [18,19,20].
Bifurcation methodologies can be viewed as wonderful candidates to acquire some beneficial information of intricate systems [21,22,23]. Compared with the literatures available on bifurcations of traditional integer-order systems, the bifurcations of fractional-order systems are promising topics [24,25,26]. The bifurcations of FONNs with a single delay have received intensive surveys, and a number of eminent bifurcation attainments have been currently attained [27, 28]. For vanquishing the imperfection in depicting real systems with unique delay, some results on bifurcations of FONNs with multiple delays have been reported [29,30,31]. In [30], the issue of bifurcation for a FONN with two leakage delays was considered, and the stability performance of the proposed FONN can be undermined once leakage delays occur. It should be pointed out that the bifurcations of multiple-delayed FONNs were considered with relatively low-order dimension. As a matter of fact, low-order NNs possess numerous ingenerate imperfections in convergence rate, storage capacity, and fault tolerance. On the contrary, high-order NNs can satisfactorily vanquish these shortcomings and exhibit bigger storage capacity, stronger approximation property, faster convergence rate, and higher fault tolerance [32,33,34]. This motivates numerous scholars to make use of NNs with high order connections. Thus, it is essential to explore high-order interactions of NNs for vanquishing the deficiency of low-order NNs. Remarkably, most of existing results discussing the bifurcation of FONNs by using communication delay as a bifurcation parameter, few efforts can be found to investigate this issue by taking connection delay as a bifurcation parameter [27]. It is noteworthy that the discussions with respect to bifurcation of delayed high-order FONNs involving multiple delays are extremely inadequate as a result of experiencing theoretically the difficulty of discussing characteristic equation [35].
Motivated by the previous discussions, we are committed to presenting a theoretical research of bifurcation for high-order FONNs with multiple delays in this paper. The highlights of this paper can be protruded as follows: (1) The bifurcation results of a conventional integer-order NN with three neurons are generalized to high-order FONNs version in [36]. The obtained results are more accurate, and this reduces the conservatism of the previous ones. (2) By breaking through the difficulty of analyzing the characteristic equation, the exact bifurcation conditions-induced by two different delays are derived. (3) The effects of fractional order on the bifurcation points are explored in high-order FONNs with multiple delays. It discovers that fractional order has an important influence in affecting the stability and bifurcation for the developed NNs.
The framework of the paper is constructed in the following: In Sect. 2 presents the fractional Caputo derivative definition. In Sect. 3 addresses the fundamental mathematical model. Section 4 achieves the outcomes of bifurcations by making use of different delays as bifurcation parameters. Section 5 affirms the efficaciousness of the developed results by adopting simulation examples. Section 6 comes to the essential conclusion.
2 Preliminaries
This section addresses the Caputo definition with respect to fractional calculus for the next theoretical analysis and simulations.
Definition 1
[37] The fractional-order integral of non-integer order q for a function f(t) is defined as
where \(q>0\), \(\varGamma (\cdot )\) is the Gamma function, \(\varGamma (s)=\int _0^\infty t^{s-1}e^{-t}ds\).
Definition 2
[37] The Caputo fractional-order derivative is defined by
where \(\iota -1<q\le \iota \in Z^+\), \(t=t_0\) is the initial time.
Based on the Laplace transform, we can express as
If \(f^{(k)}(0)=0\), \(k=1,2,\ldots ,n\), then \(L\{D^{q}f(t);s\}=s^q F(s).\)
3 Mathematical Modeling
On the basis of the conventional NN model in [36], the following FONNs with n neurons and self-connection delay is formulated in this paper.
where \(q\in (0,1]\), \(x_1(t)\), \(x_i(t)\) \((i=2,3,\ldots ,n)\) denotes state variables, \(k>0\) denotes adjustable parameter of neurons, \(p>0\), \(c_i>0\) represents connection weights, and \(c_i>0\), \(f(\cdot )\), \(g(\cdot )\) denote activation functions, \(\eta \) is self-connection delay, \(\tau _i\) is communication delay.
Throughout this paper, the following assumption on the activation functions in FONNs (1) are addressed:
\((\mathbf{H1} )\) \(f,g\in C^3(R,R)\), \(f(0)=g(0)=0\), \(f'(0)\ne 0\), \(g'(0)\ne 0\).
Based on the analytic technique used in [38], we intend to establish the bifurcation point in FONNs (1) by selecting self-connection delay as a bifurcation parameter.
4 Main Results
In this section, the major stability results and the bifurcation points shall be established by selecting self-connection delay as a bifurcation parameter. Applying \((\mathbf{H1} )\), it can be observed that the origin is an equilibrium of FONNs (1). Adopting Taylor expansion, the following linear form of FONNs (1) can be derived as
where \(a=pf'(0)\), \(b_i=c_ig'(0)\).
The characteristic equation of FONNs (2) takes the following form
Equation (3) can be simplified as
where \(\tau =\frac{\sum _{i=1}^n\tau _i}{n}\).
Equation (4) is equal to
where \(b=\root n \of {\prod _{i=1}^nb_i}\).
Let \(s=w(\cos \frac{\pi }{2}+i\sin \frac{\pi }{2})(w>0)\) be a purely imaginary root of Eq. (5), then we arrive at
By employing Eq. (6), it derives
where
It is clear from Eq. (7) that
To establish our main results, we assume
\((\mathbf{H2} )\) Assumed that Eq. (8) has positive real roots \(w_k(k=0,1,2,\ldots )\).
According to the first equation of Eq. (7), we get
Define the bifurcation point
Let \(\eta =0\), then Eq. (5) can be transformed into
Assume that \(s=\varpi (\cos \frac{\pi }{2}+i\sin \frac{\pi }{2})(\varpi >0)\) is a purely imaginary root of Eq. (10), we have
By employing Eq. (11), it obtains as
where
It follows from Eq. (12) that
If Eq. (13) has positive root, then the values of \(\varpi _k(k=0,1,2,\ldots )\) can be determined. In terms of Eq. (12), we get
It defines as
To establish the conditions of Hopf bifurcation, the following assumption is useful:
\((\mathbf{H3} )\) \(\varLambda >0\), where \(\varLambda >0\) is defined by Eq. (16).
Lemma 1
Assume that \(s(\eta )=\zeta (\eta )+iw(\eta )\) is the root of Eq. (5) near \(\eta =\eta _0\) satisfying \(\zeta (\eta _0)=0\), \(w(\eta _0)=w_0\), then the following transversality condition can be derived
where \(w_0\) and \(\eta _0\) denote the critical frequency and the bifurcation point of FONNs (1), respectively.
Proof
Using differential techniques for Eq. (5) with respect to \(\eta \), then one procures
In view of Eq. (15), it derives that
where \(\varLambda =qw_0^{q-2}\Big [w_0^q+k\cos \frac{q\pi }{2} -b\cos \Big (w_0\tau +\frac{(nq-4l)\pi }{2n}\Big )\Big ]+ab\tau \cos \frac{2l\pi }{n}\).
Taking advantage of \((\mathbf{H3} )\), it is evident that \(\mathrm {Re}\Big [\!\frac{ds}{d\eta }\!\Big ]\Big |_{(w=w_0,\eta =\eta _0)}\!>\!0\). It follows Lemma 1.
\(\square \)
Theorem 1
Under \((\mathbf{H1} )\)–\((\mathbf{H3} )\), the following results can be derived:
-
(i)
The origin of FONNs (1) is asymptotically stable for \(\eta \in [0,\eta _0)\) if \(\tau \in [0,\tau _0)\).
-
(ii)
FONNs (1) experiences a Hopf bifurcation at the origin if \(\tau \in [0,\tau _0)\) when \(\eta =\eta _0\), i.e., it has a branch of periodic solutions bifurcating from the origin near \(\eta =\eta _0\).
Remark 1
In this paper, self-connection delay \(\eta \) is viewed as a bifurcation parameter to discuss the bifurcations of high-order fractional NNs. The stability domains and self-connection delay \(\eta \) induced bifurcation results are completely established. As a matter of fact, \(\tau _i(i=1,2,\ldots ,n)\) in FONNs (1) can be taken as bifurcation parameter to explore the problem of bifurcation of FONNs (1) by fixing the parameter \(\eta \).
5 Numerical Tests
To authenticate the efficiency of the developed theory, two numerical examples are provided in this section.
5.1 Example 1
Consider the following FONN with three neurons
where \(k=1\), \(p=-\,2\), \(c_1=1\), \(c_2=2\), \(c_3=4\), \(\tau _1=0.3\), \(\tau _2=0.4\), \(\tau _3=0.5\).
Choosing \(q=0.92\), it obtains as \(w_0=1.636\), then \(\eta _0=0.3897\). To confirm the derived bifurcation results, the initial values are taken as \(x_1(0),x_2(0),x_3(0)=(0.02,0.02,0.02)\). It is simple to verify that \((\mathbf{H1} )\)–\((\mathbf{H3} )\) hold. According to Theorem 1, the origin of FONN (17) is asymptotically stable when \(\eta =0.35<\eta _{0}\), which is depicted in Fig. 1. It can be observed that the origin of FONN (17) is unstable, Hopf bifurcation occurs from the origin when \(\eta =0.45>\eta _{0}\), as revealed in Fig. 2. Figure 3 reveals the influence of fractional order q on the bifurcation point \(\eta _0\) of FONN (17). This implies that the onset of bifurcation for FONN (17) can be postponed with the increment of fractional order q, which are diagrammatically confirmed in Figs. 4, 5 and 6 by choosing \(q=0.63, 0.65, 0.98\).
5.2 Example 2
Consider the following FONN with four neurons
where \(k=0.5\), \(p=-\,2.5\), \(c_1=1\), \(c_2=2\), \(c_3=3\), \(c_4=4\), \(\tau _1=0.2\), \(\tau _2=0.3\), \(\tau _3=0.4\), \(\tau _4=0.5\).
Selecting \(q=0.95\), it derives as \(w_0=6.6365\), then \(\eta _0=0.3798\). To demonstrate the bifurcation results, the initial values are selected as \(x_1(0),x_2(0),x_3(0),x_4(0)=(0.02,0.02,0.02,0.02)\). It is simple to confirm that \((\mathbf{H1} )\)–\((\mathbf{H3} )\) meet. In terms of Theorem 1, the origin of FONN (18) is asymptotically stable when \(\eta =0.3<\eta _{0}\), which is simulated in Figs. 7 and 8. It can be observed that the origin of FONN (18) is unstable, Hopf bifurcation occurs from the origin when \(\eta =0.4>\eta _{0}\), which is reflected in Figs. 9 and 10. Clearly, Fig.11 reflects the relation of fractional order q on the bifurcation point \(\eta _0\) of FONN (18). Fig.11 clearly displays that the onset of bifurcation for FONN (17) can be lagged as fractional order q increases. The observed results are nicely verified in Figs. 12, 13, 14 and 15 by selecting \(q=0.71, 0.72, 0.96\).
6 Conclusion
The issue of bifurcation for FONNs with n neurons and self-connection delay has been explored in this paper. Stability domain has been established, and self-connection delay induced bifurcation results have been determined in terms of self-connection delay as a bifurcation parameter. It has reflected that the stability performance of developed FONNs can be nicely maintained if taking a smaller connection delay, and Hopf bifurcation emerges upon self-connection delay negotiates the critical value. On the basis of theoretical calculations, the relation between the bifurcation points and fractional order has been revealed. It has manifested that fractional order plays an essential role in stabilizing the stability performance of the developed FONNs. Namely, the onset of bifurcation can be postponed with the enlargement of fractional order. Numerical simulations are performed to check the availability of obtained results.
References
Chen ZM, Liu KH, Liu XX, Lou YJ (2020) Modelling epidemics with fractional-dose vaccination in response to limited vaccine supply. J Theor Biol 486:110085
Hashemizadeh E, Ebrahimzadeh A (2018) An efficient numerical scheme to solve fractional diffusion-wave and fractional Klein–Gordon equations in fluid mechanics. Physica A 503:1189–1203
Liu J, Li P, Chen W, Qin KY, Qi L (2019) Distributed formation control of fractional-order multi-agent systems with relative damping and nonuniform time-delays. ISA Trans 93:189–198
Zhang Q, Cui NX, Y. Shang YL, Xing GJ, Zhang CH, (2018) Relevance between fractional-order hybrid model and unified equivalent circuit model of electric vehicle power battery. Sci China Inf Sci 61:070208
Meng B, Wang XH, Zhang ZY, Wang Z (2020) Necessary and sufficient conditions for normalization and sliding mode control of singular fractional-order systems with uncertainties. Sci China Inf Sci 63:152202
Lundstrom B, Higgs M, Spain W, Fairhall A (2008) Fractional differentiation by neocortical pyramidal neurons. Nat Neurosci 11:1335–1342
Anastassiou G (2012) Fractional neural network approximation. Comput Math Appl 64:1655–1676
Gu YJ, Yu YG, Wang H (2017) Synchronization-based parameter estimation of fractional-order neural networks. Physica A 483:351–361
Aslipour Z, Yazdizadeh A (2019) Identification of nonlinear systems using adaptive variable-order fractional neural networks. Eng Appl Artif Intell 85:462–473
Gu YJ, Wang H, Yu YG (2019) Stability and synchronization for Riemann-Liouville fractional-order time-delayed inertial neural networks. Neurocomputing 340:270–280
Fan YJ, Huang X, Wang Z, Li YX (2018) Global dissipativity and quasi-synchronization of asynchronous updating fractional-order memristor-based neural networks via interval matrix method. J Frankl Inst 355:5998–6025
Jia J, Huang X, Li YX, Cao JD, Alsaedi A (2020) Global stabilization of fractional-order memristor-based neural networks with time delay. IEEE Trans Neural Netw Learn Syst 31:997–1009
Marcus CM, Westervelt RM (1989) Stability of analog neural network with delay. Phys Rev A 39:347–359
Tian XH, Xu R, Gan QT (2015) Hopf bifurcation analysis of a BAM neural network with multiple time delays and diffusion. Appl Math Comput 266:909–926
Faydasicok O (2020) A new Lyapunov functional for stability analysis of neutral-type Hopfield neural networks with multiple delays. Neural Netw 129:288–297
Zhang JM, Wu JW, Bao HB, Cao JD (2018) Synchronization analysis of fractional-order three-neuron BAM neural networks with multiple time delays. Appl Math Comput 339:441–450
Ge JH, Xu J (2018) Stability and Hopf bifurcation on four-neuron neural networks with inertia and multiple delays. Neurocomputing 287:34–44
Liang S, Wu RC, Chen LP (2015) Comparison principles and stability of nonlinear fractional-order cellular neural networks with multiple time delays. Neurocomputing 168:618–625
Chen LP, Cao JD, Wu RC, Machadod JAT, Lopese AM, Yang HJ (2017) Stability and synchronization of fractional-order memristive neural networks with multiple delays. Neural Netw 94:76–85
Zhang WW, Zhang H, Cao JD, Alsaadi FE, Chen DY (2019) Synchronization in uncertain fractional-order memristive complex-valued neural networks with multiple time delays. Neural Netw 110:186–198
Cao JD, Guerrini L, Cheng ZS (2019) Stability and Hopf bifurcation of controlled complex networks model with two delays. Appl Math Comput 343:21–29
Tigan G, Lazureanu C, Munteanu F, Sterbeti C, Florea A (2020) Bifurcation diagrams in a class of Kolmogorov systems. Nonlinear Anal Real World Appl 56:103154
Jia YT (2020) Bifurcation and pattern formation of a tumor-immune model with time-delay and diffusion. Math Comput Simul 178:92–108
Djilali S, Ghanbari B, Bentout S, Mezouaghi A (2020) Turing-Hopf bifurcation in a diffusive mussel-algae model with time-fractional-order derivative. Chaos Solitons Fractals 138:109954
Eshaghi S, Ghaziani RK, Ansari A (2020) Hopf bifurcation, chaos control and synchronization of a chaotic fractional-order system with chaos entanglement function. Math Comput Simul 172:321–340
Alidousti J (2020) Stability and bifurcation analysis for a fractional prey-predator scavenger model. Appl Math Model 81:342–355
Huang CD, Li ZH, Ding DW, Cao JD (2018) Bifurcation analysis in a delayed fractional neural network involving self-connection. Neurocomputing 314:186–197
Huang CD, Nie XB, Zhao X, Song QK, Tu ZW, Xiao M, Cao JD (2019) Novel bifurcation results for a delayed fractional-order quaternion-valued neural network. Neural Netw 117:67–93
Huang CD, Zhao X, Wang XH, Wang ZX, Xiao M, Cao JD (2019) Disparate delays-induced bifurcations in a fractional-order neural network. J Frankl Inst 356:2825–2846
Huang CD, Liu H, Shi XY, Chen XP, Xiao M, Wang ZX, Cao JD (2020) Bifurcations in a fractional-order neural network with multiple leakage delays. Neural Netw 131:115–126
Huang CD, Cao JD (2020) Bifurcation mechanisation of a fractional-order neural network with unequal delays. Neural Process Lett 52:1171–1187
Alimi AM, Aouiti C, Miaadi F (2019) Effect of leakage delay on finite time boundedness of impulsive high-order neutral delay generalized neural networks. Neurocomputing 347:34–45
He ZL, Li CD, Li HF, Zhang QQ (2020) Global exponential stability of high-order Hopfield neural networks with state-dependent impulses. Physica A 542:123434
Shen WQ, Zhang X, Wang YT (2020) Stability analysis of high order neural networks with proportional delays. Neurocomputing 372:33–39
Huang CD, Cao JD, Xiao M, Alsaedi A, Hayat T (2018) Effects of time delays on stability and Hopf bifurcation in a fractional ring-structured network with arbitrary neurons. Commun Nonlinear Sci Numer Simul 57:1–13
Yuan SL, Li XM (2010) Stability and bifurcation analysis of an annular delayed neural network with self-connection. Neurocomputing 73:2905–2912
Podlubny I (1999) Fractional differential equations. Academic Press, New York
Deng WH, Li CP, Lü JH (2007) linear fractional differential system with multiple time delays. Nonlinear Dyn 48:409–416
Acknowledgements
This work was jointly supported by the Key Scientific Research Project for Colleges and Universities of Henan Province under Grant No.20A110004 and the Nanhu Scholars Program for Young Scholars of Xinyang Normal University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, C., Cao, J. Bifurcations Induced by Self-connection Delay in High-Order Fractional Neural Networks. Neural Process Lett 53, 637–651 (2021). https://doi.org/10.1007/s11063-020-10395-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-020-10395-5