1 Introduction

In the modern era, NLPDEs and their solutions have become more interesting and challenging research areas for mathematicians and research communities. These play a significant role in the study of nonlinear physical phenomena in mathematical studies and applied physics, with essential applications in several areas of engineering and natural science. Exact or analytical solutions have been the focus of scholars due to their essential contribution to the analysis of the real features of nonlinear problems. Due to its wide utilization and applications in the domain of nonlinear sciences, a momentous consideration for studying NLPDEs has been increased [1,2,3]. Therefore, extracting solitary wave solutions to NLPDEs is becoming a fascinating field in the nonlinear sciences day by day. Numerous NLPDEs can be solved using various mathematical strategies such as extended simplest equation method [4], improved auxiliary equation technique [5], modulation instability [6], F-expansion technique [7], modified Sardar sub-equation method [8], unified method [9], extended rational sine-cosine/ sinh-cosh method [10], generalized exponential rational function method (GERFM) [11], extended sinh-Gordon equation expansion method [12], generalized Kudryashov method [13], \(\left( \frac{G^{\prime }}{G^{2}}\right) \)-expansion method [14], modified Khater method [15], advanced auxiliary equation method [16], (w/g)-expansion approach [17], extended hyperbolic function technique [18], modified extended auxiliary equation mapping (MEAEM) technique [19], polynomial expansion technique [20].

The KdV equation is a partial differential equation (PDE) that mathematically represents waves in shallow water. It is notable for being the classic illustration of an integrable PDE, exhibiting many of the common characteristics, including an abundance of explicit solutions, especially soliton solutions, and an infinite number of conserved quantities. The equation has a wide range of applications, including the evolution of long, one-dimensional waves in many physical contexts. Its original intent was to describe shallow water waves with weakly non-linear restoring forces. The KdV equation is a significant mathematical model that possesses soliton solutions. Solitons are localized waves that can maintain their shape and speed even after colliding with other solitons. These waves have been extensively studied in the field of mathematical physics [21,22,23].

To determine the explicit and individual wave solutions of NLPDEs, the utilization of the traveling wave solution method is imperative. Soliton solutions are present in NLPDEs, representing a singular traveling wave [24,25,26]. Specifically, the equilibrium between the dispersion and nonlinear elements of nonlinear equations results in soliton solutions, sparking interest in solitary wave theory across various disciplines. Solitons maintain stability, remaining localized without dispersion and defying the principle of superposition. The concept of solitary waves in nonlinear mediums has garnered significant attention due to their utility in high-speed communications. Scholars have extensively examined the well-posedness of nonlinear models, with a focus on solitary and shallow water waves. Solitons propagate through monomode optical fibers, commonly used in long-distance communication networks and fiber optic-based ultra-fast pulse analysis devices. The prospect of transmitting high-bandwidth data over vast distances through large erbium-doped fiber amplifiers using optical solitons appears to be technically viable in the foreseeable future.

In mathematical physics, the cmKdV equation is important, especially when studying waves and solitons. By describing the nontrivial motions of water particles from a water layer’s surface to its bottom, this equation helps to clarify wave behavior. A more thorough explanation of wave phenomena is possible thanks to the complex-valued extension of the classical KdV equation, known as the cmKdV system [27]. The cmKdV system is given by [28]:

$$\begin{aligned} & \psi _{t}+\psi _{xxy}+i\psi \varphi +\left( \psi \tau \right) _{x}=0, \nonumber \\ & \varphi _{x}+2i\rho (\psi ^{*}\psi _{xy}-\psi _{xy}^{*}\psi )=0, \end{aligned}$$
(1)
$$\begin{aligned} \tau _{x}-2\rho \left( \left| \psi \right| ^{2}\right) _{y}=0. \end{aligned}$$

Here, \(\psi ,\psi ^{*},\varphi ,\) and \(\tau \) functions depends on xyt. Furthermore, \(\psi \) is a complex function, and its conjugate is \( \psi ^{*},\) \(\varphi \) and \(\tau \) are real functions, \(\rho =\pm 1\) and the partial derivatives for xy,  and t are symbolized by the subscripts. This prototype is a generalization of the cmKdV system in the \( (2+1)\)-dimension and has considerable significance for applied ferromagnetism and nanomagnetism [28].

Numerous investigations have used the Darboux transformation (DT) to examine the system (1). One-soliton and two-soliton solutions are acquired using DT, starting with the zero seed, according to Yesmakhanova et al. [29]. In Yuan et al. [30], deformed solitons are generated by n-fold DT. The method can be started using a plane wave seed to produce periodic line wave solutions and breather solutions [31]. Order-n-breather solutions are presented by Shaikhova et al. [32]. Still, none of the aforementioned investigations are traveling wave solutions. However, three approaches- the sine-cosine, Kudryashov, and tanh-coth methods- have been used in recent studies to build traveling wave solutions for the system (1) [33].

The main objective of this work is to construct novel optical soliton solutions for the system (1). We use the nGERFM, a new method that is the primary subject of our study, for this aim. One might easily conclude that the new approach is quite effective and successful in seeking the exact solutions of the NLPDEs. Moving beyond analytical solutions, we unveil intricate system behaviors through a comprehensive bifurcation analysis using planar dynamical systems. Subsequently, the exploration delves into chaotic phenomena by introducing an external term to the system, followed by an investigation of two- and three-dimensional phase portraits to uncover complex dynamics. To ensure solution stability, sensitivity analysis using the Runge–Kutta method is performed against minor initial perturbations. Comprehensive bifurcation analysis and phase portraits of the unperturbed system are presented. The chaos analysis of the perturbed system employs various techniques to detect chaotic patterns in time series and phase portraits. The novelty of our investigation lies in its unprecedented nature within the discussed system’s context. It leads readers on an exciting journey into the world of nonlinear waves and dynamical systems, offering additional revelations and insights.

The following are the remaining sections of this study: The Lax pair for the (2+1) dimensional cmKdV system is shown in Sect. 2. Section 3 presents the methodology of the selected method. Applications of the selected method are displayed in Sect. 4. Section 5 addresses qualitative analysis, which includes bifurcation analysis, sensitivity analysis, quasi-periodic and chaotic behaviors, and multistability analysis. Section 6 offers comparisons. Section 7 presents graphical explanations and Sect. 8 explains the conclusions.

2 The Lax pair system of the equation

For the system (1), the Lax pair system is

$$\begin{aligned} \Omega _{x}=K\Omega ,\quad \Omega _{t}=4\mu ^{2}\Omega _{y}+M\Omega , \end{aligned}$$
(2)

in which

$$\begin{aligned} K=\mu H+K_{0},\quad M=\mu M_{1}+M_{0}, \end{aligned}$$
(3)

with

$$\begin{aligned} H= & \left( \begin{array}{cc} -i & 0 \\ 0 & i \end{array} \right) ,\quad K_{0}=\left( \begin{array}{cc} 0 & \psi \\ -s & 0 \end{array} \right) ,\quad \\ M_{1}= & \left( \begin{array}{cc} i\tau & 2i\psi _{y} \\ 2is_{y} & -i\tau \end{array} \right) , \\ M_{0}= & \left( \begin{array}{cc} -\frac{i\varphi }{2} & -\psi _{xy}-\tau \psi \\ s_{xy}+\tau s & \frac{i\varphi }{2} \end{array} \right) ,\quad \\ \Omega= & \left( \begin{array}{c} \phi _{1}(\mu ,x,y,t) \\ \phi _{2}(\mu ,x,y,t) \end{array} \right) . \end{aligned}$$

The compatibility condition

$$\begin{aligned} K_{t}-M_{x}+KM-MK-4\mu ^{2}K_{y}=0 \end{aligned}$$
(4)

infers the following cmKdV system:

$$\begin{aligned} & \psi _{t}+\psi _{xxy}+i\psi \varphi +\left( \tau \psi \right) _{x} =0, \nonumber \\ & s_{t}+s_{xxy}-i\varphi s+(\tau s)_{x} =0, \nonumber \\ & \varphi _{x}+2i(s\psi _{xy}-s_{xy}\psi ) =0, \nonumber \\ & \tau _{x}-(\psi s)_{y} =0, \end{aligned}$$
(5)

in which \(\varphi ,\tau \) are real functions, \(\psi \) and s are complex functions. By setting \(s=\rho \psi ^{*}\) Eq. (5) become the cmKdV system (1).

3 Methodology

In this section, the procedures employed will be described. Consider the NLPDE as follows:

$$\begin{aligned} & Y_{1}[\psi (x,y,t),\frac{\partial }{\partial t}\psi (x,y,t),\frac{\partial }{ \partial x}\psi (x,y,t),\nonumber \\ & \quad \frac{\partial ^{2}}{\partial t^{2}}\psi (x,y,t), \frac{\partial ^{2}}{\partial x^{2}}\psi (x,y,t),\ldots ]=0. \end{aligned}$$
(6)

Using \(\psi =\psi (x,y,t)=\Phi (\xi )\), and \(\xi =x+y+ct\), Eq. (6) is transferred to

$$\begin{aligned} Y_{2}[c\Phi ,\Phi ^{\prime \prime },\Phi ^{\prime \prime \prime },\ldots ]=0. \end{aligned}$$
(7)

3.1 Details of the nGERFM

This subsection provides the nGERFM-the revised methodology results in novel and differentiated findings [34].

Step 1 Let we set up the solution of Eq. (7) as:

$$\begin{aligned} \Phi (\xi )=k_{0}+\sum _{n=1}^{n_{0}}k_{n}\left( \frac{\Lambda ^{\prime }(\xi )}{\Lambda (\xi )}\right) ^{n}+\sum _{n=1}^{n_{0}}l_{n}\left( \frac{\Lambda ^{\prime }(\xi )}{\Lambda (\xi )}\right) ^{-n}, \nonumber \\ \end{aligned}$$
(8)

in which

$$\begin{aligned} \Lambda (\xi )=\frac{\varsigma _{1}\exp (\jmath _{1}\xi )+\varsigma _{2}\exp (\jmath _{2}\xi )}{\varsigma _{3}\exp (\jmath _{3}\xi )+\varsigma _{4}\exp (\jmath _{4}\xi )}. \end{aligned}$$
(9)

In the pre-assumed structures Eqs. (9) and (8), \( k_{0},k_{n},l_{n}(1\le n\le n_{0}),\) and \(\varsigma _{i},\jmath _{i}\) \( (1\le i\le 4)\) are unknown coefficients. Further, to determine the positive integer \(n_{0}\), we can use some known balancing rules in the literature.

Step 2 Inserting solution Eq. (8) into account in Eq. (7) introduces a polynomial equation \(\Pi (\Xi _{1},\Xi _{2},\Xi _{3},\Xi _{4})=0\) in terms of \(\Xi _{n}=\exp (\jmath _{v}\xi )\) for \(v=1,2,3,4.\)

Step 3 Eventually, analytical solutions for Eq. (6) are obtained after insetting the results obtained from solving this system in the general structure Eq. (8).

4 Extraction of solution

The primary purpose of this section is to compile a diverse set of solutions to the given prototype. By operating wave transformation

$$\begin{aligned} \psi (x,y,t)=\Phi (x,y,t)\times \exp (i(b_{1}x+b_{2}y+b_{3}t)),\nonumber \\ \end{aligned}$$
(10)

the system (1) reduces to ordinary differential equation (ODE):

$$\begin{aligned} & \Phi _{t}-2b_{1}b_{2}\Phi _{x}-b_{1}^{2}\Phi _{y}+\Phi _{xxy}+\Phi _{x}\tau +\Phi \tau _{x}\nonumber \\ & \quad +i\left( \left( b_{3}-b_{1}^{2}b_{2}\right) \Phi +2b_{1}\Phi _{xy}+b_{2}\Phi _{xx}\right. \nonumber \\ & \quad \left. +b_{1}\Phi \tau +\Phi \varphi \right) =0, \end{aligned}$$
(11)
$$\begin{aligned} & \varphi _{x}-4\rho (b_{2}\Phi \Phi _{x}+b_{1}\Phi \Phi _{y})=0, \end{aligned}$$
(12)
$$\begin{aligned} & \tau _{x}-2\rho (\Phi ^{2})_{y}=0. \end{aligned}$$
(13)

Here \(b_{1},\) \(b_{2},\) and \(b_{3}\) denote real constants.

Inserting the wave transformation

$$\begin{aligned} \psi (x,y,t)= & \Phi (\xi )=\Phi (x+y+ct), \end{aligned}$$
(14)
$$\begin{aligned} \varphi (x,y,t)= & \varphi (\xi )=\varphi (x+y+ct), \end{aligned}$$
(15)
$$\begin{aligned} \tau (x,y,t)= & \tau (\xi )=\tau (x+y+ct), \end{aligned}$$
(16)

in the system of (11)-(13), we get

$$\begin{aligned} & (c-2b_{1}b_{2}-b_{1}^{2})\Phi ^{\prime }+\Phi ^{\prime \prime \prime }+\Phi ^{\prime }\tau +\Phi \tau ^{\prime } \nonumber \\ & \quad +i\left( \left( b_{3}-b_{1}^{2}b_{2}\right) \Phi +(2b_{1}+b_{2})\Phi ^{\prime \prime }\right. \nonumber \\ & \quad \left. +b_{1}\Phi \tau +\Phi \varphi \right) =0, \end{aligned}$$
(17)
$$\begin{aligned} & \varphi ^{\prime }-4\rho (b_{2}+b_{1})\Phi \Phi ^{\prime }=0, \end{aligned}$$
(18)
$$\begin{aligned} & \tau ^{\prime }-2\rho (\Phi ^{2})^{\prime }=0. \end{aligned}$$
(19)

Integrating Eqs. (18) and (19) one time concerning \(\xi \) and taking integration to zero, we reach

$$\begin{aligned} \varphi =2\rho (b_{2}+b_{1})\Phi ^{2},\qquad \tau =2\rho \Phi ^{2}. \end{aligned}$$
(20)

Substituting Eq. (20) into Eq. (17), we reach the following ODE:

$$\begin{aligned} & (c-2b_{1}b_{2}-b_{1}^{2})\Phi ^{\prime }+\Phi ^{\prime \prime \prime }+2\rho (\Phi ^{3})^{\prime } \nonumber \\ & \quad +i\left( \left( b_{3}-b_{1}^{2}b_{2}\right) \Phi +(2b_{1}+b_{2})\Phi ^{\prime \prime }\right. \nonumber \\ & \quad \left. +2\rho (2b_{1}+b_{2})\Phi ^{3}\right) =0. \end{aligned}$$
(21)

The prime above denotes the derivative concerning \(\xi .\) Now, separating imaginary and real parts of Eq. (21), we reach

$$\begin{aligned} & (c-2b_{1}b_{2}-b_{1}^{2})\Phi ^{\prime }+\Phi ^{\prime \prime \prime }\nonumber \\ & \quad +2\rho (\Phi ^{3})^{\prime }=0, \end{aligned}$$
(22)
$$\begin{aligned} & \frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{(2b_{1}+b_{2})}\Phi +\Phi ^{\prime \prime }+2\rho \Phi ^{3}=0. \end{aligned}$$
(23)

By calculating the anti-derivative of Eq. (22) once, concerning \( \xi \), and setting the integration constant to zero, we arrive at

$$\begin{aligned} (c-2b_{1}b_{2}-b_{1}^{2})\Phi +\Phi ^{\prime \prime }+2\rho \Phi ^{3}=0. \end{aligned}$$
(24)

Only in the event that the constraint condition is met are the Eqs. (23) and (24) equal

$$\begin{aligned} c-2b_{1}b_{2}-b_{1}^{2}=\frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{ (2b_{1}+b_{2})}. \end{aligned}$$
(25)

Solving for

$$\begin{aligned} c=2b_{1}b_{2}+b_{1}^{2}+\frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{ (2b_{1}+b_{2})}, \end{aligned}$$
(26)

we re-write Eq. (23) as:

$$\begin{aligned} \Phi ^{\prime \prime }+\frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{ (2b_{1}+b_{2})}\Phi +2\rho \Phi ^{3}=0. \end{aligned}$$
(27)

4.1 Application of the nGERFM

Employing some common balancing rules in Eq. (27) between \(\Phi ^{3} \) and \(\Phi ^{\prime \prime }\) yields \(3n_{0}=n_{0}+2\). Hence, one should take \(n_{0}=1\). As a result, Eq. (8) can be written as:

$$\begin{aligned} \Phi (\xi )=k_{0}+k_{1}\left( \frac{\Lambda ^{\prime }(\xi )}{\Lambda (\xi )} \right) +l_{1}\left( \frac{\Lambda ^{\prime }(\xi )}{\Lambda (\xi )}\right) ^{-1}. \end{aligned}$$
(28)

\(\Lambda (\xi )\) is defined by Eq. (9).

Class 1

Taking \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[1,1,1,0]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[0,1,2,0]\) in Eq. (9) yields

$$\begin{aligned} \Lambda (\xi )=\frac{1+\exp (\xi )}{\exp (2\xi )}. \end{aligned}$$
(29)

To obtain parameter values, we use package programs (Maple or Mathematica) to solve algebraic equations. The set of answers that are produced can be provided as:

Type 1.1

$$\begin{aligned} & b_{1}=\pm \frac{\mp 1+\sqrt{1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}}, \\ & k_{0}=\mp \frac{5}{2}\sqrt{-\frac{1}{\rho }},\quad k_{1}=\pm \sqrt{ -\frac{1}{\rho }},\quad l_{1}=0. \end{aligned}$$

By plugging the aforementioned values of \(k_{0}\), \(k_{1}\), \(l_{1}\) into Eq. (28), we obtain

$$\begin{aligned} \Phi ^{\pm }(\xi )=\frac{1}{2}\sqrt{-\frac{1}{\rho }}\times \left( \frac{ \exp (\xi )-1}{\exp (\xi )+1}\right) . \end{aligned}$$
(30)

By using Eq. (30), we discover the following exponential function solution for system (1)

$$\begin{aligned} & \psi _{1,1}^{\pm }(x,y,t) =\frac{1}{2}\sqrt{-\frac{1}{\rho }}\times \left( \frac{\exp (x+y+ct)-1}{\exp (x+y+ct)+1}\right) \nonumber \\ & \times \exp (i(\pm \frac{\mp 1+\sqrt{1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}} x +b_{2}y+b_{3}t)),\nonumber \\ \end{aligned}$$
(31)
$$\begin{aligned} & \varphi _{1,1}^{\pm }(x,y,t)=2\rho (b_{2}\pm \frac{\mp 1+\sqrt{ 1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}})\nonumber \\ & \quad \times \left[ \frac{1}{2}\sqrt{-\frac{1}{ \rho }}\times \left( \frac{\exp (x+y+ct)-1}{\exp (x+y+ct)+1}\right) \right] ^{2},\qquad \end{aligned}$$
(32)
$$\begin{aligned} & \tau _{1,1}^{\pm }(x,y,t)=2\rho \nonumber \\ & \quad \times \left[ \frac{1}{2}\sqrt{-\frac{1}{ \rho }}\times \left( \frac{\exp (x+y+ct)-1}{\exp (x+y+ct)+1}\right) \right] ^{2}. \end{aligned}$$
(33)

Type 1.2

$$\begin{aligned} b_{1}= & \pm \frac{\mp 1+\sqrt{1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}}, \\ k_{0}= & \mp \frac{5}{2}\sqrt{-\frac{1}{\rho }}, \qquad k_{1}=0,\qquad l_{1}=\pm 6\sqrt{-\frac{1}{\rho }}. \end{aligned}$$

By inserting the aforementioned values of \(k_{0}\), \(k_{1}\), \(l_{1}\) into Eq. (28), we get

$$\begin{aligned} \Phi ^{\mp }(\xi )=\frac{1}{2}\sqrt{-\frac{1}{\rho }}\times \left( \frac{ 3\exp (\xi )-2}{3\exp (\xi )+2}\right) . \end{aligned}$$
(34)

Using Eq. (34), the exponential function solution is found for system (1) as follows:

$$\begin{aligned} & \psi _{1,2}^{\mp }(x,y,t) =\frac{1}{2}\sqrt{-\frac{1}{\rho }}\times \left( \frac{3\exp (x+y+ct)-2}{3\exp (x+y+ct)+2}\right) \nonumber \\ & \quad \times \exp (i(\pm \frac{\mp 1+\sqrt{1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}} x+b_{2}y+b_{3}t)),\nonumber \\ \end{aligned}$$
(35)
$$\begin{aligned} & \varphi _{1,2}^{\mp }(x,y,t)=2\rho (b_{2}\pm \frac{\mp 1+\sqrt{ 1+4b_{2}b_{3}-2b_{2}^{2}}}{2b_{2}})\nonumber \\ & \quad \times \left[ \frac{1}{2}\sqrt{-\frac{1}{ \rho }}\times \left( \frac{3\exp (x+y+ct)-2}{3\exp (x+y+ct)+2}\right) \right] ^{2}, \end{aligned}$$
(36)
$$\begin{aligned} & \tau _{1,2}^{\mp }(x,y,t)=2\rho \nonumber \\ & \quad \times \left[ \frac{1}{2}\sqrt{-\frac{1}{ \rho }}\times \left( \frac{3\exp (x+y+ct)-2}{3\exp (x+y+ct)+2}\right) \right] ^{2}. \end{aligned}$$
(37)

Class 2

When we pick \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[1,-1,2i,0]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[i,-i,1,0]\) in Eq. (9), we attain

$$\begin{aligned} \Lambda (\xi )=\frac{\sin (\xi )}{\exp (\xi )}. \end{aligned}$$
(38)

Using package programs, we solve algebraic equations to acquire parameter values; the set of answers that arise can be provided as:

Type 2.1

$$\begin{aligned} b_{1}= & \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}, \\ k_{0}= & k_{1}=\pm \sqrt{-\frac{1}{\rho }},\qquad l_{1}=0. \end{aligned}$$

By plugging these values into Eq. (28), we yield

$$\begin{aligned} \Phi ^{\pm }(\xi )=\sqrt{-\frac{1}{\rho }}\times \cot \left( \xi \right) . \end{aligned}$$
(39)

By using Eq. (39), we reach the following singular periodic optical soliton solution for system (1)

$$\begin{aligned} & \psi _{2,1}^{\pm }(x,y,t) =\sqrt{-\frac{1}{\rho }}\times \cot \left( x+y+ct\right) \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(40)
$$\begin{aligned} & \varphi _{2,1}^{\pm }(x,y,t)=2\rho \left( b_{2}\pm \frac{\pm 2+\sqrt{ 4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \cot \left( x+y+ct\right) \right] ^{2}, \end{aligned}$$
(41)
$$\begin{aligned} & \tau _{2,1}^{\pm }(x,y,t)=2\rho \times \left[ \sqrt{-\frac{1}{\rho }}\times \cot \left( x+y+ct\right) \right] ^{2}. \end{aligned}$$
(42)

Type 2.2

$$\begin{aligned} b_{1}= & \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}, \\ k_{0}= & \pm \sqrt{-\frac{1}{\rho }},\qquad k_{1}=0,\qquad l_{1}=\pm 2\sqrt{-\frac{1}{\rho }}. \end{aligned}$$

By plugging these values into Eq. (28), we yield

$$\begin{aligned} \Phi ^{\pm }(\xi )=\sqrt{-\frac{1}{\rho }}\times \left( \frac{\cos \left( \xi \right) +\sin \left( \xi \right) }{\cos \left( \xi \right) -\sin \left( \xi \right) }\right) . \end{aligned}$$
(43)

By using Eq. (43), the combo trigonometric soliton solution is obtained for system (1) as follows:

$$\begin{aligned} & \psi _{2,2}^{\pm }(x,y,t) \nonumber \\ & \quad =\sqrt{-\frac{1}{\rho }}\times \left( \frac{\cos \left( x+y+ct\right) +\sin \left( x+y+ct\right) }{\cos \left( x+y+ct\right) -\sin \left( x+y+ct\right) }\right) \nonumber \\ & \qquad \times \exp (i(\pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t)),\nonumber \\ \end{aligned}$$
(44)
$$\begin{aligned} & \varphi _{2,2}^{\pm }(x,y,t)=2\rho (b_{2}\pm \frac{\pm 2+\sqrt{ 4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}})\nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{\cos \left( x+y+ct\right) +\sin \left( x+y+ct\right) }{\cos \left( x+y+ct\right) -\sin \left( x+y+ct\right) }\right) \right] ^{2},\nonumber \\ \end{aligned}$$
(45)
$$\begin{aligned} & \tau _{2,2}^{\pm }(x,y,t)=2\rho \nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{\cos \left( x+y+ct\right) +\sin \left( x+y+ct\right) }{\cos \left( x+y+ct\right) -\sin \left( x+y+ct\right) }\right) \right] ^{2}.\nonumber \\ \end{aligned}$$
(46)

Class 3

For \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[1,-1,2,0] \) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[1,-1,-1,0]\) in Eq. (9) provides

$$\begin{aligned} \Lambda (\xi )=\frac{\sinh (\xi )}{\exp (-\xi )}. \end{aligned}$$
(47)

Proceeding as the outline of nGERFM, we achieve

$$\begin{aligned} b_{1}= & \pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}, \\ k_{0}= & k_{1}=\pm \sqrt{-\frac{1}{\rho }},\qquad l_{1}=0. \end{aligned}$$

By plugging these values into Eq. (28), we yield

$$\begin{aligned} \Phi ^{\mp }(\xi )=\sqrt{-\frac{1}{\rho }}\times \tanh \left( \xi \right) . \end{aligned}$$
(48)

By using Eq. (48), we obtain the following shock wave solution for system (1)

$$\begin{aligned} & \psi _{3}^{\mp }(x,y,t) =\sqrt{-\frac{1}{\rho }}\times \tanh \left( x+y+ct\right) \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(49)
$$\begin{aligned} & \varphi _{3}^{\mp }(x,y,t)=2\rho \left( b_{2}\pm \frac{\mp 2+\sqrt{ 4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \tanh \left( x+y+ct\right) \right] ^{2}, \end{aligned}$$
(50)
$$\begin{aligned} & \tau _{3}^{\mp }(x,y,t)=2\rho \times \left[ \sqrt{-\frac{1}{\rho }}\times \tanh \left( x+y+ct\right) \right] ^{2}. \end{aligned}$$
(51)

Class 4

In Eq. (9), picking \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[2,0,1,1]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[1,0,i,-i]\) produces

$$\begin{aligned} \Lambda (\xi )=\frac{\exp (\xi )}{\cos (\xi )}. \end{aligned}$$
(52)

We also arrive at

Type 4.1

$$\begin{aligned} & b_{1}=\pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}, \\ & k_{0}=\mp \sqrt{-\frac{1}{\rho }},\qquad k_{1}=\pm \sqrt{-\frac{1}{ \rho }},\qquad l_{1}=0. \end{aligned}$$

Combining these results with Eq. (28) generates

$$\begin{aligned} \Phi ^{\pm }(\xi )=\sqrt{-\frac{1}{\rho }}\times \tan \left( \xi \right) . \end{aligned}$$
(53)

As an outcome, we uncover that the singular periodic solution may be characterized as:

$$\begin{aligned} & \psi _{4,1}^{\pm }(x,y,t) =\sqrt{-\frac{1}{\rho }}\times \tan \left( x+y+ct\right) \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(54)
$$\begin{aligned} & \varphi _{4,1}^{\pm }(x,y,t)=2\rho \left( b_{2}\pm \frac{\pm 2+\sqrt{ 4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \tan \left( x+y+ct\right) \right] ^{2}, \end{aligned}$$
(55)
$$\begin{aligned} & \tau _{4,1}^{\pm }(x,y,t)=2\rho \times \left[ \sqrt{-\frac{1}{\rho }}\times \tan \left( x+y+ct\right) \right] ^{2}. \end{aligned}$$
(56)

Type 4.2

$$\begin{aligned} b_{1}= & \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}, \\ k_{0}= & \pm \sqrt{-\frac{1}{\rho }},\qquad k_{1}=0,\qquad l_{1}=\mp 2\sqrt{-\frac{1}{\rho }}. \end{aligned}$$

Combining these results with Eq. (28) produces

$$\begin{aligned} \Phi ^{\pm }(\xi )=\sqrt{-\frac{1}{\rho }}\times \left( \frac{2\cos \left( \xi \right) \sin \left( \xi \right) -1}{2\cos \left( \xi \right) ^{2}-1} \right) . \end{aligned}$$
(57)

As a result, the combo trigonometric soliton solution is obtained as follows:

$$\begin{aligned} & \psi _{4,2}^{\pm }(x,y,t) \nonumber \\ & \quad =\sqrt{-\frac{1}{\rho }}\times \left( \frac{ 2\cos \left( x+y+ct\right) \sin \left( x+y+ct\right) -1}{2\cos \left( x+y+ct\right) ^{2}-1}\right) \nonumber \\ & \qquad \times \exp \left( i\left( \pm \frac{\pm 2+\sqrt{4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(58)
$$\begin{aligned} & \varphi _{4,2}^{\pm }(x,y,t)=2\rho \left( b_{2}\pm \frac{\pm 2+\sqrt{ 4+b_{2}b_{3}+2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{2\cos \left( x+y+ct\right) \sin \left( x+y+ct\right) -1}{2\cos \left( x+y+ct\right) ^{2}-1}\right) \right] ^{2}, \nonumber \\ \end{aligned}$$
(59)
$$\begin{aligned} & \tau _{4,2}^{\pm }(x,y,t)=2\rho \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{2\cos \left( x+y+ct\right) \sin \left( x+y+ct\right) -1}{2\cos \left( x+y+ct\right) ^{2}-1}\right) \right] ^{2}.\nonumber \\ \end{aligned}$$
(60)

Class 5

In Eq. (9), considering \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[2,0,1,1]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[0,0,1,-1]\) create

$$\begin{aligned} \Lambda (\xi )=\frac{1}{\cosh (\xi )}. \end{aligned}$$
(61)

We accomplish

Type 5.1

$$\begin{aligned} & b_{1}=\pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}, \\ & k_{0}=k_{1}=0,\qquad l_{1}=\pm \sqrt{-\frac{1}{\rho }}. \end{aligned}$$

By plugging the values of \(k_{0}\), \(k_{1}\), \(l_{1}\) into Eq. (28), we gain

$$\begin{aligned} \Phi ^{\mp }(\xi )=\sqrt{-\frac{1}{\rho }}\times \coth \left( \xi \right) . \end{aligned}$$
(62)

Hence, we uncover the singular soliton solutions can be derived as:

$$\begin{aligned} & \psi _{5,1}^{\mp }(x,y,t) =\sqrt{-\frac{1}{\rho }}\times \coth \left( x+y+ct\right) \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(63)
$$\begin{aligned} & \varphi _{5,1}^{\mp }(x,y,t)=2\rho \left( b_{2}\pm \frac{\mp 2+\sqrt{ 4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \coth \left( x+y+ct\right) \right] ^{2}, \end{aligned}$$
(64)
$$\begin{aligned} & \tau _{5,1}^{\mp }(x,y,t)=2\rho \times \left[ \sqrt{-\frac{1}{\rho }}\times \coth \left( x+y+ct\right) \right] ^{2}. \end{aligned}$$
(65)

Type 5.2

$$\begin{aligned} & b_{1}=\pm \frac{\mp 8+\sqrt{64+b_{2}b_{3}-8b_{2}^{2}}}{b_{2}}, \\ & k_{0}=0,\qquad k_{1}=l_{1}=\pm \sqrt{-\frac{1}{\rho }}. \end{aligned}$$

Thus, concerning these solutions and Eq. (28), it is likely to reach the subsequent outcome

$$\begin{aligned} \Phi ^{\mp }(\xi )=\sqrt{-\frac{1}{\rho }}\times \left( \frac{2\cosh \left( \xi \right) ^{2}-1}{\cosh \left( \xi \right) \sinh (\xi )}\right) . \end{aligned}$$
(66)

The hyperbolic solution in mixed form may be stated as follows:

$$\begin{aligned} & \psi _{5,2}^{\mp }(x,y,t) \nonumber \\ & \quad =\sqrt{-\frac{1}{\rho }}\times \left( \frac{ 2\cosh \left( x+y+ct\right) ^{2}-1}{\cosh \left( x+y+ct\right) \sinh (x+y+ct) }\right) \nonumber \\ & \qquad \times \exp \left( i\left( \pm \frac{\mp 8+\sqrt{64+b_{2}b_{3}-8b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(67)
$$\begin{aligned} & \varphi _{5,2}^{\mp }(x,y,t)=2\rho \left( b_{2}\pm \frac{\mp 8+\sqrt{ 64+b_{2}b_{3}-8b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }} \times \left( \frac{2\cosh \left( x+y+ct\right) ^{2}-1}{\cosh \left( x+y+ct\right) \sinh (x+y+ct)}\right) \right] ^{2},\nonumber \\ \end{aligned}$$
(68)
$$\begin{aligned} & \tau _{5,2}^{\mp }(x,y,t)=2\rho \nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{2\cosh \left( x+y+ct\right) ^{2}-1}{\cosh \left( x+y+ct\right) \sinh (x+y+ct)}\right) \right] ^{2}.\nonumber \\ \end{aligned}$$
(69)

Class 6

As long as, and if it is taken into account in Eq. (9), \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[2,0,1,1]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[-2,0,1,-1]\) generates

$$\begin{aligned} \Lambda (\xi )=\frac{\exp (-2\xi )}{\cosh (\xi )}. \end{aligned}$$
(70)

Type 6.1

$$\begin{aligned} & b_{1}=\pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}, \\ & k_{0}=\mp \frac{2}{\rho \sqrt{-\frac{1}{\rho }}},\qquad k_{1}=\pm \sqrt{-\frac{1}{\rho }},\qquad l_{1}=0. \end{aligned}$$

By entering the values of \(k_{0}\), \(k_{1}\), \(l_{1}\) into Eq. (28), one obtains

$$\begin{aligned} \Phi ^{\pm }(\xi )=\frac{1}{\rho \sqrt{-\frac{1}{\rho }}}\times \tanh (\xi ). \end{aligned}$$
(71)

By using Eq. (71), we recovered the following shock wave solutions

$$\begin{aligned} & \psi _{6,1}^{\pm }(x,y,t) =\frac{1}{\rho \sqrt{-\frac{1}{\rho }}}\times \tanh (x+y+ct) \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(72)
$$\begin{aligned} & \varphi _{6,1}^{\pm }(x,y,t) =2\rho \left( b_{2}\pm \frac{\mp 2+\sqrt{ 4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \frac{1}{\rho \sqrt{-\frac{1}{ \rho }}}\times \tanh (x+y+ct)\right] ^{2}, \end{aligned}$$
(73)
$$\begin{aligned} & \tau _{6,1}^{\pm }(x,y,t)=2\rho \nonumber \\ & \quad \times \left[ \frac{1}{\rho \sqrt{-\frac{1}{ \rho }}}\times \tanh (x+y+ct)\right] ^{2}. \end{aligned}$$
(74)

Type 6.2

$$\begin{aligned} & b_{1}=\pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}, \\ & k_{0}=\pm 2\sqrt{-\frac{1}{\rho }},\qquad k_{1}=0,\qquad l_{1}=\pm 3\sqrt{-\frac{1}{\rho }}. \end{aligned}$$

By entering the values of \(k_{0}\), \(k_{1}\), \(l_{1}\) into Eq. (28), one obtains

$$\begin{aligned} \Phi ^{\pm }(\xi )=\sqrt{-\frac{1}{\rho }}\times \left( \frac{2\sinh (\xi )+\cosh (\xi )}{2\cosh (\xi )+\sinh (\xi )}\right) . \end{aligned}$$
(75)

By using Eq. (75), we reach the combo soliton solution

$$\begin{aligned} & \psi _{6,2}^{\pm }(x,y,t) \nonumber \\ & \quad =\sqrt{-\frac{1}{\rho }}\times \left( \frac{ 2\sinh (x+y+ct)+\cosh (x+y+ct)}{2\cosh (x+y+ct)+\sinh (x+y+ct)}\right) \nonumber \\ & \qquad \times \exp \left( i\left( \pm \frac{\mp 2+\sqrt{4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(76)
$$\begin{aligned} & \varphi _{6,2}^{\pm }(x,y,t)=2\rho \left( b_{2}\pm \frac{\mp 2+\sqrt{ 4+b_{2}b_{3}-2b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{\cosh (x+y+ct)+2\sinh (x+y+ct)}{2\cosh (x+y+ct)+\sinh (x+y+ct)} \right) \right] ^{2}, \nonumber \\ \end{aligned}$$
(77)
$$\begin{aligned} & \tau _{6,2}^{\pm }(x,y,t)=2\rho \nonumber \\ & \qquad \times \left[ \sqrt{-\frac{1}{\rho }}\times \left( \frac{\cosh (x+y+ct)+2\sinh (x+y+ct)}{2\cosh (x+y+ct)+\sinh (x+y+ct)} \right) \right] ^{2}.\nonumber \\ \end{aligned}$$
(78)

Class 7

If we take \([\varsigma _{1},\varsigma _{2},\varsigma _{3},\varsigma _{4}]=[1,1,2,0]\) and \([\jmath _{1},\jmath _{2},\jmath _{3},\jmath _{4}]=[i,-i,0,0]\) in Eq. (9) offers

$$\begin{aligned} \Lambda (\xi )=\cos (\xi ). \end{aligned}$$
(79)

We have,

$$\begin{aligned} & b_{1}=\pm \frac{\mp 4+\sqrt{16+b_{2}b_{3}-4b_{2}^{2}}}{b_{2}}, \\ & k_{0}=0,\qquad k_{1}=l_{1}=\pm \sqrt{-\frac{1}{\rho }}. \end{aligned}$$

If these outcomes are taken into account along with Eq. (28), the next result is got

$$\begin{aligned} \Phi ^{\mp }(\xi )=\sqrt{-\frac{1}{\rho }}\times \frac{1}{\cos \left( \xi \right) \sin (\xi )}. \end{aligned}$$
(80)

Thus, we have the following periodic solution

$$\begin{aligned} & \psi _{7}^{\mp }(x,y,t) =\sqrt{-\frac{1}{\rho }}\nonumber \\ & \quad \times \frac{1}{\cos \left( x+y+ct\right) \sin (x+y+ct)} \nonumber \\ & \quad \times \exp \left( i\left( \pm \frac{\mp 4+\sqrt{16+b_{2}b_{3}-4b_{2}^{2}}}{b_{2}} x+b_{2}y+b_{3}t\right) \right) ,\nonumber \\ \end{aligned}$$
(81)
$$\begin{aligned} & \varphi _{7}^{\mp }(x,y,t)=2\rho \left( b_{2}\pm \frac{\mp 4+\sqrt{ 16+b_{2}b_{3}-4b_{2}^{2}}}{b_{2}}\right) \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }} \times \frac{1}{\sin (x+y+ct)\cos \left( x+y+ct\right) }\right] ^{2}, \end{aligned}$$
(82)
$$\begin{aligned} & \tau _{7}^{\mp }(x,y,t)=2\rho \nonumber \\ & \quad \times \left[ \sqrt{-\frac{1}{\rho }}\times \frac{1}{\sin (x+y+ct)\cos \left( x+y+ct\right) }\right] ^{2}. \end{aligned}$$
(83)

5 Qualitative analysis

This section provides a thorough examination of the governing equation’s bifurcation analysis, sensitivity analysis, quasi-periodic and chaotic behaviors, and multistability analysis.

5.1 Bifurcation analysis

Depending on the equilibrium points, phase pictures of dynamical systems can undergo considerable changes. The phase image of a dynamical system implies a wave solution for the underlying nonlinear equation for each orbit. The study of nonlinear dynamics relies heavily on the bifurcation theory of planar dynamical systems (PDSs) [35,36,37,38,39].

Equation (27) defined as:

$$\begin{aligned} \Phi ^{\prime \prime }+\frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{ (2b_{1}+b_{2})}\Phi +2\rho \Phi ^{3}=0. \end{aligned}$$

Let’s modify the above equation to make things simpler

Fig. 1
figure 1

Phase portraits for the system (85)

Fig. 2
figure 2

Plot of the sensitivity of the dynamical structure (85) for \((\Phi (0),T(0))=(0.6,0.0)\) in the red hue, \((\Phi (0),T(0))=(0.5,0.0)\) in the green hue, for \(\varpi _{1}=-1\), \(\varpi _{2}=1\) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-6,\) \( \rho =\frac{1}{2},\) and stepsize\(=0.05\)

Fig. 3
figure 3

Plot of the sensitivity of the dynamical structure (85) for \((\Phi (0),T(0))=(0.61,0.0)\) in the red hue, \((\Phi (0),T(0))=(0.51,0.0)\) in the green hue, for \(\varpi _{1}=-1\), \(\varpi _{2}=1\) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-6,\) \( \rho =\frac{1}{2},\) and stepsize\(=0.05\)

Fig. 4
figure 4

Plot of the sensitivity of the dynamical structure (85) for \((\Phi (0),T(0))=(0.061,0.0)\) in the red hue, \((\Phi (0),T(0))=(0.051,0.0)\) in the green hue, for \(\varpi _{1}=-1\), \(\varpi _{2}=1 \) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-6,\) \( \rho =\frac{1}{2},\) and stepsize\(=0.05\)

Fig. 5
figure 5

Plot of the sensitivity of the dynamical structure (85) for \((\Phi (0),T(0))=(0.6,0.0)\) in the red hue, \((\Phi (0),T(0))=(0.7,0.0)\) in the green hue, for \(\varpi _{1}=-1\), \(\varpi _{2}=1\) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-6,\) \( \rho =\frac{1}{2},\) and stepsize\(=0.05\)

Fig. 6
figure 6

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.1,\) and \(\varrho =1.28\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown, when \(b_{1} =1,\) \(b_{2}=8,\) \(b_{3} =9,\) \( \rho =3/4\)

Fig. 7
figure 7

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.3,\) and \(\varrho =1.28\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown

Fig. 8
figure 8

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.8,\) and \(\varrho =1.28\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown

Fig. 9
figure 9

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.1,\) and \(\varrho =4.18\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown

Fig. 10
figure 10

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.1,\) and \(\varrho =4.38\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown

Fig. 11
figure 11

The nonlinear dynamical system for \( \varpi _{1}=1.5,\) \(\varpi _{2}=0.1,\) \(\epsilon =5.1,\) and \(\varrho =4.58\) with the initial condition \((\Phi (0),T(0))=(0.20,0.15)\) is shown

Fig. 12
figure 12

Multistability of the dynamical system for \((\Phi ,T)=(1.8,1.25)\) in red hue, and \((\Phi ,T)=(0.20,0.15)\) in a black hue

$$\begin{aligned} \Phi ^{\prime \prime }+\varpi _{1}\Phi ^{3}+\varpi _{2}\Phi =0, \end{aligned}$$
(84)

in which \(2\rho =\varpi _{1},\) and \(\frac{\left( b_{3}-b_{1}^{2}b_{2}\right) }{(2b_{1}+b_{2})}=\varpi _{2}.\)

Denote \(\Phi ^{\prime }=T\) in Eq. (84) to obtain the PDS, which is as follows:

$$\begin{aligned} {\left\{ \begin{array}{ll} \frac{d\Phi }{d\xi }=T, \\ \frac{dT}{d\xi }=-\varpi _{1}\Phi ^{3}-\varpi _{2}\Phi . \end{array}\right. } \end{aligned}$$
(85)

The roots of \(-\varpi _{1}\Phi ^{3}-\varpi _{2}\Phi \) are the equilibrium points (EPs) on the axis \(T=0\) that correspond to the PDS (85). The obtained result is

$$\begin{aligned} g(\Phi )=-\varpi _{1}\Phi ^{3}-\varpi _{2}\Phi . \end{aligned}$$
(86)

Consequently, the aforementioned system (85) has unique EP \(\Upsilon _{1}=(0,0)\) if \(\varpi _{1}\varpi _{2}>0\) also \(\varpi _{1}\varpi _{2}<0\) then, (85) contains these EPs: \(\Upsilon _{1}=(0,0),\) \(\Upsilon _{2}=\left( \sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) ,\) and \( \Upsilon _{3}=\left( -\sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) .\)

Let \(W(\Phi ,T)\) represent the linearized system’s coefficient matrix at EP \((\Phi ,T).\) This matrix is referred to as the system’s ”Jacobian” matrix. The determinant of the Jacobian matrix, denoted by PDS (85), is expressed as:

$$\begin{aligned} det[J(\Phi ,T)]=3\varpi _{1}\Phi ^{2}+\varpi _{2}, \end{aligned}$$
(87)

in which \((\Phi ,0)\) is system’s EP for (85). Based on the bifurcation theory, if \(det[J(\Phi ,0)]=0,\) the EP of PDS (85) is a cusp point, if \(det[J(\Phi ,0)]<0\) the EP of (85) is a saddle point, and if \(det[J(\Phi ,0)]>0\) the EP of (85) is a center point along the Poincare index of the EP is zero. The bifurcation of the PDS depending on the parameters \(\varpi _{1},\) and \( \varpi _{2}.\)

When we consider \(\varpi _{1}>0,\) \(\varpi _{2}>0\) then, the center point of (85) is EP \(\Upsilon _{1}=(0,0)\), since \(det[J(\Phi ,T)]>0\) in (87). If we choose \(\varpi _{1}>0,\) \(\varpi _{2}<0\) then, (85) has three EPs: \(\Upsilon _{1}=(0,0),\) \(\Upsilon _{2}=\left( \sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) ,\) and \(\Upsilon _{3}=\left( -\sqrt{-\frac{ \varpi _{2}}{\varpi _{1}}},0\right) .\) Because of this, the Jacobi matrix’s determinant for \(\Upsilon _{1}=(0,0)\) is negative, suggesting that this point is the saddle. Moreover, this indicates that \(\Upsilon _{2}=\left( \sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) ,\) and \(\Upsilon _{3}=\left( -\sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) \) are center points because they are both positive. When we take \(\varpi _{1}<0, \) \(\varpi _{2}>0\) then, (85) has three EPs: \(\Upsilon _{1}=(0,0),\) \(\Upsilon _{2}=\left( \sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) ,\) and \(\Upsilon _{3}=\left( -\sqrt{-\frac{\varpi _{2}}{\varpi _{1} }},0\right) .\) Because of this, the center of \(\Upsilon _{1}=(0,0)\) is indicated by the positive determinant of the Jacobi matrix. Additionally, \( \Upsilon _{2}=\left( \sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) ,\) \( \Upsilon _{3}=\left( -\sqrt{-\frac{\varpi _{2}}{\varpi _{1}}},0\right) \) have negative Jacobi matrix determinants, suggesting that they are saddle. If we regard \(\varpi _{1}<0,\) \(\varpi _{2}<0\) then, \(\Upsilon _{1}=(0,0)\) is the only EP for (85), and it is classified as a saddle point due to the negative determinant of the Jacobi matrix in (87).

5.2 Sensitivity analysis

In this subsection, we operate the Runge–Kutta method to scrutinize the sensitivity of the dynamical system described by PDS (85) [40]. The PDS (85) is chosen for investigation in this subsection utilizing sensitivity inspections. Keeping the parameters as they are in Figs. 234 and 5, respectively, yields four non-identical initial values. It may be shown that the PDS (85) exhibits a quasi-periodic pattern under the initial tested circumstances. It is evident from the figures that even minor modifications to the starting conditions result in significant shifts in the system’s behavior. A comprehensive analysis of these graphical representations unmistakably reveals that even minor adjustments in the initial conditions yield significant disparities in the overall dynamics exhibited by the system. This phenomenon underscores the system’s inherent sensitivity to its initial state, where even slight deviations can trigger substantial divergences in the subsequent trajectory and behavior.

Fig. 13
figure 13

The 3D, contour, and density plots for the solution \(\left| \psi _{1,1}(x, y, t)\right| \) in (31) when \(b_{1}=1,\) \(b_{2}=2,\) \(b_{3}=4,\) \(\rho =2,\) \( c=11/2, \) and \(y=1\)

Fig. 14
figure 14

The 3D, contour, and density plots for the solution \(\left| \psi _{3}(x,y,t)\right| \) in (49) when \(b_{1}=-2,\) \(b_{2}=1,\) \(b_{3}=-2,\) \(\rho =2,\) \(c=2,\) and \(y=1\)

Fig. 15
figure 15

The 3D, contour, and density plots for the solution \(\left| \psi _{5,1}(x,y,t)\right| \) in (67) when \(b_{1}=1,\) \(b_{2}=1,\) \(b_{3}=25,\) \(\rho =2,\) \(c=11,\) and \(y=1\)

Fig. 16
figure 16

The 3D, contour, and density plots for the solution \(\left| \varphi _{6,1}(x,y,t)\right| \) in (73) when \(b_{1}=-2,\) \(b_{2}=1,\) \(b_{3}=-2,\) \(\rho =2,\) \(c=2,\) and \(y=1\)

Fig. 17
figure 17

The 3D, contour, and density plots for the solution \(\left| \tau _{7}(x,y,t)\right| \) in (83) when \(b_{1}=1,\) \(b_{2}=1,\) \(b_{3}=3,\) \(\rho =2,\) \(c=7,\) and \( y=1\)

5.3 Quasi periodic and chaotic behaviors

By introducing the perturbation term \(\varrho ,\) formulation (85) may be interpreted into the perturbed dynamical system (pDS) \(\varrho \sin (\epsilon \xi ):\)

$$\begin{aligned} {\left\{ \begin{array}{ll} \frac{d\Phi }{d\xi }=T, \\ \frac{dT}{d\xi }=-\varpi _{1}\Phi ^{3}-\varpi _{2}\Phi +\varrho \sin (\epsilon \xi ) \end{array}\right. } \end{aligned}$$
(88)

where \(\varrho \) and \(\epsilon \) represent the magnitude and frequency of the external force exerted on the system (88). In this analysis, we will investigate how the factors \(\varrho \) and \(\epsilon \) of the perturbation term effect the pDS (85). For this reason, we will fix all other physical parameters of the (88) and then observe the effects of \(\varrho \) and \(\epsilon .\)

5.4 Multistability analysis

This subsection handles the multistability of a system like (88) for the perturbed term. To explore a dynamical system’s tendency toward multistability (88), multistability [40,41,42] is the concurrent combination of numerous, even massive, solutions for a given range of physical variables and variable beginning values. For \(\varpi _{1}=0.5,\) \(\varpi _{2}=0.1\) (\(b_{1}=1,\) \(b_{2}=8,\) \(b_{3}=9,\) and \(\rho =1/4 \)),  \(\varrho =8.1,\) \(\epsilon =8.923,\) and stepsize\(=0.1\) two distinct phase portrait types can be created for the beginning conditions \( (\Phi ,T)=(1.8,1.25)\) and \((\Phi ,T)=(0.20,0.15)\), which represents the hues red and black. A quasi-periodic style is detected in the beginning value (1.8, 1.25) by the tested system, although the periodic style indicated a similar number of variables with the initial condition (0.20, 0.15).

6 Comparisons

This section compares the results of this investigation with other studies that were acquired using different analytical techniques and published in the literature. The purpose of this comparative analysis is to draw attention to the distinctive features and novel contributions of the present study. In [28], the (2+1)-dimensional cmKdV system was studied by using the Darboux transformation to find soliton solutions. In [43], the author uncovered analytical solutions, including dark solitons, bright solitons, and periodic waves by using the the improved Sardar equation method. Our work synthesizes this research to apply the more effective technique, namely the nGERFM. Thus, by implementing the above methodology, we give novel soliton solutions, such as exponential function solutions, singular periodic wave solutions, combo trigonometric solutions, shock wave solutions, singular soliton solutions, and hyperbolic solutions in mixed form. Furthermore, the examination of bifurcation in the model mentioned above is explored, a crucial aspect in the study of dynamical systems. Chaos theory and bifurcation theory are essential instruments for comprehending intricate systems and are widely applicable in various scientific fields. This assessment plays a significant role in elucidating the resilience and enduring dynamics of solitons in diverse physical systems.

It becomes clear that several of the conclusions in this study, which were attained by carefully choosing the parameters, are consistent with findings from earlier research. It is important to remember that, despite possible similarities, the original expressions of these results are not the same as ours. Despite an extensive search of relevant publications, no solution identical to the one revealed in this work could be found. Because they do not seem to have been published before, it is notable that the remaining results we have obtained are new and inventive. The results presented in this research were obtained by applying the nGERFM. On the other hand, the retrieved results differ from the previous ones obtained by [33] as well.

7 Graphical explanation

This section showcases graphical representations of the obtained solutions. 3D, contour and density plots were created for some solutions obtained using the nGERFM. These graphs were generated using the Mathematica program by taking the absolute value of the obtained solutions. By using the Maple program, graphs for bifurcation analysis, sensitivity analysis, quasi-periodic and chaotic behaviors, and multistability analysis are also included.

For Fig. 1a shows the phase portrait for \(\varpi _{1}=1\), \(\varpi _{2}=1\) \((\varpi _{1}>0,\) \(\varpi _{2}>0)\) when \(b_{1}=2,\) \( b_{2}=-2,\) \(b_{3}=-6,\) \(\rho =\frac{1}{2}.\)

For Fig. 1b depicts the phase graph for \(\varpi _{1}=1 \), \(\varpi _{2}=-1\) \(\left( \varpi _{1}>0,\varpi _{2}<0\right) \) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-10,\) \(\rho =\frac{1}{2}\).

For Fig. 1c illustrates the phase picture for \(\varpi _{1}=-1\), \(\varpi _{2}=1\) \(\left( \varpi _{1}<0,\varpi _{2}>0\right) \) when \(b_{1}=2,\) \(b_{2}=-2,\) \(b_{3}=-6,\) \(\rho =-\frac{1}{2}\).

For Fig. 1d demonstrates the phase image for \(\varpi _{1}=-1\), \(\varpi _{2}=-1\) \(\left( \varpi _{1}<0,\varpi _{2}<0\right) \) when \(b_{1}=2, \) \(b_{2}=-2,\) \(b_{3}=-10,\) \(\rho =-\frac{1}{2}\).

In our simulations for Figs. 234567891011 and 12, we observe a variety of intricate and anomalous phenomena within natural systems. Upon examination of the graphical representations, it becomes evident that even minor alterations in initial conditions yield significant disruptions within the system, leading to the emergence of novel and peculiar behaviors. These observations underscore the profound impact of slight modifications in the initial state, revealing a pronounced sensitivity of the system under scrutiny to its initial parameters. It is within the dynamic interplay between order and disorder that we witness the genesis of innovative phenomena, where minute perturbations can precipitate divergent outcomes on a grand scale. As we probe deeper into the realm of chaos, we encounter elusive attractors and fractal structures, which provide tantalizing glimpses of underlying stability amidst apparent randomness. The exploration of chaotic systems poses formidable challenges to conventional notions of predictability, necessitating the utilization of sophisticated mathematical methodologies to elucidate discernible patterns amidst the apparent disorder while embracing the enigmatic essence of these intricately intertwined systems (Figs. 1314151617).

8 Conclusion

This paper considered the (2+1) dimensional cmKdV system. The cmKdV is a complex extension of the well-known Korteweg–de Vries (KdV) equation, which describes the propagation of long waves in shallow water.

To begin with, we regarded the nGERFM. Thanks to the nGERFM, we obtained various types of soliton solutions, such as exponential function solutions, singular periodic wave solutions, combo trigonometric solutions, shock wave solutions, singular soliton solutions, and hyperbolic solutions in mixed form. Predicted arrangements for solutions are established from the outset, which is one of these methodologies’ major advantages. To visualize the graphical representation of the acquired soliton solutions, 3D, density, and contour curves were plotted by choosing suitable parameter values via Mathematica. The approach used is clear and methodical, enabling interested individuals to apply it immediately to solve their NLPDEs. The results of this study suggest that the proposed method is promising for exploring various soliton solutions of nonlinear equations in optical physics. Secondly, similar two-dimensional PDSs were developed, and the equilibrium points of the system were determined through the application of bifurcation theory. Examination was conducted on the periodic, quasi-periodic, and chaotic responses of traveling waves under the influence of an external periodic disturbance. As the intensity of the periodic disturbance increases, the perturbed system exhibits a transition to quasi-periodic behavior, leading to chaos. The occurrence of quasi-periodic and chaotic movements was documented in the presence of an external perturbation term, with sensitivity analysis employed to validate the findings. Graphs were drawn using the Maple program.

The soliton solutions we obtain are new and unique for the (2+1)-dimensional cmKdV system. Also, compared to many other works, our findings contain a more comprehensive range of functions, including trigonometric, hyperbolic, exponential, etc. Moreover, these accepted solutions will apply to studying analytically NLPDEs in mathematical physics, plasma physics, applied sciences, non-linear dynamics, and engineering. In the future, we could explore the stability and long-term behavior of the identified solitary wave solutions in more detail. Additionally, examining how different parameters affect the system dynamics may help us discover more interesting phenomena. With Maple’s assistance, we double-checked the results by substituting them back into the original formula.