Abstract
The linear noise approximation models the random fluctuations from the mean-field model of a chemical reaction that unfolds near the thermodynamic limit. Specifically, the fluctuations obey a linear Langevin equation up to order \(\Omega ^{-1/2}\), where \(\Omega \) is the size of the chemical system (usually the volume). In the presence of disparate timescales, the linear noise approximation admits a quasi-steady-state reduction referred to as the slow scale linear noise approximation (ssLNA). Curiously, the ssLNAs reported in the literature are slightly different. The differences in the reported ssLNAs lie at the mathematical heart of the derivation. In this work, we derive the ssLNA directly from geometric singular perturbation theory and explain the origin of the different ssLNAs in the literature. Moreover, we discuss the loss of normal hyperbolicity and we extend the ssLNA derived from geometric singular perturbation theory to a non-classical singularly perturbed problem. In so doing, we disprove a commonly-accepted qualifier for the validity of stochastic quasi-steady-state approximation of the Michaelis –Menten reaction mechanism.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
The set of elementary reactions that comprise a chemical system often occur at disproportionate rates. From the chemical physics point of view, chemical systems whose elementary reaction rates are disparate constitute a multiscale process. From a modeling point of view, multiscale reactions are highly advantageous, since the presence of widely separated timescales permits a reduction in the number of mathematical equations required to model the equation over slow (long) timescales.
In the deterministic regime, near the thermodynamic limit, chemical equations can be accurately modeled with a system of nonlinear ordinary differential equations. The reduction of deterministic models is generally achieved through the application of Tikhonov’s theorem Tikhonov (1952) and Fenichel theory (Fenichel 1971, 1979). Several analyses of enzyme-catalyzed reactions have made good use of singular perturbation theory to generate approximations referred to as quasi-steady-state (QSS) approximations or reductions (Eilertsen et al. 2019; Eilertsen and Schnell 2020). In fact, over the last decade, much progress has been made in developing and applying the formalism of Fenichel theory to chemical kinetics, and the culmination of the recent literature has turned up some surprising results. First and foremost, the advent of Tikhonov–Fenichel parameter value (TFPV) theory, developed extensively by Goeke et al. (2017), Goeke et al. (2015), has rigorously demonstrated that not all QSS reductions emerge as a result of a singular perturbation scenario, despite what scaling and numerical simulations might suggest (Noethen and Walcher 2011; Eilertsen et al. 2021). TFPV theory has also enhanced our understanding of the singular perturbation structure (when applicable) to pertinent reaction models, which has led to the discovery of bifurcations and other interesting phenomena present in the singular vector fields of the model equations (Eilertsen and Schnell 2020). Most surprising, however, is the revelation that traditional scaling methods may lead to erroneous conclusions concerning the mathematical origin and justification of QSS reduction in chemical kinetics (see, for example, Goeke et al. (2012), Sect. 4, as well as Eilertsen et al. (2021)).
Given the recent developments in the deterministic theory of QSS reduction, the natural question to ask is: Do any of these developments have something important to say about model reduction in the stochastic realm? Model reduction is more challenging in the stochastic regime, but rigorous reduction methods that leverage the presence of disparate timescales do exist (see, for example, Kan et al. 2016; Kim et al. 2017; Kang and Kurtz 2013). The focus of this paper is on the application of QSS reduction in the linear noise regime, where stochastic fluctuations from the deterministic mean-field model are governed by a linear Langevin equation called the linear noise approximation (LNA). The general methodology for QSS reduction in the LNA regime, called the slow scale linear noise approximation (ssLNA), is by Thomas et al. (2012a), Pahlajani et al. (2011), and Herath and Del Vecchio (2018). Interestingly, the reported ssLNAs are slightly different, and this raises the question: Where do these differences come from, and are they critical? The intent of this paper is three-fold: (i) to explain why different ssLNAs exist in the literature, (ii) to introduce recent developments of deterministic QSS theory to the stochastic community, and (iii) to demonstrate techniques to extend the ssLNA to specific non-classical singularly-perturbed problems. In what follows, we revisit the mathematical formalism of geometric singular perturbation theory (GSPT) and derive the ssLNA directly from GSPT. We discuss the role of TFPV theory in the applicability of GSPT, and demonstrate where the differences emerge between the GSPT-derived ssLNA and the ssLNAs of Thomas et al. (2012a), Pahlajani et al. (2011), and Herath and Del Vecchio (2018). We also discuss the role of the GSPT-derived ssLNA in the QSS reduction of the chemical master equation (CME) and use it to debunk a well-established result in the literature.
2 Singular perturbations and fenichel theory: A brief introduction
In this section, we give a very brief overview of Fenichel theory as it applies to singular perturbations by shadowing Wechselberger [2020, Chapter 3]. However, the results were originally obtained by Fenichel [1979, Sect. 5]. A detailed mathematical expose on Fenichel reduction and its applicability in enzyme kinetics can be found in Noethen and Walcher (2011), Goeke et al. (2012), Goeke and Walcher (2014).
2.1 Coordinate-free slow manifold projection
Fenichel theory is concerned with the persistence of normally hyperbolic invariant manifolds with respect to a perturbation. Dynamical systems subject to a small perturbation are of the general form
where \(0<\varepsilon \ll 1\). The stationary points of the unperturbed vector field, w(z), determine the classification of the perturbation problem. If the perturbation is singular, then there exists a set, S, comprised of non-isolated equilibrium points:
Fenichel reduction applies to compact subsets, \({\mathcal {S}}_0 \subseteq S\) that are differentiable manifolds (with a possible boundary). The compactness requirement of \({\mathcal {S}}_0\) is generally easy to satisfy in chemical kinetics: due to conservation laws, phase-space trajectories remain within a bounded, positively invariant set, \(\Lambda \). If \(S_0\) is an embedded k-dimensional submanifold of \(\mathbb {R}^n\), then
Furthermore, if the algebraic and geometric multiplicity of the zero eigenvalue are both equal to k, then
and there is continuous splitting,
for all \(z \in S_0\). Perturbing the vector field by setting \(0 < \varepsilon \ll 1\) results in the formation of an invariant, slow manifold, M. If the real parts of the \(n-k\) non-zero eigenvalues of Dw(z) are strictly less than zero,Footnote 1 then M will attract nearby trajectories at an exponentially fast rate. Projecting the perturbation, \(\varepsilon G(z,0)\), onto the tangent space of \(S_0\) results in a reduced equation (called a QSS approximation) that captures the long-time behavior of the system.
The decomposition (3) implies the existence of a projection operator, \(\Pi ^{S_0}\), that maps to \(\ker Dw(z)\)
The explicit form of \(\Pi ^{S_0}\) is obtained by exploiting the fact that w(z) factors (locally) as
The columns of N comprise a basis for the range of the Jacobian, Dw(z), and the zero level set of \(\mu (z)\) is identically \(S_0\). Since \(\text {rank} \;Dw(z)=n-k\), and the zero set of \(\mu :\mathbb {R}^n\mapsto \mathbb {R}^{n-k}\) corresponds to \(S_0\) (a submanifold of \(\mathbb {R}^n\)), we have that N(z) has full (column) rank, and \(D\mu (z)\) has full (row) rank:
The row vectors of \(D\mu (z)\) form a basis for the orthogonal complement of \(\ker Dw(z)\). Since projection operators are uniquely determined by their range and the orthogonal complement of their kernel, the operator \(\Pi ^{S_0}\) is
which is an oblique projection operator (see, Fig. 1 for a geometric interpretation of \(\Pi ^{S_0}\)).
Once the projection operator is constructed, the reduced equation is formulated by projecting the perturbation, G(z, 0), onto \(\ker Dw(z)\):
3 Singular perturbation reduction in biochemical kinetics: didactic examples
In this section, we compute several QSS reductions of the Michaelis-Menten (MM) reaction mechanism. We introduce the mass action equations of the deterministic MM reaction mechanism and discuss the computation of QSS reductions directly from Fenichel theory without a priori non-dimensionalization. Several QSS reductions are computed, including the standard QSS approximation (sQSSA) and the quasi-equilibrium approximation (QEA).
3.1 The Michaelis–Menten reaction mechanism
The MM reaction consists of three elementary reactions: the binding of a substrate molecule, S, with an enzyme molecule, E, leading to the formation of an intermediate complex molecule, C. The complex molecule can disassociate back into unbound enzyme and substrate molecules, or it disassociates into a product molecule, P, and an enzyme molecule. The chemical equation is given by
where \(k_1\), \(k_{-1}\) and \(k_2\) are deterministic rate constants.
The mass action equations that describe the kinetics of (8) in the thermodynamic limit constitute a two-dimensional system of nonlinear ordinary differential equations,
where lowercase s, c, e and p denote the concentrations of S, C, E and P, respectively. Once the temporal dynamics of s and c are known, the evolution of product is recovered from
The temporal concentration of enzyme, e, is computed from \(e_T-c\), where \(e_T\) is a conserved quantity, the total enzyme concentration, and accounts for the concentration of both bound and unbound enzyme molecules. A second conservation law is obtained from the addition of (9a)–(10), \({\dot{s}}+{\dot{c}}+{\dot{p}}=0\), yielding the conservation of substrate:
Unless otherwise stated, we will take \(s(0)=s_T\) in the analysis that follows, which implies \(c(0)=p(0)=0\).
3.2 Tikhonov–Fenichel parameter value theory
It is possible (and convenient) to compute QSS reductions directly from the dimensional equation. This a result of the TFPV theory developed by Goeke (2013) and Goeke et al. (2015, 2017), which we briefly outline here.
In physical applications, most dynamical systems depend on an m-tuple of parameters, \(\pi \in \mathbb {R}^m\):
A TFPV value is a point, \({\widehat{\pi }}\), in parameter space for which the vector field, \(f(z,{\widehat{\pi }})\), contains a normally hyperbolic and attracting critical manifold.
As an example, the MM reaction mechanism mass action equations depend on the parameters \(\pi =(e_T,k_1,k_{-1},k_2)^{tr.}\), where tr. denotes transpose. There are three engaging TFPV valuesFootnote 2 associated with the MM reaction mechanism:
Singular perturbation theory applies to vector fields that are sufficiently close to the TFPVs. Thus, the QSS reductions that are constructed by projecting onto the tangent space of a critical manifold associated with the TFPVs will be valid for \(\pi \) sufficiently close \({\widehat{\pi }}_i\). Consequently, we will consider parameter values close to TFPVs:
where \(\varepsilon \) is very small but positive, and \({\widehat{e}}_T\), \({\widehat{k}}_1\) and \({\widehat{k}}_2\) are of unit magnitude and simply encode the units of \(e_T\), \(k_1\) and \(k_2\), respectively. As we demonstrate in the subsection that follows, this notation enables the computation of QSS reductions without the need to non-dimensionalize the mass action equations.
3.3 Fenichel reduction: The sQSSA of the MM reaction mechanism
To extract a reduced model from (9), we begin with the assumption that \(e_T\) is small and therefore \(\pi \) is close to \({\widehat{\pi }}_1\). Consequently, we rescale \(e_T\) as \(e_T \mapsto \varepsilon {\widehat{e}}_T\), where \(0<\varepsilon \ll 1\) (again, this notation really just serves as a reminder that \(e_T\) is small). In (s, c) coordinates, we have \(z:=(s\;\;c)^T\), and in perturbation form, the mass action Eq. (9) are
The singular problem recovered by setting \(\varepsilon =0\) so that \(\pi ={\widehat{\pi }}_1\) yields a critical manifold of equilibria
It is straightforward to verify that \(S_0\) is normally hyperbolic. Moreover, since the non-trivial eigenvalue of the Jacobian, \(\lambda _{MM}\), is strictly less than zero
the critical manifold is attractive.
Since \(S_0\) is normally hyperbolic and attracting, we proceed to compute \(\Pi ^{S_0}\). The factorization of w(z) is straightforward to compute
as is the derivative of \(\mu (s,c)=c\):
Putting the pieces together, the projection operator \(\Pi ^{S_0}\) is
where \(K_S = k_{-1}/k_1\) and \(K_M = (k_{-1} + k_2)/k_1\). The corresponding QSS approximation is
which is the sQSSA.Footnote 3
Remark 1
Note that the sQSSA (17) is not the result of singular perturbation problem that is in standard form
This is contrary to the justification established from scaling analyses that utilize non-dimensionalization (see, Heineken et al. 1967, Segel 1988).
3.4 Fenichel reduction: The QEA
In addition to the sQSSA, the QEA is a QSS reduction that is valid in the limit of slow product formation that occurs when \(\pi \) is close to \({\widehat{\pi }}_3\). Rescaling \(k_2\) as \(k_2 \mapsto \varepsilon {\widehat{k}}_2\), the mass action system
has a critical manifold of equilibria in the singular limit that coincides with \(\pi ={\widehat{\pi }}_3:\)
which is identical to the s-nullcline. The QEA in (s, c) coordinates is well understood but trickier than the sQSSA. The consequence is that there can be noticeable depletion of s during the approach to the slow manifold unless \(e_T \ll K_M + s_T\) 0. We will not rehash the details here, but state the main results also found in Goeke et al. (2017) and Wechselberger (2020). The projection matrix, \(\Pi ^{S_0}\), and perturbation, G(s, c, 0), are given by
and corresponding QSS reduction for s is
3.5 Fenichel reduction: The reverse QSSA
The reverse QSSA (rQSSA) was originally defined by Segel and Slemrod (1989) as a perturbation problem, and later investigated in detail by Schnell and Maini (2000). To preface the derivation of the rQSSA as a Fenichel reduction, we remark that there are two common conditions that emerge in applications:
-
1.
\(D\mu (z)\) vanishes (or changes rank) at at least one point belonging to the set \(\mu (z)=0\).
-
2.
The zero eigenvalue of the Jacobian evaluated at at least one point on \(S_0\) has an algebraic multiplicity that is greater than the geometric multiplicity (the splitting (3) does not hold at such points).
The rQSSA is valid for small \(k_{-1}\) and small \(k_2\), and is of the variety 1. In perturbation form this corresponds to
The critical set is given by,
The rank of the Jacobian along \(S_0\) is not constant
and thus TFPV theory does not apply.Footnote 4 However, observe that the compact submanifolds
are normally hyperbolic and attracting. When \(s(0)>0\), trajectories will initially approach and follow \(S_a^r\) before eventually following \(S_a^b\). In fact, a straightforward analysis reveals the existence of a transcritical bifurcation (see, Fig. 2).
By the projection methods above, it is straightforward to show that the QSS reductions obtained via projection onto \(T_zS_a^r\) and \(T_zS_a^b\) are, respectively:
As a concluding remark, note that we have successfully computed QSS reductions without a priori scaling and non-dimensionalization of the mass action equations. The ability to compute QSS reductions directly from the dimensional equations is a result of the TFPV theory developed by Goeke et al. (2015, 2017), which we have utilized here.
4 Stochastic chemical Kinetics: expansions, reductions, and approximations
In this section, we discuss QSS reduction in the stochastic regime. We introduce the CME and the derivation of the LNA via the \(\Omega \)–expansion. We conclude with a review of the ssLNA as derived by Pahlajani et al. (2011) and Thomas et al. (2012a), and we compare it to the GSPT-derived ssLNA.
4.1 Stochastic chemical kinetics far from the thermodynamic limit: The master equation
Under physical conditions, a reaction occurs within a bounded volume, \(\Omega \). If the number of molecules in the system is finite, the reaction will always exhibit fluctuations. In fact, in the presence of random fluctuations and intrinsic noise, stochastic models provide a more physically realistic description of the kinetics when a system is far from the thermodynamic limit since the time interval between successive reactions becomes a random variable. The appropriate mathematical model depends on how “close" the system is to the thermodynamic limit.
If the chemical reaction consists of “R" elementary reactions, and the mixture is homogeneous and not diffusion limited then, far from the thermodynamic limit, the probability of finding the system in state Z at time t can be obtained from the solution to CME (see, Gillespie (1992) and Kampen (2007) for details),
where \({\nu }_j\) are the stoichiometric vectors that correspond to the jth elementary reaction. If the system is in state Z when the jth reaction occurs, then the new state of the system will be \({Z} + {\nu }_j\). The functions \(a_j\) are called propensity functions. Dynamically the state of the system at time t is Z, and it moves from state Z to the state \({Z}+{\nu }_j\) within the infinitesimal window \([t,t+\text {d}t)\) with the probability
The conditional probability (26) of jumping into the state \({Z}+{\nu }_j\) depends only on the present state of the system, which is called the Markov property.
The CME is possibly the most fundamental description of a chemical reaction. The difficulty is that closed-form solutions are rarely attainable. This begs question: Is it possible to derive physical models that exhibit stochasticity, but are nevertheless easier to analyze? The answer is yes, but the cost is that simplified models are usually only valid in monostable systems near the thermodynamic limit. The LNA is of this variety.
4.2 Approaching the thermodynamic limit: the LNA
To introduce the LNA, it is helpful to express the mass action equations in the form
where \({\mathcal {S}}\) is the stoichiometric matrix, and q is the main diagonal of the matrix F, whose diagonal components correspond to the elementary reactions of the chemical system. For example, the MM reaction mechanism (8) consists of three elementary reactions: the formation of complex, the disassociation of complex into S and E, and the disassociation of complex into E and P. Hence, the mass action system in form (27) is
To formally derive the LNA, one starts with the operator form of the CME,
where \(z=Z/\Omega \) and \(\mathbb {E}^{{\mathcal {S}}_{ij}}\) is the step operator:Footnote 5
Inserting the ansatz \({Z} = \Omega {z} + \Omega ^{1/2}{X}\) into (29) and expanding (29) in powers of \(\Omega \) yields (27) at zeroth-order in \(\Omega \). Thus, the mean of the stochastic trajectory obeys the mass action Eq. (27).
At order \(\Omega ^{-1/2}\), the equation that determines the randomly fluctuating departure from the mean, X, is a linear linear stochastic differential equation (SDE),
where J, the Jacobian, is \(J:=D(Sq)\), and W is a Wiener process. Collectively, (31) and the mass action equations comprise the LNA. On occasion we will express the LNA in the form
where the Gaussian white noise, \(\zeta (t)\), is understood to be the generalized derivative of W.
The LNA is notably simpler than the CME, since the Langevin Eq. (31) is linear, and the integration of linear stochastic differential equations of the form (31) is well-understood. The Fokker–Plank equation associated with (31) is also linear,
where the diffusion matrix, D, is given by \( D = {\mathcal {S}} F {\mathcal {S}}^T\).
As mentioned in the earlier sections, the reduction of the LNA based on timescale separation is the ssLNA developed by Pahlajani et al. (2011) and Thomas et al. (2012a, 2012b). In the nonlinear regime, Katzenberger 1991 addressed reduction of SDEs of the form
where \(\varepsilon \) and \(\nu \) are extremely small (i.e., \(\varepsilon , \nu \ll 1\)). In short, Katzenberger (1991) proved that provided specific conditions hold, SDEs of the form (34) converge, in a certain sense, to the reduced SDE,
where \(\Pi \) is a projection operator that maps to the tangent space of the critical manifold \(S_0:=\{x\in \mathbb {R}^n:w(x)=0\}\) that emerges when \(\varepsilon = \nu =0\), and \(\nu {\mathfrak {D}}(x)\) is a noise-induced drift term. Parsons and Rogers (2017) derived the explicit construction of \(\Pi \) and \({\mathfrak {D}}(x)\) in their analysis of fully nonlinear Langevin equations. Notably, Parsons and Rogers (2017) did not discuss the reduction of noisy systems in standard form, and a projection operator \(\Pi \) that is consistent with Fenichel theory has not been defined for standard-form singularly perturbed systems in the linear noise regime. Such is the subject of the subsection that follows.
4.3 Projecting onto the tangent space of the critical manifold
Singular perturbation reduction of a deterministic system requires the existence of a normally hyperbolic invariant manifold in the singular limit; this fact is non-negotiable. The reduction of the LNA is also straightforward, provided one has a well-defined critical manifold. The key observation in the LNA regime is to recognize that the dimension of the problem increases, but that the LNA is still of the form (34), and therefore the results of Katzenberger (1991) are applicable. All that remains is to identify a normally hyperbolic critical manifold, its tangent space, and construct the unique projection operator, \(\Pi \).
The Jacobian, Dw(z), is equal to \(\textit{ND}_{\mu }\) if \(z \in S_0\) and, in standard form, the general LNA is
where \(\Gamma := (\zeta _1(t), \zeta _2(t),..)^T\) is a white noise vector:
In perturbation form, the LNA is
with
For a planar system in which \(z\in \mathbb {R}^2\), the perturbation problem (37) has the form
where \(x=(x_1,x_2,X_1,X_2)^T\), and the critical set, \({\widetilde{S}}\), is given by
The corresponding projection operator is
where \({\mathcal {D}}\) denotes differentiation with respect to x with \(x:=(x_1,x_2,X_1,X_2)^T\). The projection of the right hand side of (39) onto the tangent space of \({\widetilde{S}}_0\) is
Remark 2
In the nonlinear Langevin regime, the reduced equation may contain a stochastic drift term that is \(\Omega ^{-1}\) (see, Katzenberger (1991) and Parsons and Rogers (2017)). Hence, simply projecting onto the tangent space of the critical manifold does not yield a sufficient reduction of the Langevin equation unless the drift term vanishes or can be ignored. Such a term will also be present in the LNA regime. As Parsons and Rogers (2017) point out, the drift term is not negligible when: the curvature of the slow manifold is significant, the curvature effect of the flow field is extreme, or the angle between the fast and slow subspace generates a bias in the way a trajectory returns to the slow manifold. It may be possible to discard the drift term when \(\Omega \) is sufficiently large, but proof of this conjecture is open. Hence, (42) holds for systems that have a negligible (or identically zero) drift term.
4.4 The ssLNA for systems in standard form: comparison to previous results
The reduction method introduced by Thomas et al. (2012a) differs from (42). For a two-dimensional singularly perturbed problem in the standard form,Footnote 6
the critical manifold \(S_0:=\{(x,y)\in \mathbb {R}^2:g_0(x,y)=0\}\) attracts nearby trajectories if \(g_{0y} <0\;\;\forall (x,y)\in S_0\). Moreover, by the Implicit Function Theorem, \(g_{0y} \ne 0\;\;\forall (x,y)\in S_0\) implies the critical manifold is locally expressible as \(y=h(x)\):
Thomas et al. (2012a) construct the ssLNA directly from the non-singular JacobianFootnote 7 (that corresponds to \(0 <\varepsilon \)),
with the a priori requirement that the system be in standard form. From this, they define the maps:
Let X and Y denote the respective fluctuations from the x and y. The ssLNA of Thomas et al. (2011) is
In contrast, to derive the deterministic sQSSA from GSPT, we begin with the singular Jacobian of the layer problem associated with (43). The corresponding projection operator \(\Pi ^{S_0}\) is
and again the level set \(g_0(x,y)=0\) defines the critical manifold, \(S_0\). The perturbation term, \(\varepsilon G(z,\varepsilon )\) is
and therefore the reduced flow for the mean field is
Again, \(g_{0y} \ne 0 \;\;\forall z \in S_0\) implies \(y=h(x)\) such that \(g_0(x,h(x))=0\). Thus, the sQSSA for x is:
For the corresponding ssLNA, and for two-dimensional systems of the standard form (43), we have
and thus the critical manifold is
The perturbation term, \(G(z,\varepsilon )\), is
Computing \({\widetilde{\Pi }}^{{\widetilde{S}}_0}\) from \(\varvec{\mu }(x)\) and \({\varvec{N}}(x)\) and projecting G(z, 0) onto the tangent space of the critical manifold yields
Remark 3
We note that for systems in standard form, an equivalent reduction to (48) is given in Herath and Del Vecchio (2018) and extends to to non-autonomous systems.
Note the difference from the ssLNA of Thomas et al. (2012a). First, we do not map
This is a consequence of the fact that our derivation from GSPT begins with the singular Jacobian, which is consistent with singular perturbation theory. In contrast, (Thomas et al. 2012a) began with the perturbed, non-singular Jacobian. Consequently, when derived from GSPT, the ssLNA contains fewer diffusion terms than the ssLNA of Thomas et al. (2012a). However, for planar systems \({\mathcal {S}}_{slow}\) and \(\bar{{\mathcal {S}}}_{slow}\) should be close whenever \(|f_y/g_y| \ll 1\). Hence, the difference between the ssLNA of Thomas et al. (2012a) and (48) should be small when the perturbation is in standard form. We note that \({\mathcal {S}}_{slow}\) is also invariant in the ssLNAs of Pahlajani et al. (2011) and Herath and Del Vecchio (2018).
Second, observe that
unless g(x, y) does not depend on \(\varepsilon \), which is not always the case in applications. This difference follows from the utilization of the singular Jacobian in the derivation.
4.5 Benchmark example: The MM reaction mechanism in the limit of small \(k_2\) in (c, p) coordinates
To demonstrate the projection operator methodology on a problem that is in standard form, we analyze the MM reaction mechanism in (p, c) coordinates and consider the limit of small \(k_2\): \(k_2 \mapsto \varepsilon {\widehat{k}}_2.\) In (p, c)-coordinates, the deterministic rate equations are given byFootnote 8
which is in the standard form (43); p is the slow variable and c is the fast variable. The projection matrix isFootnote 9
and the critical manifold
is normally hyperbolic and attracting since
Since \(\mu _c < 0\;\;\forall (c,p)\in S_0\), it follows from the Implicit Function Theorem that the critical manifold is locally expressible as a graph over the slow variable, \(c=y(p)\),
The reduced equation for p is
One could also employ the total QSSA (tQSSA) in this case. Again, see Herath and Del Vecchio (2018) for an excellent analysis of the ssLNA in the context of the tQSSA.
We now turn to the reduction of the LNA. The complete perturbation form of the LNA is
where B is given by
and \(\mu (p,c)\) in (54) is
The critical manifold,
is normally hyperbolic and attracting. Proceeding in the usual way by calculating \({\widetilde{\Pi }}^{{\widetilde{S}}_0}\), the reduced equation for \(X_p\) is
To eliminate \(X_c\) from (58) we invoke the critical manifold relationship
which yields
where “\(y'(p)\)” denotes \(\frac{\text {d}y}{\text {d}p}\). Interestingly, it is worthwhile noting that Eqs. (52) and (60) are equivalent to the tQSSA in the linear noise regime.
4.6 Estimating conditions for the QSS: The MM reaction mechanism with feedback in the limit of small \(k_2\) and \(k_3\)
In this subsection, we analyze the QSS behavior of the MM reaction mechanism with feedback:
In (p, c)-coordinates the reaction is modelled by the ODE system
which admits a nontrivial steady-state solution at \((p,c)=(p_{SS},c_{SS})\). Furthermore, small \(k_2\) and \(k_3\) defines a singularly perturbed system in the standard form (43):
The LNA approximation includes the randomly fluctuating departure from the mean field (61),
where the Jacobian, J, is given by
Under QSS conditions, the covariance matrix, \(\Sigma \), of the LNA satisfies the Lyapunov equation,
The variance of the slow variable, p, is \(\Sigma (1,1)\).
The corresponding ssLNA is
and under steady-state conditions the variance is
Numerical simulations confirm that (65) is an excellent approximation to \(\Sigma (1,1)\) as \(k_3,k_2 \rightarrow 0\) (see, Fig. 3).
5 Reduction of the CME: intimations from the linear noise regime
In this section, we discuss the reduction of the CME for the MM reaction mechanism and its relationship to singular perturbations and critical manifolds. Specifically, we address the presence of transcritical bifurcations in the linear noise regime and illustrate that knowledge of the critical manifold can assist in avoiding erroneous conclusions concerning the validity of the stochastic QSSA.
5.1 Dynamic bifurcations and the Segel–Slemrod sQSS condition
The CME for the MM reaction mechanism is
where \(n_{e_T}\) denotes the total number of enzyme molecules, and \(P(n_S,n_C,t)\) is the probability of finding the system with \(n_S\) substrate molecules and \(n_C\) complex molecules at time t.
The homologous sQSS reduction of (66) is as follows. Given that there are \(n_S\) substrate molecules at time t, the probability that one one product molecule forms in an infinitesimal window \([t,t+\text {d}t)\) is
where the propensity function, \(a(n_S)\), is adopted from deterministic sQSSA rate law, and the reduced CME is
In what follows, for simplicity, we set \(\Omega = 1\) and work in arbitrary units (with a large number of molecules).
Numerical work by Sanft et al. (2011) suggests that the Segel–Slemrod condition (expressed in terms of stochastic rate constants)
ensures the validity of the stochastic sQSSA (68). This is surprising, especially since the long-time validity of the deterministic sQSSA for the MM reaction mechanism requires \(e_T/K_M\ll 1\) (Eilertsen and Schnell 2020), which is more restrictive than the Segel and Slemrod condition. However, excellent (and extremely rigorous) work by Kang et al. (2019) disputes this claim. In the stochastic regime, Kang et al. (2019) concluded that \(e_T \ll K_M\), which is in agreement with the deterministic qualifier. A similar conclusion was drawn by Mastny et al. (2007).
Importantly, although the deterministic and stochastic QSS reductions of the MM mechanism are justified via singular perturbation theory, the rigorous derivation of the sQSSA from singular perturbation was only recently established (Goeke et al. 2012). This raises the question: given what we now understand about the bifurcation structure of the critical set associated with the deterministic MM reaction mechanism, what consequence(s) does this have on the stochastic QSS reduction? More specifically, does the Segel and Slemrod condition guarantee that the stochastic sQSSA will remain accurate for all time, or is the more restrictive condition derived by Kang et al. (2019) and Mastny et al. (2007) necessary to ensure the accuracy of the stochastic sQSSA?
To answer this question, we note that the perturbation problem corresponding to small \(k_{-1}\) and \(k_2\) is of the form (43):
If \(e_T \ll s_T=s(0) \), then the Fenichel reduction is formulated by projecting the perturbation onto the tangent space of \({\mathcal {S}}_a^r\), \(T_z{\mathcal {S}}_a^r\):
This approximation does not hold for all-time: eventually the trajectory follows \({\mathcal {S}}_a^b\), and the Fenichel reduction is
The behavior of the reduction in small neighborhoods containing the bifurcation point is beyond the scope of this paper. In general, one must defer to non-classical methods to derive scaling laws near the bifurcation point (see, Krupa and Szmolyan 2001; Berglund and Gentz 2006).
As \(\Omega \) shrinks and fluctuations emerge, the LNA holds sway. The presence of a bifurcation point in the critical set is not too restrictive in this case. The ssLNA obtained via projection onto \({\mathcal {S}}_a^r\) is
Note the relationship between the mean and variance. Likewise, projecting onto \(T_z{\mathcal {S}}_a^b\) yields
As \(\Omega \rightarrow 0\) the CME prevails as the physically relevant model. The ssLNA (73) is a Gaussian process with equal mean and variance. In the CME regime, the reaction mechanism on \({\mathcal {S}}_a^r\) is equivalent to
where \(\lambda =k_2n_{e_T}\) and \(n_{e_T}\) denotes the total number (bound or unbound) of enzyme molecules. The CME that describes (75) is solvable. Let P(N, t) denote the probability that there are N product molecules at time t. Then,
Note the consistency with (73). The Poisson jump process is approximately Gaussian when the system size is sufficiently large.
Unfortunately, (76) is not valid for all-time, and it is necessary to ascertain the range of its validity. More precisely, we ask: How long (on average) from the onset of the reaction does it take before (74) is valid? Since (75) is a Poisson process the jump times, \(t_N\), are gamma-distributed:
Let \(n_{s_T}\) denote the total number of substrate molecules. The average time it takes to produce \(N^*=n_{S_T}-n_{e_T}\) product molecules is
which is exactly homologous to the deterministic scenario.
Moving on, once \(N = n_{S_T}-n_{e_T}\) we arrive at the intersection of the critical branches, \({\mathcal {S}}_a^r \cap {\mathcal {S}}_a^b\). At this point, no substrate molecules remain and the formation product is synonymous with the depletion of c:
Once again, the CME associated with (77) is solvable:
where \(n_c\) denotes the number of complex molecules, and time has been translated so that:
The question that remains is: How should the Gillespie algorithm be modified to reduce the computational complexity when \(k_2\) and \(k_{-1}\) are sufficiently small? The above analysis indicates that P(N, t) depends on the number of product molecules present at a given time in the reaction. Specifically, P(N, t) depends on whether or not \(N <N^*\). To modify the Gillespie algorithm, observe that the propensity function a(N) for product formation–at any given time–depends on the number of product molecules, N, present at time t. Thus,
Numerical simulations support the results of our analysis, and demonstrate that the Segel and Slemrod condition does not imply the validity of the stochastic sQSSA (see, Fig. 4).
We note that one can employ the reduction technique of Thomas et al. (2012a). In general, the ssLNA of Thomas et al. (2012a) will be close (in the asymptotic sense) to (73)–(74), but will be more complicated due to the presence of additional diffusion terms. The simplicity of the GSPT-derived ssLNA (73)–(74) helps to explain the insufficiency of the Segel–Slemrod condition for the validity of the stochastic sQSSA in the linear noise regime, thereby validating the results of Kang et al. (2019) and Mastny et al. (2007) from the context of GSPT.
As a final remark, we mention that the bifurcation point can also be handled with appropriate utilization of the tQSSA. Although the treatment of bifurcation points has so far not been addressed in the stochastic tQSSA literature, several rigorous studies suggest that the stochastic tQSSA is superior to the sQSSA in the CME and LNA regimes. Rigorous analyses of the stochastic tQSSA are can be found in Barik et al. (2008), MacNamara et al. (2008), Kim et al. (2014, 2015), Kim and Tyson (2020).
6 Discussion
The primary contribution of this work is the derivation of the ssLNA in a way that is consistent with Fenichel theory (Fenichel 1979), that is, the projection of a perturbation term onto the tangent space of a normally hyperbolic critical manifold. Our derivation explains the origin of the differences between the the ssLNAs reported in Thomas et al. (2012a), Pahlajani et al. (2011), and Herath and Del Vecchio (2018).
By re-deriving the ssLNA directly from GSPT, we illustrated how the GSPT-derived ssLNA can be extended to singular perturbation problems where normal hyperbolicity fails and classical Fenichel theory breaks down. To the best of our knowledge, this is the first extension of the ssLNA to singular perturbation problems that contain a transcritical bifurcation.
Finally, let us remark on the possible special role of the standard form in the reduction of the CME. In their derivation of the ssLNA, Thomas et al. (2012a) shared the following insight: the mapping
does not result in physically meaningful slow variable stoichiometry in the CME regime. However, as we pointed out, when the system is truly in standard form (again, the MM reaction mechanism with small \(e_T\) does not technically qualify), the stoichiometry component of the slow variable, \({\mathcal {S}}_{slow}\) is invariant: \({\mathcal {S}}_{slow}\mapsto {\mathcal {S}}_{slow}\). This suggests that singularly perturbed systems in standard formFootnote 10 might, in some way, be amenable to QSS reduction in the CME regime. However, this hypothesis warrants further investigation.
Notes
We will assume this to hold throughout so that both the critical and slow manifolds are attracting.
The non-zero parameters in \({\widehat{\pi }}\) are appropriately bounded below and above by positive constants.
In (17), we have transformed \(\varepsilon {\widehat{e}}_T\) back to \(e_T\) for clarity, and will continue to do this from this point forward.
The point \(\pi ^*=(e_T,k_1,0,0)^{tr.}\) is not a TFPV.
Here, \(e_i\) is the standard basis vector in \(\mathbb {R}^n.\)
For simplicity, we have assumed that \(\varepsilon f(x,y)\) contains only terms that are \({\mathcal {O}}(\varepsilon )\), as this form is common in chemical kinetics. The analysis of the more general form can be found in Wechselberger (2020).
The notation \(f_y\) denotes \(\partial _y f(x,y)\).
In (49), \(s_T\) denotes the total substrate.
Again, \(\mu _c\) denotes \(\partial _c \mu (p,c)\) and \(\mu _p\) denotes \(\partial _p \mu (p,c)\).
In addition, the drift term \(\nu {\mathcal {D}}(x)\) introduced by Katzenberger (1991) will presumably be zero when the system is in standard form.
References
Barik D, Paul MR, Baumann WT, Cao Y, Tyson JJ (2008) Stochastic simulation of enzyme-catalyzed reactions with disparate timescales. Biophys J 95:3563–3574
Berglund N, Gentz B (2006) Noise-induced phenomena in slow-fast dynamical systems. Springer-Verlag, London Ltd, London
Eilertsen J, Schnell S (2020) The quasi-steady-state approximations revisited: Timescales, small parameters, singularities, and normal forms in enzyme kinetics. Math Biosci 325:108339
Eilertsen J, Stroberg W, Schnell S (2019) Characteristic, completion or matching timescales? An analysis of temporary boundaries in enzyme kinetics. J Theor Biol 481:28–43
Eilertsen J, Roussel M, Schnell S, Walcher S (2021) On the quasi-steady-state approximation in an open Michaelis-Menten reaction mechanism. AIMS Math 6:6781–6814
Fenichel N (1971) Persistence and smoothness of invariant manifolds for flows. Indiana Univ Math J 21:193–226
Fenichel N (1979) Geometric singular perturbation theory for ordinary differential equations. J Differ Equ 31:53–98
Gillespie DT (1992) A rigorous derivation of the chemical master equation. Physica A 188:404–425
Goeke A (2013) Reduktion und asymptotische reduktion von reaktionsgleichungen, Doctoral Dissertation, RWTH Aachen
Goeke A, Walcher S (2014) A constructive approach to quasi-steady state reductions. J Math Chem 52:2596–2626
Goeke A, Schilli C, Walcher S, Zerz E (2012) Computing quasi-steady state reductions. J Math Chem 50:1495–1513
Goeke A, Walcher S, Zerz E (2015) Determining “small parameters’’ for quasi-steady state. J Differ Equ 259:1149–1180
Goeke A, Walcher S, Zerz E (2015) Determining “small parameters’’ for quasi-steady state. J Differ Equ 259:1149–1180
Goeke A, Walcher S, Zerz E (2017) Classical quasi-steady state reduction - A mathematical characterization. Physica D 345:11–26
Heineken FG, Tsuchiya HM, Aris R (1967) On the mathematical status of the pseudo-steady hypothesis of biochemical kinetics. Math Biosci 1:95–113
Herath N, Del Vecchio D (2018) Reduced linear noise approximation for biochemical reaction networks with time-scale separation: The stochastic tQSSA\(^+\). J Chem Phys 148:094108
Kampen NV, Chapter V (2007) The Master Equation, in: Stochastic Processes in Physics and Chemistry (3rd Edition), North-Holland Personal Library, Elsevier, Amsterdam, pp. 96–133
Kan X, Lee CH, Othmer HG (2016) A multi-time-scale analysis of chemical reaction networks: II. Stochastic systems. J Math Biol 73:1081–1129
Kang H-W, Kurtz TG (2013) Separation of time-scales and model reduction for stochastic reaction networks. Ann Appl Probab 23:529–583
Kang H-W, KhudaBukhsh WR, Koeppl H, Rempala G (2019) Quasi-steady-state approximations derived from the stochastic model of enzyme kinetics. Bull Math Biol 81:1303–1336
Katzenberger GS (1991) Solutions of a stochastic differential equation forced onto a manifold by a large drift. Ann Probab 19:1587–1628
Kim JK, Tyson JJ (2020) Misuse of the michaelis-menten rate law for protein interaction networks and its remedy. PLoS Comp Biol 16:1–21
Kim J, Josiá K, Bennett M (2014) The validity of quasi-steady-state approximations in discrete stochastic simulations. Biophys J 107:783–793
Kim JK, Josić K, Bennett MR (2015) The relationship between stochastic and deterministic quasi-steady state approximations. BMC Syst Biol 9:87
Kim JK, Rempala GA, Kang H-W (2017) Reduction for stochastic biochemical reaction networks with multiscale conservations. Multiscale Model Simul 15:1376–1403
Krupa M, Szmolyan P (2001) Extending slow manifolds near transcritical and pitchfork singularities. Nonlinearity 14:1473–1491
MacNamara S, Bersani AM, Burrage K, Sidje RB (2008) Stochastic chemical kinetics and the total quasi-steady-state assumption: Application to the stochastic simulation algorithm and chemical master equation. J Chem Phys 129:095105
Mastny EA, Haseltine EL, Rawlings JB (2007) Two classes of quasi-steady-state model reductions for stochastic kinetics. J Chem Phys 127:094106
Noethen L, Walcher S (2011) Tikhonov’s theorem and quasi-steady state. Discrete Contin Dyn Syst Ser B 16:945–961
Pahlajani CD, Atzberger PJ, Khammash M (2011) Stochastic reduction method for biological chemical kinetics using time-scale separation. J Theo Biol 272:96–112
Parsons TL, Rogers T (2017) Dimension reduction for stochastic dynamical systems forced onto a manifold by large drift: A constructive approach with examples from theoretical biology. J Phys A 50:415601
Sanft K, Gillespie DT, Petzold LR (2011) The legitimacy of the stochastic Michaelis-Menten approximation. IET Syst Biol 5:58–69
Schnell S, Maini PK (2000) Enzyme kinetics at high enzyme concentration. Bull Math Biol 62:483–499
Segel LA (1988) On the validity of the steady state assumption of enzyme kinetics. Bull Math Biol 50:579–593
Segel LA, Slemrod M (1989) The quasi-steady-state assumption: A case study in perturbation. SIAM Rev 31:446–477
Thomas P, Straube AV, Grima R (2011) Communication: Limitations of the stochastic quasi-steady-state approximation in open biochemical reaction networks. J Chem Phys 135:181103
Thomas P, Straube AV, Grima R (2012a) The slow-scale linear noise approximation: an accurate, reduced stochastic description of biochemical networks under timescale separation conditions. BMC Sys Biol 6:39
Thomas P, Grima R, Straube AV (2012b) Rigorous elimination of fast stochastic variables from the linear noise approximation using projection operators. Phys Rev E 86:041110
Tikhonov A (1952) Systems of differential equations containing small parameters in their derivatives. Mat Sb (NS) 31:575–586
Wechselberger M (2020) Geometric Singular Perturbation Theory Beyond the Standard Forms, in Applied dynamical systems: Tutorials and Reviews, Springer Nature, Switzerland
Acknowledgements
We are grateful to Dr. Ramon Grima (University of Edinburgh), for providing critical comments in an early draft of this manuscript. JE was supported by the University of Michigan Postdoctoral Pediatric Endocrinology and Diabetes Training Program “Developmental Origins of Metabolic Disorder” (NIH/NIDDK Grant: T32 DK071212).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Eilertsen, J., Srivastava, K. & Schnell, S. Stochastic enzyme kinetics and the quasi-steady-state reductions: Application of the slow scale linear noise approximation à la Fenichel. J. Math. Biol. 85, 3 (2022). https://doi.org/10.1007/s00285-022-01768-6
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00285-022-01768-6
Keywords
- Singular perturbation
- Stochastic process
- Quasi-steady-state approximation
- Michaelis–Menten reaction mechanism
- Langevin equation
- Linear noise approximation
- Slow scale linear noise approximation