Abstract
Parameter estimation is a critical problem in the wide applications of uncertain differential equations. The method of moments is employed for the first time as an approach for estimating the parameters in uncertain differential equations. Based on the difference form of an uncertain differential equation, a function of the parameters is proved to follow a standard normal uncertainty distribution. Setting the empirical moments of the functions of the parameters and the observed data equal to the moments of the standard normal uncertainty distribution, a system of equations about the parameters is obtained whose solutions are the estimates of the parameters. Analytic examples and numerical examples are given to illustrate the proposed method of moments.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
The stochastic differential equations have been widely applied to modeling time evolution of dynamic systems which are influenced by random noises. The coefficients of these models sometimes contain parameters whose values are to be estimated based on some observed data of the systems. So far, many useful methods have been proposed for the task of parameter estimation in stochastic differential equations, which mainly could be divided into two categories, namely likelihood-based methods (Taraskin 1974; Kutoyant 1978) and methods of moments (Chan et al. 1992). Interested readers may consult Bishwal (2008).
With the Wiener processes describing the white noises, the stochastic differential equations may fail to model many time-varying systems. For example, two paradoxes were pointed out by Liu (2013) when modeling stock prices with stochastic differential equations. Hence, alternative approaches are required to describe the dynamic systems with noises. Within the framework of uncertainty theory which was founded by Liu (2007) and perfected by Liu (2009) based on the normality, duality, subadditivity and product axioms, Liu process was designed as a counterpart of Wiener process. The uncertain differential equations, which aim to model the dynamic systems with human uncertainty, are a type of differential equations driven by Liu processes. Chen and Liu (2010) showed an uncertain differential equation has a unique solution if its coefficients satisfy the linear growth condition and the Lipschitz condition, and Yao et al. (2013) showed the solution is stable in measure if the coefficients satisfy the strong Lipschitz condition. The numerical methods for solving uncertain differential equations were first designed by Yao and Chen (2013) and later extended by Yang and Ralescu (2015), Wang et al. (2015), Gao (2016), Zhang et al. (2017), etc.
The uncertain differential equations have been widely applied to the financial markets. For example, Liu (2009) assumed the short-term stock price follows the exponential Liu process, and calculated the prices of European options, and Chen (2011) calculated the prices of American options. Chen and Gao (2013) described the interest rate in the ideal market with an uncertain differential equation, and calculated the price of a zero-coupon bond. These works were later extended by other researchers such as Jiao and Yao (2015), Zhang et al. (2016), Ji and Zhou (2015), etc. In addition, the uncertain differential equations have also found many applications in optimal control (Zhu 2019), differential game (Yang and Gao 2016), population model (Sheng et al. 2017), epidemic model (Li et al. 2017), and so on.
With so many applications of uncertain differential equations, how to estimate their coefficients based on the observations is a core problem in practice. In this paper, we undertake the issue by applying the method of moments to the difference forms of the uncertain differential equations. The rest of this paper is organized as follows. In the next section, we introduce some basic concepts and theorems about uncertain variables and uncertain differential equations. Then in Sect. 3, we introduce the method of moments for the parameter estimation problems in uncertain differential equations, and give some analytic examples to illustrate the method. After that, we give some numerical examples in Sect. 4. Finally, some remarks are made in Sect. 5.
2 Preliminary
In this section, we introduce some basic concepts and formulas about uncertain variables and uncertain differential equations.
Definition 2.1
(Liu 2007, 2009) Let \(\mathcal {L}\) be a \(\sigma \)-algebra on a nonempty set \(\Gamma .\) A set function \(\mathcal {M}:\)\(\mathcal {L}\rightarrow [0,1]\) is called an uncertain measure if it satisfies the following axioms:
Axiom 1 (Normality Axiom) \(\mathcal {M}\{\Gamma \}=1\) for the universal set \(\Gamma .\)
Axiom 2 (Duality Axiom) \(\mathcal {M}\{\Lambda \}+\mathcal {M}\{\Lambda ^c\}=1\) for any event \(\Lambda \).
Axiom 3 (Subadditivity Axiom) For every countable sequence of events \(\Lambda _1,\Lambda _2,\cdots ,\) we have
$$\begin{aligned} \mathcal {M}\left\{ \bigcup _{i=1}^{\infty }\Lambda _i\right\} \le \sum _{i=1}^{\infty } \mathcal {M}\left\{ \Lambda _i\right\} . \end{aligned}$$Axiom 4 (Product Axiom) Let \((\Gamma _k,\mathcal {L}_k,\mathcal {M}_k)\) be uncertainty spaces for \(k=1,2,\cdots \) Then the product uncertain measure \(\mathcal {M}\) is an uncertain measure satisfying
$$\begin{aligned} \mathcal {M}\left\{ \prod _{k=1}^{\infty }\Lambda _k\right\} =\min _{k\ge 1}\mathcal {M}_k\{\Lambda _k\} \end{aligned}$$where \(\Lambda _k\) are arbitrarily chosen events from \(\mathcal {L}_k\) for \(k=1,2,\cdots \), respectively.
An uncertain variable \(\xi \) is a measurable function from the uncertainty space \((\Gamma , \mathcal {L}, \mathcal {M})\) to the set of real numbers. The uncertain variables \(\xi _1,\xi _2,\ldots ,\xi _n\) are said to be independent if
for any Borel sets \(B_1,B_2,\ldots ,B_n\) of real numbers.
Definition 2.2
(Liu 2007) Let \(\xi \) be an uncertain variable. Then its uncertainty distribution is defined by
for any real number x.
An uncertain variable \(\xi \) is called normal if it has an uncertainty distribution
denoted by \(\mathcal {N}(\mu ,\sigma )\). If \(\mu =0\) and \(\sigma =1\), then \(\xi \) is called a standard normal uncertain variable. The inverse uncertainty distribution of a standard normal uncertain variable is
Definition 2.3
(Liu 2007) Let \(\xi \) be an uncertain variable, and k be a positive integer. Then the k-th moment of \(\xi \) is defined by
provided that at least one of the two integrals is finite.
Liu (2015) proved that if \(\xi \) has an inverse uncertainty distribution \(\Phi ^{-1}(\alpha )\), then
Hence, for a standard normal uncertain variable \(\xi \sim \mathcal {N}(0,1),\) we have
Specially, we have \(E[\xi ^k]=0\) for any positive odd number k, and
An uncertain process is a sequence of uncertain variables indexed by the time. As an uncertain counterpart of Wiener process, Liu process is one of the most frequently used uncertain processes.
Definition 2.4
(Liu 2009) An uncertain process \(C_t\) is called a Liu process if
- (i)
\(C_0=0\) and almost all sample paths are Lipschitz continuous,
- (ii)
\(C_t\) has stationary and independent increments,
- (iii)
the increment \(C_{s+t}-C_s\) has a normal uncertainty distribution
$$\begin{aligned} \Phi _t(x)= \left( 1+\mathrm{exp}\left( -\frac{\pi x}{\sqrt{3}t}\right) \right) ^{-1},\quad x\in \mathfrak {R}. \end{aligned}$$
Let \(X_t\) be an uncertain process. Then the uncertain integral of \(X_t\) with respect to the Liu process \(C_t\) is
provided that the limit exists almost surely and is finite for any partition of closed interval [a, b] with \(a=t_1<t_2<\cdots <t_{k+1}=b\) and
Definition 2.5
(Liu 2008) Suppose that \(C_t\) is a Liu process, and f and g are two measurable real functions. Then
is called an uncertain differential equation.
An uncertain process \(X_t\) is called the solution of the uncertain differential equation (1) if it satisfies
A real-valued function \(X_t^{\alpha }\) is called the \(\alpha \)-path of the uncertain differential equation (1) if it solves the corresponding ordinary differential equation
where
is the inverse uncertainty distribution of a standard normal uncertain variable. For example, the uncertain differential equation
has a solution
and an \(\alpha \)-path
3 Parameter estimation
Consider an uncertain differential equation
where \({{\varvec{\mu }}}\) and \({{\varvec{\sigma }}}\) are unknown parameters to be estimated. Note that the Eq. (2) has a difference form
which can be rewritten as
According to Definition 2.4 of Liu process, the right term
is a standard normal uncertain variable with expected value 0 and variance 1, which has an uncertainty distribution
Hence, the estimates of the parameters \({{\varvec{\mu }}}\) and/or \({{\varvec{\sigma }}}\) are supposed to follow the standard normal uncertainty distribution, i.e.,
Assume that there are n observations \(x_{t_1}, x_{t_2},\cdots ,x_{t_n}\) of the solution \(X_t\) at the times \(t_1,t_2,\cdots ,t_n\) with \(t_1<t_2<\cdots <t_n\), respectively. Substituting \(X_{t_i}\) and \(X_{t_{i+1}}\) with the observations \(x_{t_i}\) and \(x_{t_{i+1}}\) in the Eq. (3), we write
which are real functions of the parameters \({{\varvec{\mu }}}\) and \({{\varvec{\sigma }}}\). For the estimates of \({{\varvec{\mu }}}\) and \({{\varvec{\sigma }}}\), denoted by \({{\varvec{\mu }}}^*\) and \({{\varvec{\sigma }}}^*\), it follows from the Eq. (3) that the values of these functions \(h_1({{\varvec{\mu }}}^*,{{\varvec{\sigma }}}^*),h_2({{\varvec{\mu }}}^*,{{\varvec{\sigma }}}^*),\cdots ,h_{n-1}({{\varvec{\mu }}}^*,{{\varvec{\sigma }}}^*)\) can be regarded as \(n-1\) samples of a standard normal uncertainty distribution \(\mathcal {N}(0,1)\). The sample moments would provide good estimates of the corresponding population moments. Note that the k-th sample moments are
and the k-th population moments are
Hence, we set
where K is the number of unknown parameters. The solutions \({{\varvec{\mu }}}^*\) and \({{\varvec{\sigma }}}^*\) of the system (4) of equations are the estimates of the parameters \({{\varvec{\mu }}}\) and \({{\varvec{\sigma }}}\), respectively. The above method to estimate the parameters in uncertain differential equations is called the method of moments.
Example 1
Consider the uncertain differential equation
with two parameters \(\mu \) and \(\sigma >0\) to be estimated. Assume we have n observations \(x_{t_1}, x_{t_2},\cdots ,x_{t_n}\) of the solution \(X_t\) at the times \(t_1,t_2,\cdots ,t_n\) with \(t_1<t_2<\cdots <t_n\), respectively. Then
for \(i=1,2,\ldots ,n-1\), and the system (4) of equations becomes
Solving the above system of equations, we have
which are the estimates of \(\mu \) and \(\sigma \) in the Eq. (5).
Example 2
Consider the uncertain differential equation
with two parameters \(\mu \) and \(\sigma >0\) to be estimated. Assume we have n observations \(x_{t_1}, x_{t_2},\ldots ,x_{t_n}\) of the solution \(X_t\) at the times \(t_1,t_2,\ldots ,t_n\) with \(t_1<t_2<\cdots <t_n\), respectively. Then
for \(i=1,2,\cdots ,n-1\), and the system (4) of equations becomes
Solving the above system of equations, we have
which are the estimates of \(\mu \) and \(\sigma \) in the Eq. (6).
4 Numerical examples
In this section, we give two numerical examples to illustrate the method of moments in estimating the parameters in uncertain differential equations.
Example 3
Consider the uncertain differential equation
with three parameters \(\mu _1,\mu _2\) and \(\sigma >0\) to be estimated. Assume that we have 15 groups of observed data as shown in Table 1. According to the system (4) of equations, the estimates \(\mu _1^*,\mu _2^*\) and \(\sigma ^*\) solve the following system of equations
which are
Hence, the uncertain differential equation is
As shown in Fig. 1, all the observed data fall in the area between the 0.17-path and the 0.93-path of the uncertain differential equation (7), so the estimates
are acceptable.
Example 4
Consider the uncertain differential equation
with three parameters \(\mu _1,\mu _2\) and \(\sigma >0\) to be estimated. Assume that we have 12 groups of observed data as shown in Table 2.
According to the system (4) of equations, the estimates \(\mu _1^*,\mu _2^*\) and \(\sigma ^*\) solve the following system of equations
which are
Hence, the uncertain differential equation is
As shown in Fig. 2, all the observed data fall in the area between the 0.25-path and the 0.81-path of the uncertain differential equation (8), so the estimates
are acceptable.
5 Conclusion
The method of moments was employed in this paper to estimate the parameters in uncertain differential equations based on some observations. As an approximation of the uncertain differential equation, a difference equation was obtained and transformed to a special expression in order to derive a system of the equations about the parameters. By solving the system of the equations, the estimates of the parameters could be found. Some analytic examples as well as numerical examples were given to illustrate the method of moments in uncertain differential equations. Future researches may consider the hypothesis test and interval estimation of the parameters in uncertain differential equations.
References
Bishwal, J. P. (2008). Parameter Estimation in Stochastic Differential Equations. Berlin: Springer.
Chan, K. C., Karolyi, G. A., Longstaff, F. A., & Sanders, A. B. (1992). An empirical comparison of alternative models of the short-term interest rate. Journal of Finance, 47(3), 1209–1227.
Chen, X. (2011). American option pricing formula for uncertain financial market. International Journal of Operations Research, 8(2), 32–37.
Chen, X., & Gao, J. (2013). Uncertain term structure model of interest rate. Soft Computing, 17(4), 597–604.
Chen, X., & Liu, B. (2010). Existence and uniqueness theorem for uncertain differential equations. Fuzzy Optimization and Decision Making, 9(1), 69–81.
Gao, R. (2016). Milne method for solving uncertain differential equations. Applied Mathematics and Computation, 274, 774–785.
Ji, X., & Zhou, J. (2015). Option pricing for an uncertain stock model with jumps. Soft Computing, 19(11), 3323–3329.
Jiao, D., & Yao, K. (2015). An interest rate model in uncertain environment. Soft Computing, 19(3), 775–780.
Li, Z., Sheng, Y., Teng, Z., & Miao, H. (2017). An uncertain differential equation for SIS epidemic model. Journal of Intelligent and Fuzzy Systems, 33(4), 2317–2327.
Liu, B. (2007). Uncertainty Theory (2nd ed.). Berlin: Springer.
Liu, B. (2008). Fuzzy process, hybrid process and uncertain process. Journal of Uncertain systems, 2(1), 3–16.
Liu, B. (2009). Some research problems in uncertainty theory. Journal of Uncertain Systems, 3(1), 3–10.
Liu, B. (2013). Toward uncertain finance theory. Journal of Uncertainty Analysis and Applications, 1, Article 1.
Liu, B. (2015). Uncertainty Theory (4th ed.). Berlin: Springer.
Kutoyant, Y. A. (1978). Estimation of the trend parameter of a diffusion process in the smooth case. Theory of Probability and Its Applications, 22(2), 399–405.
Sheng, Y., Gao, R., & Zhang, Z. (2017). Uncertain population model with age-structure. Journal of Intelligent and Fuzzy Systems, 33(2), 853–858.
Taraskin, A. (1974). On the asymptotic normality of vectorvalued stochastic integrals and estimates of drift parameters of a multidimensional diffusion process. Theory of Probability and Mathematical Statistics, 2, 209–224.
Wang, X., Ning, Y., Moughal, T. A., & Chen, X. (2015). Adams-Simpson method for solving uncertain differential equation. Applied Mathematics and Computation, 271, 209–219.
Yang, X., & Ralescu, D. A. (2015). Adams method for solving uncertain differential equations. Applied Mathematics and Computation, 270, 993–1003.
Yang, X., & Gao, J. (2016). Linear-quadratic uncertain differential game with application to resource extraction problem. IEEE Transactions on Fuzzy Systems, 24(4), 819–826.
Yao, K., Gao, J., & Gao, Y. (2013). Some stability theorems of uncertain differential equation. Fuzzy Optimization and Decision Making, 12(1), 3–13.
Yao, K., & Chen, X. (2013). A numerical method for solving uncertain differential equations. Journal of Intelligent and Fuzzy Systems, 25(3), 825–832.
Zhang, Y., Gao, J., & Huang, Z. (2017). Hamming method for solving uncertain differential equations. Applied Mathematics and Computation, 313, 331–341.
Zhang, Z., Ralescu, D. A., & Liu, W. (2016). Valuation of interest rate ceiling and floor in uncertain financial market. Fuzzy Optimization and Decision Making, 15(2), 139–154.
Zhu, Y. (2019). Uncertain Optimal Control. Singapore: Springer.
Acknowledgements
This work was supported by National Natural Science Foundation of China (Grant No. 61873329), and the University of Chinese Academy of Sciences.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yao, K., Liu, B. Parameter estimation in uncertain differential equations. Fuzzy Optim Decis Making 19, 1–12 (2020). https://doi.org/10.1007/s10700-019-09310-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10700-019-09310-y