Abstract
Efficiency is greatly concerned in reliability analysis community, especially for the problems with high-dimensional input random variables, because the computation cost of common reliability analysis methods may increase sharply with respect to the dimension of the problem. This paper proposes a novel meta-model based on the concepts of polynomial chaos expansion (PCE), dimension-reduction method (DRM), and information-theoretic entropy. Firstly, a PCE method based on DRM is developed to approximate the original function by a series of PCEs of univariate components. Compared with the PCE of the original function, the DRM-based PCE can reduce the computational cost. Before constructing the meta-model, a prior of the degree of the PCE is required, which determines the accuracy and efficiency of the PCE. However, the prior is usually determined by experience. According to the maximum entropy principle, this paper proposes an adaptive method for the selection of the polynomial chaos basis efficiently. With the adaptive PCE method based on DRM, a novel meta-model method is proposed, with which the reliability analysis can be achieved by Monte Carlo simulation efficiently. In order to verify the performance of the proposed method, three numerical examples and one structural dynamics engineering example are tested, with good accuracy and efficiency.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Due to the uncertainties frequently involved in industrial application, such as uncertainties of material, loads, and geometry, it has been well recognized that the assessment of structural safety based on probabilistic theory plays an important role in practical engineering (Du and Chen 2004; Youn et al. 2005). One of the common ways to assess structural safety is reliability analysis, which is usually modeled by the following mathematical formulation:
where Pf is the failure probability, Pr(•) is the probability of an event, gt is the threshold for the definition of failure, x is the vector of input variables with the joint probability density function (PDF) of f(x), and g(x) is the interested response of input variables with the PDF of p(g).
Based on Eq. (1), extensive methods have been developed to achieve the structural reliability analysis with good efficiency and/or accuracy, including the sampling-based methods (Xu and Kong 2018a; Xi et al. 2014; Engelund and Rackwitz 1993), MPP-based methods (Du and Chen 2001; Meng et al. 2018), moment-based methods (Du and Sudjianto 2004; Liu et al. 2018; Wu et al. 2020; Xu et al. 2017; Xi et al. 2012; Zhang and Han 2020), and surrogate-based methods (Zhang et al. 2015; Zhang et al. 2017; Xiong et al. 2007; Zhu and Du 2016). In general, sampling-based methods are accurate and robust; therefore, many advanced sampling-based methods have been proposed recently, such as line sampling method (Lu et al. 2008), importance sampling method (Dai et al. 2015a, 2015b), and stratified sampling method (Shields et al. 2015). However, the deficiency on efficiency still limits the application of sampling-based methods (Xu and Kong 2018). Although MPP-based methods usually have good efficiency and are widely used in reliability-based design optimization and some nonprobability reliability analysis problems (Meng and Keshtegar 2019; Meng et al. 2020b), they are not accurate enough for highly nonlinear problems. Moment-based methods can achieve the trade-off between accuracy and efficiency, but they may be confronted with the problem of numerical stability (Youn et al. 2008; Huang and Du 2006; He et al. 2019b). The basic idea of surrogate-based methods is to construct a numerical black box or an analytical model to substitute the real physical model. Then, the Monte Carlo simulation (MCS) method can be performed by the meta-model efficiently. Because the surrogate-based methods reduce the computational burden greatly with satisfactory accuracy, a large number of advanced meta-models have been proposed in the recent decades, such as neural network method (Dai et al. 2015), kriging method (Meng et al. 2020a; Zhang et al. 2019; Zhang et al. 2020) and polynomial chaos expansion (PCE) method (Wang et al. 2018; Xu and Kong 2018b; Guo et al. 2018; Zhou et al. 2019). Among these methods, the PCE method has received increasing attention, which is regarded as probably the most widely used meta-model for propagating uncertainties (Abraham et al. 2017).
The main idea of PCE is to represent a random variable, e.g., structural stochastic response, by a series of polynomial chaos basis (Soize and Ghanem 2004). It should be noted that the term chaos in PCE, which is coined by Wiener for handling Gaussian random process (Wiener 1938), is different from the concept of chaos in dynamic systems. According to Wiener’s idea, Ghanem and Spanos (1991) started the study on Wiener-Hermite polynomial chaos for stochastic finite element. In order to overcome the difficulties of Hermite polynomial chaos in non-normal problems, Xiu and Karniadakis (2002a, 2002b, 2003) proposed the generalized polynomial chaos, which generates the orthogonal basis based on the probability distribution of the input random variable. On the basis of the well-chosen orthogonal basis, a recursive procedure can be used to derive the PCE for fitting the stochastic responses of mechanical systems.
To obtain the PCE meta-model, it is required to calculate the regression coefficients of the PCE accurately. The common non-intrusive methods for the calculation can be grouped into two categories: least squares approximation (LSA) method (Hadigol and Doostan 2018; Berveiller et al. 2006) and projection method (Marelli and Sudret 2015). The LSA method is a classical method for regression analysis and frequently used in PCE. Many researches have been done to enhance efficiency and convergence of LSA method (Hampton and Doostan 2015; Narayan et al. 2017). The projection method calculates the coefficients with the aid of the orthonormality of the polynomial basis. Thus, the calculation of the coefficients is reduced to a numerical integration problem. Some algorithms have been developed to calculate the numerical integration efficiently and accurately, such as Gaussian quadrature method and Smolyak’ sparse quadrature method (Gerstner and Griebel 1998). However, the applications of both LSA method and projection method are limited by the dimension of the space of original input random variables, because the difficulty of the curse of dimension always poses a great challenge in multiple- and high-dimensional problems. To overcome the tricky problem, many sparse PCE methods have been proposed, which neglect the unimportant PCE terms to reduce the number of PCE coefficients. Typically, Blatman and Sudret (Blatman and Sudret 2011) proposed an adaptive sparse PCE based on least angle regression. Cheng and Lu (2018a) proposed a sparse PCE method based on D-MORPH regression. Xu and Wang (2019) proposed a sparse PCE for efficient structural reliability analysis based on Voronoi cells. Cheng and Lu (2018b) proposed an adaptive sparse PCE for global sensitivity analysis based on support vector regression. These sparse strategies have been proven to be effective in terms of the reduction of computational cost. In addition to the sparse strategies, dimension-reduction method (DRM) is also an effective way to deal with multiple- and high-dimensional problems, but DRM receives much less attention than the sparse strategies in the researches of PCE.
Dimension-reduction method (DRM) is usually used to approximate arbitrary multivariate function by a series of lower order components. In reliability analysis community, Rahman and Xu (2004) firstly proposed a univariate DRM (UDRM) for the calculation of statistical moments of structural responses. Due to the high efficiency of UDRM, it is widely used in structural reliability analysis and reliability-based design optimization. Acar et al. (2010) employed the combination of the UDRM and the extended generalized lambda distribution for reliability analysis. Youn and Xi (2009) proposed an eigenvector dimension-reduction method for reliability-based robust design optimization. In order to calculate the fractional moments of structural responses, Zhang and Pandey (2019) proposed the multiplicative UDRM (MUDRM). Based on MUDRM and Laplace transformation, Li et al. (2019) proposed an improved fractional moment-based maximum entropy method for reliability analysis. Although widespread efforts have been made, the work about the combination of DRM and PCE is few. One of the typical representatives in this field is provided by Zhang (2013), which coupled MUDRM with PCE to calculate the PCE coefficients by projection method efficiently. In this paper, the problem of curse of dimension in PCE is solved from another angle based on the DRM and entropy.
The contribution of this paper is twofold. Firstly, different from the work of Zhang, this paper reduces a multiple- or high-dimensional function to multiple one-dimensional functions, and then fits each univariate function by PCE. Secondly, an adaptive method is proposed to select the PCE basis based on the concept of the information-theoretic entropy. Compared with the common sparse strategies, the proposed adaptive method can construct the PCE adaptively and assess the convergence of the model, without specifying the prior of the order of the PCE and resampling for the verification of the PCE model. Organization of this paper is as follows. In Sect. 2, the fundamental theory of PCE is presented. Section 3 provides the details of DRM. Section 4 first proposes an adaptive method for selecting the polynomial chaos basis based on the concept of the information-theoretic entropy and then develops a novel surrogate-based reliability analysis method with the combination of PCE and DRM. In Sect. 5, the performance of the proposed meta-model is illustrated by three numerical examples and one engineering example. Finally, some conclusions are summarized in Sect. 6.
2 The fundamental theory of polynomial chaos expansion
2.1 The concept of polynomial chaos basis
In theory, a random variable V can be represented by a sum of polynomial chaos basis as follows (Karagiannis and Lin 2014):
where ci are the PCE coefficients, ζ is random variable with the PDF of f(ζ), and ϕi are one-dimensional polynomial chaos basis with the following orthogonality (Blatman and Sudret 2010):
where for arbitrary f(ζ), ϕi can be derived by Stieltjes procedure (Wan and Karniadakis 2006) with the following recurrence relation:
where αn and βn are given by the Christoffel-Darboux formulae as follows:
With Eqs. (4) and (5), the polynomial chaos basis can be derived for the random variable with arbitrary PDF. Herein, five classical PCEs are listed in Table 1. If V does not follow the distributions listed in Table 1, Nataf transformation can be employed to transform arbitrary random variable into the five classical ones. However, Nataf transformation can be highly nonlinear; therefore, it can lead to a significantly detrimental effect on the accuracy and/or convergence of the final truncated PCE. Therefore, Stieltjes procedure is recommended to construct the PCE for the non-classical cases.
2.2 The truncation form of multivariate polynomial chaos expansion
By partial tensorization of the one-dimensional polynomial chaos basis, a multivariable function Y(x) with mutually independent random variables can be approximated by a truncation expression of M-dimensional PCE as follows (Cheng et al. 2019):
where Φi are multivariable PCE basis expressed as
where M is the dimension of multi-dimensional random vectors, x = [x1, x2, …, xM] and ζ = [ζ1, ζ2, …, ζM], and ij compose the following multi-indices set:
whose cardinality can be calculated by (Shao et al. 2017)
where p is the degree of the PCE.
2.3 The calculation of the polynomial chaos expansion coefficients
Two methods are usually used for the calculation of PCE coefficients, namely, projection method (Palar et al. 2016) and least squares approximation (LSA) method (Blatman and Sudret 2010). Because the projection method is not involved in this study, only the LSA method is presented herein.
The LSA method estimates the PCE coefficients by minimizing the residue errors between PCE and the real physical model at a set of experiment designs. Thus, the following optimization formulation can be used to calculate the coefficients (Blatman and Sudret 2010):
with the solution as
where c = [c1, c2, …, cP-1], Y = [Y1, Y2, …, Ym] is the response vector of real physical model at m experiment designs, and Φ is defined as
According to Eq. (9), the dimension of c increases steeply with respect to the dimension of the input random variables and the degree of PCE. Therefore, the computational cost of experiment designs is intolerable for high-dimensional problems.
It can be seen that the LSA method is confront with the problem caused by the dimension of the input random variables when calculating the PCE coefficients. Extensive efforts have been made to solve the problem, such as the popular sparse PCE methods. In this paper, the problem is solved from another angle, say dimension-reduction method.
3 Dimension-reduction method
The main idea of dimension-reduction method (DRM) is to approximate arbitrary multivariate function Y(x) by a sum of functions of lower order in an increasing hierarchy as
where μ = (μ1, μ2, ..., μM) is the vector of reference point. For a sufficiently smooth function, the higher-order components can be neglected compared with the univariate components (Zhang and Pandey 2013). Therefore, Eq. (13) can be reduced into UDRM as follows (He et al. 2019a):
where μ-(•) presents the vector of reference point without the element “•.”
For the estimation of fractional statistical moments, Zhang and Pandey (2013) proposed the multiplicative UDRM to approximate multivariate functions. The method is performed as follows:
-
Step 1:
Transform Y(x) into the logarithmic form:
-
Step 2:
Approximate T(x) by UDRM,
-
Step 3:
Perform exponential transformation on Eq. (16),
Thus, the approximation of Y(x) can be obtained by the multiplication of the univariate components. In order to avoid confusion, we name Eq. (14) as SUDRM and Eq. (17) as MUDRM and take UDRM as a general term for SUDRM and MUDRM.
4 The proposed meta-model based on polynomial chaos expansion, univariate dimension-reduction method, and entropy
In this paper, the UDRM is used to solve the problem of curse of dimension in PCE. Instead of fitting the original multivariate function, we approximate the univariate components by PCE, namely:
Then, the original multivariate function can be recovered by the PCEs based on SUDRM and MUDRM. Generally speaking, it is easier and more efficient to fit a univariate function than a multivariate one. Therefore, the PCE based on UDRM needs less computational cost compared with the PCE of original function. If Ni samples are used to construct PCE of the ith univariate component, the total function evaluations will be
4.1 An adaptive method for the selection of polynomial chaos basis
Before the calculation of the coefficients, the degree of PCE, p, should be determined. Without the prior of complexity of the univariate function, a large p should be given for a good approximation. However, when the LSA method is used to calculate the PCE coefficients, a larger p means that more coefficients need to be calculated, that is, more experiment designs are required. Therefore, to enhance the efficiency of the meta-model, an adaptive method based on the concept of information-theoretic entropy is proposed to select the polynomial chaos basis without specifying a prior of p.
4.1.1 The concept of information-theoretic entropy
Shannon (1948) first proposed the concept of information-theoretic entropy as follows:
where h is a constant with positive support and pi are the probability mass function of a discrete random variable. The information-theoretic entropy is usually used to measure the uncertainty of a probabilistic system and widely applied in the fields of mechanic, signal process and statistical inference. On the basis of Eq. (20), Jaynes (1957) proposed the maximum entropy principle (MEP): out of all candidate distributions, one should choose the distribution that maximizes H. If no other information is available in addition to the axiom of unit measure, the distribution is p1 = p2 = … = pd = 1/d according to MEP, which means that one can only give the most unbiased estimation for maximizing the uncertainty of the system. When some information of pi, such as the response of real physical model at the experimental designs, is available, the formulation of MEP is expressed as
where gk are arbitrary functions of random vector x and mk is the expectation of gk. It has been proven that H is a convex function with respect to pi, i = 1, 2, …, d. Therefore, the unique maximum of H can be obtained if the stationary point is found.
4.1.2 An adaptive method for the selection of the polynomial chaos basis
PCE consists of the unknown expansion coefficients and the given polynomial chaos basis; therefore, characterizing the uncertainty of the response (the PDF of the response) is equivalent to evaluating the PCE coefficients (Cheng et al. 2019), that is, the PCE coefficients determine the probabilistic information of the predicted response to some extent. From Eq. (2), it can be concluded that the PCE converges to the interested random variable when p is large enough, namely, p ≥ t. As we know, different values of p correspond to different expansion coefficients. Before the PCE converges, these different expansion coefficients result in different probabilistic information of the predicted response. While after the PCE converges, these coefficients provide the same probabilistic information of the predicted response because the convergent PCEs represent the information of real response. If the information-theoretic entropy is used to characterize the probabilistic information of the prediction response, it can be concluded that the entropy changes obviously with respect to p before the PCE converges but almost keeps constant after convergence. In this section, an adaptive method is proposed for selecting the polynomial chaos basis for the univariate components using the entropy as the convergence criterion, without a prior of the degree of PCE. Thus, we can obtain t and select the polynomial chaos basis for the univariate components adaptively.
Firstly, assume p as a small integer, such as p = 1, for constructing the PCE of the univariate component. The expansion coefficients, c, can be calculated by projection method or LSA method. Then, the realizations of the univariate component estimated by the PCE can be obtained by the samples of ζ; therefore, the entropy can be calculated via Eq. (20), noted as H1. Secondly, assume p = 2, then H2 can be obtained. Similarly, perform the procedure step by step until the differences of the entropy of successive three p, p = t − 1, p = t, and p = t + 1, are smaller than ξ, namely,
from which it can be concluded that the PCE converges the real model when p ≥ t.
It should be pointed out that when Eq. (22) holds, the stationary point of H(p1, p2, …, pd) is then found and Hmax = Ht can be obtained according to the property of convex function. It means that after the PCE converges, the final result that we obtained in all possible candidates maximizes the entropy. Correspondingly, univariate component can be approximated by the following truncated PCE:
Thus, the proposed meta-model is finally constructed as follows:
and
from which the structural reliability analysis can be achieved by MCS efficiently. If Y(x) is dominantly additive, e.g., Y = x1 + x2, Eq. (24) (the PCE based on SUDRM) can approximate the original function with good accuracy. If Y(x) is dominantly multiplicative, e.g., Y = x1x2, Eq. (25) (the PCE based on MUDRM) should be employed. This paper selects SUDRM or MUDRM based on the coefficient of determination with the following expression:
where Yi is real response at the ith verification sample point, \( \overline{Y} \) is the mean value of the real responses at all verification sample points, and \( \hat{Y} \)i is the prediction of PCE at the ith verification sample point. The flowchart of the proposed method is shown in Fig. 1.
5 Examples
In this section, three numerical examples and one engineering example are tested to verify the performance of the proposed method. For comparison, four methods, including crude MCS, full PCE, sparse PCE based on the least angle regression, and the proposed method, are used to analyze each example. The PCE coefficients are calculated by the LSA method due to its flexibility of strategy of sample augment. According to Wang et al. (2018), the number of sample points, Ns, for building the PCE models is twice the number of coefficients. The accuracy of each method is assessed by relative error as follows:
where r is the reference solution from crude MCS and re represents the results from other methods. Moreover, according to Marelli and Sudret (2015), the Stieltjes procedure is better than Nataf transformation for the problems with non-classical random variables; therefore, we will employ the Stieltjes procedure for the non-classical cases.
5.1 Example 1: high-dimensional problem with interaction terms
A non-smooth and non-monotonous g-function (Saltelli and Sobol 1995) is first employed to verify the performance of the proposed method for the high-dimensional problem with interaction terms, whose expression is given as:
where ai = 0.5(i − 2) and xi’s independently and identically follow Gumbel distribution with the mean value of 1 and the standard deviation of 0.05. Herein, we set d = 20, and examine the three cases of q = 1, 2, and 3. It can be seen that the effects of the interaction terms as well as the nonlinearity of the function become more significant with the increase of q. Therefore, this function is a challenging test, due to the complex interaction terms and the presence of the absolute value which prevents the spectral convergence of the PCE (Crestaux et al. 2009).
5.1.1 The construction of the proposed meta-model
In the light of the flowchart in Fig. 1, the univariate components of the original function, namely, \( F\left({\boldsymbol{\upmu}}_{\left(-i\right)},{x}_i\right)=\frac{{\left|4{x}_i-2\right|}^q+{a}_i}{1+{a}_i}\prod \limits_{j=1,j\ne i}^d\frac{{\left|4{\mu}_j-2\right|}^q+{a}_j}{1+{a}_j} \), i = 1, 2, … d, are derived. Because the random variables in this example are not the classical cases in Table 1, the Stieltjes procedure is used to construct the polynomial chaos bases. For the three cases of (d = 20, q = 1), (d = 20, q = 2), and (d = 20, q = 3), the convergence histories of the univariate component of X1 are shown in Fig. 2. It can be seen that the proposed adaptive method converges after three, four, and five iterations respectively for three cases with different nonlinear degrees. Such a good convergence property facilitates the efficient reliability analysis, which will be seen in the next subsection. Repeating the similar steps 20 times, the PCEs of all of the univariate components can be obtained. Then, collecting PCEs of the univariate components together in the forms of Eqs. (24) and (25), the proposed meta-model can be derived. To verify the performance of the proposed meta-model, we sample 100 verification points randomly and compare the results of the proposed method with the real model in Figs. 3, 4, and 5, from which it can be concluded that the MUDRM-based meta-model is superior to the SUDRM-based one. According to Eq. (26), the superiority of MUDRM-based meta-model can be quantified by R2 listed in Table 2, from which it can be concluded that the original function is dominantly multiplicative. The results show that the proposed method can provide a good approximation for the high-dimensional problem with interaction terms. Thus, the PCE based on MUDRM will be used in the following reliability analysis.
5.1.2 Reliability analysis
With the aid of the proposed meta-model, the uncertainty of the original function can be quantified. As shown in Figs. 6, 7, and 8, the proposed method can recover the POE (probability of exceedance) curves accurately for the three cases. For comparison, the reliability analysis results from different methods are listed in Table 3. For the case of q = 1, each method can calculate the failure probability accurately, but the proposed method is the most efficient, whose number of function evaluations is less than one tenth of that of full PCE and sparse PCE. For the cases of q = 2 and 3, full PCE and sparse PCE fail to complete the construction of the meta-model because the original function has complex interaction terms and high nonlinearity. By contrast, the proposed method can accurately evaluate the failure probabilities, whose relative errors are 0.29% and 2.00%, respectively. According to the convergence histories, we can also calculate the number of function evaluations, namely, 5 × 2 × 20 = 200 and 6 × 2 × 20 = 240. It is quite efficient that the proposed method can achieve accurate reliability analysis for the complex problem with so low computational cost. Therefore, it can be concluded that the proposed method can predict the failure probability accurately and efficiently for the high-dimensional problem with interaction terms.
5.2 Example 2: high-dimensional and nonlinear case
The second example is a classic high-dimensional case for verifying the performance of reliability analysis method (Xu and Kong 2018). The response function is expressed as
where d is the dimension of the input random variables and Xi follow the independent standard normal distributions. Herein, three cases of d = 50, 100, and 200 are tested with the failure regions of g < 0, g < 0, and g < 1, respectively.
5.2.1 The construction of the proposed meta-model
Similarly, the PCEs of the univariate components are derived firstly. Limited by space, the convergence history of the univariate component of X1 is given for illustration. As shown in Fig. 9, four iterations are enough to obtain the accurate results. For the case of d = 50, repeat the adaptive procedure for the selection of polynomial basis 50 times, and then all the PCEs of univariate components can be obtained step by step. Subsequently, the proposed meta-model can be derived via Eqs. (24) and (25). To verify the performance of the proposed meta-model, 100 verification points are depicted in Fig. 10, from which it can be concluded that the SUDRM-based meta-model is superior to the MUDRM-based one. Furtherly, the performances of the two models are assessed by R2. The R2 of the SUDRM-based meta-model is 1 and the other one is 0.98, that is, the original function is dominantly additive, Therefore, the SUDRM-based meta-model is adopted for reliability analysis. For the cases of d = 100 and 200, the proposed meta-models can be built in the same way. Figures 11 and 12 show that the proposed method is accurate for high-dimensional problem and robust with respect to the dimension of the input random variables.
5.2.2 Reliability analysis
In the reliability analysis of high-dimensional problems, we focus on not only the accuracy but also the efficiency, because the curse of dimension blocks the application of many common methods in high-dimensional problems. For example, if the full PCE with the degree of three is used for the case of d = 50, \( \frac{2\left(3+50\right)!}{3!50!}=46852 \) sample points will be required, which is computationally prohibitive. From Table 4, it can be seen that accurate results can be obtained for the cases of d = 50 and 100 when sparse PCE method is used for the high-dimensional problem. However, sparse PCE fails to achieve the reliability analysis in the case of d = 200, that is, it is still limited by the dimension of the input random variables. Compared with the sparse PCE method, the proposed method can estimate the failure probability accurately with 300, 600, and 1200 function evaluations. Obviously, it is fairly efficient that the proposed method can accurately predict such small failure probabilities, i.e., the order of 10−4–10−6, with so low computational cost. Again, Figs. 13, 14, and 15 show the good performance of the proposed method for high-dimensional problems, especially for capturing the tail of the CDF. Therefore, for high-dimensional problems, the proposed method can be used to predict the failure probability with good accuracy and efficiency.
5.3 influence of nonlinearity on results of high-dimensional case
This example is employed to show the influence of the nonlinearity of the original function on the reliability analysis results. The performance function is given as follows (Sadoughi et al. 2018):
where Xi follows normal distributions with means of 1.5 and standard deviations of 0.3 and the parameter b represents the nonlinearity of Z along X1.
5.3.1 The construction of the proposed meta-model
In order to discuss influence of nonlinearity of the original function, the proposed meta-models in the cases of b = 2, 4, 6, 8, and 10 are tested. Based on the adaptive method for selection of the polynomial basis, the PCEs of the univariate components can be obtained. Limited by length, only the convergence histories of univariate component of X1 are presented, as shown in Fig. 16, from which it can be seen that the iteration history will be prolonged with the increase of the nonlinearity of the original function. It should be noted that for the case of b = 10, 3p = 52 experiment designs are used to fit the univariate component of X1 due to the high nonlinearity. With the PCEs of the univariate components, the final meta-models of the five cases can be obtained. As a representative, the results of b = 10 are shown in Fig. 17, from which the SUDRM-based PCE approximates the original function better than the MUDRM-based one. The R2 of the SUDRM-based PCE and the MUDRM-based PCE are also calculated by the 100 verification points, which are 0.9999 and 0.9882, respectively. Therefore, the SUDRM-based meta-model is used for the subsequent reliability analysis.
5.3.2 Reliability analysis
Table 5 lists the reliability analysis results of different methods. It can be seen that full PCE is not able to complete the reliability analysis of the high-dimensional problem because of unaffordable computational cost. For the case of b = 2, both the sparse PCE and the proposed method can predict the failure probability accurately with the relative errors below 1%. However, the sparse PCE method pays nearly twice computational cost compared with the proposed method. For the cases of b = 4, 6, 8, and 10, sparse PCE method needs to select interested basis from \( \frac{\left(p+40\right)}{p!40!} \) candidates, where the degree of PCE, p, increases with respect to the nonlinearity parameter, b. For example, when b = 4, it is rational to assume p = 5 based on the prior shown in Fig. 16. Thus, the total number of the candidates is 1,221,759. Therefore, the sparse PCE is excessively expensive for the high-dimensional and high-nonlinear cases. The proposed method can provide accurate predictions for the failure probabilities in different cases. It should be noted that the proposed method only employs 320–340 experiment designs to evaluate the failure probabilities with the order of 10−4–10−5; therefore, the proposed method is accurate and efficient for the high-dimensional and high-nonlinear cases. In order to illustrate the performance of the proposed method further, the approximated CDF is presented in Fig. 18. Because the CDFs of the five cases are similar, only the case of b = 10 is taken as a representative. It can be seen that the proposed method can accurately recover the probabilistic information of the stochastic response in the whole range.
5.4 Example 4: high-dimensional structural dynamics problem without explicit expression
The final example presents a high-dimensional structural dynamics case without explicit expression, which is stochastic model of the dynamic response of an underwater vehicle (He et al. 2019a). The underwater vehicle is approximately modeled by Timoshenko beam, which is 13 m long and has an annular section with the diameter of 2.11 m and the thickness of 7.11 mm. The schematic view of simplified model is shown in Fig. 19. The beam is composed of three parts, which are connected by two nonlinear structures, and subjected to the time-dependent loads from water. The loads only act on the position between 0.9 and 5.6 m and are equivalent to 15 time-dependent lateral concentrated forces, Li, on the positions of 0.3 × (i + 3) m, i = 1, …,15, which are Gaussian stochastic processes. Therefore, the reliability analysis of the structural dynamics problem is essentially a time-dependent reliability analysis problem, which can be solved by extreme value-based method (Wang and Chen 2017). Because the structural failure mode is controlled by the bending moment, the limit state function is defined as
where M(0, 0.3) is the bending moment in 0.3 s of the interested cross-section and TM is the threshold of failure, given as 195 kN m. Due to no explicit expression for M (0, 0.3), finite element analysis is employed for the calculation. The stochastic parameters in this example are listed in Table 6.
C.O.V represents the coefficient of variance
5.4.1 The construction of the proposed meta-model
To solve the time-dependent problem by extreme value-based method, it is required to discretize the time interval, [0, 0.3 s], by a small time step (e.g., 0.01 s). Thus, the loads, Li, can be approximated by the following expansion optimal linear estimation (Zhang et al. 2017):
where Uk, k = 1, ..., d, are the independent standard normal variables, Σ is the autocorrelation matrix, and Φk and λk are eigenvectors and eigenvalues of Σ, respectively. Figure 20 shows the result of the eigen decomposition of Σ, from which it can be concluded that each random load has only one dominated component, that is, Li, i = 1, 2, …, 15, can be simplified by 15 independent standard normal random variables. Thus, the proposed meta-model can be employed to approximate the bending moment of the interested cross-section at each time node, and then the maximum bending moment in 0.3 s can be obtained for each realization of the input random variables.
Firstly, the PCEs of the 19 univariate components at each time node are built. Figure 21 shows the convergence histories at 0.1 s of the univariate components of K1, K3, and L1, from which the three univariate components can be modeled by the PCEs with p = 4, 5, and 4. The convergence histories of the univariate components of the K2, K4, and Li, i = 2, …, 15 are not presented because they are similar with the results of K1, K3, and L1, respectively. Secondly, with the 19 PCEs, the meta-models at 0.1 s can be obtained based on Eqs. (24) and (25). Repeating the above steps 300 times, the meta-models at the time nodes, tn = 0.01n (n = 1, 2, …, 300) can be obtained. Finally, the proposed meta-model for the maximum bending moment can be constructed by extracting the maximum of predicted values of the 300 meta-models at each sample point. To demonstrate the accuracy of the proposed meta-models, the responses of 100 verification points are calculated, as shown in Fig. 22. Also, the coefficients of determination of the SUDRM-based meta-model and MUDRM-based meta-model are calculated by Eq. (26), say 0.9986 and 0.9999. Therefore, the MUDRM-based model is used for reliability analysis.
5.4.2 Reliability analysis
As shown in Fig. 23, the proposed method recovers the curve of POE of the maximum bending moment accurately compared with the result of crude MCS. Table 7 presents the final results of different methods, from which it can be seen that all methods can obtain the accurate prediction for the failure probability. However, considering the efficiency, the proposed method outperforms the full PCE method and the sparse PCE method. Remarkably, it can be concluded that the proposed method is a good choice for high-dimensional problems, because the proposed method employs only 194 experiment designs to estimate the failure probability accurately for the complex structural dynamics problem.
6 Conclusion
This paper proposes a novel surrogate-based method on the basis of the concepts of polynomial chaos expansion (PCE), dimension-reduction method (DRM), and maximum entropy principle (MEP). Firstly, the univariate dimension-reduction method (UDRM) is used to decompose the original function into a series of univariate components. Then, the PCE is employed to approximate the univariate components accurately and efficiently. An adaptive method for the selection of the polynomial chaos basis is proposed to construct the PCEs of the univariate components. By collecting the PCEs of the univariate components in the form of UDRM, the proposed meta-model can be obtained. The validity of the proposed method is demonstrated by three numerical examples and one engineering example. The following conclusions can be obtained:
-
1.
The adaptive method can select the polynomial chaos basis without the prior of the degree of the PCE. With the selected basis, the univariate components of original function can be approximated accurately by PCE.
-
2.
With the combination of the PCE and UDRM, the proposed method can achieve the reliability analysis accurately and efficiently.
-
3.
The common reliability analysis methods, such as full PCE and sparse PCE based on least angle regression, may be limited by the difficulty of curse of dimension, while the proposed method can solve the problem caused by high-dimensional input random variables well.
References
Abraham S, Raisee M, Ghorbaniasl G, Contino F, Lacor C (2017) A robust and efficient stepwise regression method for building sparse polynomial chaos expansions. J Comput Phys 332:461–474
Acar E, Rais-Rohani M, Eamon CD (2010) Reliability estimation using univariate dimension reduction and extended generalised lambda distribution. Int J Reliab Saf 4(2–3):166–187
Berveiller M, Sudret B, Lemaire M (2006) Stochastic finite element: a non intrusive approach by regression. European Journal of Computational Mechanics/Revue Européenne de Mécanique Numérique 15(1–3):81–92
Blatman G, Sudret B (2010) Efficient computation of global sensitivity indices using sparse polynomial chaos expansions. Reliability Engineering & System Safety 95(11):1216–1229
Blatman G, Sudret B (2011) Adaptive sparse polynomial chaos expansion based on least angle regression. J Comput Phys 230(6):2345–2367
Cheng K, Lu Z (2018a) Sparse polynomial chaos expansion based on D-MORPH regression. Appl Math Comput 323:17–30
Cheng K, Lu Z (2018b) Adaptive sparse polynomial chaos expansions for global sensitivity analysis based on support vector regression. Comput Struct 194:86–96
Cheng K, Lu Z, Zhen Y (2019) Multi-level multi-fidelity sparse polynomial chaos expansion based on Gaussian process regression. Comput Methods Appl Mech Eng 349:360–377
Crestaux T, Le Maıtre O, Martinez JM (2009) Polynomial chaos expansion for sensitivity analysis. Reliability Engineering & System Safety 94(7):1161–1172
Dai H, Zhang H, Rasmussen KJ, Wang W (2015a) Wavelet density-based adaptive importance sampling method. Struct Saf 52:161–169
Dai H, Zhang H, Wang W (2015b) A multiwavelet neural network-based response surface method for structural reliability analysis. Computer-Aided Civil and Infrastructure Engineering 30(2):151–162
Du X, Chen W (2001) A most probable point-based method for efficient uncertainty analysis. J Des Manuf Autom 4(1):47–66
Du X, Chen W (2004) Sequential optimization and reliability assessment method for efficient probabilistic design. J Mech Des 126(2):225–233
Du X, Sudjianto A (2004) First order saddlepoint approximation for reliability analysis. AIAA J 42(6):1199–1207
Engelund S, Rackwitz R (1993) A benchmark study on importance sampling techniques in structural reliability. Struct Saf 12(4):255–276
Gerstner T, Griebel M (1998) Numerical integration using sparse grids. Numerical Algorithms 18(3–4):209
Ghanem R G, Spanos P D (1991) Stochastic finite element method: response statistics. In Stochastic finite elements: a spectral approach (pp. 101-119). Springer, New York, NY
Guo J, Zhao J, Zeng S (2018) Structural reliability analysis based on analytical maximum entropy method using polynomial chaos expansion. Struct Multidiscip Optim 58(3):1187–1203
Hadigol M, Doostan A (2018) Least squares polynomial chaos expansion: a review of sampling strategies. Comput Methods Appl Mech Eng 332:382–407
Hampton J, Doostan A (2015) Coherence motivated sampling and convergence analysis of least squares polynomial chaos regression. Comput Methods Appl Mech Eng 290:73–97
He W, Li G, Hao P, Zeng Y (2019a) Maximum entropy method-based reliability analysis with correlated input variables via hybrid dimension-reduction method. J Mech Des 141(10)
He W, Zeng Y, Li G (2019b) A novel structural reliability analysis method via improved maximum entropy method based on nonlinear mapping and sparse grid numerical integration. Mech Syst Signal Process 133:106247
Huang B, Du X (2006) Uncertainty analysis by dimension reduction integration and saddlepoint approximations. J Mech Des 128(1):26–33
Jaynes ET (1957) Information theory and statistical mechanics. Phys Rev 106(4):620
Karagiannis G, Lin G (2014) Selection of polynomial chaos bases via Bayesian model uncertainty methods with applications to sparse approximation of PDEs with stochastic inputs. J Comput Phys 259:114–134
Li G, He W, Zeng Y (2019) An improved maximum entropy method via fractional moments with Laplace transform for reliability analysis. Struct Multidiscip Optim 59(4):1301–1320
Liu J, Meng X, Xu C, Zhang D, Jiang C (2018) Forward and inverse structural uncertainty propagations under stochastic variables with arbitrary probability distributions. Comput Methods Appl Mech Eng 342:287–320
Lu Z, Song S, Yue Z, Wang J (2008) Reliability sensitivity method by line sampling. Struct Saf 30(6):517–532
Marelli S, Sudret B (2015) UQLab user manual–polynomial chaos expansions Chair of Risk, Safety & Uncertainty Quantification, ETH Zürich, 0.9-104 edition, 97-110
Meng Z, Keshtegar B (2019) Adaptive conjugate single-loop method for efficient reliability-based design and topology optimization. Comput Methods Appl Mech Eng 344:95–119
Meng Z, Zhou H, Hu H, Keshtegar B (2018) Enhanced sequential approximate programming using second order reliability method for accurate and efficient structural reliability-based design optimization. Appl Math Model 62:562–579
Meng Z, Zhang Z, Li G, Zhang D (2020a) An active weight learning method for efficient reliability assessment with small failure probability. Struct Multidiscip 61:1157–1170
Meng Z, Zhang Z, Zhou H (2020b) A novel experimental data-driven exponential convex model for reliability assessment with uncertain-but-bounded parameters. Appl Math Model 77:773–787
Narayan A, Jakeman J, Zhou T (2017) A Christoffel function weighted least squares algorithm for collocation approximations. Math Comput 86(306):1913–1947
Palar PS, Tsuchiya T, Parks GT (2016) Multi-fidelity non-intrusive polynomial chaos based on regression. Comput Methods Appl Mech Eng 305:579–606
Rahman S, Xu H (2004) A univariate dimension-reduction method for multi-dimensional integration in stochastic mechanics. Probabilistic Engineering Mechanics 19(4):393–408
Sadoughi MK, Li M, Hu C, MacKenzie CA, Lee S, Eshghi AT (2018) A high-dimensional reliability analysis method for simulation-based design under uncertainty. J Mech Des 140(7):071401
Saltelli A, Sobol IM (1995) About the use of rank transformation in sensitivity analysis of model output. Reliability Engineering & System Safety 50(3):225–239
Shannon CE (1948) A mathematical theory of communication. Bell system technical journal 27(3):379–423
Shao Q, Younes A, Fahs M, Mara TA (2017) Bayesian sparse polynomial chaos expansion for global sensitivity analysis. Comput Methods Appl Mech Eng 318:474–496
Shields MD, Teferra K, Hapij A, Daddazio RP (2015) Refined stratified sampling for efficient Monte Carlo based uncertainty quantification. Reliability Engineering & System Safety 142:310–325
Soize C, Ghanem R (2004) Physical systems with random uncertainties: chaos representations with arbitrary probability measure. SIAM J Sci Comput 26(2):395–410
Wan X, Karniadakis GE (2006) Multi-element generalized polynomial chaos for arbitrary probability measures. SIAM J Sci Comput 28(3):901–928
Wang Z, Chen W (2017) Confidence-based adaptive extreme response surface for time-variant reliability analysis under random excitation. Struct Saf 64:76–86
Wang H, Yan Z, Xu X, He K (2018) Evaluating influence of variable renewable energy generation on islanded microgrid power flow. IEEE Access 6:71339–71349
Wu J, Zhang D, Liu J, Han, X. (2019) A Moment Approach to Positioning Accuracy Reliability Analysis for Industrial Robots. IEEE Transactions on Reliability 99:1–1625
Wiener N (1938) The homogeneous chaos. Am J Math 60(4):897–936
Xi Z, Hu C, Youn BD (2012) A comparative study of probability estimation methods for reliability analysis. Struct Multidiscip Optim 45(1):33–52
Xi Z, Jing R, Wang P, Hu C (2014) A copula-based sampling method for data-driven prognostics. Reliability Engineering & System Safety 132:72–82
Xiong Y, Chen W, Apley D, Ding X (2007) A non-stationary covariance-based Kriging method for metamodelling in engineering design. Int J Numer Methods Eng 71(6):733–756
Xiu D, Karniadakis GE (2002a) Modeling uncertainty in steady state diffusion problems via generalized polynomial chaos. Comput Methods Appl Mech Eng 191(43):4927–4948
Xiu D, Karniadakis GE (2002b) The Wiener--Askey polynomial chaos for stochastic differential equations. SIAM J Sci Comput 24(2):619–644
Xiu D, Karniadakis GE (2003) Modeling uncertainty in flow simulations via generalized polynomial chaos. J Comput Phys 187(1):137–167
Xu J, Kong F (2018a) A new unequal-weighted sampling method for efficient reliability analysis. Reliability Engineering & System Safety 172:94–102
Xu J, Kong F (2018b) A cubature collocation based sparse polynomial chaos expansion for efficient structural reliability analysis. Struct Saf 74:24–31
Xu J, Wang D (2019) Structural reliability analysis based on polynomial chaos, Voronoi cells and dimension reduction technique. Reliability Engineering & System Safety 185:329–340
Xu J, Dang C, Kong F (2017) Efficient reliability analysis of structures with the rotational quasi-symmetric point-and the maximum entropy methods. Mech Syst Signal Process 95:58–76
Youn BD, Xi Z (2009) Reliability-based robust design optimization using the eigenvector dimension reduction (EDR) method. Struct Multidiscip Optim 37(5):475–492
Youn BD, Choi KK, Yi K (2005) Performance moment integration (PMI) method for quality assessment in reliability-based robust design optimization. Mechanics Based Design of Structures and Machines 33(2):185–213
Youn BD, Xi Z, Wang P (2008) Eigenvector dimension reduction (EDR) method for sensitivity-free probability analysis. Struct Multidiscip Optim 37(1):13–28
Zhang X (2013) Efficient computational methods for structural reliability and global sensitivity analyses
Zhang D, Han X (2020) Kinematic reliability analysis of robotic manipulator. J Mech Des 142(4):044502
Zhang X, Pandey MD (2013) Structural reliability analysis based on the concepts of entropy, fractional moment and dimensional reduction method. Struct Saf 43:28–40
Zhang L, Lu Z, Wang P (2015) Efficient structural reliability analysis method based on advanced Kriging model. Appl Math Model 39(2):781–793
Zhang D, Han X, Jiang C, Liu J, Li Q (2017) Time-dependent reliability analysis through response surface method. J Mech Des 139(4):041404
Zhang X, Wang L, Sørensen JD (2019) REIF: a novel active-learning function toward adaptive Kriging surrogate models for structural reliability analysis. Reliability Engineering & System Safety 185:440–454
Zhang X, Wang L, Sørensen JD (2020) AKOIS: an adaptive Kriging oriented importance sampling method for structural system reliability analysis. Struct Saf 82:101876
Zhou Y, Lu Z, Cheng K (2019) Sparse polynomial chaos expansions for global sensitivity analysis with partial least squares and distance correlation. Struct Multidiscip Optim 59(1):229–247
Zhu Z, Du X (2016) Reliability analysis with Monte Carlo simulation and dependent Kriging predictions. J Mech Des 138(12):121403
Replication of results
As comprehensive implementation details are provided, we are confident that the methodology in this paper is reproducible. Therefore, no additional data and code is appended. If one is interested in the methodology and needs more help for the reproduction, please feel free to contact the corresponding author by email.
Funding
The supports were received from the National Key Research and Development Program (Grant No.: 2019YFA0706803) and the National Natural Science Foundation of China (Grant No.: 11872142) are greatly appreciated. The lead author received financial support from China Scholarship Council for his visit at University of Waterloo.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Pingfeng Wang
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
He, W., Zeng, Y. & Li, G. An adaptive polynomial chaos expansion for high-dimensional reliability analysis. Struct Multidisc Optim 62, 2051–2067 (2020). https://doi.org/10.1007/s00158-020-02594-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-020-02594-4