Introduction

The coal seams of the North China coalfields deposited in the Permo-Carboniferous period are typically exploited via underground mining. Mining is a high-risk technique, and mine accidents, such as gas and coal dust explosions and water inrush accidents, of which water inrush accidents cause major financial loss and are challenging to recover from in terms of production (Zhao et al. 2018; Zhang et al. 2017), occur frequently (Shi et al. 2019a; Wang and Meng 2018; Yang et al. 2019). The coal seams of the Shanxi Formation in the North China coalfields have been nearly fully exploited, and the deeply buried coal seams in the Taiyuan Formation constitute the main working bed. With the deepening of mines, their hydrogeological conditions are becoming increasingly complicated (Tan et al. 2010; Wu et al. 2017a). The exploitation of the deeply buried coal seams in the Taiyuan Formation is seriously threatened by floor water inrush, especially in the Ordovician limestone aquifer (Sun et al. 2015; Yin et al. 2015). According to statistics, over 200 water inrushes from the Ordovician aquifer have occurred in the past forty years, causing an estimated 30 billion yuan in losses and killing approximately 1300 people (Shi et al. 2019a). Therefore, assessing the risk of floor water inrush is essential for helping control floor water hazards.

Numerous methods have been developed to assess floor water inrush risk over the past several decades. The water inrush coefficient method, T method, proposed in 1964 is widely used for predicting water inrush risk in China; this approach defines a specific value between aquifer water pressure and aquifuge thickness (Wu et al. 2011), involving only two controlling factors. However, water inrush involves many factors: water pressure, aquifuge thickness and water-resisting strength, water abundance, fractures, and mining disturbance. With the development of artificial intelligence, many methods have been widely used in various aspects of engineering (Hashemi et al. 2019; Norouzi and Namin 2019; Qu et al. 2019; Qiu et al. 2017; Bednarik 2019; Wu and Zhou 2008). The analytic hierarchy process (AHP) (Wu and Zhou 2008), artificial neural network (ANN) (Wu et al. 2008), fuzzy mathematics method (FMM) (Wang et al. 2012), support vector machine (SVM) (Shi et al. 2017), unascertained measure theory (UMT) (Wu et al. 2017b), random forest (RF) (Zhao et al. 2018), and entropy weight method (EWM) (Shi et al. 2019a) have been used for assessing water inrush to address the limited accuracy of the water inrush coefficient method and play an important role in the evaluation of water inrush risk by integrating multiple factors. However, these methods have certain limitations in practical applications. The AHP method has many potential advantages for assessing water inrush risk by integrating multiple factors, but the weights of the factors are determined based on expert opinions, with subjective judgments that vary for different individuals; ANN and RF methods are limited because of overlearning and local minima (Shi et al. 2019a); for the FMM, the division of the evaluation index grading lacks scientific evidence; the SVM model is limited due to its complex mathematical functions; for UMT, the constant weights of the factors are assigned by subjective expert opinions; and EWM requires a large number of water inrush sample data.

Accordingly, in this paper, a new model for risk assessment of water inrush from an underlying aquifer was proposed based on the combination of the triangular fuzzy number (TFN), AHP, and Technique for Order Performance by Similarity to Ideal Solution (TOPSIS) methods. TOPSIS method, a nonlinear method, is a commonly used and effective method in multi-attribute decision-making analysis, which can evaluate the relative risk of existing assessment samples according to their proximity to idealized targets (Hwang and Yoon 1981). For TOPSIS method, it is necessary to determine the weights of assessment factors. AHP-TFN method was applied to determine the weights of the assessment factors, which can deal with vagueness of human thought and uncertainty in real-world decision problems. And then the water inrush risk index (WIRI) model was established by TOPSIS method based on the original values of factors and the weights calculated by AHP-TFN method, by which a zoning map of the water inrush risk of the No. 11 coal seam from the Ordovician aquifer in the Zhaizhen coal mine was developed for providing a scientific basis for safe production.

Study area

The Zhaizhen coal mine lies in the northern Xinwen coalfield, Shandong Province, China (Fig. 1), covering an area of approximately 13.58 km2; the Zhaizhen coal mine is a North China coalfield.

Fig. 1
figure 1

Location of the study area in Shandong Province, China, and the geological structure of the Zhaizhen coal mine

From oldest to youngest, the stratigraphy in the Zhaizhen coal mine consists of the Ordovician system (S), Carboniferous S, Permian S, Paleogene S, and Quaternary S (Fig. 2). The coal-bearing strata in the Zhaizhen coal mine, which was deposited during the Permo-Carboniferous period, include six minable seams: from top to bottom, the Nos. 2 and 4 coal seams in the Shanxi Formation (F) and the No. 6 coal seam in the Taiyuan F, which have been exhausted, and the Nos. 11, 13, and 15 coal seams in the Taiyuan F, which are being exploited now. The aquifers below the No. 11 coal seam are: the sandstone fractured aquifer and thin limestone aquifers of the Taiyuan F and the Ordovician karst aquifer. The thin sandstone fractured aquifer and limestone aquifers of the Taiyuan F have poor water abundance and therefore do not pose a serious risk to the mining of the No. 11 coal seam. In contrast, with the characteristics of high hydraulic pressure, considerable thickness of more than 800 m and good water abundance and permeability, the Ordovician karst aquifer provides the primary risk to the exploitation of the No. 11 coal seam.

Fig. 2
figure 2

Stratigraphic column of the Zhaizhen coal mine

The formation that is targeted in the Xinwen coalfield, which is affected by tectonic movement, forms a monocline dipping NNE, with gentle dips less than 25°. Primarily striking NW, NEE, and NE, the faults are well developed. In particular, the No. 10 fault (F10 in Fig. 1) and its branch faults, striking NW, cut the Xinwen coalfield into a southern zone and a northern zone (Fig. 1). The southern zone includes the Xiezhuang and Huayuan coal mines and parts of the Liangzhuang, Suncun, and Huaheng coal mines. The northern zone includes the Zhaizhen coal mine and parts of the Liangzhuang, Suncun, and Huaheng coal mines. The No. 11 coal seam is buried shallowly and the Ordovician limestone aquifer has low water pressure in the southern zone, allowing safe mining of the No. 11 coal seam, while it is opposite for the northern zone. In part of the northern zone, the No. 11 coal seam was mined, but during this mining, three Ordovician karst water inrushes occurred in the Liangzhuang and Suncun coal mines. During these three inrush events, the maximum water yield reached 772.2 m3/h, 78 m3/h, and 50 m3/h, respectively. Although parts of the No. 11 coal seam have been safely mined west of the Zhaizhen coal mine, the hydrogeological conditions are more complicated with increasing mining depth, which will make the mining of the No. 11 coal seam more dangerous.

Methodology

Procedures

Risk assessment of water inrush to coal seams from underlying aquifer based on the proposed combination method of the TFN-AHP and TOPSIS techniques includes four main steps (Fig. 3): (a) selecting the main assessment factors controlling floor water inrush and collecting geological data, (b) determining the weights of the assessment factors, (c) building WIRI model, and (d) validation, description of the results, and application.

Fig. 3
figure 3

Study flow in this paper

Selecting factors controlling floor water inrush

According to engineering experience, many aspects affect water inrush, but there are four main aspects: aquifer, aquifuge, geological structure, and mining. According to the systemic analysis of the major controlling factors (Wu et al. 2007; Wu and Zhou 2008), some relevant literature on this subject (Li and Chen 2016; Qiu et al. 2017; Shi et al. 2017, 2019a, b; Wu et al. 2011; Wu et al. 2015), and the hydrogeological conditions of the research area, these four aspects affecting water inrush and seven assessment factors were selected.

  • Aquifer (F1)

The properties of aquifers are important factors influencing floor water disasters (Li and Chen 2016). The properties of the Ordovician limestone aquifer are reflected via two components: the water abundance (F11) and the water pressure (F12).

  • Aquifuge (F2)

An aquifuge acts as a geologic barrier for preventing floor water inrush, and its water-resisting ability is closely related to its thickness and mechanical strength (Qiu et al. 2017). Therefore, the aquifuge index is as follows: aquifuge thickness is defined as the vertical distance from the No. 11 coal seam floor to the roof of the Ordovician limestone aquifer (F21), and the brittle rock percentage within the aquifuge reflects the mechanical strength of the aquifuge (F22).

  • Geological structure (F3)

Geological structure has a strong influence on water inrush (Li 2000); the water inrush is dominated by the fault structure in the study area, which is determined by two properties: (1) the fault intensity index (F31) defined as Eq. (1) (Shi et al. 2019a; Xu et al. 1991); and (2) the fault endpoint and intersection density (F32).

$$ {F}_{31}=\frac{\sum_{i=1}^n{H}_i\cdotp {L}_i}{S} $$
(1)

where F31 is the fault intensity index; H is the throw of the fault (m); L is the length of the fault in the strike direction (m); S is the area of the grid (m2); and i, where i = 1, 2, …, n, and n, is the number of faults in the grid.

  • Mining (F4)

The mine pressure that develops during mining activities will destroy the rock of a coal seam floor. The mine-damaged zone caused by the mine pressure is an important triggering factor of floor water inrush. The height of the mine-damaged zone (F41) is selected and computed by Eq. (2) (National Bureau of Coal Industry of China 2000):

$$ {F}_{41}=0.0085H+0.1665\alpha +0.1079L-4.3579 $$
(2)

where H is the depth of the mining (m); α is the coal seam dip angle (°); and L is the mining width of the mining face (m).

Seven main assessment factors were gathered, and then a contour map of each assessment factor in the study area was created using Golden Software Surfer 13.0, which has effective spatial analysis functions of space overlapping and drawing contour maps (Yin et al. 2018), as shown in Fig. 4.

Fig. 4
figure 4

Contour maps of the seven assessment factors. a Water abundance of the Ordovician limestone aquifer (F11). b Water pressure of the Ordovician limestone aquifer (F12). c Aquifuge thickness (F21). d Brittle rock percentage within the aquifuge (F22). e Fault intensity index (F31). f Fault endpoint and intersection density (F32). g Height of the mine-damaged zone (F41)

Determining the weights of the assessment factors

Determining the weights of the assessment factors is critical for assessing the water inrush risk. Several methods have been developed to calculate the weights, such as the weighting factor, statistical index, and AHP methods. The AHP method, proposed first by T. L. Saaty (Saaty 1980), is very useful for multi-attribution decision-making problems (Chang et al. 2007; Wang et al. 2012). To set up the framework of the AHP analysis, it is essential to construct comparison matrices evaluated by the Delphi method (Tahriri et al. 2014), which collect exact values given by the decision maker about the relative importance of issues. However, the natural environment of the problems would make it hard for decision makers to express their knowledge precisely. Therefore, the AHP method is often criticized for its inability to adequately deal with the inherent uncertainty and imprecision in the pairwise comparison process (Deng 1999).

To address the vagueness of human thought and uncertainty in real-world decision-making, fuzzy set theory was first introduced by Zadeh (1965); fuzzy set theory, which allows mathematical operators and programming to apply to the fuzzy domain, was first applied to a decision-making problem by Bellman and Zadeh (1970). A fuzzy set is a class of objects with a continuum of grades of membership, which is characterized by a membership function, devoting values between 0 and 1 to the objects (Zadeh 1965). In applications, a fuzzy number is either a TFN or trapezoidal fuzzy number. A TFN, \( \overset{\sim }{M} \), is expressed simply as \( \overset{\sim }{M} \)(s, m, l) or \( \overset{\sim }{M} \)(s|m, m|l), where s, l, and m are the minimum and maximum possible values and the most promising value, respectively. A fuzzy event can be described by the TFN (Ataei et al. 2012). The left and right sides of each TFN are linear representations, and the membership function of the TFN \( \overset{\sim }{M} \)(s, m, l) is expressed as Eq. (3) (Deng 1999):

$$ \mu\ \left(x|\overset{\sim }{M}\right)=\left\{\begin{array}{c}0,\kern7.75em x<s,\kern2.75em \\ {}\left(x-s\right)/\left(m-s\right),\kern0.5em s\le x\le m\kern0.75em \\ {}\begin{array}{c}\left(l-x\right)/\left(l-m\right),m\le x\le l\\ {}0,\kern7.75em x>l,\kern2.75em \end{array}\end{array}\right. $$
(3)

Compared with a trapezoidal fuzzy number, a TFN is more convenient for computational simplicity, and it is useful in information processing in the fuzzy environment (Ertugrul and Karakasoglu 2009). In this paper, to address the fuzziness of decision makers’ judgments in the conventional AHP method, the TFN method was adopted in addition to the AHP method to calculate the weights of the assessment factors. The expert only gives the maximum scores for each factor in the AHP-TFN method, and then the factor comparison matrix is prepared. The four steps to calculate the weights of the assessment factors with the AHP-TFN method are as follows: (a) establishing the hierarchical structure model; (b) determining the relative importance of the factors in each hierarchy; (c) calculating the weights of the factors in each hierarchy with the TFN method; and (d) determining the total weights of the assessment factors.

Establishing the hierarchical structure model

In this subsection, a structure of the hierarchy with an index layer, criterion layer, and target layer was set up based on the selected assessment factors, as shown in Fig. 5. The target layer of the hierarchy is the water inrush risk of the No. 11 coal seam from the Ordovician aquifer in this study. The criterion layer of the hierarchy, which is the intermediate link for solving the target problem, is formed by four aspects affecting mine water inrush: aquifer (F1), aquifuge (F2), geological structure (F3), and mining (F4). The index layer, which is the lowest layer in the hierarchal structure model, is constituted by seven quantitative assessment factors: water abundance (F11) and water pressure (F12) of the Ordovician limestone aquifer, aquifuge thickness (F21), brittle rock percentage within the aquifuge (F22), fault intensity index (F31), fault endpoint and intersection density (F32), and height of the mine-damaged zone (F41).

Fig. 5
figure 5

Hierarchical structure model

Determination of the relative importance of the factors in each hierarchy

To compute the weights of the assessment factors, it is essential to determine the relative importance of the factors with the Delphi method. The scores of the factors were collected from the experts according to the Saaty rating scale (the 1–9 scale method as shown in Table 1) (Saaty 1980). Based on the hierarchical structure model (Fig. 4), the relative importance of each factor was evaluated in each layer by the invited experts; these results were scored for each layer of the hierarchical structure model from top to bottom, as shown in Tables 2, 3, 4, 5, and 6.

Table 1 The Saaty rating scale (Saaty 1980)
Table 2 Relative importance of the factors in the criterion layer
Table 3 Relative importance of the factors F1 ~ F1t (t = 1–2)
Table 4 Relative importance of the factors F2 ~ F2t (t = 1–2)
Table 5 Relative importance of the factors F3 ~ F3t (t = 1–2)
Table 6 Relative importance of the factors F4 ~ F41

Calculating the weights of factors in each hierarchy with the TFN method

The TFN method is useful for solving the ambiguity and uncertainty, which was utilized to deal with the fuzziness of the experts’ judgments about the relative importance of each factor. The four steps to calculate the weights of the factors in each hierarchy with the TFN method are as follows.

  • Step 1. Establishing the comparison matrices.

According to the relative importance of the factors in each hierarchy listed in Tables 2, 3, 4, 5, and 6, a pairwise comparison matrix A in each hierarchy is calculated with Eq. (4) (Norouzi and Namin 2019):

$$ A=\left[{a}_{ij}\right]=\left[\begin{array}{cccc}1& {a}_{12}& \cdots & {a}_{1n}\\ {}1/{a}_{12}& 1& \cdots & {a}_{2n}\\ {}\vdots & \vdots & \ddots & \vdots \\ {}1/{a}_{1n}& 1/{a}_{2n}& \cdots & 1\end{array}\right] $$
(4)

where aij indicates a quantified judgment of the relative importance of the factors Fi and Fj, where i, j = 1, 2, …, n; n is the total number of factors in each hierarchy; Fi and Fj represent the ith and jth factors, respectively; and aji = 1/aij.

  • Step 2. Computing the fuzzy pairwise comparison matrix.

For this study, the TFN ãij was defined by Eq. (5) (Hayaty et al. 2014):

$$ {\tilde{a}}_{ij}=\left({\alpha}_{ij},{\beta}_{ij},{\gamma}_{ij}\right)=\left(\operatorname{Min}\left({a}_{ij k}\right),\left({\prod}_{k=1}^m{a}_{ij k}\right),\operatorname{Max}\left({a}_{ij k}\right)\right) $$
(5)

where αij, βij, and γij indicate the lower bound, geometric mean, and upper bound; aijk is the quantified judgment of the relative importance on the factors Fi and Fj given by the kth expert; i, j = 1, 2, …, n, and n is the total number of factors in each hierarchy; k = 1, 2, …, m, and m is the total number of experts.

This provided the fuzzy pairwise comparison matrix à (Hayaty et al. 2014), shown as Eq. (6):

$$ \tilde{A}=\left[{\tilde{a}}_{ij}\right]=\left[\begin{array}{cccc}\left(1,\kern0.33em 1,\kern0.33em 1\right)& \left({\alpha}_{12},\kern0.33em {\beta}_{12},\kern0.33em {\gamma}_{12}\right)& \cdots & \left({\alpha}_{1n},\kern0.33em {\beta}_{1n},\kern0.33em {\gamma}_{1n}\right)\\ {}\left(1/{\gamma}_{12},1/{\beta}_{12},\kern0.33em 1/{\alpha}_{12}\right)\kern0.33em & \left(1,\kern0.33em 1,\kern0.33em 1\right)& \cdots & \left({\alpha}_{2n},\kern0.33em {\beta}_{2n},\kern0.33em {\gamma}_{2n}\right)\\ {}\vdots & \vdots & \ddots & \vdots \\ {}\left(1/{\gamma}_{1n},1/{\beta}_{1n},\kern0.33em 1/{\alpha}_{1n}\right)& \left(1/{\gamma}_{2n},1/{\beta}_{2n},\kern0.33em 1/{\alpha}_{2n}\right)& \cdots & \left(1,\kern0.33em 1,\kern0.33em 1\right)\end{array}\right] $$
(6)
  • Step 3. Calculating the fuzzy synthetic extent of the ith factor (\( {\overset{\sim }{S}}_i \)), which is expressed as Eq. (7) (Chatterjee et al. 2015; Rezaei et al. 2015):

$$ {\overset{\sim }{S}}_i=\tilde{r}_{i}\otimes {\left({\overset{\sim }{r}}_1\oplus {\overset{\sim }{r}}_2\oplus \cdots \oplus \tilde{r}_{n}\right)}^{-1} $$
(7)

where \( \tilde{r}_{i} \)= (ai1ai2ain)1/n; i = 1, 2, …, n, and n is the total number of factors in each hierarchy; and the symbols ⊗ and ⊕ denote the multiplication and additive operation of fuzzy numbers, respectively.

  • Step 4. Determining the weights of the factors in each hierarchy.

Assuming two triangular fuzzy numbers \( {\overset{\sim }{S}}_1 \)= (α1, β1, γ1) and \( {\overset{\sim }{S}}_2 \)= (α2, β2, γ2), the possibility degree of \( {\overset{\sim }{S}}_2 \)\( {\overset{\sim }{S}}_1 \) is expressed by Eq. (8) (Chang 1996):

$$ {\displaystyle \begin{array}{c}P\left({\overset{\sim }{S}}_2\ge {\overset{\sim }{S}}_1\right)={\mu}_{S_2}(d)\kern8.25em \\ {}=\left\{\begin{array}{c}1\kern7em \mathrm{if}\ {\beta}_2\ge {\beta}_1\\ {}\frac{\alpha_1-{\gamma}_2}{\left({\beta}_2-{\gamma}_2\right)-\left({\beta}_1-{\alpha}_1\right)}\kern0.75em \mathrm{if}\ {\beta}_2<{\beta}_1,{\gamma}_2\ge {\alpha}_1\\ {}0\kern7em \mathrm{otherwise}\end{array}\right.\end{array}} $$
(8)

where \( P\left({\overset{\sim }{S}}_2\ge {\overset{\sim }{S}}_1\right) \) is the possibility degree of \( {\overset{\sim }{S}}_2 \)\( {\overset{\sim }{S}}_1 \); d denotes the highest ordinate of the crossing point between \( {\mu}_{{\overset{\sim }{S}}_1} \) and \( {\mu}_{{\overset{\sim }{S}}_2} \) to compare \( {\overset{\sim }{S}}_2 \) and \( {\overset{\sim }{S}}_1 \); and \( {\mu}_{{\overset{\sim }{S}}_1} \) and \( {\mu}_{{\overset{\sim }{S}}_2} \) are the membership functions of \( {\overset{\sim }{S}}_2 \) and \( {\overset{\sim }{S}}_1 \), respectively. The possibility degree of a convex fuzzy number \( \overset{\sim }{S} \) that is larger than \( {\overset{\sim }{S}}_i \) (i = 1, 2, …, n) can be expressed as Eq. (9) (Ataei et al. 2012):

$$ {\displaystyle \begin{array}{c}P\left(\overset{\sim }{S}\ge {\overset{\sim }{S}}_1,{\overset{\sim }{S}}_2,\cdots, {\overset{\sim }{S}}_n\right)=P\left[\left(\overset{\sim }{S}\ge {\overset{\sim }{S}}_1\right),\kern0.5em \left(\overset{\sim }{S}\ge {\overset{\sim }{S}}_2\right),\cdots, \left(\overset{\sim }{S}\ge {\overset{\sim }{S}}_n\right)\right]\\ {}\kern4.75em =\min P\left(\overset{\sim }{S}\ge {\overset{\sim }{S}}_i\right),i=1,2,\dots, n\end{array}} $$
(9)

Assuming \( d\left({F}_j\right)=\min P\left({\overset{\sim }{S}}_j\ge {\overset{\sim }{S}}_i\right) \) where i = 1, 2, …, n; ji, the weight vector of factors in each hierarchy is expressed by Eq. (10) (Ataei et al. 2012):

$$ {w}^{\prime }={\left(d\left({F}_1\right),d\left({F}_2\right),\cdots, d\left({F}_n\right)\right)}^{\mathrm{T}} $$
(10)

where w′ is the weight vector of the factors in each hierarchy and Fj is the jth factor, where j = 1, 2, …, n and n is the total number of factors in each hierarchy.

Finally, the normalized weight vector of the factors in each hierarchy is determined by Eq. (11) (Yin et al. 2018):

$$ w={\left(\frac{d\left({F}_1\right)}{\sum_{i=1}^nd\left({F}_i\right)},\frac{d\left({F}_2\right)}{\sum_{i=1}^nd\left({F}_i\right)},\cdots, \frac{d\left({F}_n\right)}{\sum_{i=1}^nd\left({F}_i\right)}\right)}^{\mathrm{T}} $$
(11)

For example, to calculate the weights of the factors in the criterion layer, four factors, F1, F2, F3, and F4, and three experts were used. Three 4 × 4 pairwise comparison matrices based on the data in Table 2 were established via Eq. (4) as follows:

$$ {\boldsymbol{A}}_{\mathbf{1}}=\left[\begin{array}{cccc}1.000& 1.167& 1.000& 1.167\\ {}0.857& 1.000& 0.857& 1.000\\ {}1.000& 1.167& 1.000& 1.167\\ {}0.857& 1.000& 0.857& 1.000\end{array}\right]\kern0.5em ,\kern0.5em {\boldsymbol{A}}_{\mathbf{2}}=\left[\begin{array}{cccc}1.000& 1.000& 1.000& 1.500\\ {}1.000& 1.000& 1.000& 1.500\\ {}1.000& 1.000& 1.000& 1.500\\ {}0.667& 0.667& 0.667& 1.000\end{array}\right]\kern0.5em ,\kern0.5em {\boldsymbol{A}}_{\mathbf{3}}=\left[\begin{array}{cccc}1.000& 1.000& 0.833& 1.000\\ {}1.000& 1.000& 0.833& 1.000\\ {}1.200& 1.200& 1.000& 1.200\\ {}1.000& 1.000& 0.833& 1.000\end{array}\right] $$

Applying Eqs. (5) and (6), we can obtain the fuzzy pairwise comparison matrix à as follows:

$$ \overset{\sim }{\boldsymbol{A}}=\left[\begin{array}{cccc}\left(1.000,1.000,1.000\right)& \left(1.000,1.053,1.167\right)& \left(0.833,0.941,1.000\right)& \left(1.000,1.205,1.500\right)\\ {}\left(0.857,0.950,1.000\right)\ & \left(1.000,1.000,1.000\right)& \left(0.833,0.894,1.000\right)& \left(1.000,1.145,1.500\right)\\ {}\left(1.000,1.063,1.200\right)& \left(1.000,1.119,1.200\right)& \left(1.000,1.000,1.000\right)& \left(1.167,1.281,1.500\right)\\ {}\left(0.667,0.830,1.000\right)& \left(0.667,0.874,1.000\right)& \left(0.667,0.781,0.857\right)& \left(1.000,1.000,1.000\right)\end{array}\right] $$

The fuzzy synthetic extent values of factors F1, F2, F3, and F4 were calculated with Eq. (7) as follows (Table 6):

$$ {\overset{\sim }{S}}_1=\left(0.833,1.194,1.750\right)\otimes {\left(3.011,4.254,6.267\right)}^{-1}=\left(0.133,0.281,0.581\right) $$
$$ {\overset{\sim }{S}}_2=\left(0.714,0.972,1.500\right)\otimes {\left(3.011,4.254,6.267\right)}^{-1}=\left(\mathrm{0.114,0.228,0.498}\right) $$
$$ {\overset{\sim }{S}}_3=\left(1.167,1.522,2.160\right)\otimes {\left(3.011,4.254,6.267\right)}^{-1}=\left(\mathrm{0.186,0.358,0.717}\right) $$
$$ {\overset{\sim }{S}}_4=\left(0.296,0.566,0.857\right)\otimes {\left(3.011,4.254,6.267\right)}^{-1}=\left(\mathrm{0.047,0.133,0.285}\right) $$

In the next step, the calculated fuzzy synthetic extent values were compared with Eq. (8) as follows:

$$ {\displaystyle \begin{array}{c}P\left({\overset{\sim }{S}}_1\ge {\overset{\sim }{S}}_2\right)=1.000,P\left({\overset{\sim }{S}}_1\ge {\overset{\sim }{S}}_3\right)=0.837,P\left({\overset{\sim }{S}}_1\ge {\overset{\sim }{S}}_4\right)=1.000,\\ {}P\left({\overset{\sim }{S}}_2\ge {\overset{\sim }{S}}_1\right)=0.873,P\left({\overset{\sim }{S}}_2\ge {\overset{\sim }{S}}_3\right)=0.706,P\left({\overset{\sim }{S}}_2\ge {\overset{\sim }{S}}_4\right)=1.000,\\ {}P\left({\overset{\sim }{S}}_3\ge {\overset{\sim }{S}}_1\right)=1.000,P\left({\overset{\sim }{S}}_3\ge {\overset{\sim }{S}}_2\right)=1.000,P\left({\overset{\sim }{S}}_3\ge {\overset{\sim }{S}}_4\right)=1.000,\\ {}P\left({\overset{\sim }{S}}_4\ge {\overset{\sim }{S}}_1\right)=0.507,P\left({\overset{\sim }{S}}_4\ge {\overset{\sim }{S}}_2\right)=0.643,P\left({\overset{\sim }{S}}_4\ge {\overset{\sim }{S}}_3\right)=0.306,\end{array}} $$

After that, priority weights were calculated with Eq. (9) as follows:

$$ d\left({F}_1\right)=\min \left(1.000,0.837,1.000\right)=0.837, $$
$$ d\left({F}_2\right)=\min \left(0.873,0.706,1.000\right)=0.706, $$
$$ d\left({F}_3\right)=\min \left(1.000,1.000,1.000\right)=1.000, $$
$$ d\left({F}_4\right)=\min \left(0.507,0.643,0.306\right)=0.306. $$

By these evaluations, the weight vector in the criterion layer was obtained as by Eq. (10) as w′ = (0.837, 0.707, 1.000, 0.305)T. Finally, the normalized weight vector of factors in the criterion layer was determined by Eq. (11) as follows (Table 6):

$$ w={\left(0.294,0.248,0.351,0.107\right)}^{\mathrm{T}} $$

Similarly, here, the normalized weights of factors in the hierarchy F1 ~ F1t (t = 1–2), F2 ~ F2t (t = 1–2), F3 ~ F3t (t = 1–2), and F4 ~ F41 were determined by using Eqs. (3)–(11), as shown in Table 6.

Determining the total weights of the assessment factors

After determining the normalized weight vector of factors in each hierarchy (Table 6), the total weights of seven assessment factors were calculated with Eq. (12) (Li and Chen 2016):

$$ {W}_{st}={w}_s\cdotp {w}_{st} $$
(12)

where Wst is the total weight of the tth assessment factor in the index layer belonging to the sth factor in the criterion layer in Fig. 5; ws is the normalized weight of the sth factor in the criterion layer; and wst is the normalized weight of the tth assessment factor in the index layer belonging to the sth factor in the criterion layer.

Finally, each assessment factor’s total weight was calculated based on the data in Table 7 by using Eq. (12), as shown in Table 7.

Table 7 Fuzzy and normalized weights of the factors in each layer, and total weights of the assessment factors

Building the water inrush risk index

A multifactor comprehensive evaluation method is considered to be effective when it accounts for all the factors controlling water inrush. In this paper, the TOPSIS method, which is a multifactor comprehensive evaluation method applied to a wide variety of decision problems (Baykasoğlu and Gölcük 2017; Norouzi and Namin 2019; Sepehr and Zucca 2012), was employed to rank the risk of water inrush of the No. 11 coal seam from the Ordovician aquifer by using available geological exploration data. The three steps used to build the WIRI model by the TOPSIS method are as follows:

  • Step 1. Constructing the weighted standardized matrix.

Based on the data of the seven selected factors in all the samples, the initial decision matrix was first constructed with Eq. (13) (Baykasoğlu and Gölcük 2017; Mikaeil et al. 2011):

$$ B=\left[\begin{array}{cccc}{b}_{11}& {b}_{12}& \cdots & {b}_{1n}\\ {}{b}_{21}\kern0.33em & {b}_{22}& \cdots & {b}_{2n}\\ {}\vdots & \vdots & \ddots & \vdots \\ {}{b_l}_1& {b_l}_2& \cdots & {b_l}_n\end{array}\right] $$
(13)

where B is the initial decision matrix; l and n indicate the number of samples to be assessed and the number of factors concerned; bpi indicates the observed value of the ith factor of the pth sample; p∈[1, l]; and i∈[1, n].

According to the total weights of the assessment factors in Table 7 and the initial decision matrix, the weighted standardized matrix was then established by normalization and weighting with Eq. (14) (Sepehr and Zucca 2012):

$$ V={\left({v}_{pi}\right)}_{l\times n}=\left[\begin{array}{cccc}{W}_1{c}_{11}& {W}_2{c}_{12}& \cdots & {W}_n{c}_{1n}\\ {}{W}_1{c}_{21}& {W}_2{c}_{22}& \cdots & {W}_n{c}_{2n}\\ {}\vdots & \vdots & \ddots & \vdots \\ {}{W}_1{c}_{l1}& {W}_2{c}_{l2}& \cdots & {W}_n{c}_{ln}\end{array}\right] $$
(14)

where V and vpi denote the weighted standardized matrix, and the weighted standardized value of the ith factor of the pth sample; Wi denotes the total weight of the ith factor, i∈[1, n]; cpi denotes the standardized value of the ith factor of the pth sample, calculated with Eq. (15) (Sepehr and Zucca 2012):

$$ {c}_{pi}={b}_{pi}/\sqrt{\sum \limits_{p=1}^l{b}_{pi}^2},\kern0.33em i=1,\kern0.33em 2,\kern0.33em \cdots, \kern0.33em n $$
(15)
  • Step 2. Determining the ideal solutions for water inrush.

During the determination of the ideal solutions for water inrush, the potential negative and positive related factors of the water inrush problem must be taken into account separately. The higher the value of the potential negative related factor, the less likely that water inrush would happen, while a higher value of the positive related factor indicated a higher likelihood of water inrush. Therefore, the negative ideal solution (NIS) for water inrush is the maximum value for the negative factors and the minimum value for the positive factors, while the positive ideal solution (PIS) for water inrush is the minimum value for the negative factors and the maximum value for the positive factors. If J1 and J2 indicate the set of negative factors and positive factors, respectively, the NIS and PIS are determined by Eqs. (16) and (17) (Li et al. 2013):

$$ {V}^{-}=\left\{\left(\underset{1\le p\le l}{\max }{v}_{pi}\left|\ i\in {J}_1\right.\right),\left(\underset{1\le p\le l}{\min }{v}_{pi}\left|\ i\in {J}_2\right.\right)\right\} $$
(16)
$$ {V}^{+}=\left\{\left(\underset{1\le p\le l}{\min }{v}_{pi}\left|\ i\in {J}_1\right.\right),\left(\underset{1\le p\le l}{\max }{v}_{pi}\left|\ i\in {J}_2\right.\right)\right\} $$
(17)

where V- and V+ denote NIS and PIS, respectively; J1 and J2 denote the sets of negative factors and positive factors, respectively; vpi indicates the weighted standardized value of the ith factor of the pth sample; p∈[1, l]; i∈[1, n]; and l and n indicate the number of samples to be assessed and the number of factors concerned.

  • Step 3. Determination of the final ranking of the water inrush risk for each sample.

According to the TOPSIS technique, the greatest risk would be for the sample that is farthest from the NIS and nearest to the PIS. The WIRI for each sample was defined with Eq. (18) (Li et al. 2013):

$$ {\mathrm{WIRI}}_p=\frac{D_p^{-}}{D_p^{+}+{D}_p^{-}}=\frac{\sqrt{\sum_{i=1}^n{\left({v}_{pi}-{v}_i^{-}\right)}^2}}{\sqrt{\sum_{i=1}^n{\left({v}_{pi}-{v}_i^{+}\right)}^2}+\sqrt{\sum_{i=1}^n{\left({v}_{pi}-{v}_i^{-}\right)}^2}},\left(p=1,2,\cdots, l\right) $$
(18)

where WIRI p is the water inrush risk index of the pth sample; Dp is the distance of the pth sample to the NIS; Dp+ indicates the distance of the pth sample to the PIS; vpi is the weighted standardized value of the ith factor of the pth sample; and vi and vi+ are the values of the ith factor in the sets V and V+, respectively.

A larger WIRI value indicates a higher likelihood of water inrush. By arranging WIRI in descending order, a ranking of water inrush risk was determined.

Results and discussion

Results and validation of the predictions

A grid was constructed by using 100 m × 100 m grid units in each thematic map of the assessment factors. The data of the seven assessment factors in 1378 grid units and the three water inrush cases that occurred in the adjacent coal mine, which formed 1381 assessment samples, were gathered to construct a 1381 × 7 initial decision matrix. The initial decision matrix was normalized by using Eq. (15), and then the weighted standardized matrix was formed by multiplying each standardized value and their weights determined by the TFN-AHP method shown in Table 7.

Based on the weighted standardized matrix, the PIS and NIS for water inrush were then determined. In this study, five assessment factors, F11, F12, F31, F32, and F41, which belong to set J2, were determined to have positive correlations with water inrush, and two assessment factors, F21 and F22, which belong to set J1, have negative correlations with floor water inrush. Therefore, the PIS and NIS for water inrush were then determined with Eqs. (16) and (17) as:

$$ {\displaystyle \begin{array}{c}{V}^{-}=\left\{0.0000,0.0009,0.0055,0.0028,0.0000,0.0000,0.0026\right\},\mathrm{and}\\ {}{V}^{+}=\left\{0.0128,0.0083,0.0037,0.0016,0.0577,0.0193,0.0033\right\}.\end{array}} $$

Finally, the WIRI for each sample was calculated based on the distance of each assessment sample to the PIS and NIS in regard to each criterion by using Eq. (18), by which the final ranking of water inrush risk of the No. 11 coal seam from the Ordovician aquifer was determined for each assessment sample. Then, all the WIRI data were processed with Golden Software Surfer 13.0, and a WIRI contour map was established (Fig. 6). As shown in Fig. 6, the water inrush risk as represented by the WIRI ranges from 0.023 to 0.786 in the Zhaizhen coal mine.

Fig. 6
figure 6

Zoning map determined via the WIRI method of the water inrush risk of the No. 11 coal seam from the Ordovician aquifer

A total of 190 samples of these 1381 samples were gathered to test the prediction results, of which there were 187 samples (in 15 working faces) where safe extraction was achieved and three samples representing the occurrence of water inrushes from the Ordovician aquifer (Fig. 6 and Table 8). The WIRI values of the samples representing water inrush (Nos. T1, T2, T3) were not less than 0.100, and the WIRI values of the samples where safe extraction was achieved were not larger than 0.094 (Table 8). The results show that the risk ranking of samples with water inrush were higher than that of samples where safe extraction was achieved, demonstrating that the predictions by the WIRI method are in accordance with real-world situations. Therefore, the prediction accuracy based on the WIRI method is 100% (Table 8).

Table 8 Prediction results by the WIRI method

After validation, based on the geometric mean method of the WIRI values of samples with water inrush and samples with safe extraction, the water inrush risk of the No.11 coal seam was divided into two zones:

  • I: safe area (WIRI < 0.097), where water inrushes are unlikely, mainly situated in the southwestern and eastern parts of the Zhaizhen coal mine;

  • II: dangerous area (WIRI ≥ 0.097), with a higher probability of water inrush, includes the northern, northwestern, and a small area of the southern Zhaizhen coal mine, which was further classified into two subzones:

  • II-1: moderately dangerous area (0.097 ≤ WIRI < 0.135);

  • II-2: extremely dangerous area (WIRI ≥ 0.135).

Discussions

Relationship between water inrush and the selection factors

It is a challenging and difficult task to accurately predict the risk of water inrush. The aspects affecting water inrush were considered to be the aquifer, aquifuge, geological structure, and mining, described via seven factors: water abundance, water pressure of the Ordovician limestone aquifer, aquifuge thickness, brittle rock percentage within the aquifuge, fault intensity index, fault endpoint and intersection density, and the height of the mine-damaged zone.

Based on the TFN and AHP methods, the weights of the four aspects, aquifer, aquifuge, geological structure, and mining, are 0.294, 0.248, 0.351, and 0.107, respectively, and each of the seven factors considered in this study influences water inrush, with weights of 0.142, 0.152, 0.163, 0.085, 0.242, 0.109, and 0.107, respectively (Table 6, Fig. 7). The geological structure, represented by the fault intensity index and fault endpoint and intersection density, is considered critical to water inrush, and the fault intensity index is the most important factor affecting water inrush. The aquifer and aquifuge also have a strong influence on water inrush. The aquifer is positively related to water inrush, including the water abundance and water pressure of the Ordovician limestone aquifer. The aquifuge, resented by two factors, aquifuge thickness and brittle rock percentage within the aquifuge, has a positive relation with water inrush, and the aquifuge thickness has a more important role in the resistance to water inrush. Mining activities are taken into account for the assessment of the water inrush risk via one factor: the height of the mine-damaged zone has a weight of 0.107, indicating that this factor also affects the occurrence of water inrush.

Fig. 7
figure 7

Pie diagram of weights of factors

Comparison of the predictions by the WIRI method, T method, and AHP method

Comparison of the predictions by the WIRI and T methods

The T method was proposed in 1964 and has since been widely used in China, and was calculated with Eq. (19) according to the Coal Mine Water Control Rules (Ministry of Coal Industry 2018):

$$ T=\frac{F_{12}}{F_{21}} $$
(19)

where T indicates the water inrush coefficient (MPa/m) and F12 and F21 indicate the aquifer water pressure (MPa) and aquifuge thickness (m), respectively. The water inrush risk is determined by the T method: water inrush is prone to occur when T is larger than 0.06 MPa/m in the areas with simple structures or when T is larger than 0.10 MPa/m in areas with complex structures; otherwise, water inrush tends not to occur. Figure 8 shows the zoning map of the water inrush risk of the No. 11 coal seam from the Ordovician aquifer by T, which was processed and mapped with Golden Software Surfer 13.0.

Fig. 8
figure 8

Zoning map of the water inrush risk of the No. 11 coal seam from the Ordovician aquifer by the T method

Based on the results of the 190 test samples (187 safe mining samples and three water inrush samples from the Ordovician aquifer), the predictions by the T method do not agree well with the observations: the 187 safe mining samples were all classified as safe, while the three water inrush samples were also classified as safe (Table 9). Based on the 190 test samples, the prediction accuracy of the T method is 98.4%, but the samples representing water inrush are not recognized, which will lead to serious consequences. Thus, the results show that the WIRI method proposed in this study has a higher accuracy than that of the T method.

Table 9 Prediction results by the T and AHP methods

Comparison of the predictions by the WIRI and AHP methods

The AHP method, another important method, integrates multiple factors and plays an important role in assessing the probability of water inrush. The details and steps of AHP were described by Malczewski (1999) and Adiat (2012). Accordingly, the weights of the factors in each hierarchy were calculated based on the data in Tables 2, 3, 4, 5, and 6, and the total weights of seven assessment factors were calculated with Eq. (12). Then, the vulnerability index of floor water inrush was established as follows (Wu et al. 2011):

$$ \mathrm{VI}={\sum}_{i=1}^n{W}_i{f}_i\ \left(x,y\right)=0.110{f}_1\ \left(x,y\right)+0.130{f}_2\ \left(x,y\right)+0.140{f}_3\ \left(x,y\right)+0.114{f}_4\ \left(x,y\right)+0.156{f}_5\ \left(x,y\right)+0.140{f}_6\ \left(x,y\right)+0.211{f}_7\ \left(x,y\right) $$
(20)

where VI is the vulnerability index, Wi is the weight of the assessment factors, and fi (x, y) is the contribution function of the normalized value. x and y are the geographical coordinates, and n is the number of assessment factors.

Finally, the VI for each sample was calculated based on Eq. (20); and all the VI data were processed with Golden Software Surfer 13.0, and a VI contour map was established (Fig. 9). As shown in Fig. 9, the water inrush risk as represented by VI ranges from 0.013 to 0.068 in the Zhaizhen coal mine.

Fig. 9
figure 9

Zoning map of the water inrush risk of the No. 11 coal seam from the Ordovician aquifer by the AHP method

Based on the 190 test samples, the predictions by the AHP method do not agree well with the observations. The VI values of the water inrush samples (Nos. T1, T2, T3) were 0.033, 0.019, and 0.022. There were 19 safely extracted samples whose VI values were larger than 0.019, which was larger than the VI value of a sample with water inrush, T2 (Table 9). That is, these 19 safe mining samples were classified as water inrush. Based on the 190 test samples, the prediction accuracy of the AHP method is 90%. The results show that the WIRI method proposed in this study has a higher accuracy than that of the AHP method.

The zones of water inrush risk predicted by the WIRI and T methods were compared (Figs. 6 and 8), indicating that there is a larger difference between these two evaluations. For 62% of all assessment samples, the predictions by these two methods are the same, which were all classified as safe by these two methods and were mainly situated in the southwestern and eastern areas (in Figs. 6 and 8), which are characterized by a low fault intensity and fault endpoint and intersection density, poor water abundance, high brittle rock percentage, and small height of the mine-damaged zone. For 38% of all assessment samples, the predictions by these two methods are contradictory: these samples were determined to be dangerous by the WIRI method, but were determined to be safe by the T method, mainly in small areas of the southern, northern, and northwestern parts of the study area (Figs. 6 and 8), which is characterized by a low percentage of brittle rock, complex geological structure, rich water abundance, high water pressure and large height of the mine-damaged zone (Fig. 4). This difference in the predictions is mainly because only two factors, the water pressure of the Ordovician aquifer and aquifuge thickness, were considered by the T method.

And the zones of water inrush risk predicted by the WIRI and AHP methods were compared (Figs. 6 and 9). For 84% of all assessment samples, the predictions by these two methods are the same. While for 16% of all assessment samples, the predictions by these two methods are contradictory: 218 samples were determined to be safe by the WIRI method, but were determined to be dangerous by the AHP method; and two samples were determined to be dangerous by the WIRI method, but were determined to be safe by the AHP method. This difference in the predictions is mainly because AHP method does not consider the vagueness of human thought and uncertainty in real-world decision-making and is a linear model.

In predicted safe areas by the WIRI method, the predictions show a lower risk of water inrush; however, this does not mean that mining these areas is not dangerous. Reporting abnormal observations, such as changes in aquifer water production, variations in water level, and previously concealed faults around the working face, in a timely manner is necessary. Partial dewatering should be performed where abnormalities are found. The dangerous areas are divided into two subzones, moderately and extremely dangerous areas, where the occurrence probabilities of water inrushes are high. The larger the WIRI value, the higher the risk is in the dangerous area. When mining the No.11 coal seam in these areas, the indicators of floor water inrush must be carefully monitored, and preventive measures against water disaster should be taken. Attention should be paid to the changes in the Ordovician limestone water level at all times, and advanced geophysical exploration and drilling should be conducted when the excavation roadway approaches areas with complex hydrogeological conditions. It is also recommended that the Ordovician limestone aquifer be depressurized using dewatering wells and that the hydraulic connectivity with water enrichment areas is reduced by grouting when necessary. The investigation of geological structures, via methods such as the radio wave penetration method, Rayleigh channel wave prediction method, or other techniques, should be performed to identify small faults in front of any working face (Yang and Cheng 2012). The water content and permeability of the main faults need to be detected by geophysical methods or drilling before mining. Adequate coal pillars need to be retained according to the Coal Mine Water Control Rules (Ministry of Coal Industry 2018) for sealing permeable fractures and preventing water inrush from faults.

Conclusions

To prevent coal mine flooding from the underlying Ordovician aquifer in the coal mines of North China coalfields, it is imperative to accurately assess the water inrush risk. A WIRI model based on the TFN-AHP and TOPSIS methods was successfully proposed to assess the water inrush risk of the No. 11 coal seam from the underlying Ordovician aquifer in the Zhaizhen coal mine. Seven main factors were selected for assessing water inrush risk: the water abundance and water pressure of the Ordovician limestone aquifer, aquifuge thickness, brittle rock percentage within the aquifuge, fault intensity index, fault endpoint and intersection density, and height of the mine-damaged zone. The TFN-AHP method was used to determine the factor weights, which were 0.142, 0.152, 0.163, 0.085, 0.242, 0.109, and 0.107 respectively. Each factor plays an important role in water inrush, but the most important factors are the fault intensity index and the aquifuge thickness. A WIRI model was then established using the TOPSIS method based on the weights calculated by the TFN-AHP method and initial decision data. A zoning map of water inrush risk was built according to the WIRI data with Golden Software Surfer 13.0, and the study area was classified into two zones, the safe area (WIRI < 0.097) and the dangerous area (WIRI ≥ 0.097), which was further classified into two subzones, the moderately dangerous area (0.097 ≤ WIRI < 0.135) and the extremely dangerous area (WIRI ≥ 0.135). This zoning map will provide guidance for safer coal mining and water inrush prevention.

A validation was carried out via data analysis of samples from engineering practice, showing that predictions from the WIRI method conform to actual observations, while the predictions from the T method and AHP method do not agree well with the observations. Based on the 190 test samples, the prediction accuracy of the WIRI was 100%, while the prediction accuracies of the T and AHP methods were 98.4% and 90%, respectively. Based on the comparison of the results of the WIRI and T and AHP methods, the WIRI method proposed in this study has a higher accuracy than those of the T and AHP methods. For the T method, approximately 38% of the predictions were not in agreement, mainly in small areas of the southern, northern, and northwestern parts of the study area, mainly because only two factors, the water pressure of the Ordovician aquifer and aquifuge thickness, were considered by the T method. And for the AHP method, approximately 16% of the predictions were not in agreement, mainly because AHP method does not consider the vagueness of human thought and uncertainty in real-world decision-making and is a linear model.

The results of the case study show that the proposed method can effectively predict the water inrush risk and can be applied to other mines threatened by underlying aquifers. Moreover, the reliability of the predictions would be further improved with the use of additional data.