1 Introduction

Drought is known to be the worst hydro-meteorological hazard of nature (Mishra and Desai 2005). It is a temporary event which lasts for months to years. According to Wilhite (2000), droughts can occur in any region in the world and in any kind of environment (arid, semi-arid or humid). The inter-annual variability in precipitation makes the arid region always at drought risk due to greater probability of below average precipitation (Smakhtin and Schipper 2008). According to the Centre for Research on the Epidemiology of Disasters (CRED), the drought causes large scale economical losses in a region and makes it more vulnerable for other hydro-meteorological disasters (Guha-Sapir et al. 2014). Obasi (1994) reported extreme meteorological events contribute approximately 85% of the natural disasters. Droughts generally occur due to below normal precipitation over a region and strengthen with the passage of time (Rossi 2000). The timely information about the inception of drought and its propagation over an area is very useful for drought preparedness and mitigation. Therefore, information gained by using different drought indices can be very helpful for drought monitoring. The drought frequency and intensity provide valuable information to policy makers for making timely contingency plans (Morid et al. 2006).

Many drought indices are being used around the region as just a single drought index does not provide the comprehensive drought information since climatic conditions vary from region to region. These drought indices are used to determine the drought severity and its spatio-temporal extent (Hayes 2000). According to Mendicino et al. (2008), drought indices provide a comprehensive picture of drought, which are very useful to monitor drought. The choice of drought index is very important for effective monitoring of drought in a region. Some of the drought indices used by national hydro-meteorological organizations are; SPEI and PDSI (Palmer 1968) in the United States, CZI by the meteorological Centre of China (Wu et al. 2001), DI by National Meteorological Centre of Australia (Gibbs and Maher 1967), RDI in many meteorological services of European countries, and SPI (McKee et al. 1993) which is a most commonly used indicator around the world to monitor and follow drought conditions as recommended by the world meteorological organization (WMO 2012; Hayes et al. 2011). Recent study by Adnan et al. (2015) on drought in Pakistan reflect good results using SPI only. No one (to be best of our knowledge) has used other indices to verify their capabilities pertaining to drought monitoring in Pakistan. The main focus of present study is the comparison of various drought indices and to evaluate the applicability and performance of drought indices in Pakistan. This would also be helpful to national hydro meteorological services for monitoring and early warning of drought, the water resource management and future climate change adaptation in the region.

2 Data and methodology

2.1 Study area

Pakistan lies in the domain of 23°39N–37°01N and 60°49E–77°40E with a total area of 796,096 km2 (Fig. 1). Due to diversified topography, it experiences tropical to subtropical types of climate. Generally, two major atmospheric phenomena, i.e. South Asian summer monsoon and western disturbances, cause rainfall in Pakistan during the summer and winter seasons. These rainfall systems contribute almost 45 and 31% of the annual rainfall during the monsoon (JAS) and winter (DJFM) seasons respectively (Fig. 2). The average temperature ranges from 12 to 20 and 19 to 35 °C during winter and summer respectively. The area weighted mean annual precipitation varies between 30 and 400 mm from low (south) to high (north) latitudes with a maximum 900–1800 mm in sub-mountainous region (Adnan and Khan 2009). The monsoon rainfall overcomes the moisture stress during Kharif season (May to September) and fulfills the water demands of crops during the Rabi season (October to April) as well. The arid region covers 75% land of Pakistan with a maximum in southern half of the country that makes it more vulnerable to drought.

Fig. 1
figure 1

Geographical location of Pakistan along with the In-situ meteorological network of Pakistan Meteorological Department (PMD)

Fig. 2
figure 2

Percentage distribution of seasonal precipitation during (1981–2010) of Pakistan

2.2 Data

The long term (1951–2014) monthly climatic data of precipitation (mm) and temperature (maximum and minimum) have been used in this study. For calculating 15 drought indices, 64 year’s data were obtained from 58 meteorological stations of Pakistan Meteorological Department (PMD). The idea here is to investigate the response of each index during the drought conditions over the whole country. These indices named; standardized precipitation index (SPI), standardized precipitation temperature index (SPTI) or S-Index, standardized precipitation evapotranspiration index (SPEI), weighted anomaly standardized precipitation index (WASPI), rainfall variability index (RVI), standardized soil moisture anomaly index (SSMAI), Z-Score, modified CZI (MCZI), China Z-index (CZI), the deciles index (DI), percent of normal precipitation index (PNPI), Palmer drought severity index (PDSI), composite index (CI), PAWD, and reconnaissance drought index (RDI). The performance of 12 indices is assessed with SPI by using statistical criterion (Willmott 1982; Willmott and Wicks 1980); namely standard deviation (STDEV), standard error of mean (SEM), mean bias error (MBE), mean absolute error (MAE), standard error of estimate (SEE), coefficient of residual Mass (CRM), root mean square error (RMSE), coefficient of adjustment (CA), efficiency of model (EF), relative error in percentage (RE%), correlation coefficient(R), ratio between both average estimation of drought index (r), concordance index or index of agreement(D), and confidence level (C).

2.3 Drought indices

A total of 15 drought indices are used here. A detailed description can be seen in “Appendix”.

2.4 Statistical tests

Twelve indices performance is assessed with SPI by using statistical criterion as presented in Appendix Table 2, for example STDEV, SEM, MBE, MAE, SEE, CRM, RMSE, CA, EF, RE%, R, r, D, and confidence level (C) (Willmott 1982; Willmott and Wicks 1980). The STDEV measures the variability within the data, whereas SEM estimates the variability among different data. The SEE measures the accuracy, whereas MBE provides the difference between the mean of predicted and observed variable. Furthermore, MAE is less sensitive to extreme values than RMSE; therefore, it is preferred for small or limited datasets. The lower values of MAE, RMSE, MBE, SEE, and SEM show high efficiency and vice versa (Tanny et al. 2008). The positive and negative values describe over and underestimation respectively (Wackernagel 2003). CA represents the coefficient of adjustment. EF closer to 1 represents model is more efficient and suitable, whereas a negative value shows uncertainty and inconsistency in the result (Kouchakzadeh and Nikhbakht 2004). Positive values of CRM show under estimate and negative values over estimate (Zare-Abyaneh et al. 2010).

The confidence index (C) may be calculated by the product of the model lineal correlation coefficient (R) by concordance (D). The values of concordance and confidence index vary from 0 to 1, where 1 indicates a complete agreement between the observed and predicted indices and 0 indicates complete disagreement. The correlation coefficient (R) or coefficient of determination (R2) is a good test to determine the ability of the model to predict events and it has been accepted by the geographers as the most reliable measure to test the model’s ability to estimate events (McCuen and Snyder 1975). The values near to 1 indicate good relationship.

2.5 Significance test

2.5.1 Mann–Kendall test

The linear trend of monthly, seasonal, and annual precipitation and temperature are calculated using Mann Kendal Test, which has been broadly used to analyze the long term climatological and hydrological time series (e.g., Zhang et al. 2010, 2015; Tabari et al. 2011, 2012; Du et al. 2013; Gocic and Trajkovic 2014). The following procedure is used to calculate the variance of equation as:

$$Var\left( S \right)=\frac{1}{{18}}\left[ {n(n - 1)(2n+5) - \mathop \sum \limits_{{p=1}}^{q} {t_p}({t_p} - 1)(2{t_p}+5)} \right]$$
(1)

where q number has the same value of sample data and \({t_p}\) is the data values of the pth group. The statistics S is:

$$S=\mathop \sum \limits_{{j=1}}^{{n - 1}} \mathop \sum \limits_{{k=j+1}}^{n} sgn\left( {{x_k} - {x_j}} \right)$$
(2)

where j and k are the data values, n represents the data length and sgn(θ) is the significant function varies from − 1 to 1.

$$Z=\left\{ {\begin{array}{*{20}{l}} {\frac{{S - 1}}{{\sqrt {Var(S)} }}\quad if~S> 0} \\ {0\quad\quad \quad if~S=0} \\ {\frac{{S+1}}{{\sqrt {Var(S)} }}\quad if~S < 0} \end{array}} \right.$$
(3)

The value of Z is approximately normal distributed and positive value of Z greater than 1.96 represents the significant increasing trend, whereas negative value lower than − 1.96 indicates a significant decreasing trend.

2.5.2 Sen’s slope method

The true slope (change per unit time) of linear time series trend is determined by Sen (1968).

$$~f\left( t \right)=Mt+C$$
(4)

where f(t) is the function of linear trend, M and C are the slope and constant of equation, respectively. This method estimates the magnitude of trend as follows:

$$Q=median\frac{{{X_i} - {X_j}}}{{{t_i} - {t_j}}}$$
(5)

where \({x_i}\) and \({x_j}\) are the data values at times \({t_i}\) and \(~{t_j}(i>j)\), respectively.

3 Results and discussion

The southern region (low latitude) receives less amount of precipitation as compared to northern parts (high latitude) of Pakistan. The amount of precipitation deceases as the distance from the sea increases in southern Pakistan (Adnan and Khan 2009). The latitudinal distribution of annual precipitation of the country shows a maximum increase between the 32°N to 36°N (Fig. 3). The main reason of high amount of annual rainfall in northern regions are the two seasonal weather systems i.e. summer monsoon and western disturbances (Ullah and Gao 2013), that occurs in summer and winter respectively. Whereas, some of the southern parts of Pakistan also receive rainfall during the summer or winter seasons because of these weather systems, however, the magnitude and frequency of rainfall is less than the northern regions. The failure in seasonal rainfall makes this region more vulnerable towards drought. Therefore, the frequency, severity and impacts of droughts are more widespread in southern parts of the country.

Fig. 3
figure 3

Geographical distribution of annual rainfall of 58 meteorological stations of Pakistan

3.1 Analysis of drought indices

The SPI is calculated by probability fitted distribution of accumulated precipitation and it was transformed to a normal distribution (Edwards and McKee 1997). The normalized data of SPI behaves equally well for both dry and wet climates and thus could be used to monitor drier and wetter periods. The simplicity, versatility and least data information makes it more widely used index around the world. Most importantly, SPI responds well to the soil moisture deficiency during the drought years (1999–2002). Therefore, we used SPI as a prime index to calibrate the other indices. Thus the time series analysis of fifteen drought indices along with correlation coefficient for SPI with respect to RVI, MCZI, Z score, CZI, S-index, RDI, SPEI, C Index, WASP Index, Sc-PDSI and SSMA Index have been computed for 58 stations of Pakistan. The spatial analysis was performed to find the Pearson correlation coefficient (r) of SPI to other indices on annual basis (Fig. 4). Furthermore, the statistical error tests were also applied to determine the performance of each index to SPI. The value of the coefficient of determination (R2) varies from 0.12 to 0.77. The highest value of Pearson correlation coefficient (r) was 0.88 for SPEI and the lowest 0.34 for SSMAI. It is noted that SPI has a very good correlation with SPEI, CI, RDI and Z-score (Fig. 4). The value of SPI tends to be higher (less negative) in direr period and lower (less positive) in the wet period as compared to CZI, RVI, MCZI and Z-score. The value of R2 varies from 0.56 to 0.60 between SPI and these indices. Similarly, the SSMAI, Sc-PDSI and S-index also provide the lower values than the SPI during drought periods, whereas the WASPI slightly overestimates the drought conditions. The relative frequency of deciles, percent of normal (PCN), PAWD and SPI is calculated for dry and wet periods. The histogram shows the dry period along the x-axis as follows: Extreme drought (ED), severe drought (SD), Moderate drought (MD) and Mild drought (MID), whereas we add all the wet classes into a single class Wet (W) and Normal is shown by N (Fig. 5). The drought and wet classes in DI, PCN and PAWD are higher than SPI, while normal status is much lower. The total relative frequency (%) of SPI for dry, wet and normal period was 25, 27 and 48% respectively. Similarly, the total relative frequency of PAWD and PCN is 42% for dry and 38 and 36% for wet and DI is 41% for both periods respectively. These results depict the precipitation change impacts are much higher to the sensitivity of these indices, as compared to SPI.

Fig. 4
figure 4

Spatial correlation of SPI to 11 different drought indices over Pakistan

Fig. 5
figure 5

Histogram of relative drought frequency classes of SPI and a decile, b PCN, c PAWD for Pakistan in 1951–2014

The annual time series helps to identify the historical drought episode in a region. Therefore, the long term time series analysis of 15 drought indices has been conducted for Pakistan (Figs. 6, 7). The trend line was plotted by using linear regression method. The analysis shows an increasing trend for all the drought indices except for SC-PDSI and SSMAI, where it is slightly decreasing. The result shows that all the parameters responded well during the drought period. However, SPI, SPEI, RDI, CI, RVI, CZI, Z-score, MCZ score and WASPI respond better to drought identification and its onset. The negative values are reported less for SPI than for CZI; same result is also identified by Wu et al. (2001). MCZI has also shown good results for drought identification. Significant changes in the original CZI were observed by changing the median values with the mean of precipitation. As compared to SPI, Z-score shows lower and higher values during dry and wet periods respectively. The SPTI, SSMAI and Sc-PDSI showed variability during dry and wet periods. These indices indicate high negative values during the drought period. The value of deciles, area weighted departure (%) and percent of normal are also good indices to identify the drought period. These three indices also have the capability to capture the historical drought years relative to negative SPI i.e. the deciles (1 and 2), AWD below 40% and the percent of normal rainfall remains 60% (Fig. 7).

Fig. 6
figure 6

Annual time-series analysis of different drought indices in Pakistan

Fig. 7
figure 7

Time-series analysis of a decile, b PAWD, c percent of normal (PCN) of Pakistan

3.2 Statistical analysis

The efficiency of any model may be evaluated by using different statistical tests as discussed earlier. By comparing these results, we identified those models that respond well to monitor drought in Pakistan (Table 1). The efficiency of a model depends upon the error i.e. if the model shows lowest error, then its accuracy will be high and vice versa. The two indices (SPEI and RDI) show the lowest values of all the error and their sum of the error is lower than the rest of the drought indices. Moreover, their efficiency, concordance and confidence index is close to 1, indicating that the above two indices are good to monitor drought. The negative value of MBE represents high bias error, which shows predication values are smaller than SPI. The SPEI has the highest efficiency (76%), correlation (r = 0.88), concordance (0.93) and confidence index (0.82), and minimum error values makes it more suitable drought indicator after SPI. Similarly, RDI has 57% efficiency, 0.81 linear correlations and 0.89 concordances with a confidence level of 0.72. The evapotranspiration and precipitation data used for the calculation of SPEI and RDI make both indices helpful tool for the prediction and monitoring of drought in a region. The negative efficiency of SPTI (S-Index) and SSMAI shows ambiguity with respect to SPI. The statistical test results applied to different drought indices show the best response to drought monitoring in terms of their efficiency and confidence in climate of Pakistan after SPI (right to left), whereas the performance of deciles, %AWD and percent of normal are good indices to drought monitoring in the selected region.

Table 1 Statistical test to evaluate the performance of different drought indices across Pakistan

The trend significance and magnitude of trend are calculated by using Mann Kendal and Sen’s Slope tests on different drought indices (Fig. 6). All drought indices suggest increasing trends in precipitation. Most of the drought indices are statistically significant except PAWD, S-index, Sc-PDSI, SPI, SSMAI and Z-Score. The maximum magnitude of trend is noted in PCN of rainfall increase 0.44 mm per year, whereas the rest of the significant indices are increasing by a value of 0.01–0.02 mm per year (Fig. 8). This positive increase in all the drought indices represents the reduction of drought conditions across whole Pakistan, however, there could be regional differences in different climate zones of Pakistan which warrant further investigation.

Fig. 8
figure 8

Magnitude of trend by using Sen’s Slope test of different drought indices. The hollow bars represent trends which are not statistically significant at 95% confidence level based on Mann Kendal test

3.3 Drought episode (1999–2002)

Severe and longest drought episode experienced over most parts of Asia are during the years (1999–2002) as indicated by Malik et al. (2013). The comparison of recent long episode of drought (1999–2002) as well as the historical drought period and its intensity was determined. This period was identified by all the drought indices. However, the severity and intensity of drought for each of the index were different. The SPTI highly responded to drought as the time period prolong. Almost all the indices show that drought slowly and gradually progresses and strengthen with the passage of time, except SSMAI, showing weakening (Fig. 9). The onset of drought was reported in 1999, but we may see that most of the drought indices (RVI, Z-score, MCZI, CZI, RDI and WASPI) were not able to capture this drought commencement. The identification of drought (onset and retrieve) makes it the most complex hydro-meteorological disasters among all the natural disasters. The deciles, PAWD and PCN also identify the same drought period mentioned above. The deciles gradually reduced from 4 to 1, PAWD from − 20.7 to − 49.3% and PCN from 72.4 to 47.9% during 1999 to 2002 (Fig. 10). All the indices indicate that 2002 was the most severe drought in Pakistan.

Fig. 9
figure 9

Drought indices during long episode of drought (1999–2002) across Pakistan

Fig. 10
figure 10

Performance of decile, AWD (%) and percent of normal during 1999–2002 across Pakistan

4 Conclusions

This study evaluated the drought conditions by using 15 drought indices in Pakistan. The performance of precipitation based drought indices (MCZI, Z-score, CZI, WASPI and RVI) is similar to SPI, however their intensities are different. The SPTI, SSMAI and Sc-PDSI indicate high variation towards negative values, whereas the CI did not show variation. The deciles are more sensitive to drought conditions in terms of intensity, whereas PAWD and PCN showed insignificant drought intensity. The performance based statistical analysis show that SPEI and RDI are the best drought indices as these two use evapotranspiration and precipitation data, which enable them to depict a more real picture of drought conditions. The trend analysis shows that almost all drought indices are significantly increasing towards the positive side, resulting in more wetness than dryness. All the drought indices efficiently captured the longest episode of drought 1999–2002. In the light of above results, it is recommended to use the SPI, SPEI and RDI to monitor drought conditions in Pakistan and surrounding region. However, the development of new composite drought index comprising rainfall, temperature, and remote sensing index is needed which could be an advantage to monitor and identify the drought conditions in the region.