Abstract
The outputs from general circulation models (GCMs) lack spatial and temporal accuracy for local and regional studies due to their large-scale networks. Therefore, there is a need to make the scale of outputs from these models smaller to the station and point scales. This has led to the development of regional and statistical models that have wide applications in climate change studies from the beginning of their introduction and decision-making for facing and adapting to the consequences of climate change in recent years. The models based on statistical methods are more popular and applicable due to their ease of use and because they do not need high computational power. Among the statistical methods, LARS-WG and SDSM are the most commonly used and valid downscaling models. In this study, the results of our analysis related to the performance of these two models in simulating temperature and precipitation changes in western Iran are presented. The weather stations under study include 17 stations with a long-term statistical period (1989–2018) in three provinces of Kurdistan, Kermanshah, and Ilam. To evaluate the performance of the models, MSE, RMSE, MAE, and R2 are used. The results show that the two models have an acceptable level of ability in simulating temperature and precipitation changes in the area under study. However, different results are reported for different stations and within different weather parameters. A comparison between the performance of the two models in simulating temperature and precipitation changes reveals that both of them have higher accuracy in simulating temperature than precipitation. Furthermore, the SDSM model is more successful in a monthly simulation of temperature and precipitation with lower uncertainty. However, it has a time-consuming and complicated simulation process. The LARS-WG model is more efficient in simulating annual precipitation and is simpler with a higher performance speed. In a nutshell, none of these models is better than the other and despite the differences in simulation, they can both be useful for examining climate changes. There is a need to use different models for examining the uncertainty of climate change.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The increase in greenhouse gases and the changes in climatic parameters have significant negative effects on different systems such as water resources, the environment, industries, health, agriculture, and all the other systems interacting with the climate system (Intergovernmental Panel on Climate Change (IPCC), 2007). The negative consequences of this phenomenon for humanity are such that among the ten factors threatening human beings in the twenty-first century such as poverty, nuclear weapons, and food shortages, climatic change comes first (IPCC 2001). Among the climatic elements, temperature and precipitation are of high importance due to their wide effects on other factors, especially the effects they have on human activities. So that almost all of the climate change on the Earth’s surface has been focused on these two parameters (Tabatabaei and Hosseini 2003; Salimi et al. 2018). Therefore, long-term predictions of climatic variables have been the focus of many scientific assemblies to know about the extent of changes in them and make the required preparations to moderate the negative effects caused by climatic changes. On this basis, GCM models have been developed (Qian et al. 2004). Although these models demonstrate meaningful results at the spatial atmospheric and continental scale and combine a major part of the complexity of the earth, they are not able to show the dynamics and shapes with a small-grid local scale (Carter et al. 1994; Wigley et al. 1990; Sharma et al. 2007). Therefore, evaluating the effect of climate change at the local scale requires an approach that fills the temporary spatial gap between large-scale climatic variables and meteorological variables at the local scale. In this case, the basic approach is to use downscaling techniques (Wilby et al. 2002). In fact, general circulation models (GCMs) can be never directly used for regional or point predictions. They are classified into statistical and dynamic models. The former is different from the latter for two major reasons: (1) it requires the observational (past) behavior of the station under study and (2) modeling these 2–3 months is done in a fraction of a second (Shamsipour 2013). Therefore, the most valid instrument for downscaling the GCM data is the statistical method. In this regard, Semenov et al. (1998) compared LARS-WG and WGEN models in 18 stations located in the United States, Europe, and Asia. Their results show that the LARS-WG model was better at producing different climate data including different severe weather events. Khan et al. (2006) analyzed uncertainty in three downscaling models including SDSM, LARS-WG, and ANNs. The results of their analysis show that SDSM and LARS-WG models yield better results, compared to the ANN model with lower accuracy. Hashemi et al. (2010) compared LARS-WG and SDSM models in simulating heavy precipitation in Clutha in the southern island of New Zealand. Their findings indicate that the two models have an equally good ability in simulating heavy precipitation and can be used for climatic predictions. Sunyer et al. (2015) compared well-known downscaling methods to examine extreme rainfall events in Europe. They found that statistical downscaling models had a higher accuracy. Ababayi et al. (2011) evaluated the performance of the LARS-WG model in simulating precipitation, temperature, and sunlight in the stations of the southern and northern coasts of Iran. They discovered that this model had an acceptable performance in simulating daily distribution and annual and seasonal distribution of most of the series. Aghashahi et al. (2012) introduced and compared the LARS-WG and SDSM models to downscale the environmental parameters in the studies on climate change. Their results showed that the SDSM model had a lower uncertainty and a more complicated simulation process while LARS-WG had more simplicity and a higher performance speed. Abkar et al. (2013) examined the efficiency of the SDSM model in simulating temperature indices in arid and semi-arid areas showing that the SDSM model has the required capability for simulating temperature indices. Hajjarpour et al. (2014) made a comparison between three models including LARS-WG, Weatherman, and CLIMGEN in simulating climatic parameters in three different climates in Gorgan, Gonbad, and Mashhad, Iran. Their findings were indicative of the higher efficiency of LARS-WG in simulating minimum temperature parameters. Goudarzi et al. (2015) evaluated the performance of downscaling models of SDSM and LARS-WG in the Urmia Lake basin in the northwest of Iran. Their findings were indicative of no absolute superiority of one model over the others. Sobhani et al. (2017) compared three downscaling models including SDSM, ANN, and LARS-WG in simulating temperature and precipitation changes in the northwest of Iran. The findings of their study showed that the performance of models varied depending on the type of regional climate. Ouji (2018) compared one-station and multi-station extreme temperature and precipitation events in the southern coasts of the Caspian Sea. Based on their findings, the performance of the multi-station downscaling method, particularly in downscaling of temperature indices, was better than the one-station method. Heydari Tasheh Kabood (2020) studies the effects of climate change on stream flows of the Urmia Lake basin in Iran using the LARS-WG model. The results showed that this model has high accuracy in simulating temperature and precipitation changes.
Based on the literature, among the statistical downscaling models used in examining climate change, SDSM and LARS-WG models are the highly used ones. This article presents the results of our analysis related to the performance of these two downscaling instruments in simulating temperature and precipitation changes in western Iran.
Data and methodology
The area under study included three provinces of Kurdistan, Kermanshah, and Ilam in the west of Iran. The analyzed data included the least temperature, maximum temperature, and precipitation in 17 selected weather stations across the region under study during the statistical period 1989–2018 on a daily basis. The geographical position and meteorological station study is demonstrated in Fig. 1. The geographical characteristics of the meteorological stations are presented in Table 1.
The model examined
The LARS-WG model is a random model for producing weather data using statistical downscaling techniques (Wilks 1992; Wilks and Wilby 1999). The first version of this model was presented as an instrument for statistical downscaling in Budapest in Hungary in 1990. As a downscaling model, this model has a high ability in predicting climate change despite the lower complexity of the simulation process and the input and output data (Semenov and Stratonovitch 2010). The input data for the model includes minimum temperature, maximum temperature, precipitation and the level of sunlight on a daily basis. This data should have a period of at least 30 years; in this study, the period 1989–2018 is considered as the base period. To use this model, the observed data of the basic period were received and examined to extract the statistical features of the data. To validate the data and ensure the ability of the model in the basic period, it is executed to create a series of synthetic data in the base period. Subsequently, the outputs are compared with the statistical features observed in the 30 years to evaluate the performance of the model in recreating the data. In this study, the latest version of this model, i.e. the sixth version (LARS-WG6) developed in 2018 for downscaling the Fifth Assessment Report (AR5), was used. This model produces weather parameters on a daily basis at the station scale by receiving meteorological data of the statistical period and output from the general circulation model in a period similar to the present and future statistical periods.
The SDSM downscaling model was developed by Wilby et al (2002) in England. It is based on the use of a combination of regression methods and the production of weather data. It was initially developed for producing climate change scenarios at a small scale, but with the effects of climate change becoming more apparent and passing from the static to the decision-making phase; it was used as decision-making software (Houshyar et al. 2018). The input data for the model included daily meteorological data related to the parameters under study and observational data related to the National Center for Environmental Prediction (NCEP). Since the output related to the large-scale predictors or NCEP variables have many variables, the most appropriate predictors related to the station of interest should be selected out of these variables. During this process, which is referred to as screening, the SDSM model carries out tests of correlation, partial correlation, and correlation between the predictor and predicted (generally precipitation and temperature) variables. Using these tests, the predictors that have a good correlation with the predicted variables are selected as the future climate predictors (Aghashahi et al. 2012). In this analysis, the 30-year NCEP data were used from 1989 to 2018, which included 26 independent atmospheric variables for validation and evaluation of the model to simulate temperature and precipitation parameters in the basic period.
The temperature and precipitation data of the meteorological stations studied were received from the Iran Meteorological Organization and NCEP predictor variables were downloaded from the https://sdsm.org.uk/data.html
Evaluation of model performance
For evaluating and analyzing the performance of the estimation and prediction models, there are different performance indices. In the following section, the indices used in this study will be briefly explained. The coefficient of determination (R2) is a dimensionless criterion and its best value is 1. Equation (1) shows how it is calculated (Salahi et al. 2017). Mean square error (MSE) can vary from 0 to infinity in an excellent performance, which is defined in the form of Eq. (2) (Helali et al. 2020). RMSE is used as an index for showing the difference between the simulated values and the measured values. This criterion, which is defined as Eq. (3), is used as the most common error index (Lin et al. 2006). Mean absolute error (MAE) is also utilized for comparing the case to case relative error of simulated values based on the measured values, which is expressed in Eq. (4) (Hu et al. 2001):
In the above equations, \({X}_{\mathrm{o}}\) indicates observed data, \({X}_{\mathrm{s}}\) represents simulated data and N shows the amount of data.
Results and discussion
To calibrate and ensure the accuracy of the LARS-WG model, it was first executed for the basic statistical period (1989–2018). Then the outputs from the model including the least temperature, maximum temperature, monthly precipitation, and standard deviation were compared with the observed data in the station under study. To ensure the accuracy of the SDSM downscaling model, the simulated parameters were evaluated using NCEP variables and real data for the basic statistical period. Based on the results from examining the correlation between NCEP variables and the observed data, the variables of average sea-level pressure, the geo-potential height of 500 hpa and mean temperature at the height of two meters had the highest correlation with the examined parameters (temperature and precipitation) in the study area. The results of an evaluation of the observed and simulated precipitation data by the two downscaling models including the LARS-WG and SDSM based on different statistical indices are presented in Table 2. The findings are indicative of the accuracy of the investigated models in different stations and areas. On average, the highest accuracy of the models in simulating precipitation was related to the Kangavar station and the least accuracy was in the Tazehabad and Marivan stations.
The results related to the performance of the downscaling model in simulating minimum temperature show that this model has high accuracy in simulating temperature that comparing the error between the observed and simulated data is very small and all the stations have an R2 value of 0.99. Based on the findings, the lowest error of the model concerning the least temperature was in the Kangavar station and the highest error was in Bijar and Tazeh Abad stations (see Table 3).
The results of analysis related to maximum temperature using different indices show that the LARS-WG model also had a high accuracy in downscaling maximum temperature. The highest and lowest accuracy of the models in this respect was in the Ghorveh and Tazehabad stations, respectively (see Table 4).
The results showed that the accuracy of the models varied in different stations and parameters. Both models had better accuracy in simulating temperature compared to precipitation. Besides, in simulating monthly precipitation, the SDSM model had a lower accuracy compared to the LARS-WG model in most of the stations, but in terms of simulating temperature parameters, it had a higher accuracy. In simulating temperature parameters also, both models were more successful in simulating maximum temperature than minimum temperature through the SDSM model had a higher accuracy compared to the LARS-WG model. Overall, the results of analysis related to the error measurement indices indicated that the SDSM downscaling model was more accurate in downscaling climatic parameters at the monthly scale, particularly concerning temperature indices in the area under study, which is consistent with earlier results of Aghashahi et al. (2012), Goudarzi et al. (2015) and Sobhani et al. (2017) studies.
To better illustrate the findings and ensure accuracy of the results from the investigated models, the simulated and observed minimum and maximum temperature and precipitation values were compared using comparative figures on a monthly and annual basis during the period under study in the stations of interest. Examining the maximum temperature pointed to the fact that in most of the months and annually, in all the stations, the SDSM model had a better performance than the LARS-WG model (see Figs. 2 and 3). Concerning the monthly figures, only the stations at the center of the provinces (Ilam, Sanandaj, and Kermanshah) are presented, due to a large number of stations.
A comparison between the means of the observed and simulated monthly and annual minimum temperature also showed that despite the high accuracy of the two models, the SDSM model is more successful (see Figs. 4 and 5). In a nutshell, based on the results related to temperature, the SDSM model had a better performance in simulating maximum rather than minimum temperature and also compared to the LARS-WG model.
Concerning the status of precipitation, the conditions are slightly different; the SDSM model was to some extent more successful in simulating monthly precipitation in some stations (see Fig. 6) while simulating annual precipitation in the period of interest, the simulated values by the LARS-WG model approached the observed values and in all the stations, the amount of precipitation estimated by the SDSM model was more than the observed values. In fact, the LARS-WG model was more successful than the SDSM model (Fig. 7). Our results were in agreement by Khan et al. (2006), Goudarzi et al. (2015), Salahi et al. (2017) and Heydari Tasheh Kabood et al. (2020) that obtained the high accuracy of these models in temperature and precipitation simulations.
Conclusion
This study presented the results of analysis related to the capabilities of two downscaling models of LARS-WG and SDSM in simulating temperature and precipitation changes in western Iran in the period 1989–2018. To assess the accuracy of the models, the MSE, RMSE, MAE, and R2 were used. The obtained results showed that both models had an acceptable level of ability in simulating temperature and precipitation changes in the area under investigation though their accuracy was not similar across different stations and different climatic parameters. Both models had lower accuracy in simulating precipitation than temperature. This might be due to the complexity involved in the precipitation process and its nature. The findings revealed that the SDSM model had the lowest error in simulating the observed data. Although the LARG-WG model had a good ability in simulating the observed data for downscaling, its ability is not equal to that of the SDSM model. In the SDSM model, downscaling is done via creating a regressive relationship between the predictors and the predicted in one station, but in the LARS-WG model, atmospheric large-scale variables have no direct role in simulating the data and the model analyzes them, first, to determine the parameters and the statistical properties of the observed data related to them. Then, in line with the type of future changes in the large-scale climatic variables, it changes the statistical parameters of the observed data and recreates the data in the future periods. Based on the error matrixes and comparing the two models, one of them cannot be entirely preferred over the other because in analyzing the performance of the models in different areas and for different climatic parameters and also the monthly and annual indices in the period under study, a difference was observed in the results and performance of the models. However, due to the type of simulation process and also the integrated structure of the SDSM model in downscaling the data and direct use of GCM models and large-scale NCEP data, the SDSM model had higher accuracy in simulating the data in the area under study. On the other hand, the LARS-WG model is better and provides users with more flexibility due to its simple mechanism, the input data for the model, the need for less skill, and its high-performance speed. The SDSM model, in contrast, has a relatively more complex process and needs more precision and specialization by the user. Besides meteorological parameters such as temperature, precipitation, sunny hours, and wind speed, this model can be applied to other hydrological and environmental variables including air quality, snow cover, evaporation and transpiration, wave height, etc. On the other hand, new climate change scenarios can be defined for the LARS-WG model, which can be useful in using these models in climate change discussions. It can be concluded that these models produce the statistical behavior of climate data in a weather station in terms of mean, standard deviation, etc. in a way that is similar to the statistical behavior of the observed data and none of the models has absolute superiority over the other. Because in any region before the executing of climate change models, testing their accuracy is essential (recommended by the Intergovernmental Panel on Climate Change (IPCC)). Also, according to the results of this study, it is possible to use the outputs of these models in climate change studies and predict the climatic parameters in the coming decades in different regions.
References
Ababaei B, Mirzaei F, Sehrabi T (2011) An evaluation of the performance of the LARS-WG model in 12 coastal stations of Iran. Iran Water Res 5(9):217–222
Abkar A, Habib Nejad M, Soleimani K, Naghavi N (2013) Examining the level of efficiency of the SDSM model in simulating temperature indices in the arid and semi-arid areas. Irrig Water Eng 4(14):1–17
Aghashahi M, Ardestani M, Niksokhan MH, Tahmasbi B (2012) Introducing and comparing LARS-WG and SDSM models to down-scale environmental parameters in climate change studies. In: Sixth National Specialized Environmental Engineering Conference and Exhibition, Tehran, p 10
Carter TR, Parry ML, Harasawa H, Nishioka S (1994) IPCC technical guidelines for assessing climate change impacts and adaptions, IPCC Special Report to Working Group II of IPCC, London
Goudarzi M, Salahi B, Hosseini SA (2015) Performance analysis of LARS-WG and SDSM downscaling models in simulation of climate changes in Urmia Lake Basin. Iran J Watershed Manag Sci Eng 9(31):11–22
Hajjarpour A, Yousefi M, Kamkar B (2014) Testing the accuracy of the simulation by LARS-WG, WeatherMan, and CLIMGEN models in simulating climatic parameters in three different climates (Gorgan, Gonbad, and Mashhad). Geogr Dev 35:201–215
Hashmi MZ, Shamseldin AY, Melville BW (2010) Comparison of SDSM and LARS-WG for simulation and downscaling of extreme precipitation events in a watershed. Stoch Environ Res Risk Assess 25:475
Helali J, Salimi S, Lotfi M, Hosseini SA, Bayat A, Ahmadi M, Naderizarneh S (2020) Investigation of the effect of large-scale atmospheric signals at different time lags on the autumn precipitation of Iran’s watersheds. Arab J Geosci 13(18):1–24
Heydari Tasheh Kabood SH, Hosseini SA, Heydari Tasheh Kabood A (2020) Investigating the effects of climate change on stream flows of Urmia Lake basin in Iran. Model Earth Syst Env 6(1):329–339
Houshyar M, Sobhani B, Hosseini SA (2018) Future projection of maximum temperature in Urmia through downscaling output of the CanESM2 Model. Geogr Plan 22(63):305–325
Hu TS, Lam KC, Ng ST (2001) River flow time series prediction with a range-dependent neural network. Hydrol Sci J 46:729–745
IPCC (2001) In: Watson RT, Zinyowera MC, Moss RH, Dokken DJ (eds) Special report on the regional impacts of climate change, an assessment of vulnerability. Cambridge University Press, Cambridge
IPCC (2007) Summary for policymakers, in climate change 2007. In: Solomon S, Qin D, Manning M, Chen Z, Marquis M, Averyt KB, Tignor M, Miller HL (eds) Climate change 2007: the physical science basis, contribution of working group I to the fourth assessment report of the intergovernmental
Khan MS, Coulibaly P, Dibike Y (2006) Uncertainty analysis of the statistical downscaling method. J Hydrol 319:357–382
Lin JY, Cheng CT, Chau KW (2006) Using support vector machines for long-term discharge prediction. Hydrol Sci J 51:599–612
Ouji R (2018) Comparing mono-station and multi-stational downscaling of temperature and precipitation extremes (a case study of southern coasts of the Caspian Sea). J Earth Space Phys 44(2):397–410
Qian B, Gameda S, Hayhoe H, DeJong R, Bootsma A (2004) Comparison of LARS-WG and AAFC-WG stochastic weather generators for diverse Canadian climates. Clim Res 2004:26
Salahi B, Goudarzi M, Hosseini SA (2017) Predicting the temperature and precipitation changes during the 2050s in Urmia Lake Basin. Watershed Eng Manag 8(4):425–438
Salimi S, Balyani S, Hosseini SA, Momenpour SE (2018) The prediction of the spatial and temporal distribution of precipitation regime in Iran: the case of Fars province. Model Earth Syst Env 4(2):565–577
Semenov M, Brooks R, Barrow E, Richardson C (1998) Comparison of the WGEN and LARS-WG stochastic weather generators for diverse climates. Clim Res 10:95–107
Semonov MA, Stratonovitch P (2010) Use of multi-model ensembles from global climate models for assessment of climate change impacts. Clim Res 41:1–14
Shamsipour AA (2013) Climatic modeling: theory and method. In: University of Tehran Publications, first edition, p 294
Sharma D, Gupta AD, Babel MS (2007) Spatial disaggregation of bias-corrected GCM precipitation for improved hydrologic simulation: Ping River Basin, Thailand. Hydrol Earth Syst Sci 11:1373–1390
Sobhani B, Eslahi M, Babaeian I (2017) Comparing the methods of statistical downscaling of climate change models in simulating climatic elements in the northwest of Iran. Natural Geogr Res 4(2):321–325
Sunyer MA, Hundecha Y, Lawrence D, Madsen H, Willems P, Martinkova M, Vormoor K, Bürger G, Hanel M, Kriaučiūnienė J, Loukas A, Osuch M, Yücel I (2015) Inter-comparison of statistical downscaling methods for projection of extreme precipitation in Europe. Hydrol Earth Syst Sci 19:1827–1847
Tabataba-ei H, Hoseini M (2003) Examining climate change in Semnan based on precipitation parameters and mean monthly temperature. In: Third Regional Conference and the First National Conference on Climate Change, Isfahan, Iran
Wigley TWL, Jones PD, Briffa KR, Smith G (1990) Obtaining sub-grid scale information from coarse resolution general circulation model output. J Geophys Res 951:1943–1953
Wilby RL, Dawson CW, Barrow EM (2002) SDSM- a decision support tool for the assessment of regional climate change impacts. Environ Model Softw 17:147–159
Wilks DS (1992) Adapting stochastic weather generation algorithms for climate change studies. Clim Change 22:67–84
Wilks DS, Wilby RL (1999) The weather generation game: a review of stochastic weather models. Prog Phys Geogr 23:329–357
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lotfi, M., Kamali, G.A., Meshkatee, A.H. et al. Performance analysis of LARS-WG and SDSM downscaling models in simulating temperature and precipitation changes in the West of Iran. Model. Earth Syst. Environ. 8, 4649–4659 (2022). https://doi.org/10.1007/s40808-022-01393-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40808-022-01393-8