Abstract
This paper introduces a new statistical method that we recommend should become standard procedure to quantify the goodness-of-fit of calibration and validation for land-use change models. We present a multiple-resolution Relative Operating Characteristic (ROC) that measures the goodness-of-fit between a reference map, which is considered reality, and a simulated map, which is a model’s output. This proposed ROC is based on: (1) multiple-resolutions, (2) soft classification, (3) sampling without replacement, and 4) explicit separation of factors of quantity versus location of land-use change. We illustrate the method with a case study in India’s Western Ghats, a biodiversity hotspot, where we have maps of cumulative forest disturbance for 1920 and 1990. We use a predictive modeling approach similar to GEOMOD in which we calibrate the model with the map of 1920, then predict the map of 1990, at which point we subject the model to validation. We show that the fit of calibration tends to be much larger than the fit of validation. Thus if a modeler assess a model by goodness-of-fit of calibration only, then the modeler will likely be over confident in the model’s predictive ability.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
InstitutionalAuthorNameArmy Map Service, Corps of Engineers (1944) Quarter Inch Sheet Survey of India Dehra Dun
K.S. Bawa S. Dayanandan (1997) ArticleTitleSocioeconomic factors and tropical deforestation Nature 386 562–563
K.S. Bawa S. Menon (1997) ArticleTitleBiological monitoring: the missing ingredients Trends in Ecology and Evolution 12 IssueID1 42
C.S. Jha C.B.S. Dutt K.S. Bawa (2000) ArticleTitleDeforestation and land use changes in Western Ghats, Indi Current Science 79 IssueID2 231–238
S. Menon K.S. Bawa (1997) ArticleTitleApplications of geographic information systems, remote-sensing, and a landscape ecology approach to biodiversity conservation in the Western Ghats Current Science 73 IssueID2 134–145
S. Menon K.S. Bawa (1998) ArticleTitleDeforestation in the tropics reconciling disparities in estimates for India. Ambio 27 IssueID7 576–577
N. Myers R.A. Mittermeier C.G. Mittermeier G.A. Fonseca J. Kent (2000) ArticleTitleBiodiversity hotspots for conservation priorities Nature 403 IssueID6772 853
R.G. Pontius SuffixJr. (2000) ArticleTitleQuantification error versus location error in comparison of categorical maps Photogrammetric Engineering and Remote Sensing 66 IssueID8 1011–1016
R.G. Pontius SuffixJr. (2002) ArticleTitleStatistical methods to partition effects of quantity and location during comparison of categorical maps at multiple resolutions Photogrammetric Engineering and Remote Sensing 68 IssueID10 1041–1049
Pontius Jr., R.G., Cornell J.D. and Hall C.A.S., 2001: Modeling the spatial pattern of land-use change with GEOMOD2: application and validation for Costa Rica. Agriculture, Ecosystems and Environment 191–203.
R.G. Pontius SuffixJr. L. Schneider (2001) ArticleTitleLand-cover change model validation by an ROC method for the Ipswich watershed, Massachusetts, USA Agriculture, Ecosystems & Environment 85 239–248
B.R. Ramesh S. Menon K.S. Bawa (1997) ArticleTitleA vegetation based approach to biodiversity gap analysis in the Agastyamalai Region, Western Ghats, India Ambio 26 IssueID8 529–537
J.A. Swets (1988) ArticleTitleMeasuring the accuracy of diagnostic systems Science June 1st 1285–1293
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gilmore Pontius, R., Pacheco, P. Calibration and validation of a model of forest disturbance in the Western Ghats, India 1920–1990. GeoJournal 61, 325–334 (2004). https://doi.org/10.1007/s10708-004-5049-5
Issue Date:
DOI: https://doi.org/10.1007/s10708-004-5049-5