Abstract
Using the Australian weed risk assessment (WRA) model as an example, we applied a combination of bootstrapping and Bayesian techniques as a means for explicitly estimating the posterior probability of weediness as a function of an import risk assessment model screening score. Our approach provides estimates of uncertainty around model predictions, after correcting for verification bias arising from the original training dataset having a higher proportion of weed species than would be the norm, and incorporates uncertainty in current knowledge of the prior (base-rate) probability of weediness. The results confirm the high sensitivity of the posterior probability of weediness to the base-rate probability of weediness of plants proposed for importation, and demonstrate how uncertainty in this base-rate probability manifests itself in uncertainty surrounding predicted probabilities of weediness. This quantitative estimate of the weediness probability posed by taxa classified using the WRA model, including estimates of uncertainty around this probability for a given WRA score, would enable bio-economic modelling to contribute to the decision process, should this avenue be pursued. Regardless of whether or not this avenue is explored, the explicit estimates of uncertainty around weed classifications will enable managers to make better informed decisions regarding risk. When viewed in terms of likelihood of weed introduction, the current WRA model outcomes of ‘accept’, ‘further evaluate’, or ‘reject’, whilst not always accurate in terms of weed classification, appear consistent with a high expected cost of mistakenly introducing a weed. The methods presented have wider application to the quantitative prediction of invasive species for situations where the base-rate probability of invasiveness is subject to uncertainty, and the accuracy of the screening test imperfect
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
CB Begg RA Greenes (1983) ArticleTitleAssessment of diagnostic tests when disease verification is subject to selection bias Biometrics 39 207–215 Occurrence Handle6871349 Occurrence Handle1:STN:280:DyaL3s3lslGltg%3D%3D
KP Burnham DR Anderson (2002) Model Selection and Multimodel Inference: A Practical Information–Theoretic Approach Springer-Verlag New York
CC Daehler DA Carino (2000) ArticleTitlePredicting invasive plants: prospects for a general screening system based on current regional models Biological Invasions 2 93–102 Occurrence Handle10.1023/A:1010002005024
CC Daehler JS Denslow S Ansari H-C Kuo (2004) ArticleTitleA risk-assessment system for screening out invasive pest plants from Hawaii and other Pacific islands Conservation Biology 18 360–368 Occurrence Handle10.1111/j.1523-1739.2004.00066.x
RP Duncan PA Williams (2002) ArticleTitleDarwin’s naturalization hypothesis challenged Nature 417 608–609 Occurrence Handle12050652 Occurrence Handle10.1038/417608a Occurrence Handle1:CAS:528:DC%2BD38Xkt1eksLY%3D
RP Duncan PA Williams (2002) Taxonomic patterns in the naturalisation rate of plant species in New Zealand JH Spafford J Dodd JH Moore (Eds) Thirteenth Australian Weeds Conference Plant Protection Society of Western Australia Perth, Western Australia 183–185
B Efron RJ Tibshirani (1993) An Introduction to the Bootstrap Chapman and Hall New York
JJ Ewel DJ O’Dowd J Bergelson CC Daehler CM D’Antonio LD Gomez DR Gordon RJ Hobbs A Holt KR Hopper CE Hughes M LaHart RRB Leakey WG Lee LL Loope DH Lorence SM Louda AE Lugo PB McEvoy DM Richardson PM Vitousek (1999) ArticleTitleDeliberate introductions of species: research needs BioScience 49 619–630
G Gigerenzer (2002) Calculated Risks: How to Now When Numbers Deceive You Simon and Schuster New York
T Heger L Trepl (2003) ArticleTitlePredicting biological invasions Biological Invasions 5 313–321 Occurrence Handle10.1023/B:BINV.0000005568.44154.12
G Hughes LV Madden (2003) ArticleTitleEvaluating predictive models with application in regulatory policy for invasive weeds Agricultural Systems 76 755–774 Occurrence Handle10.1016/S0308-521X(02)00164-6
R Kohavi (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection CS Mellish (Eds) Proceedings of the Fourteenth Inter- national Joint Conference on Artificial Intelligence Morgan Kaufmann Publishers, Inc. Montréal, Québec 1137–1143
CS Kolar DM Lodge (2001) ArticleTitleProgress in invasion biology: predicting invaders Trends in Ecology and Evolution 16 199–204 Occurrence Handle11245943
CS Kolar DM Lodge (2002) ArticleTitleEcological predictions and risk assessment for alien fishes in North America Science 298 1233–1236 Occurrence Handle12424378 Occurrence Handle10.1126/science.1075753 Occurrence Handle1:CAS:528:DC%2BD38XosVerurg%3D
PM Kuhnert K Mengersen (2003) ArticleTitleReliability measures for local nodes assessment in classification trees Journal of Computational and Graphical Studies 12 1–19
WM Lonsdale (1994) ArticleTitleInviting trouble: introduced pasture species in northern Australia Australian Journal of Ecology 19 345–354
RN Mack D Simberloff WM Lonsdale H Evans M Clout FA Bazzaz (2000) ArticleTitleBiotic invasions: causes, epidemiology, global consequences, and control Ecological Applications 10 689–710
S Manel HC Williams SJ Ormerod (2001) ArticleTitleEvaluating presence-absence models in ecology: the need to account for prevalence Journal of Applied Ecology 38 921–931 Occurrence Handle10.1046/j.1365-2664.2001.00647.x
RAJ Matthews (1996) ArticleTitleBase-rate errors and rain forecasts Nature 382 766 Occurrence Handle10.1038/382766a0 Occurrence Handle1:CAS:528:DyaK28XltlWruro%3D
RAJ Matthews (1997) ArticleTitleDecision-theoretic limits on earthquake prediction Geophysics Journal International 131 526–529 Occurrence Handle10.1111/j.1365-246X.1997.tb06596.x
CE Metz (1978) ArticleTitleBasic principles of ROC analysis Seminars in Nuclear Medicine 8 283–298 Occurrence Handle112681 Occurrence Handle1:STN:280:DyaE1M3kvVyltQ%3D%3D
J Pearce S Ferrier (2000) ArticleTitleEvaluating the predictive performance of habitat models developed using logistic regression Ecological Modelling 133 225–245 Occurrence Handle10.1016/S0304-3800(00)00322-7
PC Pheloung PA Williams SR Halloy (1999) ArticleTitleA weed risk assessment model for use as a biosecurity tool evaluating plant introductions Journal of Environmental Management 57 239–251 Occurrence Handle10.1006/jema.1999.0297
DL Pimentel L Lach R Zuniga D Morrison (2000) ArticleTitleEnvironmental and economic costs associated with non-indigenous species in the United States BioScience 50 53–65
SH Reichard CW Hamilton (1997) ArticleTitlePredicting invasions of woody plants introduced into North America Conservation Biology 11 193–203 Occurrence Handle10.1046/j.1523-1739.1997.95473.x
DM Richardson P Pysek M Rejmanek MG Barbour FD Panetta CJ West (2000) ArticleTitleNaturalization and invasion of alien plants: concepts and definitions Diversity and Distributions 6 93–107 Occurrence Handle10.1046/j.1472-4642.2000.00083.x
JL Ruesink IM Parker MJ Groom PM Kareiva (1995) ArticleTitleReducing the risks of nonindigenous species introductions: guilty until proven innocent BioScience 45 465–477
JK Scott FD Panetta (1993) ArticleTitlePredicting the Australian weed status of southern African plants Journal of Biogeography 20 87–93
Smith C (1999) Studies on Weed Risk Assessment. Master of Applied Science, University of Adelaide
CS Smith WM Lonsdale J Fortune (1999) ArticleTitleWhen to ignore advice: invasion predictions and decision theory Biological Invasions 1 89–96 Occurrence Handle10.1023/A:1010091918466
Council UnitedStatesNational Research (2002) Predicting Invasions of Nonindigenous Plants and Plant Pests National Academy Press Washington, DC
D Vose (2000) Risk Analysis: A Quantitative Guide John Wiley and Sons Chichester, West Sussex
M Williamson A Fitter (1996) ArticleTitleThe varying success of invaders Ecology 77 1661–1665
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Caley, P., Lonsdale, W.M. & Pheloung, P.C. Quantifying Uncertainty in Predictions of Invasiveness. Biol Invasions 8, 277–286 (2006). https://doi.org/10.1007/s10530-004-6703-z
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10530-004-6703-z