Skip to main content
Log in

Quantifying Uncertainty in Predictions of Invasiveness

  • Published:
Biological Invasions Aims and scope Submit manuscript

Abstract

Using the Australian weed risk assessment (WRA) model as an example, we applied a combination of bootstrapping and Bayesian techniques as a means for explicitly estimating the posterior probability of weediness as a function of an import risk assessment model screening score. Our approach provides estimates of uncertainty around model predictions, after correcting for verification bias arising from the original training dataset having a higher proportion of weed species than would be the norm, and incorporates uncertainty in current knowledge of the prior (base-rate) probability of weediness. The results confirm the high sensitivity of the posterior probability of weediness to the base-rate probability of weediness of plants proposed for importation, and demonstrate how uncertainty in this base-rate probability manifests itself in uncertainty surrounding predicted probabilities of weediness. This quantitative estimate of the weediness probability posed by taxa classified using the WRA model, including estimates of uncertainty around this probability for a given WRA score, would enable bio-economic modelling to contribute to the decision process, should this avenue be pursued. Regardless of whether or not this avenue is explored, the explicit estimates of uncertainty around weed classifications will enable managers to make better informed decisions regarding risk. When viewed in terms of likelihood of weed introduction, the current WRA model outcomes of ‘accept’, ‘further evaluate’, or ‘reject’, whilst not always accurate in terms of weed classification, appear consistent with a high expected cost of mistakenly introducing a weed. The methods presented have wider application to the quantitative prediction of invasive species for situations where the base-rate probability of invasiveness is subject to uncertainty, and the accuracy of the screening test imperfect

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • CB Begg RA Greenes (1983) ArticleTitleAssessment of diagnostic tests when disease verification is subject to selection bias Biometrics 39 207–215 Occurrence Handle6871349 Occurrence Handle1:STN:280:DyaL3s3lslGltg%3D%3D

    PubMed  CAS  Google Scholar 

  • KP Burnham DR Anderson (2002) Model Selection and Multimodel Inference: A Practical Information–Theoretic Approach Springer-Verlag New York

    Google Scholar 

  • CC Daehler DA Carino (2000) ArticleTitlePredicting invasive plants: prospects for a general screening system based on current regional models Biological Invasions 2 93–102 Occurrence Handle10.1023/A:1010002005024

    Article  Google Scholar 

  • CC Daehler JS Denslow S Ansari H-C Kuo (2004) ArticleTitleA risk-assessment system for screening out invasive pest plants from Hawaii and other Pacific islands Conservation Biology 18 360–368 Occurrence Handle10.1111/j.1523-1739.2004.00066.x

    Article  Google Scholar 

  • RP Duncan PA Williams (2002) ArticleTitleDarwin’s naturalization hypothesis challenged Nature 417 608–609 Occurrence Handle12050652 Occurrence Handle10.1038/417608a Occurrence Handle1:CAS:528:DC%2BD38Xkt1eksLY%3D

    Article  PubMed  CAS  Google Scholar 

  • RP Duncan PA Williams (2002) Taxonomic patterns in the naturalisation rate of plant species in New Zealand JH Spafford J Dodd JH Moore (Eds) Thirteenth Australian Weeds Conference Plant Protection Society of Western Australia Perth, Western Australia 183–185

    Google Scholar 

  • B Efron RJ Tibshirani (1993) An Introduction to the Bootstrap Chapman and Hall New York

    Google Scholar 

  • JJ Ewel DJ O’Dowd J Bergelson CC Daehler CM D’Antonio LD Gomez DR Gordon RJ Hobbs A Holt KR Hopper CE Hughes M LaHart RRB Leakey WG Lee LL Loope DH Lorence SM Louda AE Lugo PB McEvoy DM Richardson PM Vitousek (1999) ArticleTitleDeliberate introductions of species: research needs BioScience 49 619–630

    Google Scholar 

  • G Gigerenzer (2002) Calculated Risks: How to Now When Numbers Deceive You Simon and Schuster New York

    Google Scholar 

  • T Heger L Trepl (2003) ArticleTitlePredicting biological invasions Biological Invasions 5 313–321 Occurrence Handle10.1023/B:BINV.0000005568.44154.12

    Article  Google Scholar 

  • G Hughes LV Madden (2003) ArticleTitleEvaluating predictive models with application in regulatory policy for invasive weeds Agricultural Systems 76 755–774 Occurrence Handle10.1016/S0308-521X(02)00164-6

    Article  Google Scholar 

  • R Kohavi (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection CS Mellish (Eds) Proceedings of the Fourteenth Inter- national Joint Conference on Artificial Intelligence Morgan Kaufmann Publishers, Inc. Montréal, Québec 1137–1143

    Google Scholar 

  • CS Kolar DM Lodge (2001) ArticleTitleProgress in invasion biology: predicting invaders Trends in Ecology and Evolution 16 199–204 Occurrence Handle11245943

    PubMed  Google Scholar 

  • CS Kolar DM Lodge (2002) ArticleTitleEcological predictions and risk assessment for alien fishes in North America Science 298 1233–1236 Occurrence Handle12424378 Occurrence Handle10.1126/science.1075753 Occurrence Handle1:CAS:528:DC%2BD38XosVerurg%3D

    Article  PubMed  CAS  Google Scholar 

  • PM Kuhnert K Mengersen (2003) ArticleTitleReliability measures for local nodes assessment in classification trees Journal of Computational and Graphical Studies 12 1–19

    Google Scholar 

  • WM Lonsdale (1994) ArticleTitleInviting trouble: introduced pasture species in northern Australia Australian Journal of Ecology 19 345–354

    Google Scholar 

  • RN Mack D Simberloff WM Lonsdale H Evans M Clout FA Bazzaz (2000) ArticleTitleBiotic invasions: causes, epidemiology, global consequences, and control Ecological Applications 10 689–710

    Google Scholar 

  • S Manel HC Williams SJ Ormerod (2001) ArticleTitleEvaluating presence-absence models in ecology: the need to account for prevalence Journal of Applied Ecology 38 921–931 Occurrence Handle10.1046/j.1365-2664.2001.00647.x

    Article  Google Scholar 

  • RAJ Matthews (1996) ArticleTitleBase-rate errors and rain forecasts Nature 382 766 Occurrence Handle10.1038/382766a0 Occurrence Handle1:CAS:528:DyaK28XltlWruro%3D

    Article  CAS  Google Scholar 

  • RAJ Matthews (1997) ArticleTitleDecision-theoretic limits on earthquake prediction Geophysics Journal International 131 526–529 Occurrence Handle10.1111/j.1365-246X.1997.tb06596.x

    Article  Google Scholar 

  • CE Metz (1978) ArticleTitleBasic principles of ROC analysis Seminars in Nuclear Medicine 8 283–298 Occurrence Handle112681 Occurrence Handle1:STN:280:DyaE1M3kvVyltQ%3D%3D

    PubMed  CAS  Google Scholar 

  • J Pearce S Ferrier (2000) ArticleTitleEvaluating the predictive performance of habitat models developed using logistic regression Ecological Modelling 133 225–245 Occurrence Handle10.1016/S0304-3800(00)00322-7

    Article  Google Scholar 

  • PC Pheloung PA Williams SR Halloy (1999) ArticleTitleA weed risk assessment model for use as a biosecurity tool evaluating plant introductions Journal of Environmental Management 57 239–251 Occurrence Handle10.1006/jema.1999.0297

    Article  Google Scholar 

  • DL Pimentel L Lach R Zuniga D Morrison (2000) ArticleTitleEnvironmental and economic costs associated with non-indigenous species in the United States BioScience 50 53–65

    Google Scholar 

  • SH Reichard CW Hamilton (1997) ArticleTitlePredicting invasions of woody plants introduced into North America Conservation Biology 11 193–203 Occurrence Handle10.1046/j.1523-1739.1997.95473.x

    Article  Google Scholar 

  • DM Richardson P Pysek M Rejmanek MG Barbour FD Panetta CJ West (2000) ArticleTitleNaturalization and invasion of alien plants: concepts and definitions Diversity and Distributions 6 93–107 Occurrence Handle10.1046/j.1472-4642.2000.00083.x

    Article  Google Scholar 

  • JL Ruesink IM Parker MJ Groom PM Kareiva (1995) ArticleTitleReducing the risks of nonindigenous species introductions: guilty until proven innocent BioScience 45 465–477

    Google Scholar 

  • JK Scott FD Panetta (1993) ArticleTitlePredicting the Australian weed status of southern African plants Journal of Biogeography 20 87–93

    Google Scholar 

  • Smith C (1999) Studies on Weed Risk Assessment. Master of Applied Science, University of Adelaide

  • CS Smith WM Lonsdale J Fortune (1999) ArticleTitleWhen to ignore advice: invasion predictions and decision theory Biological Invasions 1 89–96 Occurrence Handle10.1023/A:1010091918466

    Article  Google Scholar 

  • Council UnitedStatesNational Research (2002) Predicting Invasions of Nonindigenous Plants and Plant Pests National Academy Press Washington, DC

    Google Scholar 

  • D Vose (2000) Risk Analysis: A Quantitative Guide John Wiley and Sons Chichester, West Sussex

    Google Scholar 

  • M Williamson A Fitter (1996) ArticleTitleThe varying success of invaders Ecology 77 1661–1665

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Caley.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Caley, P., Lonsdale, W.M. & Pheloung, P.C. Quantifying Uncertainty in Predictions of Invasiveness. Biol Invasions 8, 277–286 (2006). https://doi.org/10.1007/s10530-004-6703-z

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10530-004-6703-z

Keywords

Navigation