Abstract
Integrated Assessment (IA) aims to facilitate decision-making processes on complex issues. Dealing with uncertainty is principally at the core of Integrated Assessment. IA practitioners realise that. However: – Not all uncertainties can be adequately addressed with existingmethods and tools. This especially holds for uncertainty in model structure and uncertainty due to behavioural and societal variability, value diversity, technological surprise, ignorance and indeterminacy. – Uncertainty is usually treated as a marginal issue, as an additional physical variable, as a mathematical artifact. The current methods merely involve evaluation of the impacts of `certain uncertainties', i.e. uncertainties for which estimates or probability distributions are available.– Current methods give no indication of the magnitude and sources of thevarious underlying uncertainties and the aggregated uncertainty measures are difficult to understand to decision-makers and other audiences.Within the International Centre for Integrative Studies, Maastricht University (the Netherlands), the research project `Perspectives on uncertainty and risk' aims to develop alternative, complementary approaches to uncertainty management in Integrated Assessment. The current paper summarises the theoretical analysis of the concept of uncertainty, and it proposes a typology of sources of uncertainty. This paper further discusses insights and experiences with pluralistic uncertainty management in thecontext of Integrated Assessment modelling in order to assess the strengths and weaknesses of such an approach. Although systematic fundamental uncertainty research is still needed in the context of Integrated Assessment, this paper argues that significant profit in quality terms can be gained by using the available methods, including the pluralistic approach, more consciously and systematically.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alcamo, J. and Bartnicki, J.: 1987, 'A Framework for Error Analysis of a Long-Range Transport Model with Emphasis on Parameter Uncertainty', Atmos. Environ. 21 (10), 2121-2131.
Bailey, P., Gough, C., Chadwick, M., and McGranahan, G.: 1996, Methods for Integrated Environmental Assessment: Research Directions for the European Union, Stockholm Environment Institute (SEI), Stockholm, Sweden.
Bartels, J.: 1993, The History of the Subject, Descartes, Spinoza, Kant (in Dutch), Agora, Kampen.
Beck, M. B.: 1987, 'Water Quality Modelling: A Review of the Analysis of Uncertainty', Water Resour. Res. 23 (8), 1393-1442.
Biggs, B., Robinson, J. B., Tague, C., and Walsh, M.: 1999, 'Tools for Linking Choices and Consequences', in Healey M. (ed.), Tools for Linking Choices and Consequences. Institute for Research and the Environment, Westwater Research, Vancouver, Canada.
Casti, J. L.: 1997, Would-be Worlds: How Simulation is Changing the Frontiers of Science, John Wiley and Sons, New York, U.S.A.
Clark, W. C. and Majone, G.: 1985, 'The Critical Appraisal of Scientific Enquiries with Policy Implications', Science, Technology and Human Values 10 (3), 6-19.
Davidson, P.: 1983, 'Rational Expectations: A Fallacious Foundation for Studying Crucial Decision-Making Processes', Journal of Post-Keynesian Economics 5, 182-198.
de Marchi, B.: 1995, 'Uncertainty in Environmental Emergencies: A Diagnostic Tool', Journal of Contingencies and Crisis Management 3 (2), 103-112.
de Marchi, B., Funtowicz, S. O., and Ravetz, J. R.: 1993, The Management of Uncertainty in the Communication of Major Hazards, CEC Joint Research Centre, Ispra, Italy.
den Elzen, M. G. J., Beusen, A. H. W., Rotmans, J., and van Asselt, M. B. A.: 1997, 'Human Disturbance of the Global Biogeochemical Cycles', in Rotmans, J. and de Vries, B. (eds.), Human Disturbance of the Global Biogeochemical Cycles, Cambridge University Press, Cambridge, U.K.
Eike, M. C.: 2000, GM Food: Controversy and Uncertainty, Maastricht University, Maastricht.
Environmental Resources: 1985, Handling Uncertainty in Environmental Impact Assessment, Environmental Resources Ltd., London, U.K.
Ermoliev, Y. M.: 1993, Uncertainties and Decision Making, International Institute for Applied Systems Analysis (IIASA), Laxenburg, Austria.
Funtowicz, S. O. and Ravetz, J. R.: 1990. Uncertainty and Quality in Science for Policy, Kluwer Academic Publishers, Dordrecht.
Funtowicz, S. O. and Ravetz, J. R.: 1993a, 'The Emergence of Post-Normal Science', in von Schomberg, R. (ed.), The Emergence of Post-Normal Science, Kluwer Academic Publishers, Dordrecht.
Funtowicz, S. O. and Ravetz, J. R.: 1993b, 'Science for the Post-Normal Age', Futures 25 (7), 739-755.
Geels, F.W., van Asselt, M. B. A., and Rotmans, J.: 1995, Sulphate Aerosols and the Climate Debate: An Uncertainty Assessment, RIVM, Bilthoven.
Helton, J. C.: 1994, 'Treatment of Uncertainty in Performance Assessments for Complex Systems', Risk Analysis 14 (4), 483-511.
Henrion, M. and Fischhoff, B.: 1986, 'Assessing Uncertainty in Physical Constants', Annual Journal of Physics 54 (9), 791-797.
Hilderink, H.: 2000, World Population in Transition, an Integrated Regional Modelling Framework, THELA THESIS, Amsterdam.
Hilderink, H. B. M. and van Asselt, M. B. A.: 1997, 'Population and Health in Perspective', in Rotmans, J. and de Vries, H. J. M. (eds.), Population and Health in Perspective, Cambridge University Press, Cambridge, U.K.
Hoekstra, A. Y.: 1998a, 'Appreciation of Water: Four Perspectives', Water Policy 1, 605-622.
Hoekstra, A. Y.: 1998b, Perspectives on Water: An Integrated Model-Based Exploration of the Future, International Books, Utrecht.
Hoekstra, A. Y., Beusen, A. H. W., Hilderink, H. B. M., and van Asselt, M. B. A.: 1997, 'Water in Crisis?', in Rotmans, J. and de Vries, H. J. M. (eds.), Water in Crisis?, Cambridge University Press, Cambridge, U.K.
Hoffman, F. O. and Hammonds, J. S.: 1994, 'Propagation of Uncertainty in Risk Assessment: The Need to Distinguish between Uncertainty Due to Lack of Knowledge and Uncertainty Due to Variability', Risk Analysis 14 (5), 707-712.
Hoppe, R.: 1998, Effective Policy Documents: A Guide for Successful Decision Support (in Dutch), Coutinho, Bussum.
Jäger, J.: 1998, 'Current Thinking on Using Scientific Findings in Environmental Policy Making', Environ. Model. Assess. 3 (3, Special Issue: Challenges and Opportunities for Integrated Environmental Assessment, Rotmans, J. and Vellinga, P., eds.), 143-153.
Jäger, J. (ed.): 1999, 'The EFIEA Workshop on Uncertainty', Paper presented at the EFIEA Workshop on Uncertainty, Baden bei Wien, European Forum on Integrated Environmental Assessment.
Jager, W., van Asselt, M. B. A., Rotmans, J., and Vlek, C. A. J.: 1995, 'Modelling Consumptive Behaviour in the Context of Integrated Assessment of Global Change', in Parry, M. and Wiegandt, E. (eds.) Global Change, Local Challenge-3rd IHDP Scientific Symposium, Geneva, Switzerland.
Jager, W., van Asselt, M. B. A., Rotmans, J., and Vlek, C.: 1999, 'Consumer Behaviour: A Modelling Perspective in the Context of Integrated Assessment of Global Change', in Köhn, J., Gowdy, J., Hinterberger, F., and van der Straaten, J. (eds.), Consumer Behaviour: A Modelling Perspective in the Context of Integrated Assessment of Global Change, Edward Elgar, Cheltenham, U.K.
Janssen, M. A.: 1996, Meeting Targets, Maastricht University, Maastricht.
Jasanoff, S. and Wynne, B.: 1998, 'Science and Decision-Making', in Rayner, S. and Malone, E. L. (eds.), Science and Decision-Making, Battelle Press, Washington, D.C.
Kahn, H. and Wiener, A.: 1967, The Year 2000, MacMillan, New York.
Kahneman, D. and Tversky, A.: 1982, 'Variants of Uncertainty', in Kahneman, D., Slvic, P., and Tversky, A. (eds.), Variants of Uncertainty, Cambridge University Press, Cambridge, U.K.
Kann, A.: 1998, A Comparison of Approaches for Performing Uncertainty Analysis in Integrated Assessment Models, Energy Modeling Forum, Stanford University, U.S.A.
Kann, A. and Weyant, J. P.: 2000, 'Approaches for Performing Uncertainty Analysis in Large-Scale Energy/Economic Policy Models', Enviromental Model. Assess. 5 (1), 29-46.
Klir, G. J.: 1996, 'Uncertainty Theories, Measures and Principles', in Natke, H. G and Ben-Haim, Y. (eds.), Uncertainty Theories, Measures and Principles, Akademie Verlag, Berlin, Germany.
Knight, F. H.: 1921, Risk, Uncertainty and Profit, Houghton Mifflin, Boston, U.S.A.
Koopmans, T. C.: 1957, Three Essays on the State of Economic Science, New York, U.S.A.
Lave, L. B. and Dowlatabadi, H.: 1993, 'Climate Change: The Effects of Personal Beliefs and Scientific Uncertainty', Environmental Science and Technology 27 (10), 1962-1972.
Lazarus, M.: 1993, Towards a Fossil Free Energy Future: The Next Energy Transition, Stockholm Environment Institute for Greenpeace International, Boston, U.S.A.
Morgan, M. G. and Dowlatabadi, H.: 1996, 'Learning from Integrated Assessment of Climate Change', Clim. Change 34, 337-368.
Morgan, G. M. and Henrion, M.: 1990, Uncertainty — A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis, Cambridge University Press, New York, U.S.A.
Natke, H. G. and Ben-Haim, Y.: 1996, 'Uncertainty: A Discussion from Various Points of View', in Natke, H. G. and Ben-Haim, Y. (eds.), Uncertainty: A Discussion from Various Points of View, Akademie Verlag, Berlin, Germanyy.
Oreskes, N., Shrader-Frechette, K., and Belitz, K.: 1994, 'Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences', Science 263 (February), 641-646.
O'Riordan, T., Marris, C., and Langford, I.: 1997, 'Images of Science Underlying Public Perceptions of Risk', in Society, R. (ed.), Images of Science Underlying Public Perceptions of Risk.
Parson, E. A.: 1996, 'Three Dilemmas in the Integrated Assessment of Climate Change', Clim. Change 34, 315-326.
Patt, A.: 1999, 'Economists and Ecologists: Modelling Global Climate Change to Different Conclusions', Int. J. Sustainable Development 2 (2), 254-262.
Pendergraft, C. A.: 1998, 'Human Dimensions of Climate Change: Cultural Theory and Collective Action', Clim. Change 39, 643-666.
Proctor, J. D.: 1998, 'The Meaning of Global Environmental Change: Retheorizing Culture in Human Dimensions Research', Global Environ. Change 8 (3), 227-248.
Ravetz, J. R.: 1997, Integrated Environmental Assessment Forum: Developing Guidelines for Good Practise, Darmstadt University of Technology, Darmstadt, Germany.
Rayner, S.: 1984, 'Disagreeing about Risk: The Institutional Cultures of Risk Management and Planning for Future Generations', in Hadden, S. G. (ed.), Disagreeing about Risk: The Institutional Cultures of Risk Management and Planning for Future Generations, Associated Faculty Press, Port Washington, U.S.A.
Rayner, S.: 1991, 'A Cultural Perspective on the Structure and Implementation of Global Environmental Agreements', Evaluation Review 15 (1), 75-102.
Rayner, S.: 1992, 'Cultural Theory and Risk Analysis', in Preagor, G. D. (ed.), Cultural Theory and Risk Analysis, Westport, U.S.A.
Risbey, J., Kandlikar, M., and Patwardhan, A.: 1996, 'Assessing Integrated Assessments', Clim. Change 34, 369-395.
Rothman, D., Robinson, J., and Biggs, D.: 2002, 'Signs of Life: Linking Indicators and Models in the Context of QUEST', in Abaza, H. and Baranzini, A. (eds.), Signs of Life: Linking Indicators and Models in the Context of QUEST, Edward Elgar, Cheltenham, U.K., in press.
Rotmans, J.: 1998, 'Methods for IA: The Challenges and Opportunities Ahead', Environ. Model. Assess. 3 (3, Special issue: Challenges and Opportunities for Integrated Environmental Assessment, Rotmans, J. and Vellinga, P., eds.), 155-179.
Rotmans, J. and de Vries, H. J. M.: 1997, Perspectives on Global Change: The TARGETS Approach, Cambridge University Press, Cambridge, U.K.
Rotmans, J. and van Asselt, M. B. A.: 1999, 'Perspectives on a Sustainable Future', International Journal for Sustainable Development 2 (2), 201-230.
Rotmans, J. and van Asselt, M.: 2002a, 'Integrated Assessment: Current Practices and Challenges for the Future', in Abaza, H. and Baranzini, A. (eds.), Integrated Assessment: Current practices and Challenges for the Future, Edward Elgar, U.K., in press.
Rotmans, J. and van Asselt, M.: 2002b, 'Uncertainty Management in Integrated Assessment Modeling: Towards a Pluralistic Approach', Enviromental Monitoring and Assessment, in press.
Rotmans, J., van Asselt, M. B. A., de Bruin, A. J., den Elzen, M. G. J., de Greef, J., Hilderink, H., Hoekstra, A. Y., Janssen, M. A., Koster, H. W., Martens, W. J. M., Niessen, L. W., and de Vries, H. J. M.: 1994, Global Change and Sustainable Development: A Modelling Perspective for the Next Decade, National Institute of Public Health and the Environment (RIVM), Bilthoven.
Rotmans, J. and Vellinga, P.: 1998, Challenges and Opportunities for Integrated Environmental Assessment (Special Issue of the Journal Environmental Modelling and Assessment 3 (3), Baltzer Science Publishers, Bussum.
Rowe, W. D.: 1994, 'Understanding Uncertainty', Risk Analysis 14 (5), 743-750.
Schneider, S.: 1997, 'Integrated Assessment Modeling of Climate Change: Transparent Rational Tool for Policy Making or Opaque Screen Hiding Value-Laden Assumptions?', Environ. Model. Assess. 2 (4), 229-250.
Shackle, G. L. S.: 1955, Uncertainty in Economics and Other Reflections, Cambridge University Press, Cambridge, U.K.
Simon, J. L.: 1980, 'Resources, Population, Environment: An Oversupply of False Bad News', Science 208, 1431-1437.
Simon, J. L.: 1981, Against the Doomsdayers, Princeton University Press, Princeton, U.S.A.
Strengers, B. J., den Elzen, M. G. J., Koster, H. W., Hilderink, H. B.M., and van Asselt, M. B. A.: 1997, 'Food for the Future', in Rotmans, J. and de Vries, H. J.M. (eds.), Food for the Future, Cambridge University Press, Cambridge, U.K.
Thompson, M., Ellis, R., and Wildavsky, A.: 1990, Cultural Theory.Westview Press, Boulder, U.S.A.
van Asselt, M. B. A.: 2000, Perspectives on Uncertainty and Risk: The PRIMA Approach to Decision Support, Kluwer Academic Publishers, Dordrecht.
van Asselt, M. B. A., Beusen, A. H. W., van Hilderink, H. B. M.: 1996, 'Uncertainty in Integrated Assessment: A Social Scientific Approach', Environ. Model. Assess. 1 (1/2), 71-90.
van Asselt, M. B. A., Langendonck, R., van Asten, F., van der Giessen, A., Janssen, P., Heuberger, P., and Geuskens, I.: 2001a, Uncertainty and RIVM's Environmental Outlooks. Documenting a Learning Process, ICIS/RIVM, Maastricht.
van Asselt, M. B. A., Middelkoop, H., van 't Klooster, S. A., van Deursen, W.P.A., Haasnoot, M., Kwadijk, J. C. J., Buiteveld, H., Können, G. P., Rotmans, J., van Gemert, N., and Valkering, P.: 2001b, Integrated Water Management Strategies for the Rhine and Meuse Basins in a Changing Environment. Final report of the NRP project 0/958273/01, Maastricht/Utrecht.
van Asselt, M. B. A. and Rotmans, J.: 1995, Uncertainty in Integrated Assessment Modelling: A Cultural Perspective-Based Approach, National Institute of Public Health and the Environment (RIVM), Bilthoven.
van Asselt, M. B. A., Rotmans, J.: 1996, 'Uncertainty in Perspective', Global Environ. Change 6 (2), 121-157.
van Asselt, M. B. A. and Rotmans, J.: 1997, 'Uncertainties in Perspective', in Rotmans, J. and de Vries, B. (eds.), Uncertainties in Perspective, Cambridge University Press, Cambridge, U.K.
van Asselt, M. B. A., van Gemert, N., van 't Klooster, S. A., Rotmans, J., Middelkoop, H., Buiteveld, H., Haasnoot, M., Kwadijk, J. C. J., and van Deursen, W. P. A.: 2000, Visies voor de Rijn en Maas: Een overzicht van studies en beleidslijnen. Rapportage Fase A, ICIS, Maastricht.
van der Sluijs, J. P.: 1997, Anchoring amid Uncertainty, Utrecht University, Utrecht.
van Vlimmeren, J. C. G., Don, F. J. H., and Okker, V. R.: 1991, Composition and Pattern of Forecast Uncertainty Due to Unreliable Data: Further Results, Central Planning Bureau, The Hague.
van Witteloostuijn, A.: 1987, Uncertainty in Psychology: A Look beyond the Non-Differentiated Approach, Maastricht University, Maastricht.
Vesely, W. E. and Rasmuson, D. M.: 1984, 'Uncertainties in Nuclear Probabilistic Risk Analyses', Risk Analysis 4, 313-322.
von Schomberg, R.: 1993, 'Controversies and Political Decision Making', in von Schomberg, R. (ed.), Controversies and Political Decision Making, Kluwer Academic Publishers, Dordrecht.
Wallsten, T. S.: 1990, 'Measuring Vague Uncertainties and Understanding their Use in Decision Making', in von Furstenberg, G. M. (ed.), Measuring Vague Uncertainties and Understanding their Use in Decision Making, Kluwer Academics Publishers, Dordrecht.
Wynne, B.: 1992, 'Uncertainty and Environmental Learning: Reconceiving Science and Policy in the Preventive Paradigm', Global Environ. Change 2 (June), 111-127.
Zimmermann, H. J.: 1996, 'Uncertainty Modelling and Fuzzy Sets', in Natke, H. G. and Ben-Haim, Y. (eds.), Uncertainty Modelling and Fuzzy Sets, Akademie Verlag, Berlin, Germany.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
van Asselt, M.B.A., Rotmans, J. Uncertainty in Integrated Assessment Modelling. Climatic Change 54, 75–105 (2002). https://doi.org/10.1023/A:1015783803445
Issue Date:
DOI: https://doi.org/10.1023/A:1015783803445