nach oben

Erschienen in:

2021 | OriginalPaper | Buchkapitel

1. Introduction and Overview of Structured Expert Judgement

verfasst von : Simon French, Anca M. Hanea, Tim Bedford, Gabriela F. Nane

Erschienen in: Expert Judgement in Risk and Decision Analysis

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This chapter sets the background for when, and discusses the contexts in which, eliciting expert judgements is paramount. The way judgements are elicited and aggregated plays an essential part in distinguishing structured/formal elicitation protocols from informal ones. We emphasise the importance of properly reporting the steps and decision taken during an elicitation, and draw a parallel to the reporting of experimental designs underpinning the data collection. Directions for future research are proposed, and the chapter ends with an outline of the book.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nächstes Kapitel Recent Advances in the Elicitation of Uncertainty Distributions from Experts for Multinomial Probabilities

See https://www.cost.eu/actions/IS1304/ and https://www.expertsinuncertainty.net/.

Albert, I., Donnet, S., Guihenneuc-Jouyaux, C., Low-Choy, S., Mengersen, K., & Rousseau, J., et al. (2012). Combining expert opinions in prior elicitation. 503–532.

Banks, D. L., Aliaga, J. M. R., & Insua D. R. (2015). Adversarial risk analysis. CRC Press.

Bazerman, M. H. (2006). Managerial decision making. New York: John Wiley and Sons.

Bedford, T., & Cooke, R. M. (2001). Probabilistic risk analysis: Foundations and methods. Cambridge: Cambridge University Press.CrossRef

Burgman, M. A. (2015). Trusting judgements: How to get the best out of experts. Cambridge University Press.

Clemen, R. T., & Lichtendahl, K. C. (2002). Debiasing expert overconfidence: A Bayesian calibration model. PSAM6, San Juan, Puerto Rico.

Clemen, R. T., & Winkler, R. L. (1999). Combining probability distributions from experts in risk analysis. Risk Analysis, 19(2), 187–203.

Cooke, R. M. (1991). Experts in uncertainty. Oxford: Oxford University Press.

Cooke, R. M., ElSaadany, S., & Xinzheng, H. (2008). On the performance of social network and likelihood based expert weighting schemes. Reliability Engineering and System Safety, 93(5), 745–756.

Cooke, R. M., & Goossens, L. H. J. (2000). Procedures guide for structured expert judgement in accident consequence modelling. Radiation Protection Dosimetry, 90(3), 303–309.CrossRef

Dalkey, N., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458–467.CrossRef

DeWispelare, A. R., Herren, L. T., & Clemen, R. T. (1995). The use of probability elicitation in the high-level nuclear waste regulation program. International Journal of Forecasting, 11, 5–24.CrossRef

Dias, L., Morton, A., & Quigley, J., (Eds.) (2018). Elicitation of preferences and uncertainty: Processes and procedures. Springer.

Edwards, W. (1954). The theory of decision making. Psychological Bulletin, 51, 380–417.CrossRef

EFSA. (2014). Guidance on expert knowledge elicitation in food and feed safety risk assessment. EFSA Journal, 12(6), 3734–4012.CrossRef

Evans, J. S. B., Stanovich, K. E. (2013). Dual-process theories of higher cognition: Advancing the debate. Perspectives on Pyschological Sciences, 8(3), 223–241.

Faria, A., & Smith, J. Q. (1997). Conditionally externally Bayesian pooling operators in chain graphs. Annals of Statistics, 25(4), 1740–1761.CrossRef

French, S. (1980). Updating of belief in the light of someone else’s opinion. Journal of the Royal Statistical Society, A143, 43–48.CrossRef

French, S. (1985). Group consensus probability distributions: A critical survey (with discussion). In J. M. Bernardo, M. H. DeGroot, D. V. Lindley & A. F. M. Smith (Eds.), Bayesian Statistics 2 (pp. 183–201). North-Holland.

French, S. (1987). Conflict of belief: when advisers disagree. In P. G. Bennett (Ed.), Analysing conflict and its resolution: Some Mathematical Contributions (pp. 93–111). Oxford: Oxford University Press.

French, S. (2003). Modelling, making inferences and making decisions: The roles of sensitivity analysis. TOP, 11(2), 229–252.CrossRef

French, S. (2011). Aggregating expert judgement. Revista de la Real Academia de Ciencias Exactas, Fisicas y Naturales, 105(1), 181–206.

French, S. (2012). Expert judgment, meta-analysis, and participatory risk analysis. Decision Analysis, 9(2), 119–127.CrossRef

French, S., & Hartley, D. (2018). Elicitation and calibration: A Bayesian perspective. In L. Dias, A. Morton & J. Quigley (Eds.), Elicitation: The science and art of structuring judgement. New York: Springer (in press).

French, S., Maule, A. J., & Papamichail, K. N. (2009). Decision behaviour, analysis and support. Cambridge: Cambridge University Press.CrossRef

French, S., & Rios Insua, D. (2000). Statistical decision theory. London: Arnold.

Genest, C., & Wagner, C. G. (1987). Further evidence against independence preservation in expert judgement synthesis. Aequationes mathematicae, 32, 74–86.CrossRef

Genest, C., & Zidek, J. V. (1986). Combining probability distributions: A critique and annotated bibliography. Statistical Science, 1, 114–148.CrossRef

Gigerenzer, G. (2002). Reckoning with risk: Learning to live with uncertainty. Harmondsworth: Penguin Books.

Hanea, A., McBride, M., Burgman, M., & Wintle, B. (2018). Classical meets modern in the IDEA protocol for structured expert judgement. Journal of Risk Research, 21(4), 417–433.CrossRef

Hockey, G. R. J., Maule, A. J., Clough, P. J., & Bdzola, L. (2000). Effects of negative mood on risk in everyday decision making. Cognition and Emotion, 14, 823–856.CrossRef

Hora, S. (2007). Eliciting probabilities from experts. In W. Edwards, R. F. Miles, & D. Von Winterfeldt (Eds.), Advances in decision analysis: From foundations to applications (pp. 129–153). Cambridge: Cambridge University Press.CrossRef

Hora, S. C. (2008). Expert judgement. In E. L. Melnick & B. S. Everitt (Eds.), Encylcopedia of quantitative risk analysis and assessment (pp. 667–676). Chichester: John Wiley and Sons.

Jacobs, R. A. (1995). Methods for combining experts’ probability assessments. Neural Computing, 7, 867–888.CrossRef

Kahneman, D. (2011). Thinking, Fast and Slow. London, Penguin: Allen Lane.

Kahneman, D., & Tversky, A. (1974). Judgement under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131.CrossRef

Kahneman, D., & Tversky, A. (Eds.). (2000). Choices, values and frames. Cambridge: Cambridge University Press.

Lichtendahl, K. C., & Winkler, R. L. (2007). Probability elicitation, scoring rules, and competition among forecasters. Management Science, 53(11), 1745–1755.CrossRef

Lin, S.-W., & Bier, V. M. (2008). A study of expert overconfidence. Reliability Engineering and System Safety, 93, 711–721.CrossRef

Madansky, A. (1964). Externally Bayesian groups. RM-4141-PR, RAND.

McConway, K. (1981). Marginalisation and linear opinion pools. Journal of the American Statistical Association, 76, 410–414.CrossRef

Mumpower, J. L., & Stewart, T. R. (1996). Expert judgement and expert disagreement. Thinking & Reasoning, 2(2–3), 191–211.CrossRef

O’Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, R., Garthwaite, P. H., Jenkinson, D., et al. (2006). Uncertain judgements: Eliciting experts’ probabilities. Chichester: John Wiley and Sons.CrossRef

Osborne, M. J. (2003). An introduction to game theory. Oxford: Oxford University Press.

Pfeffer, J., & Sutton, P. J. (2006). Evidence-based management. Harvard Business Review, 84(1), 62–76.

Phillips, L. D. (2007). Decision conferencing. In W. Edwards, R. F. Miles, & D. von Winterfeldt (Eds.), Advances in decision analysis: From foundations to applications (pp. 375–399). Cambridge: Cambridge University Press.CrossRef

Quigley, J., Wilson, K. J., Walls, L., & Bedford, T. J. R. A. (2013). A Bayes linear Bayes method for estimation of correlated event rates. 33(12), 2209–2224.

Reagan-Cirincione, P. (1994). Combining group facilitation, decision modelling and information technology to improve the accuracy of group judgement Improving the accuracy of group judgment: a process intervention combining group facilitation, social judgment analysis, and information technology. Organisational Behaviour and Human Decision Process, 58, 246–270.CrossRef

Reliability Engineering and System Safety special Issue: Expert Judgment (2008). Edited by Roger M. Cooke, 93(5), 655–778.

Rowe, G., & Wright, G. (1999). The Delphi technique as a forecasting tool: Issues and analysis. International Journal of Forecasting, 15, 353–375.CrossRef

Sen, A. (2017). Collective choice and social welfare, expanded edition. Harmondsworth: Penguin.CrossRef

Shanteau, J. (1995). Expert judgment and financial decision making. In B. Green (Ed.), Risky business: Risk behavior and risk management. Stockholm: Stockholm University

Shemilt, I., Mugford, M., Vale, L., Marsh, K., & Donaldson, C. (Eds.). (2010). Evidence-Based decisions and economics: Helath care, social welfare, education and criminal justice. Oxford University Press: Oxford.

Skjong, R. & Wentworth, B. H. (2001). Expert judgement and risk perception. In Proceedings of the Eleventh (2001) International Offshore and Polar Engineering Conference. Stavanger, Norway: The International Society of Offshore and Polar Engineers.

Werner, C., Bedford, T., Cooke, R. M., Hanea, A. M., & Morales-Nápoles, O. (2017). Expert judgement for dependence in probabilistic modelling: A systematic literature review and future research directions. European Journal of Operational Research, 258(3), 801–819.CrossRef

Wilson, K. J. (2016). An investigation of dependence in expert judgement studies with multiple experts. International Journal of Forecasting.

Wright, G., & Ayton, P. (1987). Eliciting and modelling expert knowledge. Decision Support Systems, 3(1), 13–26.CrossRef

Titel: Introduction and Overview of Structured Expert Judgement
verfasst von: Simon French
Anca M. Hanea
Tim Bedford
Gabriela F. Nane
Verlag: Springer International Publishing
Buch: Expert Judgement in Risk and Decision Analysis
Print ISBN: 978-3-030-46473-8

Electronic ISBN: 978-3-030-46474-5

Copyright-Jahr: 2021
DOI: https://doi.org/10.1007/978-3-030-46474-5_1