Skip to main content
Top

2018 | OriginalPaper | Chapter

7. Sensitivity Analysis and Variable Screening

Authors : Thomas J. Santner, Brian J. Williams, William I. Notz

Published in: The Design and Analysis of Computer Experiments

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter discusses sensitivity analysis and the related topic of variable screening. The setup is as follows. A vector of inputs \(\boldsymbol{x} = (x_{1},\ldots,x_{d})\) is given which potentially affects a “response” function \(y(\boldsymbol{x}) = y(x_{1},\ldots,x_{d})\). Sensitivity analysis seeks to quantify how variation in \(y(\boldsymbol{x})\) can be apportioned to the inputs x 1, , x d and to the interactions among these inputs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Adler RJ (1990) An introduction to continuity, extrema, and related topics for general Gaussian processes. Institute of Mathematical Statistics, Hayward, CA Adler RJ (1990) An introduction to continuity, extrema, and related topics for general Gaussian processes. Institute of Mathematical Statistics, Hayward, CA
go back to reference Barton RR (1999) Graphical methods for the design of experiments. Lecture notes in statistics, vol 143. Springer, New York, NYCrossRef Barton RR (1999) Graphical methods for the design of experiments. Lecture notes in statistics, vol 143. Springer, New York, NYCrossRef
go back to reference Box GE, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New York, NYMATH Box GE, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New York, NYMATH
go back to reference Campbell K (2001) Functional sensitivity analysis for computer model output. In: Bodt BA, Wegman EJ (eds) Proceedings of the seventh U.S. army conference on applied statistics. Army Research Laboratory, pp 35–46 Campbell K (2001) Functional sensitivity analysis for computer model output. In: Bodt BA, Wegman EJ (eds) Proceedings of the seventh U.S. army conference on applied statistics. Army Research Laboratory, pp 35–46
go back to reference Campbell KS, McKay MD, Williams BJ (2006) Sensitivity analysis when model outputs are functions. Reliab Eng Syst Saf 91:1468–472CrossRef Campbell KS, McKay MD, Williams BJ (2006) Sensitivity analysis when model outputs are functions. Reliab Eng Syst Saf 91:1468–472CrossRef
go back to reference Campolongo F, Cariboni J, Saltelli A (2007) An effective screening design for sensitivity analysis of large models. Environ Model Softw 22:1509–1518CrossRef Campolongo F, Cariboni J, Saltelli A (2007) An effective screening design for sensitivity analysis of large models. Environ Model Softw 22:1509–1518CrossRef
go back to reference Campolongo F, Saltelli A, Cariboni J (2011) From screening to quantitative sensitivity analysis. A unified approach. Comput Phys Commun 43:39–52MATH Campolongo F, Saltelli A, Cariboni J (2011) From screening to quantitative sensitivity analysis. A unified approach. Comput Phys Commun 43:39–52MATH
go back to reference Chen W, Jin R, Sudjianto A (2005) Analytical variance-based global sensitivity analysis in simulation-based design under uncertainty. J Mech Des 127:875–876CrossRef Chen W, Jin R, Sudjianto A (2005) Analytical variance-based global sensitivity analysis in simulation-based design under uncertainty. J Mech Des 127:875–876CrossRef
go back to reference Chen W, Jin R, Sudjianto A (2006) Analytical global sensitivity analysis and uncertainty propogation for robust design. J Qual Technol 38:333–348CrossRef Chen W, Jin R, Sudjianto A (2006) Analytical global sensitivity analysis and uncertainty propogation for robust design. J Qual Technol 38:333–348CrossRef
go back to reference Constantine PG, Dow E, Wang Q (2014) Active subspace methods in theory and practice: applications to kriging surfaces. SIAM J Sci Comput 36(4):A1500–A1524MathSciNetCrossRef Constantine PG, Dow E, Wang Q (2014) Active subspace methods in theory and practice: applications to kriging surfaces. SIAM J Sci Comput 36(4):A1500–A1524MathSciNetCrossRef
go back to reference Davis C (2015) A Bayesian approach to prediction and variable selection using nonstationary Gaussian processes. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH Davis C (2015) A Bayesian approach to prediction and variable selection using nonstationary Gaussian processes. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH
go back to reference Draper NR, Smith H (1981) Applied regression analysis. Wiley, New York, NYMATH Draper NR, Smith H (1981) Applied regression analysis. Wiley, New York, NYMATH
go back to reference Helton JC, Johnson JD, Sallaberry CJ, Storlie CB (2006) Survey of sampling-based methods for uncertainty and sensitivity analysis. Reliab Eng Syst Saf 91:1175–1209CrossRef Helton JC, Johnson JD, Sallaberry CJ, Storlie CB (2006) Survey of sampling-based methods for uncertainty and sensitivity analysis. Reliab Eng Syst Saf 91:1175–1209CrossRef
go back to reference Joseph VR, Hung Y, Sudjianto A (2008) Blind kriging: a new method for developing metamodels. ASME J Mech Des 130:377–381CrossRef Joseph VR, Hung Y, Sudjianto A (2008) Blind kriging: a new method for developing metamodels. ASME J Mech Des 130:377–381CrossRef
go back to reference Kleijnen JPC, Bettonvil B, Persson F (2006) Screening for the important factors in large discrete-event simulation models: sequential bifurcation and its applications. In: Dean AM, Lewis SM (eds) Screening: methods for experimentation in industry, drug discovery and genetics. Springer, New York, NY, pp 287–307CrossRef Kleijnen JPC, Bettonvil B, Persson F (2006) Screening for the important factors in large discrete-event simulation models: sequential bifurcation and its applications. In: Dean AM, Lewis SM (eds) Screening: methods for experimentation in industry, drug discovery and genetics. Springer, New York, NY, pp 287–307CrossRef
go back to reference Lewis SM, Dean AM (2001) Detection of interactions in experiments on large numbers of factors (with discussion). J R Stat Soc Ser B 63:633–672MathSciNetCrossRef Lewis SM, Dean AM (2001) Detection of interactions in experiments on large numbers of factors (with discussion). J R Stat Soc Ser B 63:633–672MathSciNetCrossRef
go back to reference Linkletter C, Bingham D, Hengartner N, Higdon D, Ye KQ (2006) Variable selection for Gaussian process models in computer experiments. Technometrics 48:478–490MathSciNetCrossRef Linkletter C, Bingham D, Hengartner N, Higdon D, Ye KQ (2006) Variable selection for Gaussian process models in computer experiments. Technometrics 48:478–490MathSciNetCrossRef
go back to reference Loeppky JL, Williams BJ, Moore LM (2013) Global sensitivity analysis for mixture experiments. Technometrics 55:68–78MathSciNetCrossRef Loeppky JL, Williams BJ, Moore LM (2013) Global sensitivity analysis for mixture experiments. Technometrics 55:68–78MathSciNetCrossRef
go back to reference Marrel A, Iooss B, Lauren B, Roustant O (2009) Calculations of Sobol indices for the Gaussian process metamodel. Reliab Eng Syst Saf 94:742–751CrossRef Marrel A, Iooss B, Lauren B, Roustant O (2009) Calculations of Sobol indices for the Gaussian process metamodel. Reliab Eng Syst Saf 94:742–751CrossRef
go back to reference Montgomery GP, Truss LT (2001) Combining a statistical design of experiments with formability simulations to predict the formability of pockets in sheet metal parts. Technical report 2001-01-1130, Society of Automotive Engineers Montgomery GP, Truss LT (2001) Combining a statistical design of experiments with formability simulations to predict the formability of pockets in sheet metal parts. Technical report 2001-01-1130, Society of Automotive Engineers
go back to reference Moon H (2010) Design and analysis of computer experiments for screening input variables. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH Moon H (2010) Design and analysis of computer experiments for screening input variables. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH
go back to reference Moon H, Santner TJ, Dean AM (2012) Two-stage sensitivity-based group screening in computer experiments. Technometrics 54(4):376–387MathSciNetCrossRef Moon H, Santner TJ, Dean AM (2012) Two-stage sensitivity-based group screening in computer experiments. Technometrics 54(4):376–387MathSciNetCrossRef
go back to reference Morris MD (1991) Factorial sampling plans for preliminary computational experiments. Technometrics 33:161–174CrossRef Morris MD (1991) Factorial sampling plans for preliminary computational experiments. Technometrics 33:161–174CrossRef
go back to reference Morris MD (2006) An overview of group factor screening. In: Dean AM, Lewis SM (eds) Screening: methods for experimentation in industry, drug discovery and genetics. Springer, New York, NY, pp 191–206CrossRef Morris MD (2006) An overview of group factor screening. In: Dean AM, Lewis SM (eds) Screening: methods for experimentation in industry, drug discovery and genetics. Springer, New York, NY, pp 191–206CrossRef
go back to reference Morris MD, Moore LM, McKay MD (2006) Sampling plans based on balanced incomplete block designs for evaluating the importance of computer model inputs. J Stat Plann Inf 136(9):3203–3220MathSciNetCrossRef Morris MD, Moore LM, McKay MD (2006) Sampling plans based on balanced incomplete block designs for evaluating the importance of computer model inputs. J Stat Plann Inf 136(9):3203–3220MathSciNetCrossRef
go back to reference Morris MD, Moore LM, McKay MD (2008) Using orthogonal arrays in the sensitivity analysis of computer models. Technometrics 50(2):205–215MathSciNetCrossRef Morris MD, Moore LM, McKay MD (2008) Using orthogonal arrays in the sensitivity analysis of computer models. Technometrics 50(2):205–215MathSciNetCrossRef
go back to reference Pujol G (2009) Simplex-based screening designs for estimating metamodels. Reliab Eng Syst Saf 94:1156–1160CrossRef Pujol G (2009) Simplex-based screening designs for estimating metamodels. Reliab Eng Syst Saf 94:1156–1160CrossRef
go back to reference Russi TM (2010) Uncertainty quantification with experimental data and complex system models. PhD thesis, UC Berkeley, CA Russi TM (2010) Uncertainty quantification with experimental data and complex system models. PhD thesis, UC Berkeley, CA
go back to reference Saltelli A (2002) Making best use of model evaluations to compute sensitivity indices. Comput Phys Commun 145 (2):280–297MathSciNetCrossRef Saltelli A (2002) Making best use of model evaluations to compute sensitivity indices. Comput Phys Commun 145 (2):280–297MathSciNetCrossRef
go back to reference Saltelli A, Sobol´ IM (1995) About the use of rank transformation in sensitivity analysis of model output. Reliab Eng Syst Saf 50:225–239CrossRef Saltelli A, Sobol´ IM (1995) About the use of rank transformation in sensitivity analysis of model output. Reliab Eng Syst Saf 50:225–239CrossRef
go back to reference Saltelli A, Chan K, Scott E (2000) Sensitivity analysis. Wiley, ChichesterMATH Saltelli A, Chan K, Scott E (2000) Sensitivity analysis. Wiley, ChichesterMATH
go back to reference Saltelli A, Tarantola S, Campolongo F, Ratto M (2004) Sensitivity analysis in practice: a guide to assessing scientific models. Wiley, ChichesterMATH Saltelli A, Tarantola S, Campolongo F, Ratto M (2004) Sensitivity analysis in practice: a guide to assessing scientific models. Wiley, ChichesterMATH
go back to reference Saltelli A, Annoni P, Azzini I, Campolongo F, Ratto M, Tarantola S (2010) Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Comput Phys Commun 181:259–270MathSciNetCrossRef Saltelli A, Annoni P, Azzini I, Campolongo F, Ratto M, Tarantola S (2010) Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Comput Phys Commun 181:259–270MathSciNetCrossRef
go back to reference Savitsky T, Vannucci M, Sha N (2011) Variable selection for nonparametric Gaussian process priors: models and computational strategies. Stat Sci 26(1):130–149MathSciNetCrossRef Savitsky T, Vannucci M, Sha N (2011) Variable selection for nonparametric Gaussian process priors: models and computational strategies. Stat Sci 26(1):130–149MathSciNetCrossRef
go back to reference Sobol´ IM (1990) Sensitivity estimates for nonlinear mathematical models. Matematicheskoe Modelirovanie 2:112–118 Sobol´ IM (1990) Sensitivity estimates for nonlinear mathematical models. Matematicheskoe Modelirovanie 2:112–118
go back to reference Sobol´ IM (1993) Sensitivity estimates for nonlinear mathematical models. Math Model Comput Exp 1(4):407–414 Sobol´ IM (1993) Sensitivity estimates for nonlinear mathematical models. Math Model Comput Exp 1(4):407–414
go back to reference Sobol´ I, Kucherenko S (2009) Derivative based global sensitivity measures and their link with global sensitivity indices. Math Comput Simul 79(10):3009–3017MathSciNetCrossRef Sobol´ I, Kucherenko S (2009) Derivative based global sensitivity measures and their link with global sensitivity indices. Math Comput Simul 79(10):3009–3017MathSciNetCrossRef
go back to reference Storlie CB, Helton JC (2008) Multiple predictor smoothing methods for sensitivity analysis: description of technique. Reliab Eng Syst Saf 93:28–54CrossRef Storlie CB, Helton JC (2008) Multiple predictor smoothing methods for sensitivity analysis: description of technique. Reliab Eng Syst Saf 93:28–54CrossRef
go back to reference Storlie CB, Swiler LP, Helton JC, Salaberry CJ (2009) Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models. Reliab Eng Syst Saf 94(11):1735–1763CrossRef Storlie CB, Swiler LP, Helton JC, Salaberry CJ (2009) Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models. Reliab Eng Syst Saf 94(11):1735–1763CrossRef
go back to reference Sun F, Santner TJ, Dean AM (2013) One-at-a-time designs for estimating elementary effects of simulator experiments with non-rectangular input regions. Stat Appl 11:15–32 Sun F, Santner TJ, Dean AM (2013) One-at-a-time designs for estimating elementary effects of simulator experiments with non-rectangular input regions. Stat Appl 11:15–32
go back to reference Svenson JD (2011) Computer experiments: multiobjective optimization and sensitivity analysis. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH Svenson JD (2011) Computer experiments: multiobjective optimization and sensitivity analysis. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH
go back to reference Svenson J, Santner TJ, Dean A, Moon H (2014) Estimating sensitivity indices based on Gaussian process metamodels with compactly supported correlation functions. J Stat Plann Inf 144:160–172MathSciNetCrossRef Svenson J, Santner TJ, Dean A, Moon H (2014) Estimating sensitivity indices based on Gaussian process metamodels with compactly supported correlation functions. J Stat Plann Inf 144:160–172MathSciNetCrossRef
go back to reference Van Der Vaart AW (1998) Asymptotic statistics. Cambridge University Press, CambridgeCrossRef Van Der Vaart AW (1998) Asymptotic statistics. Cambridge University Press, CambridgeCrossRef
go back to reference Vine AE, Lewis SM, Dean AM (2005) Two-stage group screening in the presence of noise factors and unequal probabilities of active effects. Stat Sinica 15:871–888MathSciNetMATH Vine AE, Lewis SM, Dean AM (2005) Two-stage group screening in the presence of noise factors and unequal probabilities of active effects. Stat Sinica 15:871–888MathSciNetMATH
go back to reference Welch WJ, Buck RJ, Sacks J, Wynn HP, Mitchell TJ, Morris MD (1992) Screening, predicting, and computer experiments. Technometrics 34:15–25CrossRef Welch WJ, Buck RJ, Sacks J, Wynn HP, Mitchell TJ, Morris MD (1992) Screening, predicting, and computer experiments. Technometrics 34:15–25CrossRef
go back to reference Yaglom AM (1962) Introduction to the theory of stationary random functions. Dover, New York, NYMATH Yaglom AM (1962) Introduction to the theory of stationary random functions. Dover, New York, NYMATH
Metadata
Title
Sensitivity Analysis and Variable Screening
Authors
Thomas J. Santner
Brian J. Williams
William I. Notz
Copyright Year
2018
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4939-8847-1_7

Premium Partner