Skip to main content
Erschienen in: Structural and Multidisciplinary Optimization 3/2013

01.09.2013 | Research Paper

Batch sequential design of optimal experiments for improved predictive maturity in physics-based modeling

verfasst von: Sez Atamturktur, Brian Williams, Matthew Egeberg, Cetin Unal

Erschienen in: Structural and Multidisciplinary Optimization | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The focus of nuclear fuel design and maintenance has been shifting from a primarily empirical endeavor to that of highly advanced simulations characterized by experiment-based calibration, validation and uncertainty quantification. The experimental data available for calibration and validation, however, is limited by the availability of resources. This limitation poses difficulties especially if the model is to be executed to predict at different settings and/or regimes within a domain. To assure that the model exhibits predictive maturity throughout the domain of applicability, a sufficient number of experiments must be conducted to explore this domain. Given the limited resources, it is therefore crucial to design validation experiments to maximize the improvement in the predictive capability of the physics-based numerical models. This article contributes to the recent developments in the optimal design of validation experiments by evaluating the performance of several experiment selection criteria that specify the specific benefits desired from future experiments. Our focus is on the Batch Sequential Design methods, which for a given set of initial experiments and a selection criteria, iteratively select a batch of future experiments. The performance of various selection criteria in improving model predictiveness are compared considering not only the empirically identified model discrepancy, but also the coverage of the domain of applicability. The manuscript provides an extensive simulation-based study on a polycrystal plasticity material model, utilizing an established index that quantifies predictive maturity of numerical models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Note that validation experiments must be conducted to explore this domain.
 
Literatur
Zurück zum Zitat Atamturktur S, Hemez F, Unal C, William B (2009) Predictive maturity of computer models using functional and multivariate output. In: Proceedings of the 27th SEM international modal analysis conference, Orlando, FL Atamturktur S, Hemez F, Unal C, William B (2009) Predictive maturity of computer models using functional and multivariate output. In: Proceedings of the 27th SEM international modal analysis conference, Orlando, FL
Zurück zum Zitat Atamturktur S, Hemez F, Williams B, Tome C, Unal C (2011) A forecasting metric for predictive modeling. Comput Struct 89:2377–2387CrossRef Atamturktur S, Hemez F, Williams B, Tome C, Unal C (2011) A forecasting metric for predictive modeling. Comput Struct 89:2377–2387CrossRef
Zurück zum Zitat Atamturktur S, Hegenderfer J, Williams B, Egeberg M, Lebensohn R, Unal C (2012) A resource allocation framework for experiment-based validation of numerical models. Mech Adv Mater Struc (in press) Atamturktur S, Hegenderfer J, Williams B, Egeberg M, Lebensohn R, Unal C (2012) A resource allocation framework for experiment-based validation of numerical models. Mech Adv Mater Struc (in press)
Zurück zum Zitat Balci O, Adams RJ, Myers DS, Nance RE (2002) Credibility assessment: a collaborative evaluation for credibility assessment of modeling and simulation applications. In: Proceedings of the 34th winter simulation conference: exploring new frontiers, San Diego, California, USA, pp 214–220 Balci O, Adams RJ, Myers DS, Nance RE (2002) Credibility assessment: a collaborative evaluation for credibility assessment of modeling and simulation applications. In: Proceedings of the 34th winter simulation conference: exploring new frontiers, San Diego, California, USA, pp 214–220
Zurück zum Zitat Bulutoglu DA, Ryan KJ (2009) D-optimal and near D-optimal 2k fractional factorial designs of resolution V. J Stat Plann Inference 139:16–22MathSciNetCrossRefMATH Bulutoglu DA, Ryan KJ (2009) D-optimal and near D-optimal 2k fractional factorial designs of resolution V. J Stat Plann Inference 139:16–22MathSciNetCrossRefMATH
Zurück zum Zitat Cook RD, Nachtsheim CJ (1980) A comparison of algorithms for constructing exact D-optimal designs. Technometrics 22:315–324CrossRefMATH Cook RD, Nachtsheim CJ (1980) A comparison of algorithms for constructing exact D-optimal designs. Technometrics 22:315–324CrossRefMATH
Zurück zum Zitat Dersjö T, Olsson M (2012) Efficient design of experiments for structural optimization using significance screening. J Int Soc Struct Multidisc Optim (ISSMO) 45:185–196CrossRefMATH Dersjö T, Olsson M (2012) Efficient design of experiments for structural optimization using significance screening. J Int Soc Struct Multidisc Optim (ISSMO) 45:185–196CrossRefMATH
Zurück zum Zitat Egeberg M, Atamturktur S, Hemez F (2013) Defining coverage of a domain using a modified nearest-neighbor metric. In: Proceedings of 31st Society of Experimental Mechanics (SEM) international modal analysis conference (IMAC-XXVIII), Orange County, California, USA Egeberg M, Atamturktur S, Hemez F (2013) Defining coverage of a domain using a modified nearest-neighbor metric. In: Proceedings of 31st Society of Experimental Mechanics (SEM) international modal analysis conference (IMAC-XXVIII), Orange County, California, USA
Zurück zum Zitat Evans J, Manson A (1978) Optimal experimental designs in two dimensions using minimum bias estimation. J Am Stat Assoc 73:171–176CrossRefMATH Evans J, Manson A (1978) Optimal experimental designs in two dimensions using minimum bias estimation. J Am Stat Assoc 73:171–176CrossRefMATH
Zurück zum Zitat Fedorov VV (1972) Theory of optimal design. Academic, New York Fedorov VV (1972) Theory of optimal design. Academic, New York
Zurück zum Zitat Green LL, Blattnig SR, Hemsch MJ, Luckring JM, Tripathi RK (2008) An uncertainty structure matrix for models and simulations. American Institute of Aeronautics and Astronautics AIAA-2008-2154 Green LL, Blattnig SR, Hemsch MJ, Luckring JM, Tripathi RK (2008) An uncertainty structure matrix for models and simulations. American Institute of Aeronautics and Astronautics AIAA-2008-2154
Zurück zum Zitat Hemez F, Atamturktur S (2011) The dangers of sparse sampling for the quantification of margin and uncertainty. Reliab Eng Syst Saf 96:1220–1231CrossRef Hemez F, Atamturktur S (2011) The dangers of sparse sampling for the quantification of margin and uncertainty. Reliab Eng Syst Saf 96:1220–1231CrossRef
Zurück zum Zitat Hemez F, Atamturktur S, Unal C (2010) Defining predictive maturity for validated numerical simulations. Comput Struct J 88:497–505CrossRef Hemez F, Atamturktur S, Unal C (2010) Defining predictive maturity for validated numerical simulations. Comput Struct J 88:497–505CrossRef
Zurück zum Zitat Higdon DM, Lee H, Holloman C (2003) Markov chain Monte Carlo-based approaches for inference in computationally intensive inverse problems. Bayesian Stat 7:181–197MathSciNet Higdon DM, Lee H, Holloman C (2003) Markov chain Monte Carlo-based approaches for inference in computationally intensive inverse problems. Bayesian Stat 7:181–197MathSciNet
Zurück zum Zitat Higdon D, Gattiker J, Williams B, Rightley M (2008) Computer model calibration using high-dimensional output. J Am Stat Assoc 103(482):570–583MathSciNetCrossRefMATH Higdon D, Gattiker J, Williams B, Rightley M (2008) Computer model calibration using high-dimensional output. J Am Stat Assoc 103(482):570–583MathSciNetCrossRefMATH
Zurück zum Zitat Jacobson JJ, Matthern GE, Piet SJ, Shropshire DE (2009) Vision: verifiable fuel cycle simulation model. In: Advances in Nuclear Fuel Management IV (ANFM), Hilton Head, South Carolina, USA Jacobson JJ, Matthern GE, Piet SJ, Shropshire DE (2009) Vision: verifiable fuel cycle simulation model. In: Advances in Nuclear Fuel Management IV (ANFM), Hilton Head, South Carolina, USA
Zurück zum Zitat Jiang X, Mahadevan S (2006) Bayesian cross-entropy methodology for optimal design of validation experiments. Meas Sci Technol 17:1895–1908CrossRef Jiang X, Mahadevan S (2006) Bayesian cross-entropy methodology for optimal design of validation experiments. Meas Sci Technol 17:1895–1908CrossRef
Zurück zum Zitat Johnson ME, Moore LM, Ylvisaker D (1990) Minimax and maximin distance designs. J Stat Plann Inference 26:131–148MathSciNetCrossRef Johnson ME, Moore LM, Ylvisaker D (1990) Minimax and maximin distance designs. J Stat Plann Inference 26:131–148MathSciNetCrossRef
Zurück zum Zitat Lam CQ, Notz WI (2008) Sequential adaptive designs in computer experiments for response surface model fit. Stat Appl 6:207–233 Lam CQ, Notz WI (2008) Sequential adaptive designs in computer experiments for response surface model fit. Stat Appl 6:207–233
Zurück zum Zitat Lebensohn RA, Hartley CS, Tomé CN, Castelnau O (2010) Modeling the mechanical response of polycrystals deforming by climb and glide. Philos Mag 90(5):567–583CrossRef Lebensohn RA, Hartley CS, Tomé CN, Castelnau O (2010) Modeling the mechanical response of polycrystals deforming by climb and glide. Philos Mag 90(5):567–583CrossRef
Zurück zum Zitat Li G, Aute V, Azarm S (2010) An accumulative error based adaptive design of experiments for offline metamodeling. J Int Soc Struct Multidisc Optim (ISSMO) 40:137–155CrossRef Li G, Aute V, Azarm S (2010) An accumulative error based adaptive design of experiments for offline metamodeling. J Int Soc Struct Multidisc Optim (ISSMO) 40:137–155CrossRef
Zurück zum Zitat Lindley DV (1972) Bayesian statistics: a review. Society for Industrial and Applied Mathematics. Capital City Press, Montpelier, VermontCrossRef Lindley DV (1972) Bayesian statistics: a review. Society for Industrial and Applied Mathematics. Capital City Press, Montpelier, VermontCrossRef
Zurück zum Zitat Loeppky JL, Moore LM, Williams BJ (2010) Batch sequential designs for computer experiments. J Stat Plann Inference 140:1452–1464MathSciNetCrossRefMATH Loeppky JL, Moore LM, Williams BJ (2010) Batch sequential designs for computer experiments. J Stat Plann Inference 140:1452–1464MathSciNetCrossRefMATH
Zurück zum Zitat Metropolis N, Rosenbluth A, Rosenbluth M, Teller A, Teller E (1953) Equations of state calculations by fast computing machines. J Chem Phys 21:1087–1091CrossRef Metropolis N, Rosenbluth A, Rosenbluth M, Teller A, Teller E (1953) Equations of state calculations by fast computing machines. J Chem Phys 21:1087–1091CrossRef
Zurück zum Zitat Morris MD, Mitchell TJ (1995) Exploratory designs for computational experiments: two examples. Stat Sin 2:359–379MathSciNet Morris MD, Mitchell TJ (1995) Exploratory designs for computational experiments: two examples. Stat Sin 2:359–379MathSciNet
Zurück zum Zitat Müller WG, Pötscher BM (1989) Batch sequential design for a nonlinear estimation problem. Forschungsbericht/Research Memorandum No. 259 Müller WG, Pötscher BM (1989) Batch sequential design for a nonlinear estimation problem. Forschungsbericht/Research Memorandum No. 259
Zurück zum Zitat Myers RH, Khuri AI, Carter WH (1989) Response surface methodology: 1966–1988. Technometrics 31:137–157MathSciNetMATH Myers RH, Khuri AI, Carter WH (1989) Response surface methodology: 1966–1988. Technometrics 31:137–157MathSciNetMATH
Zurück zum Zitat Oberkampf WL, Pilch M, Trucano TG (2007) Predictive capability maturity model for computational modeling and simulation. Sandia National Laboratories Report; SAND2007-5948 Oberkampf WL, Pilch M, Trucano TG (2007) Predictive capability maturity model for computational modeling and simulation. Sandia National Laboratories Report; SAND2007-5948
Zurück zum Zitat Ogungbenro K, Graham G, Gueorguieva I, Aarons L (2005) The use of a modified Fedorov exchange algorithm to optimize sampling times for population pharmacokinetic experiments. Comput Methods Programs Biomed 80:115–125CrossRef Ogungbenro K, Graham G, Gueorguieva I, Aarons L (2005) The use of a modified Fedorov exchange algorithm to optimize sampling times for population pharmacokinetic experiments. Comput Methods Programs Biomed 80:115–125CrossRef
Zurück zum Zitat Rennen G, Husslage B, Van Dam ER, Hertog DD (2010) Nested maximin Latin hypercube designs. J Int Soc Struct Multidisc Optim (ISSMO) 41:371–395CrossRefMATH Rennen G, Husslage B, Van Dam ER, Hertog DD (2010) Nested maximin Latin hypercube designs. J Int Soc Struct Multidisc Optim (ISSMO) 41:371–395CrossRefMATH
Zurück zum Zitat Rosner R (2008) Making nuclear energy work How shifting research goals and improving collaboration with industry will help U.S. national labs spur new nuclear energy development. Bull At Sci 64(1):28–33 Rosner R (2008) Making nuclear energy work How shifting research goals and improving collaboration with industry will help U.S. national labs spur new nuclear energy development. Bull At Sci 64(1):28–33
Zurück zum Zitat Sacks J, Schiller SB (1988) Spatial designs. In: Gupta SS, Berger JO (eds) Statistical decision theory and related topics IV, vol 2. Springer, Berlin, pp 385–399CrossRef Sacks J, Schiller SB (1988) Spatial designs. In: Gupta SS, Berger JO (eds) Statistical decision theory and related topics IV, vol 2. Springer, Berlin, pp 385–399CrossRef
Zurück zum Zitat Shao T (2007) Toward a structured approach to simulation-based engineering design under uncertainty. PhD Dissertation, University of Massachusetts, Amherst Shao T (2007) Toward a structured approach to simulation-based engineering design under uncertainty. PhD Dissertation, University of Massachusetts, Amherst
Zurück zum Zitat Shewry MC, Wynn HP (1987) Maximum entropy sampling. J Appl Stat 14:165–170CrossRef Shewry MC, Wynn HP (1987) Maximum entropy sampling. J Appl Stat 14:165–170CrossRef
Zurück zum Zitat Stull CJ, Hemez F, Williams BJ, Unal C, Rogers ML (2011) An improved description of predictive maturity for verification and validation activities. Los Alamos National Laboratory Technical Report, LA-UR-11-05659 Stull CJ, Hemez F, Williams BJ, Unal C, Rogers ML (2011) An improved description of predictive maturity for verification and validation activities. Los Alamos National Laboratory Technical Report, LA-UR-11-05659
Zurück zum Zitat Thompson DE, McAuley KB, McLellan PJ (2010) Design of optimal experiments to improve model predictions from a polyethelene molecular weight distribution model. Macromol React Eng 4(1):73–85CrossRef Thompson DE, McAuley KB, McLellan PJ (2010) Design of optimal experiments to improve model predictions from a polyethelene molecular weight distribution model. Macromol React Eng 4(1):73–85CrossRef
Zurück zum Zitat Trucano TG, Swiler LP, Igusa T, Oberkampf WL, Pilch M (2006) Calibration, validation, and sensitivity analysis: what’s what. Reliab Eng Syst Saf J 91:1331–1357CrossRef Trucano TG, Swiler LP, Igusa T, Oberkampf WL, Pilch M (2006) Calibration, validation, and sensitivity analysis: what’s what. Reliab Eng Syst Saf J 91:1331–1357CrossRef
Zurück zum Zitat Unal C, Williams B, Hemez F, Atamturktur SH, McClure P (2011) Improved best estimate plus uncertainty methodology, including advanced validation concepts, to license evolving nuclear reactors. Nucl Eng Des J 241:1813–1833CrossRef Unal C, Williams B, Hemez F, Atamturktur SH, McClure P (2011) Improved best estimate plus uncertainty methodology, including advanced validation concepts, to license evolving nuclear reactors. Nucl Eng Des J 241:1813–1833CrossRef
Zurück zum Zitat van Keulen F, Vervenne K (2004) Gradient-enhanced response surface building. J Int Soc Struct Multidisc Optim (ISSMO) 27:337–351 van Keulen F, Vervenne K (2004) Gradient-enhanced response surface building. J Int Soc Struct Multidisc Optim (ISSMO) 27:337–351
Zurück zum Zitat Williams B, Higdon D, Gattiker J, Moore L, McKay M, Keller-McNulty S (2006) Combining experimental data and computer simulations, with an application to flyer plate experiments. Bayesian Anal 1:765–792MathSciNetCrossRef Williams B, Higdon D, Gattiker J, Moore L, McKay M, Keller-McNulty S (2006) Combining experimental data and computer simulations, with an application to flyer plate experiments. Bayesian Anal 1:765–792MathSciNetCrossRef
Zurück zum Zitat Williams BJ, Loeppky JL, Moore LM, Macklem MS (2011) Batch sequential design to achieve predictive maturity with calibrated computer models. Reliab Eng Syst Saf 96(9):1208–1219CrossRef Williams BJ, Loeppky JL, Moore LM, Macklem MS (2011) Batch sequential design to achieve predictive maturity with calibrated computer models. Reliab Eng Syst Saf 96(9):1208–1219CrossRef
Zurück zum Zitat Yoshiie T (2005) Factors that infuence cascade-induced defect growth in pure metals and model alloys. Mater Trans 46(3):425–432CrossRef Yoshiie T (2005) Factors that infuence cascade-induced defect growth in pure metals and model alloys. Mater Trans 46(3):425–432CrossRef
Metadaten
Titel
Batch sequential design of optimal experiments for improved predictive maturity in physics-based modeling
verfasst von
Sez Atamturktur
Brian Williams
Matthew Egeberg
Cetin Unal
Publikationsdatum
01.09.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
Structural and Multidisciplinary Optimization / Ausgabe 3/2013
Print ISSN: 1615-147X
Elektronische ISSN: 1615-1488
DOI
https://doi.org/10.1007/s00158-013-0915-8

Weitere Artikel der Ausgabe 3/2013

Structural and Multidisciplinary Optimization 3/2013 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.