Skip to main content
Top

2019 | OriginalPaper | Chapter

General Introduction to Monte Carlo and Multi-level Monte Carlo Methods

Authors : Robin Schmidt, Matthias Voigt, Michele Pisaroni, Fabio Nobile, Penelope Leyland, Jordi Pons-Prats, Gabriel Bugeda

Published in: Uncertainty Management for Robust Industrial Design in Aeronautics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter, we present a general introduction to Monte Carlo (MC)-based methods, sampling methodologies, stratification methods, and variance reduction techniques. In the first part, we will discuss the theoretical basis and the convergence proprieties of MC methods. The next part is devoted to pseudorandom and quasi-random number generation, the generation of random variables and the application of stratification. It is followed by techniques for correlation and discrepancy control. The third part presents the concept of Latin Hypercube Sampling (LHS). The last part introduces the concept of Multi-Level Monte Carlo (MLMC).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kroese, D.P., Taimre, T., Botev, Z.I.: Handbook of Monte Carlo Methods. Wiley, Inc. (2011) Kroese, D.P., Taimre, T., Botev, Z.I.: Handbook of Monte Carlo Methods. Wiley, Inc. (2011)
2.
go back to reference Matsumoto, M., Nishimura, T.: Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. Simul. (TOMACS) 8(1), 3–30 (1998)CrossRef Matsumoto, M., Nishimura, T.: Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. Simul. (TOMACS) 8(1), 3–30 (1998)CrossRef
3.
go back to reference L’Ecuyer, P.: Good parameters and implementations for combined multiple recursive random number generators. Oper. Res. 47(1), 159–164 (1999)CrossRef L’Ecuyer, P.: Good parameters and implementations for combined multiple recursive random number generators. Oper. Res. 47(1), 159–164 (1999)CrossRef
4.
go back to reference Niederreiter, H.: Random number generation and quasi-Monte Carlo methods. In: Society for Industrial and Applied Mathematics, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 63, Pa (1992) Niederreiter, H.: Random number generation and quasi-Monte Carlo methods. In: Society for Industrial and Applied Mathematics, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 63, Pa (1992)
6.
go back to reference Kocis, L., Whiten, W.J.: Computational investigations of low-discrepancy sequences. ACM Trans. Math. Softw. (TOMS) 23(2), 266–294 (1997)CrossRef Kocis, L., Whiten, W.J.: Computational investigations of low-discrepancy sequences. ACM Trans. Math. Softw. (TOMS) 23(2), 266–294 (1997)CrossRef
7.
go back to reference Hong, H.S., Hickernell, F.J.: Algorithm 823: implementing scrambled digital sequences. ACM Trans. Math. Softw. (TOMS) 29(2), 95–109 (2003)MathSciNetCrossRef Hong, H.S., Hickernell, F.J.: Algorithm 823: implementing scrambled digital sequences. ACM Trans. Math. Softw. (TOMS) 29(2), 95–109 (2003)MathSciNetCrossRef
8.
go back to reference Cochran, W.G.: Sampling Techniques, 3rd edn. Wiley Series in Probability and Mathematical Statistics. Wiley, New York (1977) Cochran, W.G.: Sampling Techniques, 3rd edn. Wiley Series in Probability and Mathematical Statistics. Wiley, New York (1977)
9.
go back to reference Nataf, A.: Dtermination des distributions de probabilits dont les marges sont donns. Comptes Rendus de l’Acadmie des Sciences 225, 42–43 (1962)MATH Nataf, A.: Dtermination des distributions de probabilits dont les marges sont donns. Comptes Rendus de l’Acadmie des Sciences 225, 42–43 (1962)MATH
10.
go back to reference Ditlevsen, O., Madsen, H.O.: Structural Reliability Methods. Wiley, Chichester, New York (1996) Ditlevsen, O., Madsen, H.O.: Structural Reliability Methods. Wiley, Chichester, New York (1996)
11.
go back to reference Iman, R.L., Conover, W.J.: A distribution-free approach to inducing rank correlation among input variables. Commun. Stat. Simul. Comput. 11(3), 311–334 (1982)CrossRef Iman, R.L., Conover, W.J.: A distribution-free approach to inducing rank correlation among input variables. Commun. Stat. Simul. Comput. 11(3), 311–334 (1982)CrossRef
12.
go back to reference Dandekar, R.A., Cohen, M., Kirkendall, N.: Sensitive micro data protection using Latin hypercube sampling technique. In: Inference Control in Statistical Databases, Springer, pp. 117–125 (2002) Dandekar, R.A., Cohen, M., Kirkendall, N.: Sensitive micro data protection using Latin hypercube sampling technique. In: Inference Control in Statistical Databases, Springer, pp. 117–125 (2002)
13.
go back to reference Vořechovský, M., Novák, D.: Correlation control in small-sample Monte Carlo type simulations I: a simulated annealing approach. Probab. Eng. Mech. 24(3), 452–462 (2009)CrossRef Vořechovský, M., Novák, D.: Correlation control in small-sample Monte Carlo type simulations I: a simulated annealing approach. Probab. Eng. Mech. 24(3), 452–462 (2009)CrossRef
14.
go back to reference Liefvendahl, M., Stocki, R.: A study on algorithms for optimization of Latin hypercubes. J. Stat. Plan. Inference 136(9), 3231–3247 (2006)MathSciNetCrossRef Liefvendahl, M., Stocki, R.: A study on algorithms for optimization of Latin hypercubes. J. Stat. Plan. Inference 136(9), 3231–3247 (2006)MathSciNetCrossRef
15.
go back to reference Damblin, G., Couplet, M., Iooss, B.: Numerical studies of space-filling designs: optimization of Latin hypercube samples and subprojection properties. J. Simul. 7(4), 276–289 (2013)CrossRef Damblin, G., Couplet, M., Iooss, B.: Numerical studies of space-filling designs: optimization of Latin hypercube samples and subprojection properties. J. Simul. 7(4), 276–289 (2013)CrossRef
16.
go back to reference Hickernell, F.: A generalized discrepancy and quadrature error bound. Math. Comput. Am. Math. Soc. 67(221), 299–322 (1998)MathSciNetCrossRef Hickernell, F.: A generalized discrepancy and quadrature error bound. Math. Comput. Am. Math. Soc. 67(221), 299–322 (1998)MathSciNetCrossRef
17.
go back to reference McKay, M.D., Beckman, R.J., Conover, W.J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42(1), 55–61 (1979)MathSciNetCrossRef McKay, M.D., Beckman, R.J., Conover, W.J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42(1), 55–61 (1979)MathSciNetCrossRef
18.
go back to reference Iman, R.L., Conover, W.: Small sample sensitivity analysis techniques for computer models with an application to risk assessment. Commun. Stat. Theory Methods 9(17), 1749–1842 (1980)MathSciNetCrossRef Iman, R.L., Conover, W.: Small sample sensitivity analysis techniques for computer models with an application to risk assessment. Commun. Stat. Theory Methods 9(17), 1749–1842 (1980)MathSciNetCrossRef
19.
go back to reference Stein, M.: Large sample properties of simulations using Latin hypercube sampling. Technometrics 29(2), 143–151 (1987)MathSciNetCrossRef Stein, M.: Large sample properties of simulations using Latin hypercube sampling. Technometrics 29(2), 143–151 (1987)MathSciNetCrossRef
20.
go back to reference Manteufel, R.D.: Evaluating the convergence of Latin hypercube sampling. In: 41st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference (2000) Manteufel, R.D.: Evaluating the convergence of Latin hypercube sampling. In: 41st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference (2000)
21.
22.
go back to reference Heinrich, S., Sindambiwe, E.: Monte Carlo complexity of parametric integration. J. Complex. 15(3), 317–341 (1999)MathSciNetCrossRef Heinrich, S., Sindambiwe, E.: Monte Carlo complexity of parametric integration. J. Complex. 15(3), 317–341 (1999)MathSciNetCrossRef
24.
go back to reference Barth, A., Lang, A., Schwab, C.: Multilevel Monte Carlo method for parabolic stochastic partial differential equations. BIT Numer. Math. 53(1), 3–27 (2013)MathSciNetCrossRef Barth, A., Lang, A., Schwab, C.: Multilevel Monte Carlo method for parabolic stochastic partial differential equations. BIT Numer. Math. 53(1), 3–27 (2013)MathSciNetCrossRef
25.
go back to reference Barth, A., Schwab, C., Zollinger, N.: Multi-level Monte Carlo finite element method for elliptic PDEs with stochastic coefficients. Numer. Math. 119(1), 123–161 (2011)MathSciNetCrossRef Barth, A., Schwab, C., Zollinger, N.: Multi-level Monte Carlo finite element method for elliptic PDEs with stochastic coefficients. Numer. Math. 119(1), 123–161 (2011)MathSciNetCrossRef
26.
go back to reference Charrier, J., Scheichl, R., Teckentrup, A.L.: Finite element error analysis of elliptic PDEs with random coefficients and its application to multi level Monte Carlo methods. SIAM J. Numer. Anal. 51(1), 322–352 (2013)MathSciNetCrossRef Charrier, J., Scheichl, R., Teckentrup, A.L.: Finite element error analysis of elliptic PDEs with random coefficients and its application to multi level Monte Carlo methods. SIAM J. Numer. Anal. 51(1), 322–352 (2013)MathSciNetCrossRef
27.
go back to reference Cliffe, K., Giles, M., Scheichl, R., Teckentrup, A.L.: Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients. Comput. Vis. Sci. 14(1), 3–15 (2011)MathSciNetCrossRef Cliffe, K., Giles, M., Scheichl, R., Teckentrup, A.L.: Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients. Comput. Vis. Sci. 14(1), 3–15 (2011)MathSciNetCrossRef
28.
go back to reference Teckentrup, A., Scheichl, R., Giles, M., Ullmann, E.: Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients. Numer. Math. 125(3), 569–600 (2013)MathSciNetCrossRef Teckentrup, A., Scheichl, R., Giles, M., Ullmann, E.: Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients. Numer. Math. 125(3), 569–600 (2013)MathSciNetCrossRef
Metadata
Title
General Introduction to Monte Carlo and Multi-level Monte Carlo Methods
Authors
Robin Schmidt
Matthias Voigt
Michele Pisaroni
Fabio Nobile
Penelope Leyland
Jordi Pons-Prats
Gabriel Bugeda
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-319-77767-2_16

Premium Partners