Skip to main content
Top

2016 | OriginalPaper | Chapter

Recent Results on Nonparametric Quantile Estimation in a Simulation Model

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present recent results on nonparametric estimation of a quantile of distribution of Y given by a simulation model \(Y=m(X)\), where \(m: \mathbb {R}^d\rightarrow \mathbb {R}\) is a function which is costly to compute and X is a \(\mathbb {R}^d\)-valued random variable with given density. We argue that importance sampling quantile estimate of m(X), based on a suitable estimate \(m_n\) of m achieves better rate of convergence than the estimate based on order statistics alone. Similar results are given for Robbins-Monro type recursive importance sampling and for quantile estimation based on surrogate model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Arnold BC, Balakrishnan N, Nagaraja HN (1992) A first course in order statistics. Wiley, New YorkMATH Arnold BC, Balakrishnan N, Nagaraja HN (1992) A first course in order statistics. Wiley, New YorkMATH
2.
go back to reference Beirlant J, Györfi L (1998) On the asymptotic \({L}_2\)-error in partitioning regression estimation. J Stat Plan Inference 71:93–107CrossRefMATH Beirlant J, Györfi L (1998) On the asymptotic \({L}_2\)-error in partitioning regression estimation. J Stat Plan Inference 71:93–107CrossRefMATH
3.
go back to reference Benveniste A, Métivier M, Priouret P (1990) Adaptive algorithms and stochastic approximation. Springer, New YorkCrossRef Benveniste A, Métivier M, Priouret P (1990) Adaptive algorithms and stochastic approximation. Springer, New YorkCrossRef
4.
go back to reference Bichon B, Eldred M, Swiler M, Mahadevan S, McFarland J (2008) Efficient global reliability analysis for nonlinear implicit performance functions. AIAA J 46:2459–2468CrossRef Bichon B, Eldred M, Swiler M, Mahadevan S, McFarland J (2008) Efficient global reliability analysis for nonlinear implicit performance functions. AIAA J 46:2459–2468CrossRef
5.
go back to reference Bourinet JM, Deheeger F, Lemaire M (2011) Assessing small failure probabilities by combined subset simulation and support vector machines. Struct Saf 33:343–353CrossRef Bourinet JM, Deheeger F, Lemaire M (2011) Assessing small failure probabilities by combined subset simulation and support vector machines. Struct Saf 33:343–353CrossRef
7.
go back to reference Chen H-F (2002) Stochastic approximation and its applications. Kluwer Academic Publishers, BostonMATH Chen H-F (2002) Stochastic approximation and its applications. Kluwer Academic Publishers, BostonMATH
8.
go back to reference Das PK, Zheng Y (2000) Cumulative formation of response surface and its use in reliability analysis. Probab Eng Mech 15:309–315CrossRefMATH Das PK, Zheng Y (2000) Cumulative formation of response surface and its use in reliability analysis. Probab Eng Mech 15:309–315CrossRefMATH
10.
go back to reference Deheeger F, Lemaire M (2010) Support vector machines for efficient subset simulations: \(^2\)SMART method. In: Proceedings of the 10th international conference on applications of statistics and probability in civil engineering (ICASP10), Tokyo, Japan Deheeger F, Lemaire M (2010) Support vector machines for efficient subset simulations: \(^2\)SMART method. In: Proceedings of the 10th international conference on applications of statistics and probability in civil engineering (ICASP10), Tokyo, Japan
11.
go back to reference Devroye L, Wagner TJ (1980) Distribution-free consistency results in nonparametric discrimination and regression function estimation. Ann Stat 8:231–239MathSciNetCrossRefMATH Devroye L, Wagner TJ (1980) Distribution-free consistency results in nonparametric discrimination and regression function estimation. Ann Stat 8:231–239MathSciNetCrossRefMATH
12.
go back to reference Devroye L (1982) Necessary and sufficient conditions for the almost everywhere convergence of nearest neighbor regression function estimates. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete 61:467–481MathSciNetCrossRef Devroye L (1982) Necessary and sufficient conditions for the almost everywhere convergence of nearest neighbor regression function estimates. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete 61:467–481MathSciNetCrossRef
13.
go back to reference Devroye L, Krzyżak A (1989) An equivalence theorem for \({L}_1\) convergence of the kernel regression estimate. J Stat Plan Inference 23:71–82CrossRefMATH Devroye L, Krzyżak A (1989) An equivalence theorem for \({L}_1\) convergence of the kernel regression estimate. J Stat Plan Inference 23:71–82CrossRefMATH
14.
go back to reference Devroye L, Györfi L, Krzyżak A, Lugosi G (1994) On the strong universal consistency of nearest neighbor regression function estimates. Ann Stat 22:1371–1385CrossRef Devroye L, Györfi L, Krzyżak A, Lugosi G (1994) On the strong universal consistency of nearest neighbor regression function estimates. Ann Stat 22:1371–1385CrossRef
15.
go back to reference Dubourg V, Sudret B, Deheeger F (2013) Metamodel-based importance sampling for structural reliability analysis. Probab Eng Mech 33:47–57CrossRef Dubourg V, Sudret B, Deheeger F (2013) Metamodel-based importance sampling for structural reliability analysis. Probab Eng Mech 33:47–57CrossRef
17.
go back to reference Enss GC, Kohler M, Krzyżak A, Platz R (2014) Nonparametric quantile estimation based on surrogate models. Submitted for publication Enss GC, Kohler M, Krzyżak A, Platz R (2014) Nonparametric quantile estimation based on surrogate models. Submitted for publication
18.
go back to reference Glasserman P (2004) Monte Carlo methods in financial engineering. Springer, New YorkMATH Glasserman P (2004) Monte Carlo methods in financial engineering. Springer, New YorkMATH
19.
20.
go back to reference Györfi L (1981) Recent results on nonparametric regression estimate and multiple classification. Probl Control Inf Theory 10:43–52MATH Györfi L (1981) Recent results on nonparametric regression estimate and multiple classification. Probl Control Inf Theory 10:43–52MATH
21.
go back to reference Györfi L, Kohler M, Krzyżak A, Walk H (2002) A distribution-free theory of nonparametric regression. Springer series in statistics. Springer, New York Györfi L, Kohler M, Krzyżak A, Walk H (2002) A distribution-free theory of nonparametric regression. Springer series in statistics. Springer, New York
22.
go back to reference Holst U (1987) Recursive estimation of quantiles using recursive kernel density estimators. Seq Anal: Des Methods Appl 6(3):219–237MathSciNetCrossRef Holst U (1987) Recursive estimation of quantiles using recursive kernel density estimators. Seq Anal: Des Methods Appl 6(3):219–237MathSciNetCrossRef
23.
go back to reference Hurtado J (2004) Structural reliability—statistical learning perspectives, Lecture notes in applied and computational mechanics, vol 17. Springer, New York Hurtado J (2004) Structural reliability—statistical learning perspectives, Lecture notes in applied and computational mechanics, vol 17. Springer, New York
24.
go back to reference Kaymaz I (2005) Application of Kriging method to structural reliability problems. Struct Saf 27:133–151CrossRef Kaymaz I (2005) Application of Kriging method to structural reliability problems. Struct Saf 27:133–151CrossRef
25.
go back to reference Kim SH, Na SW (1997) Response surface method using vector projected sampling points. Struct Saf 19:3–19CrossRef Kim SH, Na SW (1997) Response surface method using vector projected sampling points. Struct Saf 19:3–19CrossRef
27.
go back to reference Kohler M (2000) Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression. J Stat Plan Inference 89:1–23MathSciNetCrossRef Kohler M (2000) Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression. J Stat Plan Inference 89:1–23MathSciNetCrossRef
28.
go back to reference Kohler M, Krzyżak A (2001) Nonparametric regression estimation using penalized least squares. IEEE Trans Inf Theory 47:3054–3058CrossRefMATH Kohler M, Krzyżak A (2001) Nonparametric regression estimation using penalized least squares. IEEE Trans Inf Theory 47:3054–3058CrossRefMATH
29.
go back to reference Kohler M (2014) Optimal global rates of convergence for noiseless regression estimation problems with adaptively chosen design. J Multivar Anal 132:197–208MathSciNetCrossRef Kohler M (2014) Optimal global rates of convergence for noiseless regression estimation problems with adaptively chosen design. J Multivar Anal 132:197–208MathSciNetCrossRef
30.
go back to reference Kohler M, Krzyżak A, Walk H (2014) Nonparametric recursive quantile estimation. Stat Probab Lett 93:102–107CrossRef Kohler M, Krzyżak A, Walk H (2014) Nonparametric recursive quantile estimation. Stat Probab Lett 93:102–107CrossRef
31.
go back to reference Kohler M, Krzyżak A, Tent R, Walk H (2014) Nonparametric quantile estimation using importance sampling. Submitted for publication Kohler M, Krzyżak A, Tent R, Walk H (2014) Nonparametric quantile estimation using importance sampling. Submitted for publication
32.
go back to reference Kushner HJ, Yin G (2003) Stochastic approximation and recursive algorithms and applications, 2nd edn. Springer, New YorkMATH Kushner HJ, Yin G (2003) Stochastic approximation and recursive algorithms and applications, 2nd edn. Springer, New YorkMATH
33.
go back to reference Ljung L, Pflug G, Walk H (1992) Stochastic approximation and optimization of random systems. Birkhäuser Verlag, BaselCrossRefMATH Ljung L, Pflug G, Walk H (1992) Stochastic approximation and optimization of random systems. Birkhäuser Verlag, BaselCrossRefMATH
35.
go back to reference Morio J (2012) Extreme quantile estimation with nonparametric adaptive importance sampling. Simul Model Pract Theory 27:76–89CrossRef Morio J (2012) Extreme quantile estimation with nonparametric adaptive importance sampling. Simul Model Pract Theory 27:76–89CrossRef
36.
go back to reference Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141–142CrossRef Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141–142CrossRef
37.
go back to reference Nadaraya EA (1970) Remarks on nonparametric estimates for density functions and regression curves. Theory Probab Appl 15:134–137CrossRefMATH Nadaraya EA (1970) Remarks on nonparametric estimates for density functions and regression curves. Theory Probab Appl 15:134–137CrossRefMATH
38.
go back to reference Neddermeyer JC (2009) Computationally efficient nonparametric importance sampling. J Am Stat Assoc 104(486):788–802MathSciNetCrossRef Neddermeyer JC (2009) Computationally efficient nonparametric importance sampling. J Am Stat Assoc 104(486):788–802MathSciNetCrossRef
39.
40.
go back to reference Papadrakakis M, Lagaros N (2002) Reliability-based structural optimization using neural networks and Monte Carlo simulation. Comput Methods Appl Mech Eng 191:3491–3507CrossRefMATH Papadrakakis M, Lagaros N (2002) Reliability-based structural optimization using neural networks and Monte Carlo simulation. Comput Methods Appl Mech Eng 191:3491–3507CrossRefMATH
41.
go back to reference Polyak BT, Juditsky AB (2002) Acceleration of stochastic approximation by averaging. SIAM J Control Optim 30(4):838–855MathSciNetCrossRef Polyak BT, Juditsky AB (2002) Acceleration of stochastic approximation by averaging. SIAM J Control Optim 30(4):838–855MathSciNetCrossRef
42.
go back to reference Rafajłowicz E (1987) Nonparametric orthogonal series estimators of regression: a class attaining the optimal convergence rate in L2. Stat Probab Lett 5:219–224CrossRef Rafajłowicz E (1987) Nonparametric orthogonal series estimators of regression: a class attaining the optimal convergence rate in L2. Stat Probab Lett 5:219–224CrossRef
44.
go back to reference Ruppert D (1991) Stochastic approximation. In: Gosh BK, Sen PK (eds) Handbook of sequential analysis, Ch. 22. Marcel Dekker, New York, pp 503–529 Ruppert D (1991) Stochastic approximation. In: Gosh BK, Sen PK (eds) Handbook of sequential analysis, Ch. 22. Marcel Dekker, New York, pp 503–529
45.
go back to reference Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, New YorkCrossRefMATH Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, New YorkCrossRefMATH
46.
47.
go back to reference Stone CJ (1982) Optimal global rates of convergence for nonparametric regression. Ann Stat 10:1040–1053CrossRefMATH Stone CJ (1982) Optimal global rates of convergence for nonparametric regression. Ann Stat 10:1040–1053CrossRefMATH
48.
go back to reference Takeuchi I, Le QV, Sears TD, Smola AJ (2006) Nonparametric quantile estimation. J Mach Learn Res 7:1231–1264MathSciNetMATH Takeuchi I, Le QV, Sears TD, Smola AJ (2006) Nonparametric quantile estimation. J Mach Learn Res 7:1231–1264MathSciNetMATH
49.
go back to reference Tierney L (1983) A space-efficient recursive procedure for estimating a quantile of an unknown distribution. SIAM J Sci Stat Comput 4(4):706–711MathSciNetCrossRef Tierney L (1983) A space-efficient recursive procedure for estimating a quantile of an unknown distribution. SIAM J Sci Stat Comput 4(4):706–711MathSciNetCrossRef
52.
go back to reference Yu K, Lu Z, Stander J (2003) Quantile regression: application and current research areas. J R Stat Soc, Ser D 52:331–350MathSciNetCrossRef Yu K, Lu Z, Stander J (2003) Quantile regression: application and current research areas. J R Stat Soc, Ser D 52:331–350MathSciNetCrossRef
Metadata
Title
Recent Results on Nonparametric Quantile Estimation in a Simulation Model
Author
Adam Krzyżak
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-18781-5_13

Premium Partner