Skip to main content

2015 | OriginalPaper | Buchkapitel

3. Model-Based Prediction in Regression

verfasst von : Dimitris N. Politis

Erschienen in: Model-Free Prediction and Regression

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In applying the Model-free Prediction Principle, the problem of nonparametric regression is addressed in detail; the model-free predictors are worked out, and shown to be applicable under minimal assumptions. Interestingly, model-free prediction in regression is a totally automatic technique that does not necessitate the search for an optimal data transformation before model fitting. The resulting model-free predictive distributions and intervals are compared to their corresponding model-based analogs, and the use of cross-validation is extensively discussed. As an aside, improved prediction intervals in linear regression are also obtained.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
In general, the L 2–optimal predictor of Y f would be given by the conditional expectation of Y f given \(Y _{1},\ldots,Y _{n}\) as well as x f. However, under model (3.1), the Y data are independent, and \(E(Y _{\mathrm{f}}\vert Y _{1},\ldots,Y _{n},x_{\mathrm{f}})\) simplifies to just E(Y f | x f); the same will be true under the Model-free regression setting of Chap. 4 The study of dependent data will be undertaken in Part III of the book.
 
2
If σ 2(x) is not assumed constant, then \(\tilde{e}_{t} = e_{t}C_{t}/(1 -\delta _{x_{t}})\) where \(C_{t} = s_{x_{t}}/s_{x_{t}}^{(t)}\).
 
3
mx and s x can use the same bandwidth as the original estimators m x and s x provided these are slightly undersmoothed; otherwise, a two bandwidth trick is recommended—see Remark  3.5.2.
 
4
Efron (1983) proposed an iterated bootstrap method in order to correct the downward bias of the bootstrap estimate of variance of prediction error; notably, his method involved the use of predictive residuals albeit at the 2nd bootstrap tier—see also Efron and Tibshirani (1993, Chap. 17.7).
 
5
If c = 0, the bound (3.34) is trivial: | W t | < .
 
6
In the rare case of non-unique minima in PRESAR cross-validation, the dilemma may be resolved by picking the result closest to one given by PRESS.
 
Literatur
Zurück zum Zitat Alonso AM, Peña D, Romo J (2002) Forecasting time series with sieve bootstrap. J Stat Plan Infer 100(1):1–11CrossRefMATH Alonso AM, Peña D, Romo J (2002) Forecasting time series with sieve bootstrap. J Stat Plan Infer 100(1):1–11CrossRefMATH
Zurück zum Zitat Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185MathSciNet
Zurück zum Zitat Andersen TG, Bollerslev T (1998) Answering the sceptics: yes, standard volatility models do provide accurate forecasts. Int Econ Rev 39(4):885–905MathSciNetCrossRef Andersen TG, Bollerslev T (1998) Answering the sceptics: yes, standard volatility models do provide accurate forecasts. Int Econ Rev 39(4):885–905MathSciNetCrossRef
Zurück zum Zitat Andersen TG, Bollerslev T, Christoffersen PF, Diebold FX (2006) Volatility and correlation forecasting. In: Elliott G, Granger CWJ, Timmermann A (eds) Handbook of economic forecasting. North-Holland, Amsterdam, pp 778–878 Andersen TG, Bollerslev T, Christoffersen PF, Diebold FX (2006) Volatility and correlation forecasting. In: Elliott G, Granger CWJ, Timmermann A (eds) Handbook of economic forecasting. North-Holland, Amsterdam, pp 778–878
Zurück zum Zitat Andersen TG, Bollerslev T, Meddahi N (2004) Analytic evaluation of volatility forecasts. Int Econ Rev 45:1079–1110MathSciNetCrossRef Andersen TG, Bollerslev T, Meddahi N (2004) Analytic evaluation of volatility forecasts. Int Econ Rev 45:1079–1110MathSciNetCrossRef
Zurück zum Zitat Atkinson AC (1985) Plots, transformations and regression. Clarendon Press, OxfordMATH Atkinson AC (1985) Plots, transformations and regression. Clarendon Press, OxfordMATH
Zurück zum Zitat Antoniadis A, Paparoditis E, Sapatinas T (2006) A functional wavelet-kernel approach for time series prediction. J R Stat Soc Ser B 68(5):837–857MathSciNetCrossRefMATH Antoniadis A, Paparoditis E, Sapatinas T (2006) A functional wavelet-kernel approach for time series prediction. J R Stat Soc Ser B 68(5):837–857MathSciNetCrossRefMATH
Zurück zum Zitat Bachelier L (1900) Theory of speculation. Reprinted in Cootner PH (ed) The random character of stock market prices. MIT Press, Cambridge, MA, pp 17–78, 1964 Bachelier L (1900) Theory of speculation. Reprinted in Cootner PH (ed) The random character of stock market prices. MIT Press, Cambridge, MA, pp 17–78, 1964
Zurück zum Zitat Barndorff-Nielsen OE, Nielsen B, Shephard N, Ysusi C (1996) Measuring and forecasting financial variability using realized variance with and without a model. In: Harvey AC, Koopman SJ, Shephard N (eds) State space and unobserved components models: theory and applications. Cambridge University Press, Cambridge, pp 205–235 Barndorff-Nielsen OE, Nielsen B, Shephard N, Ysusi C (1996) Measuring and forecasting financial variability using realized variance with and without a model. In: Harvey AC, Koopman SJ, Shephard N (eds) State space and unobserved components models: theory and applications. Cambridge University Press, Cambridge, pp 205–235
Zurück zum Zitat Bartlett MS (1946) On the theoretical specification of sampling properties of autocorrelated time series. J R Stat Soc Suppl 8:27–41MathSciNetCrossRefMATH Bartlett MS (1946) On the theoretical specification of sampling properties of autocorrelated time series. J R Stat Soc Suppl 8:27–41MathSciNetCrossRefMATH
Zurück zum Zitat Berkes I, Gombay E, Horvath L, Kokoszka P (2004) Sequential change-point detection in GARCH (p, q) models. Econ Theory 20(6):1140–1167MathSciNetCrossRefMATH Berkes I, Gombay E, Horvath L, Kokoszka P (2004) Sequential change-point detection in GARCH (p, q) models. Econ Theory 20(6):1140–1167MathSciNetCrossRefMATH
Zurück zum Zitat Bickel P, Gel YR (2011) Banded regularization of autocovariance matrices in application to parameter estimation and forecasting of time series. J R Stat Soc Ser B 73(5):711–728MathSciNetCrossRefMATH Bickel P, Gel YR (2011) Banded regularization of autocovariance matrices in application to parameter estimation and forecasting of time series. J R Stat Soc Ser B 73(5):711–728MathSciNetCrossRefMATH
Zurück zum Zitat Bollerslev T, Chou R, Kroner K (1992) ARCH modelling in finance: a review of theory and empirical evidence. J Econ 52:5–60CrossRefMATH Bollerslev T, Chou R, Kroner K (1992) ARCH modelling in finance: a review of theory and empirical evidence. J Econ 52:5–60CrossRefMATH
Zurück zum Zitat Bose A (1988) Edgeworth correction by bootstrap in autoregressions. Ann Stat 16:1345–1741CrossRef Bose A (1988) Edgeworth correction by bootstrap in autoregressions. Ann Stat 16:1345–1741CrossRef
Zurück zum Zitat Bose A, Chatterjee S (2002) Comparison of bootstrap and jackknife variance estimators in linear regression: second order results. Stat Sin 12:575–598MathSciNetMATH Bose A, Chatterjee S (2002) Comparison of bootstrap and jackknife variance estimators in linear regression: second order results. Stat Sin 12:575–598MathSciNetMATH
Zurück zum Zitat Box GEP, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New YorkMATH Box GEP, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New YorkMATH
Zurück zum Zitat Box GEP, Jenkins GM (1976) Time series analysis, control, and forecasting. Holden Day, San Francisco Box GEP, Jenkins GM (1976) Time series analysis, control, and forecasting. Holden Day, San Francisco
Zurück zum Zitat Breidt FJ, Davis RA, Dunsmuir W (1995) Improved bootstrap prediction intervals for autoregressions. J Time Ser Anal 16(2):177–200MathSciNetCrossRefMATH Breidt FJ, Davis RA, Dunsmuir W (1995) Improved bootstrap prediction intervals for autoregressions. J Time Ser Anal 16(2):177–200MathSciNetCrossRefMATH
Zurück zum Zitat Breiman L, Friedman J (1985) Estimating optimal transformations for multiple regression and correlation. J Am Stat Assoc 80:580–597MathSciNetCrossRefMATH Breiman L, Friedman J (1985) Estimating optimal transformations for multiple regression and correlation. J Am Stat Assoc 80:580–597MathSciNetCrossRefMATH
Zurück zum Zitat Brockwell PJ, Davis RA (1991) Time series: theory and methods, 2nd edn. Springer, New YorkCrossRef Brockwell PJ, Davis RA (1991) Time series: theory and methods, 2nd edn. Springer, New YorkCrossRef
Zurück zum Zitat Brockwell PJ, Davis RA (1988) Simple consistent estimation of the coefficients of a linear filter. Stoch Process Appl 22:47–59MathSciNetCrossRef Brockwell PJ, Davis RA (1988) Simple consistent estimation of the coefficients of a linear filter. Stoch Process Appl 22:47–59MathSciNetCrossRef
Zurück zum Zitat Bühlmann P, van de Geer S (2011) Statistics for high-dimensional data. Springer, New YorkCrossRefMATH Bühlmann P, van de Geer S (2011) Statistics for high-dimensional data. Springer, New YorkCrossRefMATH
Zurück zum Zitat Cai TT, Ren Z, Zhou HH (2013) Optimal rates of convergence for estimating Toeplitz covariance matrices. Probab Theory Relat Fields 156(1–2):101–143MathSciNetCrossRefMATH Cai TT, Ren Z, Zhou HH (2013) Optimal rates of convergence for estimating Toeplitz covariance matrices. Probab Theory Relat Fields 156(1–2):101–143MathSciNetCrossRefMATH
Zurück zum Zitat Cao R, Febrero-Bande M, Gonzalez-Manteiga W, Prada-Sanchez JM, GarcIa-Jurado I (1997) Saving computer time in constructing consistent bootstrap prediction intervals for autoregressive processes. Commun Stat Simul Comput 26(3):961–978MathSciNetCrossRefMATH Cao R, Febrero-Bande M, Gonzalez-Manteiga W, Prada-Sanchez JM, GarcIa-Jurado I (1997) Saving computer time in constructing consistent bootstrap prediction intervals for autoregressive processes. Commun Stat Simul Comput 26(3):961–978MathSciNetCrossRefMATH
Zurück zum Zitat Carmack PS, Schucany WR, Spence JS, Gunst RF, Lin Q, Haley RW (2009) Far casting cross-validation. J Comput Graph Stat 18(4):879–893MathSciNetCrossRef Carmack PS, Schucany WR, Spence JS, Gunst RF, Lin Q, Haley RW (2009) Far casting cross-validation. J Comput Graph Stat 18(4):879–893MathSciNetCrossRef
Zurück zum Zitat Carroll RJ, Ruppert D (1988) Transformations and weighting in regression. Chapman and Hall, New YorkCrossRef Carroll RJ, Ruppert D (1988) Transformations and weighting in regression. Chapman and Hall, New YorkCrossRef
Zurück zum Zitat Caroll RJ, Ruppert D (1991) Prediction and tolerance intervals with transformation and/or weighting. Technometrics 33(2):197–210MathSciNetCrossRef Caroll RJ, Ruppert D (1991) Prediction and tolerance intervals with transformation and/or weighting. Technometrics 33(2):197–210MathSciNetCrossRef
Zurück zum Zitat Chen X, Xu M, Wu W-B (2013) Covariance and precision matrix estimation for high-dimensional time series. Ann Stat 41(6):2994–3021MathSciNetCrossRefMATH Chen X, Xu M, Wu W-B (2013) Covariance and precision matrix estimation for high-dimensional time series. Ann Stat 41(6):2994–3021MathSciNetCrossRefMATH
Zurück zum Zitat Cheng T-ZF, Ing C-K, Yu S-H (2015) Inverse moment bounds for sample autocovariance matrices based on detrended time series and their applications. Linear Algebra Appl (to appear) Cheng T-ZF, Ing C-K, Yu S-H (2015) Inverse moment bounds for sample autocovariance matrices based on detrended time series and their applications. Linear Algebra Appl (to appear)
Zurück zum Zitat Cox DR (1975) Prediction intervals and empirical Bayes confidence intervals. In: Gani J (eds) Perspectives in probability and statistics. Academic, London, pp 47–55 Cox DR (1975) Prediction intervals and empirical Bayes confidence intervals. In: Gani J (eds) Perspectives in probability and statistics. Academic, London, pp 47–55
Zurück zum Zitat Dahlhaus R (2012) Locally stationary processes. In: Handbook of statistics, vol 30. Elsevier, Amsterdam, pp 351–412 Dahlhaus R (2012) Locally stationary processes. In: Handbook of statistics, vol 30. Elsevier, Amsterdam, pp 351–412
Zurück zum Zitat Dai J, Sperlich S (2010) Simple and effective boundary correction for kernel densities and regression with an application to the world income and Engel curve estimation. Comput Stat Data Anal 54(11):2487–2497MathSciNetCrossRefMATH Dai J, Sperlich S (2010) Simple and effective boundary correction for kernel densities and regression with an application to the world income and Engel curve estimation. Comput Stat Data Anal 54(11):2487–2497MathSciNetCrossRefMATH
Zurück zum Zitat DasGupta A (2008) Asymptotic theory of statistics and probability. Springer, New YorkMATH DasGupta A (2008) Asymptotic theory of statistics and probability. Springer, New YorkMATH
Zurück zum Zitat Davison AC, Hinkley DV (1997) Bootstrap methods and their applications. Cambridge University Press, CambridgeCrossRef Davison AC, Hinkley DV (1997) Bootstrap methods and their applications. Cambridge University Press, CambridgeCrossRef
Zurück zum Zitat Dawid AP (2004) Probability, causality, and the empirical world: a Bayes-de Finetti-Popper-Borel synthesis. Stat Sci 19(1):44–57MathSciNetCrossRefMATH Dawid AP (2004) Probability, causality, and the empirical world: a Bayes-de Finetti-Popper-Borel synthesis. Stat Sci 19(1):44–57MathSciNetCrossRefMATH
Zurück zum Zitat Dowla A, Paparoditis E, Politis DN (2003) Locally stationary processes and the local block bootstrap. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 437–444CrossRef Dowla A, Paparoditis E, Politis DN (2003) Locally stationary processes and the local block bootstrap. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 437–444CrossRef
Zurück zum Zitat Draper NR, Smith H (1998) Applied regression analysis, 3rd edn. Wiley, New YorkMATH Draper NR, Smith H (1998) Applied regression analysis, 3rd edn. Wiley, New YorkMATH
Zurück zum Zitat Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman and Hall, New YorkCrossRefMATH Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman and Hall, New YorkCrossRefMATH
Zurück zum Zitat Engle R (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of UK inflation. Econometrica 50:987–1008MathSciNetCrossRefMATH Engle R (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of UK inflation. Econometrica 50:987–1008MathSciNetCrossRefMATH
Zurück zum Zitat Fama EF (1965) The behaviour of stock market prices. J Bus 38:34–105CrossRef Fama EF (1965) The behaviour of stock market prices. J Bus 38:34–105CrossRef
Zurück zum Zitat Fan J (1993) Local linear regression smoothers and their minimax efficiencies. Ann Stat 21(1):196–216CrossRefMATH Fan J (1993) Local linear regression smoothers and their minimax efficiencies. Ann Stat 21(1):196–216CrossRefMATH
Zurück zum Zitat Fan J, Gijbels I (1996) Local polynomial modelling and its applications. Chapman and Hall, New YorkMATH Fan J, Gijbels I (1996) Local polynomial modelling and its applications. Chapman and Hall, New YorkMATH
Zurück zum Zitat Fan J, Yao Q (2003) Nonlinear time series: nonparametric and parametric methods. Springer, New YorkCrossRef Fan J, Yao Q (2003) Nonlinear time series: nonparametric and parametric methods. Springer, New YorkCrossRef
Zurück zum Zitat Ferraty F, Vieu P (2006) Nonparametric functional data analysis. Springer, New YorkMATH Ferraty F, Vieu P (2006) Nonparametric functional data analysis. Springer, New YorkMATH
Zurück zum Zitat Francq C, Zakoian JM (2011) GARCH models: structure, statistical inference and financial applications. Wiley, New York Francq C, Zakoian JM (2011) GARCH models: structure, statistical inference and financial applications. Wiley, New York
Zurück zum Zitat Franke J, Härdle W (1992) On bootstrapping kernel spectral estimates. Ann Stat 20:121–145CrossRefMATH Franke J, Härdle W (1992) On bootstrapping kernel spectral estimates. Ann Stat 20:121–145CrossRefMATH
Zurück zum Zitat Franke J, Kreiss J-P, Mammen E (2002) Bootstrap of kernel smoothing in nonlinear time series. Bernoulli 8(1):1–37MathSciNetMATH Franke J, Kreiss J-P, Mammen E (2002) Bootstrap of kernel smoothing in nonlinear time series. Bernoulli 8(1):1–37MathSciNetMATH
Zurück zum Zitat Freedman D (1984) On bootstrapping two-stage least-squares estimates in stationary linear models. Ann Stat 12:827–842CrossRefMATH Freedman D (1984) On bootstrapping two-stage least-squares estimates in stationary linear models. Ann Stat 12:827–842CrossRefMATH
Zurück zum Zitat Fryzlewicz P, Van Bellegem S, Von Sachs R (2003) Forecasting non-stationary time series by wavelet process modelling. Ann Inst Stat Math 55(4):737–764CrossRefMATH Fryzlewicz P, Van Bellegem S, Von Sachs R (2003) Forecasting non-stationary time series by wavelet process modelling. Ann Inst Stat Math 55(4):737–764CrossRefMATH
Zurück zum Zitat Gangopadhyay AK, Sen PK (1990) Bootstrap confidence intervals for conditional quantile functions. Sankhya Ser A 52(3):346–363MathSciNetMATH Gangopadhyay AK, Sen PK (1990) Bootstrap confidence intervals for conditional quantile functions. Sankhya Ser A 52(3):346–363MathSciNetMATH
Zurück zum Zitat Ghysels E, Santa-Clara P, Valkanov R (2006) Predicting volatility: getting the most out of return data sampled at different frequencies. J Econ 131(1–2):59–95MathSciNetCrossRef Ghysels E, Santa-Clara P, Valkanov R (2006) Predicting volatility: getting the most out of return data sampled at different frequencies. J Econ 131(1–2):59–95MathSciNetCrossRef
Zurück zum Zitat Gray RM (2005) Toeplitz and circulant matrices: a review. Commun Inf Theory 2(3):155–239 Gray RM (2005) Toeplitz and circulant matrices: a review. Commun Inf Theory 2(3):155–239
Zurück zum Zitat Grenander U, Szegö G (1958) Toeplitz forms and their applications, vol 321. University of California Press, BerkeleyMATH Grenander U, Szegö G (1958) Toeplitz forms and their applications, vol 321. University of California Press, BerkeleyMATH
Zurück zum Zitat Hahn J (1995) Bootstrapping quantile regression estimators. Econ Theory 11(1):105–121CrossRef Hahn J (1995) Bootstrapping quantile regression estimators. Econ Theory 11(1):105–121CrossRef
Zurück zum Zitat Hall P (1992) The bootstrap and edgeworth expansion. Springer, New YorkCrossRef Hall P (1992) The bootstrap and edgeworth expansion. Springer, New YorkCrossRef
Zurück zum Zitat Hall P (1993) On Edgeworth expansion and bootstrap confidence bands in nonparametric curve estimation. J R Stat Soc Ser B 55:291–304MATH Hall P (1993) On Edgeworth expansion and bootstrap confidence bands in nonparametric curve estimation. J R Stat Soc Ser B 55:291–304MATH
Zurück zum Zitat Hall P, Wehrly TE (1991) A geometrical method for removing edge effects from kernel type nonparametric regression estimators. J Am Stat Assoc 86:665–672MathSciNetCrossRef Hall P, Wehrly TE (1991) A geometrical method for removing edge effects from kernel type nonparametric regression estimators. J Am Stat Assoc 86:665–672MathSciNetCrossRef
Zurück zum Zitat Hall P, Wolff RCL, Yao Q (1999) Methods for estimating a conditional distribution function. J Am Stat Assoc 94(445):154–163MathSciNetCrossRefMATH Hall P, Wolff RCL, Yao Q (1999) Methods for estimating a conditional distribution function. J Am Stat Assoc 94(445):154–163MathSciNetCrossRefMATH
Zurück zum Zitat Hamilton JD (1994) Time series analysis. Princeton University Press, Princeton, NJMATH Hamilton JD (1994) Time series analysis. Princeton University Press, Princeton, NJMATH
Zurück zum Zitat Hansen BE (2004) Nonparametric estimation of smooth conditional distributions. Working paper, Department of Economics, University of Wisconsin Hansen BE (2004) Nonparametric estimation of smooth conditional distributions. Working paper, Department of Economics, University of Wisconsin
Zurück zum Zitat Hansen PR, Lunde A (2005) A forecast comparison of volatility models: does anything beat a GARCH (1,1)? J Appl Econ 20:873–889MathSciNetCrossRef Hansen PR, Lunde A (2005) A forecast comparison of volatility models: does anything beat a GARCH (1,1)? J Appl Econ 20:873–889MathSciNetCrossRef
Zurück zum Zitat Hansen PR, Lunde A, Nason JM (2003) Choosing the best volatility models: the model confidence set approach. Oxf Bull Econ Stat 65:839–861CrossRef Hansen PR, Lunde A, Nason JM (2003) Choosing the best volatility models: the model confidence set approach. Oxf Bull Econ Stat 65:839–861CrossRef
Zurück zum Zitat Härdle W (1990) Applied nonparametric regression. Cambridge University Press, CambridgeCrossRefMATH Härdle W (1990) Applied nonparametric regression. Cambridge University Press, CambridgeCrossRefMATH
Zurück zum Zitat Härdle W, Bowman AW (1988) Bootstrapping in nonparametric regression: local adaptive smoothing and confidence bands. J Am Stat Assoc 83:102–110MATH Härdle W, Bowman AW (1988) Bootstrapping in nonparametric regression: local adaptive smoothing and confidence bands. J Am Stat Assoc 83:102–110MATH
Zurück zum Zitat Härdle W, Marron JS (1991) Bootstrap simultaneous error bars for nonparametric regression. Ann Stat 19:778–796CrossRefMATH Härdle W, Marron JS (1991) Bootstrap simultaneous error bars for nonparametric regression. Ann Stat 19:778–796CrossRefMATH
Zurück zum Zitat Hastie T, Tibshirani R, Friedman JH (2009) The elements of statistical learning: data mining, inference, and predictions, 2nd edn. Springer, New YorkCrossRef Hastie T, Tibshirani R, Friedman JH (2009) The elements of statistical learning: data mining, inference, and predictions, 2nd edn. Springer, New YorkCrossRef
Zurück zum Zitat Hong Y (1999) Hypothesis testing in time series via the empirical characteristic function: a generalized spectral density approach. J Am Stat Assoc 94:1201–1220CrossRefMATH Hong Y (1999) Hypothesis testing in time series via the empirical characteristic function: a generalized spectral density approach. J Am Stat Assoc 94:1201–1220CrossRefMATH
Zurück zum Zitat Hong Y, White H (2005) Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73(3):837–901MathSciNetCrossRefMATH Hong Y, White H (2005) Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73(3):837–901MathSciNetCrossRefMATH
Zurück zum Zitat Huber PJ (1973) Robust regression: asymptotics, conjectures and Monte Carlo. Ann Stat 1:799–821CrossRefMATH Huber PJ (1973) Robust regression: asymptotics, conjectures and Monte Carlo. Ann Stat 1:799–821CrossRefMATH
Zurück zum Zitat Hurvich CM, Zeger S (1987) Frequency domain bootstrap methods for time series. Technical Report, New York University, Graduate School of Business Administration Hurvich CM, Zeger S (1987) Frequency domain bootstrap methods for time series. Technical Report, New York University, Graduate School of Business Administration
Zurück zum Zitat Jentsch C, Politis DN (2015) Covariance matrix estimation and linear process bootstrap for multivariate time series of possibly increasing dimension. Ann Stat 43(3):1117–1140MathSciNetCrossRef Jentsch C, Politis DN (2015) Covariance matrix estimation and linear process bootstrap for multivariate time series of possibly increasing dimension. Ann Stat 43(3):1117–1140MathSciNetCrossRef
Zurück zum Zitat Kirch C, Politis DN (2011) TFT-Bootstrap: resampling time series in the frequency domain to obtain replicates in the time domain. Ann Stat 39(3):1427–1470MathSciNetCrossRefMATH Kirch C, Politis DN (2011) TFT-Bootstrap: resampling time series in the frequency domain to obtain replicates in the time domain. Ann Stat 39(3):1427–1470MathSciNetCrossRefMATH
Zurück zum Zitat Kokoszka P, Politis DN (2011) Nonlinearity of ARCH and stochastic volatility models and Bartlett’s formula. Probab Math Stat 31:47–59MathSciNetMATH Kokoszka P, Politis DN (2011) Nonlinearity of ARCH and stochastic volatility models and Bartlett’s formula. Probab Math Stat 31:47–59MathSciNetMATH
Zurück zum Zitat Koopman SJ, Jungbacker B, Hol E (2005) Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements. J Empir Finance 12:445–475CrossRef Koopman SJ, Jungbacker B, Hol E (2005) Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements. J Empir Finance 12:445–475CrossRef
Zurück zum Zitat Kreiss J-P, Paparoditis E, Politis DN (2011) On the range of validity of the autoregressive sieve bootstrap. Ann Stat 39(4):2103–2130MathSciNetCrossRefMATH Kreiss J-P, Paparoditis E, Politis DN (2011) On the range of validity of the autoregressive sieve bootstrap. Ann Stat 39(4):2103–2130MathSciNetCrossRefMATH
Zurück zum Zitat Künsch H (1989) The jackknife and the bootstrap for general stationary observations. Ann Stat 17:1217–1241CrossRefMATH Künsch H (1989) The jackknife and the bootstrap for general stationary observations. Ann Stat 17:1217–1241CrossRefMATH
Zurück zum Zitat Lahiri SN (2003) A necessary and sufficient condition for asymptotic independence of discrete Fourier transforms under short-and long-range dependence. Ann Stat 31(2):613–641CrossRefMATH Lahiri SN (2003) A necessary and sufficient condition for asymptotic independence of discrete Fourier transforms under short-and long-range dependence. Ann Stat 31(2):613–641CrossRefMATH
Zurück zum Zitat Li Q, Racine JS (2007) Nonparametric econometrics. Princeton University Press, PrincetonMATH Li Q, Racine JS (2007) Nonparametric econometrics. Princeton University Press, PrincetonMATH
Zurück zum Zitat Linton OB, Chen R, Wang N, Härdle W (1997) An analysis of transformations for additive nonparametric regression. J Am Stat Assoc 92:1512–1521CrossRefMATH Linton OB, Chen R, Wang N, Härdle W (1997) An analysis of transformations for additive nonparametric regression. J Am Stat Assoc 92:1512–1521CrossRefMATH
Zurück zum Zitat Linton OB, Sperlich S, van Keilegom I (2008) Estimation of a semiparametric transformation model. Ann Stat 36(2):686–718CrossRefMATH Linton OB, Sperlich S, van Keilegom I (2008) Estimation of a semiparametric transformation model. Ann Stat 36(2):686–718CrossRefMATH
Zurück zum Zitat Loader C (1999) Local regression and likelihood. Springer, New YorkMATH Loader C (1999) Local regression and likelihood. Springer, New YorkMATH
Zurück zum Zitat Mandelbrot B (1963) The variation of certain speculative prices. J Bus 36:394–419CrossRef Mandelbrot B (1963) The variation of certain speculative prices. J Bus 36:394–419CrossRef
Zurück zum Zitat Maronna RA, Martin RD, Yohai VJ (2006) Robust statistics: theory and methods. Wiley, New YorkCrossRef Maronna RA, Martin RD, Yohai VJ (2006) Robust statistics: theory and methods. Wiley, New YorkCrossRef
Zurück zum Zitat Masarotto G (1990) Bootstrap prediction intervals for autoregressions. Int J Forecast 6(2):229–239CrossRef Masarotto G (1990) Bootstrap prediction intervals for autoregressions. Int J Forecast 6(2):229–239CrossRef
Zurück zum Zitat Masry E, Tjøstheim D (1995) Nonparametric estimation and identification of nonlinear ARCH time series. Econ Theory 11:258–289CrossRef Masry E, Tjøstheim D (1995) Nonparametric estimation and identification of nonlinear ARCH time series. Econ Theory 11:258–289CrossRef
Zurück zum Zitat McMurry T, Politis DN (2008) Bootstrap confidence intervals in nonparametric regression with built-in bias correction. Stat Probab Lett 78:2463–2469MathSciNetCrossRefMATH McMurry T, Politis DN (2008) Bootstrap confidence intervals in nonparametric regression with built-in bias correction. Stat Probab Lett 78:2463–2469MathSciNetCrossRefMATH
Zurück zum Zitat McMurry T, Politis DN (2010) Banded and tapered estimates of autocovariance matrices and the linear process bootstrap. J Time Ser Anal 31:471–482 [Corrigendum: J Time Ser Anal 33, 2012] McMurry T, Politis DN (2010) Banded and tapered estimates of autocovariance matrices and the linear process bootstrap. J Time Ser Anal 31:471–482 [Corrigendum: J Time Ser Anal 33, 2012]
Zurück zum Zitat McMurry T, Politis DN (2015) High-dimensional autocovariance matrices and optimal linear prediction (with discussion). Electr J Stat 9:753–822MathSciNetCrossRefMATH McMurry T, Politis DN (2015) High-dimensional autocovariance matrices and optimal linear prediction (with discussion). Electr J Stat 9:753–822MathSciNetCrossRefMATH
Zurück zum Zitat Meddahi N (2001) An eigenfunction approach for volatility modeling. Technical report, CIRANO Working paper 2001s–70, University of Montreal Meddahi N (2001) An eigenfunction approach for volatility modeling. Technical report, CIRANO Working paper 2001s–70, University of Montreal
Zurück zum Zitat Mikosch T, Starica C (2004) Changes of structure in financial time series and the GARCH model. Revstat Stat J 2(1):41–73MathSciNetMATH Mikosch T, Starica C (2004) Changes of structure in financial time series and the GARCH model. Revstat Stat J 2(1):41–73MathSciNetMATH
Zurück zum Zitat Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141–142CrossRef Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141–142CrossRef
Zurück zum Zitat Neumann M, Polzehl J (1998) Simultaneous bootstrap confidence bands in nonparametric regression. J Nonparametr Stat 9:307–333MathSciNetCrossRefMATH Neumann M, Polzehl J (1998) Simultaneous bootstrap confidence bands in nonparametric regression. J Nonparametr Stat 9:307–333MathSciNetCrossRefMATH
Zurück zum Zitat Pagan A, Ullah A (1999) Nonparametric econometrics. Cambridge University Press, CambridgeCrossRef Pagan A, Ullah A (1999) Nonparametric econometrics. Cambridge University Press, CambridgeCrossRef
Zurück zum Zitat Pan L, Politis DN (2014) Bootstrap prediction intervals for Markov processes. Discussion paper, Department of Economics, University of California, San Diego. Retrievable from http://escholarship.org/uc/item/7555757g. Accepted for publication in CSDA Annals of Computational and Financial Econometrics Pan L, Politis DN (2014) Bootstrap prediction intervals for Markov processes. Discussion paper, Department of Economics, University of California, San Diego. Retrievable from http://​escholarship.​org/​uc/​item/​7555757g. Accepted for publication in CSDA Annals of Computational and Financial Econometrics
Zurück zum Zitat Pan L, Politis DN (2015) Bootstrap prediction intervals for linear, nonlinear and nonparametric autoregressions (with discussion). J Stat Plan Infer (to appear) Pan L, Politis DN (2015) Bootstrap prediction intervals for linear, nonlinear and nonparametric autoregressions (with discussion). J Stat Plan Infer (to appear)
Zurück zum Zitat Paparoditis E, Politis DN (1998) The backward local bootstrap for conditional predictive inference in nonlinear time series. In: Lipitakis EA (ed) Proceedings of the 4th Hellenic-European conference on computer mathematics and its applications (HERCMA’98). Lea Publishing, Athens, pp 467–470 Paparoditis E, Politis DN (1998) The backward local bootstrap for conditional predictive inference in nonlinear time series. In: Lipitakis EA (ed) Proceedings of the 4th Hellenic-European conference on computer mathematics and its applications (HERCMA’98). Lea Publishing, Athens, pp 467–470
Zurück zum Zitat Paparoditis E, Politis DN (2001) A Markovian local resampling scheme for nonparametric estimators in time series analysis. Econ Theory 17(3):540–566MathSciNetCrossRefMATH Paparoditis E, Politis DN (2001) A Markovian local resampling scheme for nonparametric estimators in time series analysis. Econ Theory 17(3):540–566MathSciNetCrossRefMATH
Zurück zum Zitat Patel JK (1989) Prediction intervals: a review. Commun Stat Theory Methods 18:2393–2465CrossRefMATH Patel JK (1989) Prediction intervals: a review. Commun Stat Theory Methods 18:2393–2465CrossRefMATH
Zurück zum Zitat Patton AJ (2011) Volatility forecast evaluation and comparison using imperfect volatility proxies. J Econ 160(1):246–256MathSciNetCrossRef Patton AJ (2011) Volatility forecast evaluation and comparison using imperfect volatility proxies. J Econ 160(1):246–256MathSciNetCrossRef
Zurück zum Zitat Politis DN (1998) Computer-intensive methods in statistical analysis. IEEE Signal Process Mag 15(1):39–55CrossRef Politis DN (1998) Computer-intensive methods in statistical analysis. IEEE Signal Process Mag 15(1):39–55CrossRef
Zurück zum Zitat Politis DN (2003a) A normalizing and variance-stabilizing transformation for financial time series. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 335–347CrossRef Politis DN (2003a) A normalizing and variance-stabilizing transformation for financial time series. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 335–347CrossRef
Zurück zum Zitat Politis DN (2004) A heavy-tailed distribution for ARCH residuals with application to volatility prediction. Ann Econ Finance 5:283–298 Politis DN (2004) A heavy-tailed distribution for ARCH residuals with application to volatility prediction. Ann Econ Finance 5:283–298
Zurück zum Zitat Politis DN (2007a) Model-free vs. model-based volatility prediction. J Financ Econ 5(3):358–389MathSciNet Politis DN (2007a) Model-free vs. model-based volatility prediction. J Financ Econ 5(3):358–389MathSciNet
Zurück zum Zitat Politis DN (2007b) Model-free prediction, vol LXII. Bulletin of the International Statistical Institute, Lisbon, pp 1391–1397 Politis DN (2007b) Model-free prediction, vol LXII. Bulletin of the International Statistical Institute, Lisbon, pp 1391–1397
Zurück zum Zitat Politis DN (2014) Bootstrap confidence intervals in nonparametric regression without an additive model. In: Akritas MG, Lahiri SN, Politis DN (eds) Proceedings of the first conference of the international society for nonParametric statistics. Springer, New York, pp 271–282 Politis DN (2014) Bootstrap confidence intervals in nonparametric regression without an additive model. In: Akritas MG, Lahiri SN, Politis DN (eds) Proceedings of the first conference of the international society for nonParametric statistics. Springer, New York, pp 271–282
Zurück zum Zitat Politis DN, Romano JP (1992) A general resampling scheme for triangular arrays of alpha-mixing random variables with application to the problem of spectral density estimation. Ann Stat 20:1985–2007MathSciNetCrossRefMATH Politis DN, Romano JP (1992) A general resampling scheme for triangular arrays of alpha-mixing random variables with application to the problem of spectral density estimation. Ann Stat 20:1985–2007MathSciNetCrossRefMATH
Zurück zum Zitat Politis DN, Thomakos D (2008) Financial time series and volatility prediction using NoVaS transformations. In: Rapach DE, Wohar ME (eds) Forecasting in the presence of structural breaks and model uncertainty. Emerald Group Publishing, Bingley, pp 417–447CrossRef Politis DN, Thomakos D (2008) Financial time series and volatility prediction using NoVaS transformations. In: Rapach DE, Wohar ME (eds) Forecasting in the presence of structural breaks and model uncertainty. Emerald Group Publishing, Bingley, pp 417–447CrossRef
Zurück zum Zitat Politis DN, Thomakos DD (2012) NoVaS transformations: flexible inference for volatility forecasting. In: Chen X, Swanson N (eds) Recent advances and future directions in causality, prediction, and specification analysis: essays in honor of Halbert L. White Jr. Springer, New York, pp 489–528 Politis DN, Thomakos DD (2012) NoVaS transformations: flexible inference for volatility forecasting. In: Chen X, Swanson N (eds) Recent advances and future directions in causality, prediction, and specification analysis: essays in honor of Halbert L. White Jr. Springer, New York, pp 489–528
Zurück zum Zitat Pourahmadi M (1999) Joint mean-covariance models with applications to longitudinal data: unconstrained parameterisation. Biometrika 86(3):677–690MathSciNetCrossRefMATH Pourahmadi M (1999) Joint mean-covariance models with applications to longitudinal data: unconstrained parameterisation. Biometrika 86(3):677–690MathSciNetCrossRefMATH
Zurück zum Zitat Poon S, Granger C (2003) Forecasting volatility in financial markets: a review. J Econ Lit 41:478–539CrossRef Poon S, Granger C (2003) Forecasting volatility in financial markets: a review. J Econ Lit 41:478–539CrossRef
Zurück zum Zitat Priestley MB (1965) Evolutionary spectra and non-stationary processes. J R Stat Soc Ser B 27:204–237MathSciNetMATH Priestley MB (1965) Evolutionary spectra and non-stationary processes. J R Stat Soc Ser B 27:204–237MathSciNetMATH
Zurück zum Zitat Priestley MB (1988) Nonlinear and nonstationary time series analysis. Academic, London Priestley MB (1988) Nonlinear and nonstationary time series analysis. Academic, London
Zurück zum Zitat Raïs N (1994) Méthodes de rééchantillonnage et de sous-échantillonnage pour des variables aléatoires dépendantes et spatiales. Ph.D. thesis, University of Montreal Raïs N (1994) Méthodes de rééchantillonnage et de sous-échantillonnage pour des variables aléatoires dépendantes et spatiales. Ph.D. thesis, University of Montreal
Zurück zum Zitat Resnick S, Samorodnitsky G, Xue F (1999) How misleading can sample ACF’s of stable MA’s be? (Very!) Ann Appl Probab 9(3):797–817MathSciNetMATH Resnick S, Samorodnitsky G, Xue F (1999) How misleading can sample ACF’s of stable MA’s be? (Very!) Ann Appl Probab 9(3):797–817MathSciNetMATH
Zurück zum Zitat Rissanen J, Barbosa L (1969) Properties of infinite covariance matrices and stability of optimum predictors. Inf Sci 1:221–236MathSciNetCrossRef Rissanen J, Barbosa L (1969) Properties of infinite covariance matrices and stability of optimum predictors. Inf Sci 1:221–236MathSciNetCrossRef
Zurück zum Zitat Ruppert D, Cline DH (1994) Bias reduction in kernel density estimation by smoothed empirical transformations. Ann Stat 22:185–210MathSciNetCrossRefMATH Ruppert D, Cline DH (1994) Bias reduction in kernel density estimation by smoothed empirical transformations. Ann Stat 22:185–210MathSciNetCrossRefMATH
Zurück zum Zitat Schucany WR (2004) Kernel smoothers: an overview of curve estimators for the first graduate course in nonparametric statistics. Stat Sci 19:663–675MathSciNetCrossRefMATH Schucany WR (2004) Kernel smoothers: an overview of curve estimators for the first graduate course in nonparametric statistics. Stat Sci 19:663–675MathSciNetCrossRefMATH
Zurück zum Zitat Shephard N (1996) Statistical aspects of ARCH and stochastic volatility. In: Cox DR, Hinkley DV, Barndorff-Nielsen OE (eds) Time series models in econometrics, finance and other fields. Chapman and Hall, London, pp 1–67 Shephard N (1996) Statistical aspects of ARCH and stochastic volatility. In: Cox DR, Hinkley DV, Barndorff-Nielsen OE (eds) Time series models in econometrics, finance and other fields. Chapman and Hall, London, pp 1–67
Zurück zum Zitat Starica C, Granger C (2005) Nonstationarities in stock returns. Rev Econ Stat 87(3):503–522CrossRef Starica C, Granger C (2005) Nonstationarities in stock returns. Rev Econ Stat 87(3):503–522CrossRef
Zurück zum Zitat Tibshirani R (1988) Estimating transformations for regression via additivity and variance stabilization. J Am Stat Assoc 83:394–405MathSciNetCrossRef Tibshirani R (1988) Estimating transformations for regression via additivity and variance stabilization. J Am Stat Assoc 83:394–405MathSciNetCrossRef
Zurück zum Zitat Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J R Stat Soc Ser B 58(1):267–288MathSciNetMATH Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J R Stat Soc Ser B 58(1):267–288MathSciNetMATH
Zurück zum Zitat Thomakos DD, Klepsch J, Politis DN (2015) Multivariate NoVaS and inference on conditional correlations. Working paper, Department of Economics, University of California, San Diego Thomakos DD, Klepsch J, Politis DN (2015) Multivariate NoVaS and inference on conditional correlations. Working paper, Department of Economics, University of California, San Diego
Zurück zum Zitat Wang L, Brown LD, Cai TT, Levine M (2008) Effect of mean on variance function estimation in nonparametric regression. Ann Stat 36:646–664MathSciNetCrossRefMATH Wang L, Brown LD, Cai TT, Levine M (2008) Effect of mean on variance function estimation in nonparametric regression. Ann Stat 36:646–664MathSciNetCrossRefMATH
Zurück zum Zitat Wang L, Politis DN (2015) Asymptotic validity of bootstrap confidence intervals in nonparametric regression without an additive model. Working paper, Department of Mathematics, University of California, San Diego Wang L, Politis DN (2015) Asymptotic validity of bootstrap confidence intervals in nonparametric regression without an additive model. Working paper, Department of Mathematics, University of California, San Diego
Zurück zum Zitat Wu S, Harris TJ, McAuley KB (2007) The use of simplified or misspecified models: linear case. Can J Chem Eng 75:386–398 Wu S, Harris TJ, McAuley KB (2007) The use of simplified or misspecified models: linear case. Can J Chem Eng 75:386–398
Zurück zum Zitat Wu W-B, Pourahmadi M (2009) Banding sample autocovariance matrices of stationary processes. Stat Sin 19(4):1755–1768MathSciNetMATH Wu W-B, Pourahmadi M (2009) Banding sample autocovariance matrices of stationary processes. Stat Sin 19(4):1755–1768MathSciNetMATH
Zurück zum Zitat Zhou Z, Wu W-B (2009) Local linear quantile estimation for non-stationary time series. Ann Stat 37:2696–2729CrossRefMATH Zhou Z, Wu W-B (2009) Local linear quantile estimation for non-stationary time series. Ann Stat 37:2696–2729CrossRefMATH
Zurück zum Zitat Zhou Z, Wu W-B (2010) Simultaneous inference of linear models with time-varying coefficients. J R Stat Soc Ser B 72:513–531CrossRef Zhou Z, Wu W-B (2010) Simultaneous inference of linear models with time-varying coefficients. J R Stat Soc Ser B 72:513–531CrossRef
Metadaten
Titel
Model-Based Prediction in Regression
verfasst von
Dimitris N. Politis
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-21347-7_3