Abstract
In this paper we present a unified discussion of different approaches to the identification of smoothing spline analysis of variance (ANOVA) models: (i) the “classical” approach (in the line of Wahba in Spline Models for Observational Data, 1990; Gu in Smoothing Spline ANOVA Models, 2002; Storlie et al. in Stat. Sin., 2011) and (ii) the State-Dependent Regression (SDR) approach of Young in Nonlinear Dynamics and Statistics (2001). The latter is a nonparametric approach which is very similar to smoothing splines and kernel regression methods, but based on recursive filtering and smoothing estimation (the Kalman filter combined with fixed interval smoothing). We will show that SDR can be effectively combined with the “classical” approach to obtain a more accurate and efficient estimation of smoothing spline ANOVA models to be applied for emulation purposes. We will also show that such an approach can compare favorably with kriging.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Archer, G., Saltelli, A., Sobol’, I.: Sensitivity measures, ANOVA-like techniques and the use of bootstrap. J. Stat. Comput. Simul. 58, 99–120 (1997)
Gu, C.: Smoothing Spline ANOVA Models. Springer, Berlin (2002)
Hodrick, T., Prescott, E.: Post-war US business cycles: an empirical investigation. Discussion paper n. 451, Northwestern University, Evanston, IL (1981)
Kalman, R.: A new approach to linear filtering and prediction problems. ASME Trans. J. Basic Eng. D 82, 35–45 (1960)
Leser, C.: A simple method of trend construction. J. R. Stat. Soc. B 23, 91–107 (1961)
Levy, S., Steinberg, D.: Computer experiments: A review. Adv. Stat. Anal. 94(4), 311–324 (2010)
Lin, Y., Zhang, H.: Component selection and smoothing in smoothing spline analysis of variance models. Ann. Stat. 34, 2272–2297 (2006)
Lophaven, S., Nielsen, H., Sondergaard, J.: DACE A Matlab kriging toolbox, version 2.0. Technical Report IMM-TR-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark (2002). http://www.immm.dtu.dk/hbn/dace
Ng, C., Young, P.C.: Recursive estimation and forecasting of non-stationary time series. J. Forecast. 9, 173–204 (1990)
Ratto, M., Pagano, A., Young, P.C.: State dependent parameter meta-modelling and sensitivity analysis. Comput. Phys. Commun. 177, 863–876 (2007)
Schweppe, F.: Evaluation of likelihood functions for Gaussian signals. IEEE Trans. Inf. Theory 11, 61–70 (1965)
Storlie, C., Bondell, H., Reich, B., Zhang, H.: Surface estimation, variable selection, and the nonparametric oracle property. Stat. Sin. (2011, in press). http://www3.stat.sinica.edu.tw/statistica/, preprint article SS-08-241
Storlie, C.B., Swiler, L., Helton, J.C., Sallaberry, C.: Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models. SANDIA Report SAND2008-6570, Sandia Laboratories, Albuquerque, NM (2008)
Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. B 58(1), 267–288 (1996)
Wagner, T., Bröcker, C., Saba, N., Biermann, D., Matzenmiller, A., Steinhoff, K., Model of a thermomechanically coupled forming process based on functional outputs from a finite element analysis and from experimental measurements. Adv. Stat. Anal. 94(4), 389–404 (2010)
Wahba, G.: Spline Models for Observational Data. CBMS-NSF Regional Conference Series in Applied Mathematics (1990)
Wecker, W.E., Ansley, C.F.: The signal extraction approach to non linear regression and spline smoothing. J. Am. Stat. Assoc. 78, 81–89 (1983)
Weinert, H., Byrd, R., Sidhu, G.: A stochastic framework for recursive computation of spline functions: Part II, smoothing splines. J. Optim. Theory Appl. 30, 255–268 (1980)
Young, P.C.: Nonstationary time series analysis and forecasting. Prog. Environ. Sci. 1, 3–48 (1999)
Young, P.C.: Stochastic, dynamic modelling and signal processing: Time variable and state dependent parameter estimation. In: Fitzgerald, W.J., Walden, A., Smith, R., Young, P.C. (eds.) Nonlinear and Nonstationary Signal Processing, pp. 74–114. Cambridge University Press, Cambridge (2000)
Young, P.C.: The identification and estimation of nonlinear stochastic systems. In: Mees, AIea (ed.) Nonlinear Dynamics and Statistics. Birkhäuser, Boston (2001)
Young, P.C., Ng, C.N.: Variance intervention. J. Forecast. 8, 399–416 (1989)
Young, P.C., Pedregal, D.J.: Recursive and en-bloc approaches to signal extraction. J. Appl. Stat. 26, 103–128 (1999)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ratto, M., Pagano, A. Using recursive algorithms for the efficient identification of smoothing spline ANOVA models. AStA Adv Stat Anal 94, 367–388 (2010). https://doi.org/10.1007/s10182-010-0148-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10182-010-0148-8