Skip to main content
Erschienen in: Calcolo 3/2018

01.09.2018

Estimates for the generalized cross-validation function via an extrapolation and statistical approach

verfasst von: Marilena Mitrouli, Paraskevi Roupa

Erschienen in: Calcolo | Ausgabe 3/2018

Einloggen, um Zugang zu erhalten

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Generalized cross-validation (GCV) is a popular tool for specifying the tuning parameter in linear regression model or equivalently the regularization parameter in Tikhonov regularization. In this work, we are concerned with the estimation and minimization of the GCV function by using a combination of an extrapolation procedure and a statistical approach. In particular, we derive families of estimates for the GCV function. By minimizing the estimated GCV function over a grid of values, a GCV estimate of the regularization parameter is achieved. We present several numerical examples to illustrate the effectiveness of the derived families of estimates for approximating the regularization parameter for several linear discrete ill-posed problems.
Literatur
1.
Zurück zum Zitat Androulakis, E., Koukouvinos, C., Mylona, K.: Tuning parameter estimation in penalized least squares methodology. Commun. Stat. Simul. Comput. 40(9), 1444–1457 (2011)MathSciNetCrossRef Androulakis, E., Koukouvinos, C., Mylona, K.: Tuning parameter estimation in penalized least squares methodology. Commun. Stat. Simul. Comput. 40(9), 1444–1457 (2011)MathSciNetCrossRef
2.
Zurück zum Zitat Bouhamidi, A., Enkhbat, R., Jbilou, K.: Conditional gradient Tikhonov method for a convex optimization problem in image restoration. J. Comput. Appl. Math. 255, 580–592 (2014)MathSciNetCrossRef Bouhamidi, A., Enkhbat, R., Jbilou, K.: Conditional gradient Tikhonov method for a convex optimization problem in image restoration. J. Comput. Appl. Math. 255, 580–592 (2014)MathSciNetCrossRef
3.
4.
Zurück zum Zitat Brezinski, C., Fika, P., Mitrouli, M.: Estimations of the trace of powers of positive self-adjoint operators by extrapolation of the moments. Electron. Trans. Numer. Anal. 39, 144–155 (2012)MathSciNetMATH Brezinski, C., Fika, P., Mitrouli, M.: Estimations of the trace of powers of positive self-adjoint operators by extrapolation of the moments. Electron. Trans. Numer. Anal. 39, 144–155 (2012)MathSciNetMATH
5.
Zurück zum Zitat Brezinski, C., Rodriguez, G., Seatzu, S.: Error estimates for the regularization of least squares problems. Numer. Algo. 51, 61–76 (2009)MathSciNetCrossRef Brezinski, C., Rodriguez, G., Seatzu, S.: Error estimates for the regularization of least squares problems. Numer. Algo. 51, 61–76 (2009)MathSciNetCrossRef
6.
Zurück zum Zitat Craven, P., Wahba, G.: Smoothing noisy data with spline functions. Numer. Math. 31, 377–403 (1979)CrossRef Craven, P., Wahba, G.: Smoothing noisy data with spline functions. Numer. Math. 31, 377–403 (1979)CrossRef
7.
Zurück zum Zitat Fenu, C., Reichel, L., Rodriguez, G.: GCV for Tikhonov regularization via global Golub–Kahan decomposition. Numer. Linear Algebra Appl. 23, 467–484 (2016)MathSciNetCrossRef Fenu, C., Reichel, L., Rodriguez, G.: GCV for Tikhonov regularization via global Golub–Kahan decomposition. Numer. Linear Algebra Appl. 23, 467–484 (2016)MathSciNetCrossRef
9.
Zurück zum Zitat Fika, P., Koukouvinos, C.: Stochastic estimates for the trace of functions of matrices via Hadamard matrices. Commun. Stat. Simul. Comput. 46(5), 3503–3941 (2017)MathSciNetMATH Fika, P., Koukouvinos, C.: Stochastic estimates for the trace of functions of matrices via Hadamard matrices. Commun. Stat. Simul. Comput. 46(5), 3503–3941 (2017)MathSciNetMATH
10.
Zurück zum Zitat Fika, P., Mitrouli, M.: Estimation of the bilinear form \(y^*f(A)x\) for Hermitian matrices. Linear Algebra Appl. 502, 140–158 (2016)MathSciNetCrossRef Fika, P., Mitrouli, M.: Estimation of the bilinear form \(y^*f(A)x\) for Hermitian matrices. Linear Algebra Appl. 502, 140–158 (2016)MathSciNetCrossRef
11.
Zurück zum Zitat Fika, P., Mitrouli, M., Roupa, P.: Estimates for the bilinear form \(x^TA^{-1}y\) with applications to linear algebra problems. Electron. Trans. Numer. Anal. 43, 70–89 (2014)MathSciNetMATH Fika, P., Mitrouli, M., Roupa, P.: Estimates for the bilinear form \(x^TA^{-1}y\) with applications to linear algebra problems. Electron. Trans. Numer. Anal. 43, 70–89 (2014)MathSciNetMATH
12.
Zurück zum Zitat Fika, P., Mitrouli, M., Roupa, P.: Estimating the diagonal of matrix functions. Math. Methods Appl. Sci. 41(3), 1083–1088 (2018)MathSciNetCrossRef Fika, P., Mitrouli, M., Roupa, P.: Estimating the diagonal of matrix functions. Math. Methods Appl. Sci. 41(3), 1083–1088 (2018)MathSciNetCrossRef
13.
Zurück zum Zitat Gazzola, S., Novati, P., Russo, M.R.: On Krylov projection methods and Tikhonov regularization. Electron. Trans. Numer. Anal. 44, 83–123 (2015)MathSciNetMATH Gazzola, S., Novati, P., Russo, M.R.: On Krylov projection methods and Tikhonov regularization. Electron. Trans. Numer. Anal. 44, 83–123 (2015)MathSciNetMATH
14.
Zurück zum Zitat Golub, G.H., Heath, M., Wahba, G.: Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21, 215–223 (1979)MathSciNetCrossRef Golub, G.H., Heath, M., Wahba, G.: Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21, 215–223 (1979)MathSciNetCrossRef
15.
Zurück zum Zitat Golub, G.H., Meurant, G.: Matrices, Moments and Quadrature with Applications. Princeton University Press, Princeton (2010)MATH Golub, G.H., Meurant, G.: Matrices, Moments and Quadrature with Applications. Princeton University Press, Princeton (2010)MATH
16.
Zurück zum Zitat Golub, G.H., von Matt, U.: Generalized cross-validation for large-scale problems. J. Comput. Graph. Stat. 6, 1–34 (1997)MathSciNetMATH Golub, G.H., von Matt, U.: Generalized cross-validation for large-scale problems. J. Comput. Graph. Stat. 6, 1–34 (1997)MathSciNetMATH
17.
18.
Zurück zum Zitat Higham, N.J.: Functions of Matrices: Theory and Computation. SIAM, Philadelphia, PA (2008)CrossRef Higham, N.J.: Functions of Matrices: Theory and Computation. SIAM, Philadelphia, PA (2008)CrossRef
19.
Zurück zum Zitat Hutchinson, M.F.: A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines. Commun. Stat. Simul. 19, 433–450 (1990)MathSciNetCrossRef Hutchinson, M.F.: A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines. Commun. Stat. Simul. 19, 433–450 (1990)MathSciNetCrossRef
20.
Zurück zum Zitat Reichel, L., Rodriguez, G., Seatzu, S.: Error estimates for large-scale ill-posed problems. Numer. Algorithms 51(3), 341–361 (2009)MathSciNetCrossRef Reichel, L., Rodriguez, G., Seatzu, S.: Error estimates for large-scale ill-posed problems. Numer. Algorithms 51(3), 341–361 (2009)MathSciNetCrossRef
Metadaten
Titel
Estimates for the generalized cross-validation function via an extrapolation and statistical approach
verfasst von
Marilena Mitrouli
Paraskevi Roupa
Publikationsdatum
01.09.2018
Verlag
Springer International Publishing
Erschienen in
Calcolo / Ausgabe 3/2018
Print ISSN: 0008-0624
Elektronische ISSN: 1126-5434
DOI
https://doi.org/10.1007/s10092-018-0266-3

Weitere Artikel der Ausgabe 3/2018

Calcolo 3/2018 Zur Ausgabe

Premium Partner