Skip to main content
Top

2011 | OriginalPaper | Chapter

Ridge and Surrogate Ridge Regressions

Author : Ali S. Hadi

Published in: International Encyclopedia of Statistical Science

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Excerpt

Ridge regression is a method for the estimation of the parameters of a linear regression model (see Linear Regression Models) which is useful when the predictor variables are highly collinear, that is, when there is a strong linear relationship among the predictor variables. Hoerl (1959) named the method ridge regression because of its similarity to ridge analysis used in his earlier work to study second-order response surfaces in many variables. Some standard references for ridge regression are Hoerl and Kennard (1970, 1976), Belsley et al. (1980), and Chatterjee and Hadi (2006). …

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Belsley DA, Kuh E, Welsch RE (1980) Regression diagnostics: identifying influential data and sources of collinearity. Wiley, New YorkMATH Belsley DA, Kuh E, Welsch RE (1980) Regression diagnostics: identifying influential data and sources of collinearity. Wiley, New YorkMATH
go back to reference Chatterjee S, Hadi AS (2006) Regression analysis by example, 4th edn. Wiley, New YorkMATH Chatterjee S, Hadi AS (2006) Regression analysis by example, 4th edn. Wiley, New YorkMATH
go back to reference Dorugade AV, Kashid DN (2010) Alternative method for choosing ridge parameter for regression. Appl Math Sci 4:447–456MATHMathSciNet Dorugade AV, Kashid DN (2010) Alternative method for choosing ridge parameter for regression. Appl Math Sci 4:447–456MATHMathSciNet
go back to reference Golub GH, van Loan C (1989) Matrix computations. John Hopkins, BaltimoreMATH Golub GH, van Loan C (1989) Matrix computations. John Hopkins, BaltimoreMATH
go back to reference Hoerl AE (1959) Optimum solution of many variables. Chem Eng Prog 55:69–78 Hoerl AE (1959) Optimum solution of many variables. Chem Eng Prog 55:69–78
go back to reference Hoerl AE (1962) Application of ridge analysis to regression problems. Chem Eng Prog 58:54–59 Hoerl AE (1962) Application of ridge analysis to regression problems. Chem Eng Prog 58:54–59
go back to reference Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–68MATH Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–68MATH
go back to reference Hoerl AE, Kennard RW (1976) Ridge regression: iterative estimation of the biasing parameter. Commun Stat, Theory Methods A5:77–88 Hoerl AE, Kennard RW (1976) Ridge regression: iterative estimation of the biasing parameter. Commun Stat, Theory Methods A5:77–88
go back to reference Hoerl AE, Kennard RW (1981) Ridge regression – 1980: advances, algorithms, and applications. Am J Math Manag Sci 1:5–83MathSciNet Hoerl AE, Kennard RW (1981) Ridge regression – 1980: advances, algorithms, and applications. Am J Math Manag Sci 1:5–83MathSciNet
go back to reference Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulations. Commun Stat, Theory Methods 4:105–123MATH Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulations. Commun Stat, Theory Methods 4:105–123MATH
go back to reference Jensen DR, Ramirez DE (2008) Anomalies in the foundations of ridge regression. Int Stat Rev 76:89–105MATH Jensen DR, Ramirez DE (2008) Anomalies in the foundations of ridge regression. Int Stat Rev 76:89–105MATH
go back to reference Khalaf G, Shukur G (2005) Choosing ridge parameter for regression problem. Commun Stat, Theory Methods 34:1177–1182MATHMathSciNet Khalaf G, Shukur G (2005) Choosing ridge parameter for regression problem. Commun Stat, Theory Methods 34:1177–1182MATHMathSciNet
go back to reference Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat, Theory Methods 14:1589–1604 Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat, Theory Methods 14:1589–1604
go back to reference Masuo N (1988) On the almost unbiased ridge regression estimation. Commun Stat, Simul 17:729–743MATH Masuo N (1988) On the almost unbiased ridge regression estimation. Commun Stat, Simul 17:729–743MATH
go back to reference Wahba G, Golub GH, Health CG (1979) Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21:215–223MATHMathSciNet Wahba G, Golub GH, Health CG (1979) Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21:215–223MATHMathSciNet
Metadata
Title
Ridge and Surrogate Ridge Regressions
Author
Ali S. Hadi
Copyright Year
2011
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-04898-2_493