Skip to main content

2018 | OriginalPaper | Buchkapitel

Elemental Estimates, Influence, and Algorithmic Leveraging

verfasst von : K. Knight

Erschienen in: Nonparametric Statistics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

It is well-known (Subrahmanyam, Sankhya Ser B 34:355–356, 1972; Mayo and Gray, Am Stat 51:122–129, 1997) that the ordinary least squares estimate can be expressed as a weighted sum of so-called elemental estimates based on subsets of p observations where p is the dimension of parameter vector. The weights can be viewed as a probability distribution on subsets of size p of the predictors {x i : i = 1, ⋯ , n}. In this contribution, we derive the lower dimensional distributions of this p dimensional distribution and define a measure of potential influence for subsets of observations analogous to the diagonal elements of the “hat” matrix for single observations. This theory is then applied to algorithmic leveraging, which is a method for approximating the ordinary least squares estimates using a particular form of biased subsampling.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Andrews, D. F., & Pregibon, D. (1978). Finding the outliers that matter. Journal of the Royal Statistical Society. Series B, 40, 85–93.MATH Andrews, D. F., & Pregibon, D. (1978). Finding the outliers that matter. Journal of the Royal Statistical Society. Series B, 40, 85–93.MATH
2.
Zurück zum Zitat Chatterjee, S., & Hadi, A. S. (1986). Influential observations, high leverage points, and outliers in linear regression. Statistical Science, 1, 379–393.MathSciNetCrossRef Chatterjee, S., & Hadi, A. S. (1986). Influential observations, high leverage points, and outliers in linear regression. Statistical Science, 1, 379–393.MathSciNetCrossRef
3.
Zurück zum Zitat Cook, R. D. (1977). Detection of influential observations in linear regression. Technometrics, 19, 15–18.MathSciNetMATH Cook, R. D. (1977). Detection of influential observations in linear regression. Technometrics, 19, 15–18.MathSciNetMATH
4.
Zurück zum Zitat Draper, N. R., & John, J. A. (1981). Influential observations and outliers in regression. Technometrics, 23, 21–26.MathSciNetCrossRef Draper, N. R., & John, J. A. (1981). Influential observations and outliers in regression. Technometrics, 23, 21–26.MathSciNetCrossRef
5.
Zurück zum Zitat Drineas, P., Magdon-Ismail, M., Mahoney, M. W., & Woodruff, D. P. (2012). Fast approximation of matrix coherence and statistical leverage. Journal of Machine Learning Research, 13, 3475–3506.MathSciNetMATH Drineas, P., Magdon-Ismail, M., Mahoney, M. W., & Woodruff, D. P. (2012). Fast approximation of matrix coherence and statistical leverage. Journal of Machine Learning Research, 13, 3475–3506.MathSciNetMATH
6.
Zurück zum Zitat Drineas, P., Mahoney, M. W., Muthukrishnan, S., & Sarlós, T. (2011). Faster least squares approximation. Numerische Mathematik, 117, 219–249.MathSciNetCrossRef Drineas, P., Mahoney, M. W., Muthukrishnan, S., & Sarlós, T. (2011). Faster least squares approximation. Numerische Mathematik, 117, 219–249.MathSciNetCrossRef
7.
Zurück zum Zitat Gao, K. (2016). Statistical inference for algorithmic leveraging. Preprint, arXiv:1606.01473. Gao, K. (2016). Statistical inference for algorithmic leveraging. Preprint, arXiv:1606.01473.
8.
9.
Zurück zum Zitat Hoaglin, D. C., & Welsch, R. E. (1978). The hat matrix in regression and ANOVA. The American Statistician, 32, 17–22.MATH Hoaglin, D. C., & Welsch, R. E. (1978). The hat matrix in regression and ANOVA. The American Statistician, 32, 17–22.MATH
10.
Zurück zum Zitat Hoerl, A. E., & Kennard, R. W. (1980). M30. A note on least squares estimates. Communications in Statistics–Simulation and Computation, 9, 315–317.CrossRef Hoerl, A. E., & Kennard, R. W. (1980). M30. A note on least squares estimates. Communications in Statistics–Simulation and Computation, 9, 315–317.CrossRef
11.
Zurück zum Zitat Little, J. K. (1985). Influence and a quadratic form in the Andrews-Pregibon statistic. Technometrics, 27, 13–15.MathSciNet Little, J. K. (1985). Influence and a quadratic form in the Andrews-Pregibon statistic. Technometrics, 27, 13–15.MathSciNet
12.
Zurück zum Zitat Ma, P., Mahoney, M. W., & Yu, B. (2015). A statistical perspective on algorithmic leveraging. Journal of Machine Learning Research, 16, 861–911.MathSciNetMATH Ma, P., Mahoney, M. W., & Yu, B. (2015). A statistical perspective on algorithmic leveraging. Journal of Machine Learning Research, 16, 861–911.MathSciNetMATH
13.
Zurück zum Zitat Ma, P., & Sun, X. (2015). Leveraging for big data regression. Wiley Interdisciplinary Reviews: Computational Statistics, 7, 70–76.MathSciNetCrossRef Ma, P., & Sun, X. (2015). Leveraging for big data regression. Wiley Interdisciplinary Reviews: Computational Statistics, 7, 70–76.MathSciNetCrossRef
14.
Zurück zum Zitat Mayo, M. S., & Gray, J. B. (1997). Elemental subsets: The building blocks of regression. The American Statistician, 51, 122–129. Mayo, M. S., & Gray, J. B. (1997). Elemental subsets: The building blocks of regression. The American Statistician, 51, 122–129.
15.
Zurück zum Zitat Nurunnabi, A. A. M., Hadi, A. S., & Imon, A. H. M. R. (2014). Procedures for the identification of multiple influential observations in linear regression. Journal of Applied Statistics, 41, 1315–1331.MathSciNetCrossRef Nurunnabi, A. A. M., Hadi, A. S., & Imon, A. H. M. R. (2014). Procedures for the identification of multiple influential observations in linear regression. Journal of Applied Statistics, 41, 1315–1331.MathSciNetCrossRef
16.
Zurück zum Zitat Subrahmanyam, M. (1972). A property of simple least squares estimates. Sankhya Series B, 34, 355–356.MathSciNet Subrahmanyam, M. (1972). A property of simple least squares estimates. Sankhya Series B, 34, 355–356.MathSciNet
Metadaten
Titel
Elemental Estimates, Influence, and Algorithmic Leveraging
verfasst von
K. Knight
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-96941-1_15

Premium Partner