Skip to main content
Top

2017 | OriginalPaper | Chapter

12. Multivariate Linear Regression

Author : David J. Olive

Published in: Linear Regression

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter will show that multivariate linear regression with m ≥ 2 response variables is nearly as easy to use, at least if m is small, as multiple linear regression which has m = 1 response variable. Plots for checking the model are given, and prediction regions that are robust to nonnormality are developed. For hypothesis testing, it is shown that the Wilks’ lambda statistic, Hotelling Lawley trace statistic, and Pillai’s trace statistic are robust to nonnormality.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Anderson, T. W. (1984). An introduction to multivariate statistical analysis (2nd ed.). New York, NY: Wiley.MATH Anderson, T. W. (1984). An introduction to multivariate statistical analysis (2nd ed.). New York, NY: Wiley.MATH
go back to reference Berndt, E. R., & Savin, N. E. (1977). Conflict among criteria for testing hypotheses in the multivariate linear regression model. Econometrika, 45, 1263–1277.MathSciNetCrossRefMATH Berndt, E. R., & Savin, N. E. (1977). Conflict among criteria for testing hypotheses in the multivariate linear regression model. Econometrika, 45, 1263–1277.MathSciNetCrossRefMATH
go back to reference Cook, R. D. (1977). Deletion of influential observations in linear regression. Technometrics,19, 15–18. Cook, R. D. (1977). Deletion of influential observations in linear regression. Technometrics,19, 15–18.
go back to reference Cook, R. D., Helland, I. S., & Su, Z. (2013). Envelopes and partial least squares regression. Journal of the Royal Statistical Society, B, 75, 851–877.MathSciNetCrossRef Cook, R. D., Helland, I. S., & Su, Z. (2013). Envelopes and partial least squares regression. Journal of the Royal Statistical Society, B, 75, 851–877.MathSciNetCrossRef
go back to reference Cook, R. D., & Setodji, C. M. (2003). A model-free test for reduced rank in multivariate regression. Journal of the American Statistical Association, 98, 340–351.MathSciNetCrossRefMATH Cook, R. D., & Setodji, C. M. (2003). A model-free test for reduced rank in multivariate regression. Journal of the American Statistical Association, 98, 340–351.MathSciNetCrossRefMATH
go back to reference Cook, R. D., & Su, Z. (2013). Scaled envelopes: Scale-invariant and efficient estimation in multivariate linear regression. Biometrika, 100, 929–954.MathSciNetCrossRefMATH Cook, R. D., & Su, Z. (2013). Scaled envelopes: Scale-invariant and efficient estimation in multivariate linear regression. Biometrika, 100, 929–954.MathSciNetCrossRefMATH
go back to reference Cook, R. D., & Weisberg, S. (1999a). Applied regression including computing and graphics. New York, NY: Wiley. Cook, R. D., & Weisberg, S. (1999a). Applied regression including computing and graphics. New York, NY: Wiley.
go back to reference Cook, R. D., & Weisberg, S. (1999b). Graphs in statistical analysis: Is the medium the message? The American Statistician, 53, 29–37. Cook, R. D., & Weisberg, S. (1999b). Graphs in statistical analysis: Is the medium the message? The American Statistician, 53, 29–37.
go back to reference Copas, J. B. (1983). Regression prediction and shrinkage (with discussion). Journal of the Royal Statistical Society, B, 45, 311–354.MathSciNetMATH Copas, J. B. (1983). Regression prediction and shrinkage (with discussion). Journal of the Royal Statistical Society, B, 45, 311–354.MathSciNetMATH
go back to reference Fujikoshi, Y., Sakurai, T., & Yanagihara, H. (2014). Consistency of high-dimensional AIC-type and C p -type criteria in multivariate linear regression. Journal of Multivariate Analysis, 123, 184–200.MathSciNetCrossRefMATH Fujikoshi, Y., Sakurai, T., & Yanagihara, H. (2014). Consistency of high-dimensional AIC-type and C p -type criteria in multivariate linear regression. Journal of Multivariate Analysis, 123, 184–200.MathSciNetCrossRefMATH
go back to reference Hebbler, B. (1847). Statistics of Prussia. Journal of the Royal Statistical Society, A, 10, 154–186. Hebbler, B. (1847). Statistics of Prussia. Journal of the Royal Statistical Society, A, 10, 154–186.
go back to reference Henderson, H. V., & Searle, S. R. (1979). Vec and Vech operators for matrices, with some uses in Jacobians and multivariate statistics. The Canadian Journal of Statistics, 7, 65–81.MathSciNetCrossRefMATH Henderson, H. V., & Searle, S. R. (1979). Vec and Vech operators for matrices, with some uses in Jacobians and multivariate statistics. The Canadian Journal of Statistics, 7, 65–81.MathSciNetCrossRefMATH
go back to reference Hyndman, R. J. (1996). Computing and graphing highest density regions. The American Statistician, 50, 120–126. Hyndman, R. J. (1996). Computing and graphing highest density regions. The American Statistician, 50, 120–126.
go back to reference Johnson, R. A., & Wichern, D. W. (1988). Applied multivariate statistical analysis (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.MATH Johnson, R. A., & Wichern, D. W. (1988). Applied multivariate statistical analysis (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.MATH
go back to reference Kakizawa, Y. (2009). Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions. Journal of Multivariate Analysis, 100, 473–496.MathSciNetCrossRefMATH Kakizawa, Y. (2009). Third-order power comparisons for a class of tests for multivariate linear hypothesis under general distributions. Journal of Multivariate Analysis, 100, 473–496.MathSciNetCrossRefMATH
go back to reference Khattree, R., & Naik, D. N. (1999). Applied multivariate statistics with SAS software (2nd ed.). Cary, NC: SAS Institute. Khattree, R., & Naik, D. N. (1999). Applied multivariate statistics with SAS software (2nd ed.). Cary, NC: SAS Institute.
go back to reference Kshirsagar, A. M. (1972). Multivariate analysis New York, NY: Marcel Dekker.MATH Kshirsagar, A. M. (1972). Multivariate analysis New York, NY: Marcel Dekker.MATH
go back to reference Lei, J., Robins, J., & Wasserman, L. (2013). Distribution free prediction sets. Journal of the American Statistical Association, 108, 278–287.MathSciNetCrossRefMATH Lei, J., Robins, J., & Wasserman, L. (2013). Distribution free prediction sets. Journal of the American Statistical Association, 108, 278–287.MathSciNetCrossRefMATH
go back to reference Lei, J., & Wasserman, L. (2014). Distribution free prediction bands. Journal of the Royal Statistical Society, B, 76, 71–96.CrossRef Lei, J., & Wasserman, L. (2014). Distribution free prediction bands. Journal of the Royal Statistical Society, B, 76, 71–96.CrossRef
go back to reference Maronna, R. A., & Zamar, R. H. (2002). Robust estimates of location and dispersion for high-dimensional datasets. Technometrics, 44, 307–317.MathSciNetCrossRef Maronna, R. A., & Zamar, R. H. (2002). Robust estimates of location and dispersion for high-dimensional datasets. Technometrics, 44, 307–317.MathSciNetCrossRef
go back to reference Miller, D. M. (1984). Reducing transformation bias in curve fitting. The American Statistician, 38, 124–126. Miller, D. M. (1984). Reducing transformation bias in curve fitting. The American Statistician, 38, 124–126.
go back to reference Olive, D. J. (2013a), Asymptotically optimal regression prediction intervals and prediction regions for multivariate data. International Journal of Statistics and Probability, 2, 90–100. Olive, D. J. (2013a), Asymptotically optimal regression prediction intervals and prediction regions for multivariate data. International Journal of Statistics and Probability, 2, 90–100.
go back to reference Olive, D. J. (2016b). Applications of hyperellipsoidal prediction regions. Statistical Papers, to appear. Olive, D. J. (2016b). Applications of hyperellipsoidal prediction regions. Statistical Papers, to appear.
go back to reference Olive, D. J. (2016c). Robust multivariate analysis. New York, NY: Springer, to appear. Olive, D. J. (2016c). Robust multivariate analysis. New York, NY: Springer, to appear.
go back to reference R Core Team (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, www.R-project.org R Core Team (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, www.​R-project.​org
go back to reference Rencher, A., & Pun, F. (1980). Inflation of R 2 in best subset regression. Technometrics, 22, 49–53.CrossRefMATH Rencher, A., & Pun, F. (1980). Inflation of R 2 in best subset regression. Technometrics, 22, 49–53.CrossRefMATH
go back to reference SAS Institute (1985). SAS user’s guide: Statistics. Version 5. Cary, NC: SAS Institute. SAS Institute (1985). SAS user’s guide: Statistics. Version 5. Cary, NC: SAS Institute.
go back to reference Searle, S. R. (1982). Matrix algebra useful for statistics. New York, NY: Wiley.MATH Searle, S. R. (1982). Matrix algebra useful for statistics. New York, NY: Wiley.MATH
go back to reference Seber, G. A. F., & Lee, A. J. (2003). Linear regression analysis (2nd ed.). New York, NY: Wiley.CrossRefMATH Seber, G. A. F., & Lee, A. J. (2003). Linear regression analysis (2nd ed.). New York, NY: Wiley.CrossRefMATH
Metadata
Title
Multivariate Linear Regression
Author
David J. Olive
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-55252-1_12

Premium Partner