Skip to main content
Top

2024 | OriginalPaper | Chapter

3. The Multiple Regression Model

Author : Valérie Mignon

Published in: Principles of Econometrics

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Regression analysis consists in studying the dependence of a variable (the explained variable) on one or more other variables (the explanatory variables). This chapter presents the multiple regression model, which is a linear model comprising a single equation linking an explained variable to several explanatory variables. Since the parameters of this model are unknown, they must be estimated to quantify the relationship between the dependent and the explanatory variables. The chapter presents the most frequently used estimation method, i.e., the ordinary least squares (OLS) method. It also establishes the properties of the OLS estimators, describes the various tests on the regression coefficients, and presents key indicators such as the (adjusted) coefficient of determination. All the concepts are illustrated thanks to several empirical applications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
This chapter calls upon various notions of matrix algebra. In Appendix 3.1, readers will find the elements of matrix algebra necessary to understand the various developments here.
 
2
Matrices and vectors are written in bold characters. This notation convention will be used throughout the book.
 
3
In the sense that the matrix of explanatory variables is assumed to be unchanged whatever the sample of observations.
 
4
We will see later that such an assumption implies that there is no collinearity between the explanatory variables.
 
5
We consider the \(\left ( i+1\right )\)th element and not the ith since the first element of the matrix \(\left ( \boldsymbol {X}^{\prime }\boldsymbol {X}\right )^{-1}\) relates to the constant term. Obviously, if the variables are centered, it is appropriate to choose the ith element.
 
6
Recall that the first element of the matrix corresponds to the constant term, which explains why we consider the \(\left ( i+1\right )\)th element and not the ith.
 
7
The first element of the matrix corresponding to the constant \(\alpha .\)
 
8
Strictly speaking, this is known as Kullback-Leibler information (see Kullback and Leibler, 1951).
 
9
See also Akaike (1969, 1974).
 
10
In this case, the OLS and maximum likelihood estimators are equivalent.
 
Literature
go back to reference Akaike, H. (1969), “Fitting Autoregressive Models for Prediction”, Annals of the Institute of Statistical Mathematics, 21, pp. 243–247.CrossRef Akaike, H. (1969), “Fitting Autoregressive Models for Prediction”, Annals of the Institute of Statistical Mathematics, 21, pp. 243–247.CrossRef
go back to reference Akaike, H. (1973), “Information theory and an extension of maximum likelihood principle”, Second International Symposium on Information Theory, pp. 261–281. Akaike, H. (1973), “Information theory and an extension of maximum likelihood principle”, Second International Symposium on Information Theory, pp. 261–281.
go back to reference Akaike, H. (1974), “A new look at the statistical model identification”, IEEE Transactions on Automatic Control, 19(6), pp. 716–723.CrossRef Akaike, H. (1974), “A new look at the statistical model identification”, IEEE Transactions on Automatic Control, 19(6), pp. 716–723.CrossRef
go back to reference Bénassy-Quéré, A. and V. Salins (2005), “Impact de l’ouverture financière sur les inégalités internes dans les pays émergents”, Working Paper CEPII, 2005–11. Bénassy-Quéré, A. and V. Salins (2005), “Impact de l’ouverture financière sur les inégalités internes dans les pays émergents”, Working Paper CEPII, 2005–11.
go back to reference Davidson, R. and J.G. MacKinnon (1993), Estimation and Inference in Econometrics, Oxford University Press. Davidson, R. and J.G. MacKinnon (1993), Estimation and Inference in Econometrics, Oxford University Press.
go back to reference Farvaque, E., Jean , N. and B. Zuindeau (2007), “Inégalités écologiques et comportement électoral : le cas des élections municipales françaises de 2001”, Développement Durable et Territoires, Dossier 9. Farvaque, E., Jean , N. and B. Zuindeau (2007), “Inégalités écologiques et comportement électoral : le cas des élections municipales françaises de 2001”, Développement Durable et Territoires, Dossier 9.
go back to reference Greene, W. (2020), Econometric Analysis, 8th edition, Pearson. Greene, W. (2020), Econometric Analysis, 8th edition, Pearson.
go back to reference Hannan, E.J. and B.G. Quinn (1979), “The Determination of the Order of an Autoregression”, Journal of the Royal Statistical Society, Series B, 41, pp. 190–195. Hannan, E.J. and B.G. Quinn (1979), “The Determination of the Order of an Autoregression”, Journal of the Royal Statistical Society, Series B, 41, pp. 190–195.
go back to reference Hurvich, C.M. and C.-L. Tsai (1989), “Regression and time series model selection in small samples”, Biometrika, 76, pp. 297–307.CrossRef Hurvich, C.M. and C.-L. Tsai (1989), “Regression and time series model selection in small samples”, Biometrika, 76, pp. 297–307.CrossRef
go back to reference Johnston, J. and J. Dinardo (1996), Econometric Methods, 4th edition, McGraw Hill. Johnston, J. and J. Dinardo (1996), Econometric Methods, 4th edition, McGraw Hill.
go back to reference Judge, G.G., Griffiths, W.E., Hill, R.C., Lutkepohl, H. and T.C. Lee (1985), The Theory and Practice of Econometrics, 2nd edition, John Wiley & Sons. Judge, G.G., Griffiths, W.E., Hill, R.C., Lutkepohl, H. and T.C. Lee (1985), The Theory and Practice of Econometrics, 2nd edition, John Wiley & Sons.
go back to reference Judge, G.G., Griffiths, W.E., Hill, R.C., Lutkepohl, H. and T.C. Lee (1988), Introduction to the Theory and Practice of Econometrics, John Wiley & Sons. Judge, G.G., Griffiths, W.E., Hill, R.C., Lutkepohl, H. and T.C. Lee (1988), Introduction to the Theory and Practice of Econometrics, John Wiley & Sons.
go back to reference Kullback, S. and A. Leibler (1951), “On information and sufficiency”, Annals of Mathematical Statistics 22, pp. 79–86.CrossRef Kullback, S. and A. Leibler (1951), “On information and sufficiency”, Annals of Mathematical Statistics 22, pp. 79–86.CrossRef
go back to reference Puech, F. (2005), Analyse des déterminants de la criminalité dans les pays en développement, Thèse pour le doctorat de Sciences Économiques, Université d’Auvergne-Clermont I. Puech, F. (2005), Analyse des déterminants de la criminalité dans les pays en développement, Thèse pour le doctorat de Sciences Économiques, Université d’Auvergne-Clermont I.
go back to reference Schwarz, G. (1978), “Estimating the Dimension of a Model”, The Annals of Statistics, 6, pp. 461–464.CrossRef Schwarz, G. (1978), “Estimating the Dimension of a Model”, The Annals of Statistics, 6, pp. 461–464.CrossRef
go back to reference Thuilliez, J. (2007), “Malaria and Primary Education: A Cross-Country Analysis on Primary Repetition and Completion Rates”, Working Paper Centre d’Économie de la Sorbonne, 2007–13. Thuilliez, J. (2007), “Malaria and Primary Education: A Cross-Country Analysis on Primary Repetition and Completion Rates”, Working Paper Centre d’Économie de la Sorbonne, 2007–13.
Metadata
Title
The Multiple Regression Model
Author
Valérie Mignon
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-52535-3_3

Premium Partner