Skip to main content
Top

2018 | OriginalPaper | Chapter

8. Principal Component and Factor Analysis

Authors : Erik Mooi, Marko Sarstedt, Irma Mooi-Reci

Published in: Market Research

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We first provide comprehensive and advanced access to principal component analysis, factor analysis, and reliability analysis. Based on a discussion of the different types of factor analytic procedures (exploratory factor analysis, confirmatory factor analysis, and structural equation modeling), we introduce the steps involved in a principal component analysis and a reliability analysis, offering guidelines for executing them in Stata. Specifically, we cover the requirements for running an analysis, modern options for extracting the factors and deciding on their number, as well as for interpreting and judging the quality of the results. Based on a step-by-step description of Stata’s menu options and code, we present an in-depth discussion of each element of the Stata output. Interpretation of output can be difficult, which we make much easier by means of various illustrations and applications, using a detailed case study to quickly make sense of the results. We conclude with suggestions for further readings on the use, application, and interpretation of factor analytic procedures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Other methods for carrying out factor analyses include, for example, unweighted least squares, generalized least squares, or maximum likelihood. However, these are statistically complex and inexperienced users should not consider them.
 
2
Related discussions have been raised in structural equation modeling, where researchers have heatedly discussed the strengths and limitations of factor-based and component-based approaches (e.g., Sarstedt et al. 2016, Hair et al. 2017a, b).
 
3
Note that this changes when oblique rotation is used. We will discuss factor rotation later in this chapter.
 
4
Note that factor rotation primarily applies to factor analysis rather than PCA—see Preacher and MacCallum (2003) for details. However, our illustration draws on the factor, pcf command, which uses the factor analysis algorithm to compute PCA results for which rotation applies.
 
5
When the gamma is set to 1, this is a special case, because the value of 1 represents orthogonality. The result of setting gamma to 1 is effectively a varimax rotation.
 
6
Note that this is not the case when using factor analysis if the standard deviations are different from one (DiStefano et al. 2009).
 
7
Note that we omitted the error terms for clarity’s sake.
 
Literature
go back to reference Acock, A. C. (2013). Discovering structural equation modeling using Stata (Revised ed.). College Station: Stata Press. Acock, A. C. (2013). Discovering structural equation modeling using Stata (Revised ed.). College Station: Stata Press.
go back to reference Brown, J. D. (2009). Choosing the right type of rotation in PCA and EFA. JALT Testing & Evaluation SIG Newsletter, 13(3), 20–25. Brown, J. D. (2009). Choosing the right type of rotation in PCA and EFA. JALT Testing & Evaluation SIG Newsletter, 13(3), 20–25.
go back to reference Carbonell, L., Izquierdo, L., Carbonell, I., & Costell, E. (2008). Segmentation of food consumers according to their correlations with sensory attributes projected on preference spaces. Food Quality and Preference, 19(1), 71–78.CrossRef Carbonell, L., Izquierdo, L., Carbonell, I., & Costell, E. (2008). Segmentation of food consumers according to their correlations with sensory attributes projected on preference spaces. Food Quality and Preference, 19(1), 71–78.CrossRef
go back to reference Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.CrossRef Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.CrossRef
go back to reference Cliff, N. (1987). Analyzing multivariate data. New York: Harcourt Brace Jovanovich. Cliff, N. (1987). Analyzing multivariate data. New York: Harcourt Brace Jovanovich.
go back to reference Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.CrossRef Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.CrossRef
go back to reference Diamantopoulos, A., & Siguaw, J. A. (2000). Introducing LISREL: A guide for the uninitiated. London: Sage.CrossRef Diamantopoulos, A., & Siguaw, J. A. (2000). Introducing LISREL: A guide for the uninitiated. London: Sage.CrossRef
go back to reference Dinno, A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44(3), 362–388.CrossRef Dinno, A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44(3), 362–388.CrossRef
go back to reference DiStefano, C., Zhu, M., & Mîndriă, D. (2009). Understanding and using factor scores: Considerations fort he applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11. DiStefano, C., Zhu, M., & Mîndriă, D. (2009). Understanding and using factor scores: Considerations fort he applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11.
go back to reference Festge, F., & Schwaiger, M. (2007). The drivers of customer satisfaction with industrial goods: An international study. Advances in International Marketing, 18, 179–207.CrossRef Festge, F., & Schwaiger, M. (2007). The drivers of customer satisfaction with industrial goods: An international study. Advances in International Marketing, 18, 179–207.CrossRef
go back to reference Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale: Lawrence Erlbaum Associates. Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale: Lawrence Erlbaum Associates.
go back to reference Graffelman, J. (2013). Linear-angle correlation plots: New graphs for revealing correlation structure. Journal of Computational and Graphical Statistics, 22(1), 92–106.CrossRef Graffelman, J. (2013). Linear-angle correlation plots: New graphs for revealing correlation structure. Journal of Computational and Graphical Statistics, 22(1), 92–106.CrossRef
go back to reference Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.CrossRef Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.CrossRef
go back to reference Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2013). Multivariate data analysis. A global perspective (7th ed.). Upper Saddle River: Pearson Prentice Hall. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2013). Multivariate data analysis. A global perspective (7th ed.). Upper Saddle River: Pearson Prentice Hall.
go back to reference Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–151.CrossRef Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–151.CrossRef
go back to reference Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017a). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousand Oaks: Sage. Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017a). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousand Oaks: Sage.
go back to reference Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., & Thiele, K. O. (2017b). Mirror, mirror on the wall. A comparative evaluation of composite-based structural equation modeling methods. Journal of the Academy of Marketing Science, 45(5), 616–632. Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., & Thiele, K. O. (2017b). Mirror, mirror on the wall. A comparative evaluation of composite-based structural equation modeling methods. Journal of the Academy of Marketing Science, 45(5), 616–632.
go back to reference Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks: Sage. Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks: Sage.
go back to reference Hamilton, L. C. (2013), Statistics with Stata: Version 12: Cengage Learning. Hamilton, L. C. (2013), Statistics with Stata: Version 12: Cengage Learning.
go back to reference Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205.CrossRef Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205.CrossRef
go back to reference Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416.CrossRef Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416.CrossRef
go back to reference Hershberger, S. L. (2005). Factor scores. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 636–644). New York: John Wiley. Hershberger, S. L. (2005). Factor scores. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 636–644). New York: John Wiley.
go back to reference Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.CrossRef Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.CrossRef
go back to reference Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36(4), 409–426.CrossRef Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36(4), 409–426.CrossRef
go back to reference Kaiser, H. F. (1958). The varimax criterion for factor analytic rotation in factor analysis. Educational and Psychological Measurement, 23(3), 770–773. Kaiser, H. F. (1958). The varimax criterion for factor analytic rotation in factor analysis. Educational and Psychological Measurement, 23(3), 770–773.
go back to reference Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36.CrossRef Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36.CrossRef
go back to reference Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Thousand Oaks: Sage.CrossRef Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Thousand Oaks: Sage.CrossRef
go back to reference Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989). A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile eigenvalues. Multivariate Behavioral Research, 24(1), 59–69. Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989). A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile eigenvalues. Multivariate Behavioral Research, 24(1), 59–69.
go back to reference MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99.CrossRef MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99.CrossRef
go back to reference Matsunga, M. (2010). How to factor-analyze your data right: Do’s and don’ts and how to’s. International Journal of Psychological Research, 3(1), 97–110.CrossRef Matsunga, M. (2010). How to factor-analyze your data right: Do’s and don’ts and how to’s. International Journal of Psychological Research, 3(1), 97–110.CrossRef
go back to reference Mulaik, S. A. (2009). Foundations of factor analysis (2nd ed.). London: Chapman & Hall. Mulaik, S. A. (2009). Foundations of factor analysis (2nd ed.). London: Chapman & Hall.
go back to reference Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13–43.CrossRef Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13–43.CrossRef
go back to reference Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646. Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646.
go back to reference Sarstedt, M., Schwaiger, M., & Ringle, C. M. (2009). Do we fully understand the critical success factors of customer satisfaction with industrial goods? Extending Festge and Schwaiger’s model to account for unobserved heterogeneity. Journal of Business Market Management, 3(3), 185–206.CrossRef Sarstedt, M., Schwaiger, M., & Ringle, C. M. (2009). Do we fully understand the critical success factors of customer satisfaction with industrial goods? Extending Festge and Schwaiger’s model to account for unobserved heterogeneity. Journal of Business Market Management, 3(3), 185–206.CrossRef
go back to reference Sarstedt, M., Ringle, C. M., Raithel, S., & Gudergan, S. (2014). In pursuit of understanding what drives fan satisfaction. Journal of Leisure Research, 46(4), 419–447. Sarstedt, M., Ringle, C. M., Raithel, S., & Gudergan, S. (2014). In pursuit of understanding what drives fan satisfaction. Journal of Leisure Research, 46(4), 419–447.
go back to reference Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with PLS and CBSEM: Where the bias lies! Journal of Business Research, 69(10), 3998–4010.CrossRef Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with PLS and CBSEM: Where the bias lies! Journal of Business Research, 69(10), 3998–4010.CrossRef
go back to reference Steiger, J. H. (1979). Factor indeterminacy in the 1930’s and the 1970’s some interesting parallels. Psychometrika, 44(2), 157–167.CrossRef Steiger, J. H. (1979). Factor indeterminacy in the 1930’s and the 1970’s some interesting parallels. Psychometrika, 44(2), 157–167.CrossRef
go back to reference Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). Hillsdale: Erlbaum. Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). Hillsdale: Erlbaum.
go back to reference Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25(1), 1–28.CrossRef Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25(1), 1–28.CrossRef
go back to reference Vigneau, E., & Qannari, E. M. (2002). Segmentation of consumers taking account of external data. A clustering of variables approach. Food Quality and Preference, 13(7–8), 515–521.CrossRef Vigneau, E., & Qannari, E. M. (2002). Segmentation of consumers taking account of external data. A clustering of variables approach. Food Quality and Preference, 13(7–8), 515–521.CrossRef
go back to reference Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters? Multivariate Behavioral Research, 28(3), 263–311.CrossRef Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters? Multivariate Behavioral Research, 28(3), 263–311.CrossRef
go back to reference Wold, H. O. A. (1982). Soft modeling: The basic design and some extensions. In K. G. Jöreskog & H. O. A. Wold (Eds.), Systems under indirect observations: Part II (pp. 1–54). Amsterdam: North-Holland. Wold, H. O. A. (1982). Soft modeling: The basic design and some extensions. In K. G. Jöreskog & H. O. A. Wold (Eds.), Systems under indirect observations: Part II (pp. 1–54). Amsterdam: North-Holland.
go back to reference Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442.CrossRef Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442.CrossRef
Metadata
Title
Principal Component and Factor Analysis
Authors
Erik Mooi
Marko Sarstedt
Irma Mooi-Reci
Copyright Year
2018
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-5218-7_8