Skip to main content
Top

2019 | OriginalPaper | Chapter

8. Principal Component and Factor Analysis

Authors : Marko Sarstedt, Erik Mooi

Published in: A Concise Guide to Market Research

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We first provide comprehensive and advanced access to principal component analysis, factor analysis, and reliability analysis. Based on a discussion of the different types of factor analytic procedures (exploratory factor analysis, confirmatory factor analysis, and structural equation modeling), we introduce the steps involved in a principal component analysis and a reliability analysis, offering guidelines for executing them in SPSS. Specifically, we cover the requirements for running an analysis, modern options for extracting the factors and deciding on their number, as well as for interpreting and judging the quality of the results. Based on a step-by-step description of SPSS’s menu options, we present an in-depth discussion of each element of the SPSS output. Interpretation of output can be difficult, which we make much easier by means of various illustrations and applications, using a detailed case study to quickly make sense of the results. We conclude with suggestions for further readings on the use, application, and interpretation of factor analytic procedures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Other methods for carrying out factor analyses include, for example, unweighted least squares, generalized least squares, or maximum likelihood but these are statistically complex.
 
2
Related discussions have been raised in structural equation modeling, where researchers have heatedly discussed the strengths and limitations of factor-based and component-based approaches (e.g. Sarstedt et al. 2016a; Hair et al. 2017b).
 
3
Note that Fig. 8.3 describes a special case, as the five variables are scaled down into a two-dimensional space. In this set-up, it would be possible for the two factors to explain all five items. However, in real-life, the five items span a five-dimensional vector space.
 
4
Note that this changes when oblique rotation is used. We will discuss factor rotation later in this chapter.
 
5
Note that this is only the case in PCA. When using factor analysis, the standard deviations are different from one (DiStefano et al. 2009).
 
6
Note that we omitted the error terms for clarity.
 
Literature
go back to reference Brown, J. D. (2009). Choosing the right type of rotation in PCA and EFA. JALT Testing & Evaluation SIG Newsletter, 13(3), 20–25. Brown, J. D. (2009). Choosing the right type of rotation in PCA and EFA. JALT Testing & Evaluation SIG Newsletter, 13(3), 20–25.
go back to reference Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.CrossRef Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.CrossRef
go back to reference Cliff, N. (1987). Analyzing multivariate data. New York, NJ: Harcourt Brace Jovanovich. Cliff, N. (1987). Analyzing multivariate data. New York, NJ: Harcourt Brace Jovanovich.
go back to reference Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.CrossRef Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.CrossRef
go back to reference Diamantopoulos, A., & Siguaw, J. A. (2000). Introducing LISREL: A guide for the uninitiated. London: Sage.CrossRef Diamantopoulos, A., & Siguaw, J. A. (2000). Introducing LISREL: A guide for the uninitiated. London: Sage.CrossRef
go back to reference Dinno, A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44(3), 362–388.CrossRef Dinno, A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of random data. Multivariate Behavioral Research, 44(3), 362–388.CrossRef
go back to reference DiStefano, C., Zhu, M., & Mîndriă, D. (2009). Understanding and using factor scores: Considerations fort he applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11. DiStefano, C., Zhu, M., & Mîndriă, D. (2009). Understanding and using factor scores: Considerations fort he applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11.
go back to reference Festge, F., & Schwaiger, M. (2007). The drivers of customer satisfaction with industrial goods: An international study. Advances in International Marketing, 18, 179–207. Festge, F., & Schwaiger, M. (2007). The drivers of customer satisfaction with industrial goods: An international study. Advances in International Marketing, 18, 179–207.
go back to reference Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
go back to reference Graffelman, J. (2013). Linear-angle correlation plots: New graphs for revealing correlation structure. Journal of Computational and Graphical Statistics, 22(1), 92–106.CrossRef Graffelman, J. (2013). Linear-angle correlation plots: New graphs for revealing correlation structure. Journal of Computational and Graphical Statistics, 22(1), 92–106.CrossRef
go back to reference Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.CrossRef Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450.CrossRef
go back to reference Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis. A global perspective (8th ed.). Boston. MA: Cengage. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis. A global perspective (8th ed.). Boston. MA: Cengage.
go back to reference Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–151.CrossRef Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–151.CrossRef
go back to reference Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017a). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousand Oaks, CA: Sage. Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017a). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Thousand Oaks, CA: Sage.
go back to reference Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., & Thiele, K. O. (2017b). Mirror, mirror on the wall. A comparative evaluation of composite-based structural equation modeling methods. Journal of the Academy of Marketing Science, 45(5), 616–632.CrossRef Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., & Thiele, K. O. (2017b). Mirror, mirror on the wall. A comparative evaluation of composite-based structural equation modeling methods. Journal of the Academy of Marketing Science, 45(5), 616–632.CrossRef
go back to reference Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, CA: Sage. Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks, CA: Sage.
go back to reference Hamilton, L. C. (2013), Statistics with Stata: Version 12: Cengage Learning. Hamilton, L. C. (2013), Statistics with Stata: Version 12: Cengage Learning.
go back to reference Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205.CrossRef Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205.CrossRef
go back to reference Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416.CrossRef Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66(3), 393–416.CrossRef
go back to reference Hershberger, S. L. (2005). Factor scores. In: B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 636–644). New York, NJ: John Wiley. Hershberger, S. L. (2005). Factor scores. In: B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 636–644). New York, NJ: John Wiley.
go back to reference Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.CrossRef Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.CrossRef
go back to reference Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36(4), 409–426.CrossRef Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36(4), 409–426.CrossRef
go back to reference Kaiser, H. F. (1958). The varimax criterion for factor analytic rotation in factor analysis. Educational and Psychological Measurement, 23(3), 770–773. Kaiser, H. F. (1958). The varimax criterion for factor analytic rotation in factor analysis. Educational and Psychological Measurement, 23(3), 770–773.
go back to reference Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36.CrossRef Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36.CrossRef
go back to reference Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Thousand Oaks, CA: Sage.CrossRef Kim, J. O., & Mueller, C. W. (1978). Introduction to factor analysis: What it is and how to do it. Thousand Oaks, CA: Sage.CrossRef
go back to reference Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989). A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile Eigenvalues. Multivariate Behavioral Research, 24(1), 59–69.CrossRef Longman, R. S., Cota, A. A., Holden, R. R., & Fekken, G. C. (1989). A regression equation for the parallel analysis criterion in principal components analysis: Mean and 95th percentile Eigenvalues. Multivariate Behavioral Research, 24(1), 59–69.CrossRef
go back to reference MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99.CrossRef MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99.CrossRef
go back to reference Matsunga, M. (2010). How to factor-analyze your data right: Do’s and don’ts and how to’s. International Journal of Psychological Research, 3(1), 97–110.CrossRef Matsunga, M. (2010). How to factor-analyze your data right: Do’s and don’ts and how to’s. International Journal of Psychological Research, 3(1), 97–110.CrossRef
go back to reference Mulaik, S. A. (2009). Foundations of factor analysis (2nd ed.). London: Chapman & Hall. Mulaik, S. A. (2009). Foundations of factor analysis (2nd ed.). London: Chapman & Hall.
go back to reference O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402.CrossRef O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402.CrossRef
go back to reference Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13–43.CrossRef Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2(1), 13–43.CrossRef
go back to reference Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646.CrossRef Russell, D. W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646.CrossRef
go back to reference Sarstedt, M., Schwaiger, M., & Ringle, C. M. (2009). Do we fully understand the critical success factors of customer satisfaction with industrial goods? Extending Festge and Schwaiger’s model to account for unobserved heterogeneity. Journal of Business Market Management, 3(3), 185–206.CrossRef Sarstedt, M., Schwaiger, M., & Ringle, C. M. (2009). Do we fully understand the critical success factors of customer satisfaction with industrial goods? Extending Festge and Schwaiger’s model to account for unobserved heterogeneity. Journal of Business Market Management, 3(3), 185–206.CrossRef
go back to reference Sarstedt, M., Ringle, C. M., Raithel, S., & Gudergan, S. (2014). In pursuit of understanding what drives fan satisfaction. Journal of Leisure Research, 46(4), 419–447.CrossRef Sarstedt, M., Ringle, C. M., Raithel, S., & Gudergan, S. (2014). In pursuit of understanding what drives fan satisfaction. Journal of Leisure Research, 46(4), 419–447.CrossRef
go back to reference Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with PLS and CBSEM: Where the bias lies!. Journal of Business Research, 69(10), 3998–4010.CrossRef Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with PLS and CBSEM: Where the bias lies!. Journal of Business Research, 69(10), 3998–4010.CrossRef
go back to reference Steiger, J. H. (1979). Factor indeterminacy in the 1930's and the 1970's some interesting parallels. Psychometrika, 44(2), 157–167.CrossRef Steiger, J. H. (1979). Factor indeterminacy in the 1930's and the 1970's some interesting parallels. Psychometrika, 44(2), 157–167.CrossRef
go back to reference Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). Hillsdale: Erlbaum. Stevens, J. P. (2009). Applied multivariate statistics for the social sciences (5th ed.). Hillsdale: Erlbaum.
go back to reference Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25(1), 1–28.CrossRef Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25(1), 1–28.CrossRef
go back to reference Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters?. Multivariate Behavioral Research, 28(3), 263–311.CrossRef Widaman, K. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters?. Multivariate Behavioral Research, 28(3), 263–311.CrossRef
go back to reference Wold, H. O. A. (1982). Soft modeling: The basic design and some extensions. In: K. G. Jöreskog & H. O. A. Wold (Eds.), Systems under indirect observations: Part II (pp. 1–54). Amsterdam: North-Holland. Wold, H. O. A. (1982). Soft modeling: The basic design and some extensions. In: K. G. Jöreskog & H. O. A. Wold (Eds.), Systems under indirect observations: Part II (pp. 1–54). Amsterdam: North-Holland.
go back to reference Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442.CrossRef Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442.CrossRef
go back to reference Nunnally, J. C., & Bernstein, I. H. (1993). Psychometric theory (3rd ed.). New York: McGraw-Hill. Nunnally, J. C., & Bernstein, I. H. (1993). Psychometric theory (3rd ed.). New York: McGraw-Hill.
go back to reference Stewart, D. W. (1981). The application and misapplication of factor analysis in marketing research. Journal of Marketing Research, 18(1), 51–62.CrossRef Stewart, D. W. (1981). The application and misapplication of factor analysis in marketing research. Journal of Marketing Research, 18(1), 51–62.CrossRef
Metadata
Title
Principal Component and Factor Analysis
Authors
Marko Sarstedt
Erik Mooi
Copyright Year
2019
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-56707-4_8