Bootstrap Cross-Validation Indices for PLS Path Model Assessment

The goal of PLS path modeling is primarily to estimate the variance of endogenous constructs and in turn their respective manifest variables (if reflective). Models with significant jackknife or bootstrap parameter estimates may still be considered invalid in a predictive sense. In this chapter, the objective is to shift from that of assessing the significance of parameter estimates (e.g., loadings and structural paths) to that of predictive validity. Specifically, this chapter examines how predictive indicator weights estimated for a particular PLS structural model are when applied on new data from the same population. Bootstrap resampling is used to create new data sets where new R-square measures are obtained for each endogenous construct in a model. The weighted summed (WSD) R-square represents how well the original sample weights predict when given new data (i.e., a new bootstrap sample). In contrast, the simple summed (SSD) R-square examines the predictiveness using the simpler approach of unit weights. Such an approach is equivalent to performing a traditional path analysis using simple summed scale scores. A relative performance index (RPI) based on the WSD and SSD estimates is created to represent the degree to which the PLS weights yield better predictiveness for endogenous constructs than the simpler procedure of performing regression after simple summing of indicators. In addition, a Performance from Optimized Summed Index (PFO) is obtained by contrasting the WSD R-squares to the R-squares obtained when the PLS algorithm is used on each new bootstrap data set. Results from two studies are presented. In the first study, 14 data sets of sample size 1,000 were created to represent two different structural models (i.e., medium versus high R-square) consisting of one endogenous and three exogenous constructs across seven different measurement scenarios (e.g., parallel versus heterogenous loadings). Five-hundred bootstrap cross validation data sets were generated for each of 14 data sets. In study 2, simulated data based on the population model conforming to the same scenarios in study 1 were used instead of the bootstrap samples in part to examine the accuracy of the bootstrapping approach. Overall, in contrast to Q-square which examines predictive relevance at the indicator level, the RPI and PFO indices are shown to provide additional information to assess predictive relevance of PLS estimates at the construct level. Moreover, it is argued that this approach can be applied to other same set data indices such as AVE (Fornell C, Larcker D, J Mark Res 18:39–50, 1981) and GoF (Tenenhaus M, Amato S, Esposito Vinzi V, Proceedings of the XLII SIS (Italian Statistical Society) Scientific Meeting, vol. Contributed Papers, 739–742, CLEUP, Padova, Italy, 2004) to yield RPI-AVE, PFO-AVE. RPI-GoF, and PFO-GoF indices.