The Effect of Nonnormality on CB-SEM and PLS-SEM Path Estimates

Authors: Z. Jannoo, B. W. Yap, N. Auchoybur, M. A. Lazim

Abstract:

The two common approaches to Structural Equation Modeling (SEM) are the Covariance-Based SEM (CB-SEM) and Partial Least Squares SEM (PLS-SEM). There is much debate on the performance of CB-SEM and PLS-SEM for small sample size and when distributions are nonnormal. This study evaluates the performance of CB-SEM and PLS-SEM under normality and nonnormality conditions via a simulation. Monte Carlo Simulation in R programming language was employed to generate data based on the theoretical model with one endogenous and four exogenous variables. Each latent variable has three indicators. For normal distributions, CB-SEM estimates were found to be inaccurate for small sample size while PLS-SEM could produce the path estimates. Meanwhile, for a larger sample size, CB-SEM estimates have lower variability compared to PLS-SEM. Under nonnormality, CB-SEM path estimates were inaccurate for small sample size. However, CB-SEM estimates are more accurate than those of PLS-SEM for sample size of 50 and above. The PLS-SEM estimates are not accurate unless sample size is very large.  

Keywords: CB-SEM, Monte Carlo simulation, Normality conditions, Nonnormality, PLS-SEM.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1090631

References:

[1] J. Henseler, "On the convergence of the partial least squares path modeling algorithm,” Computational Statistics, vol. 25, no. 1, pp. 107–120, Aug. 2009.
[2] H. Baumgartner and C. Homburg, "Applications of structural equation modeling in marketing and consumer research: A review,” International Journal of Research in Marketing, vol. 13, no. 2, pp. 139–161, Apr. 1996.
[3] L. Williams, J. Edwards, and R. Vandenberg, "Recent Advances in Causal Modeling Methods for Organizational and Management Research,” Journal of Management, vol. 29, no. 6, pp. 903–936, Dec. 2003.
[4] R. C. Maccallum and J. T. Austin, "Applications of Structural Equation Modeling in Psychological Research,” Annual Review of Psychology, vol. 51, pp. 201–226, 2000.
[5] K. Jöreskog, "Some contributions to Maximum Likelihood Factor Analysis,” Psychometrika, vol. 32, no. 4, pp. 443–482, 1986.
[6] J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate Data Analysis, 7th ed. New York: Prentice Hall, 2009, pp. 1–816.
[7] M. Haenlein and A. M. Kaplan, "A Beginner’s Guide to Partial Least Squares Analysis,” Understanding Statistics, vol. 3, no. 4, pp. 283–297, Nov. 2004.
[8] E. E. Rigdon, C. M. Ringle, and M. Sarstedt, "Structural modeling of heterogeneous data with partial least squares,” Review of Marketing Research, vol. 7, pp. 257–298, 2010.
[9] D. W. Barclay, C. A. Higgins, and R. Thompson, "The partial least squares (PLS) approach to causal modeling: personal computer adoption and use as an illustration,” Technology Studies, vol. 2, pp. 285–323, 1995.
[10] W. W. Chin and B. L. Marcolin, "A Partial Least Squares latent variable modeling approach for measuring interaction effects: Results from a Monte Carlo Simulation study and an Electronic-Mail Emotion/Adoption study,” Information Systems Research, vol. 14, no. 2, pp. 189–217, 2003.
[11] D. Gefen, D. Straub, and M.-C. Boudreau, "Structural Equation Modeling and Regression: Guidelines for research Practice,” Communications of the Association for Information Systems, vol. 4, no. 7, pp. 1–78, 2000.
[12] W. W. Chin, "Commentary Issues and Opinion on Structural Equation Modeling,” MIS Quarterly, vol. 22, no. 1, pp. 7–11, 1998.
[13] W. W. Chin, and P. R. Newsted, Structural equation modelling analysis with small samples using partial least squares. In R. H. Hoyle (Ed.), Statistical strategies for small sample research. Thousand Oaks: SAGE Publications, 1999.
[14] Jöreskog and Sorbom, LISREL 8 User’s Reference Guide. Chicago, Scientific Software, 1996.
[15] J. L. Arbuckle, Amos 18.0 User's Guide. Chicago: SPSS, 1995.
[16] P. Bentler, EQS: Structural equations program manual. BMDP Statistical Software Inc., Los Angeles, CA, 1989.
[17] C. M. Ringle, S. Wende, and A. Will, SmartPLS 2.0 (beta). Hamburg, Germany, 2005.
[18] M. Haenlein and A. M. Kaplan, "A Beginner’s Guide to Partial Least Squares Analysis,” Understanding Statistics, vol. 3, no. 4, pp. 283–297, Nov. 2004.
[19] P. M. Bentler, and C. P. Chou, "Practical issues in structural modeling”, Sociological Methods & Research, Vol. 16, pp. 78-117, 1987.
[20] D. L. Goodhue, W. Lewis, and R. Thompson, "Does PLS have Advantages for Small Sample Size or Non-Normal Data?,” MIS Quarterly, vol. 36, no. 3, pp. 1–21, 2012.
[21] C. M. Ringle, Sarstedt, and D. W. Straub, "A critical look at the use of PLS-SEM in MIS quarterly,” MIS Quarterly, Vol. 36, no. 1, pp. 3-14, 2012.
[22] W. Reinartz, M. Haenlein, and J. Henseler, "An empirical comparison of the efficacy of covariance-based and variance-based SEM,” International Journal of Research in Marketing, vol. 26, no. 4, pp. 332–344, Dec. 2009.
[23] J. F. Hair, C. M. Ringle, and M. Sarstedt, "PLS-SEM: Indeed a Silver Bullet,” The Journal of Marketing Theory and Practice, vol. 19, no. 2, pp. 139–152, Apr. 2011.
[24] H. Wold, "Path models with latent variables: The NIPALS approach”, in H. M. Blalock, A. Aganbegian, F. M. Borodkin, R. Boudon, & V. Capecchi (Eds.), Quantitative sociology: International perspectives on mathematical and statistical modeling New York: Academic, 1975, pp. 307–357.
[25] J. Henseler, "On the convergence of the partial least squares path modeling algorithm,” Computational Statistics, vol. 25, no. 1, pp. 107–120, Aug. 2009.
[26] T. Dijkstra, "Some comments on maximum likelihood and partial least squares methods,” Journal of Econometrics, Vol. 22, no. 1, pp. 67–90, 1983.
[27] K. G. Jöreskog and D. Sorbom, "Recent developments in structural equation modeling,” Journal of Marketing Research, vol. 19, pp. 404–416, 1982.
[28] K. G. Jöreskog, and D. Sorbom, LISREL VI: Analysis of linear structural relationships by the method of maximum likelihood, Chicago: National Educational Resources, 1984.
[29] J. J. Hoogland and A. Boomsma, "Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis,” Sociological Methods & Research, vol. 26, no. 3, pp. 329–367, Feb. 1998.
[30] J. C. Anderson and D. W. Gerbing, "Structural equation modeling in practice: A review and recommended two-step approach” Psychological Bulletin, vol. 103, no. 3, pp. 411–423, 1988.
[31] H. Wold, "Soft Modeling: Intermediate between Traditional Model Building and Data Analysis,” Mathematical Statistics, vol. 6, pp. 333-346, 1882.
[32] Y. Rosseel, "lavaan”: An R Package for Structural Equation,” Journal of Statistical Software, vol. 48, no. 2, pp. 1–36, 2012.
[33] A. Monecke and F. Leisch, "semPLS”: Structural Equation Modeling Using Partial Least Squares,” Journal of Statistical Software, vol. 48, no. 3, pp. 1–32, 2012.