Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Does PLS have advantages for small sample size or non-normal data?

Published: 01 September 2012 Publication History

Abstract

There is a pervasive belief in the MIS research community that PLS has advantages over other techniques when analyzing small sample sizes or data with non-normal distributions. Based on these beliefs, major MIS journals have published studies using PLS with sample sizes that would be deemed unacceptably small if used with other statistical techniques. We used Monte Carlo simulation more extensively than previous research to evaluate PLS, multiple regression, and LISREL in terms of accuracy and statistical power under varying conditions of sample size, normality of the data, number of indicators per construct, reliability of the indicators, and complexity of the research model. We found that PLS performed as effectively as the other techniques in detecting actual paths, and not falsely detecting non-existent paths. However, because PLS (like regression) apparently does not compensate for measurement error, PLS and regression were consistently less accurate than LISREL. When used with small sample sizes, PLS, like the other techniques, suffers from increased standard deviations, decreased statistical power,and reduced accuracy. All three techniques were remarkably robust against moderate departures from normality, and equally so. In total, we found that the similarities in results across the three techniques were much stronger than the differences.

References

[1]
Barclay, D., Higgins, C., and Thompson, R. 1995. "The Partial Least Squares (PLS) Approach to Causal Modeling: Personal Computer Adoption and Use as an Illustration," Technology Studies (2:2), pp. 285-309.
[2]
Bagozzi, R. P., and Edwards, J. R. 1998. "A General Approach for Representing Constructs in Organizational Research," Organizational Research Methods (1:1), pp. 45-87.
[3]
Bollen, K. A. 1989. Structural Equations with Latent Variables, New York: Wiley.
[4]
Cassel, C., Hackl, P., and Westlund, A. 1999. "Robustness of Partial Least-Squares Method for Estimating Latent Variable Quality Structures," Journal of Applied Statistics (26:4), pp. 435-446.
[5]
Chin, W. W. 1998. "The Partial Least Squares Approach to Structural Equation Modeling," in Modern Methods for Business Research, G. A. Marcoulides (ed.), London: Psychology Press, pp. 295-336.
[6]
Chin, W. W. 2001. PLS Graph User's Guide, Version 3.0, Houston, TX: Soft Modeling, Inc.
[7]
Chin, W. W., Marcolin, B., and Newsted, P. 2003. "A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic-Mail Emotion/Adoption Study," Information Systems Research (14:2), pp. 189-217.
[8]
Chin, W. W., and Newsted, P. R. 1999. "Structural Equation Modeling Analysis with Small Samples Using Partial Least Squares," in Statistical Strategies for Small Sample Research, R. Hoyle (ed.), Newbury Park, CA: Sage Publications, pp. 307-341.
[9]
Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences, Hillsdale, N: Lawrence Erlbaum Associates.
[10]
Dijkstra, T. 1983. "Some Comments on maximum Likelihood and Partial Least Squares Methods," Journal of Econometrics (22), pp. 67-90.
[11]
Evermann, J., and Tate, M. 2010. "Testing Models or Fitting Models? Identifying Model Misspecification in PLS," in Proceedings of the 31st International Conference on Information Systems, St. Louis, MO, December 12-15.
[12]
Falk, R. F., and Miller, N. B. 1992. A Primer for Soft Modeling, Akron, OH: University of Akron Press.
[13]
Fleishman, A. I. 1978. "A Method for Simulating Non-Normal Distributions," Psychometrika (43:4), pp. 521-532.
[14]
Fornell, C. 1984. "A Second Generation of Multivariate Analysis: Classification of Methods and Implications for Marketing Research," Working Paper, University of Michigan.
[15]
Fornell, C., and Bookstein, F. 1982. "Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory," Journal of Marketing Research (19), pp. 440-452.
[16]
Fornell, C., and Larcker, D. 1981. "Evaluating Structural Equation Models with Unobservable Variables and Measurement Error," Journal of Marketing Research (18), pp. 39-50.
[17]
Gefen, D., Rigdon, E., and Straub, D. 2011. "Editor's Comments: An Update and Extension to SEM Guidelines for Administrative and Social Science Research," MIS Quarterly (35:2), pp. iii-xiv.
[18]
Gefen, D., Straub, D., and Boudreau, M. C. 2000. "Structural Equation Modeling and Regression: Guidelines for Research Practice," Communications of the Association for Information Systems (4:Article 7).
[19]
Goodhue, D., Lewis, W., and Thompson, R. 2006. "Small Sample Size and Statistical Power in MIS Research," in Proceedings of the 39th Hawaii International Conference on Systems Sciences, R. Sprague (ed.), Los Alamitos, CA: IEEE Computer Society Press, January 4-7.
[20]
Goodhue, D., Lewis, W., and Thompson, R. 2007. "Research Note - Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS With Product Indicators," Information Systems Research (18:2), pp. 211-227.
[21]
Goodhue, D., Lewis, W., and Thompson, R. 2011a. "A Dangerous Blind Spot in IS Research: False Positives Due to Multicollinearity Combined with Measurement Error," in Proceedings of the 17th Americas Conference on Information Systems, Detroit, MI, August 4-7.
[22]
Goodhue, D., Lewis, W., and Thompson, R. 2011b. "Measurement Error in PLS, Regression and CB-SEM," in Proceedings of the 6th Mediterranean Conference on Information Systems Sciences, Limassol, Cyprus, September 3-5.
[23]
Goodhue, D., Lewis., W., and Thompson, R. 2012. "Comparing PLS to Regression and LISREL: A Response to Marcoulides, Chin, and Saunders," MIS Quarterly (36:3), pp. 703-716.
[24]
Green, S. B. 199. "How Many Subjects Does it Take to Do A Regression Analysis," Multivariate Behavioral Research (26), pp. 499-510.
[25]
Hayduk, L. A. 1987. Structural Equation Modeling with LISREL, Baltimore, MD: Johns Hopkins University Press.
[26]
Hair, J. F., Jr., Anderson, R. E., Tatham, R. L., and Black, W. C. 1998. Multivariate Data Analysis with Readings (5th ed.), Englewood Cliffs, NJ: Prentice Hall.
[27]
Hair, J. F., Ringle, C. M., and Sarstedt, M. 2011. "PLS-SEM: Indeed a Silver Bullet," Journal of Marketing Theory and Practice (19:2), pp. 139-151.
[28]
Hair, J. F., Sarstedt, M., Ringle, C. M., and Mena, J. A. 2011. "An Assessment of the Use of Partial Least Squares Structural Equation Modeling in Marketing Research," Journal of the Academy of Marketing Science, Online Publication (DOI 10.1007/s11747-011-0261-6).
[29]
Kahai, S. S., and Cooper, R. B. 2003. "Exploring the Core Concepts of Media Richness Theory: The Impact of Cue Multiplicity and Feedback Immediacy on Decision Quality," Journal of Management Information Systems (20:1), pp. 263-299.
[30]
Kline, R. B. 1998. Principles and Practice of Structural Equation Modeling, New York: Guilford Press.
[31]
Lohmöller, J. B. 1988. "The PLS Program System: Latent Variables Path Analysis with Partial Least Squares Estimation," Multivariate Behavioral Research (23), pp. 125-127.
[32]
MacCallum, R., Browne, M., and Sugawara, H. 1996. "Power Analysis and Determination of Sample Size for Covariance Structure Modeling," Psychological Methods (1:2), pp. 130-149.
[33]
Majchrzak, A., Beath, C. M., Lim, R. A., and Chin, W. W. 2005. "Managing Client Dialogues During Information Systems Design to Facilitate Client Learning," MIS Quarterly (29:4), pp. 653-672.
[34]
Malhotra, A., Gosain, S., and El Sawy, O. 2007. "Leveraging Standard Electronic Business Interfaces to Enable Adaptive Supply Chain Partnerships," Information Systems Research (18:3), pp. 260-279.
[35]
Marcoulides, G. A., Chin, W. W., and Saunders, C. 2009. "Foreword: A Critical Look at Partial Least Squares Modeling," MIS Quarterly (33:1), pp. 171-175.
[36]
Marcoulides, G. A., and Saunders, C. 2006. "Editor's Comments: PLS: A Silver Bullet?," MIS Quarterly (30:2), pp. iii-ix.
[37]
McDonald, R. P. 1996. "Path Analysis with Composite Variables," Multivariate Behavioral Research (31:2), pp. 239-270.
[38]
Micceri, T. 1989. "The Unicorn, the Normal Curve, and Other Improbable Creatures," Psychological Bulletin (105:1), pp. 156-166.
[39]
Nunnally, J. C., and Bernstein, I. H. 1994. Psychometric Theory (3rd ed.), New York: McGraw-Hill.
[40]
Petter, S., Straub, D., and Rai, A. 2007. "Specifying Formative Constructs in Information Systems Research," MIS Quarterly (31:4), pp. 623-656.
[41]
Reinartz, W., Haenlein, M., and Henseler, J. 2009. "An Empirical Comparison of the Efficacy of Covariance-Based and Variance-Based SEM, 2009," International Journal of Research in Marketing (26), pp. 332-344.
[42]
Ringle, C., Sarstedt, M., and Straub, D. 2012. "Editor's Comments: A Critical Look at the Use of PLS-SEM in MIS Quarterly," MIS Quarterly (36:1), pp. iii-xiv.
[43]
Rivard, S., and Huff, S. 1988. "Factors of Success for End-User Computing," Communications of the ACM (31:5), pp. 552-561.
[44]
Rönkkö, M, and Ylitalo, J. 2010. "Construct Validity in Partial Least Squares Path Modeling," in Proceedings of the 31st International Conference on Information Systems, St. Louis, MO, December 12-15.
[45]
Wold, H. O. 1982. "Soft Modeling: The Basic Design and Some Extensions," in Systems Under Indirect Observation: Causality, Structure, Prediction, Part II, K. G. Jöreskog and H. Wold (eds.), Amsterdam: North-Holland.
[46]
Wood, R. E., Goodman, F. S., Beckmann, N., and Cook, A. 2008. "Mediation Testing in Management Research: A Review and Proposals," Organizational Research Methods (11:2), pp 270-295.
[47]
Vittadimi, G., Minotti, S. I., Fattore, M., and Lovaglio, P. G. 2007. "On the Relationship Among Latent Variables and Residuals in PLS Path Modeling: The Formative-Reflective Scheme," Computational Statistics and Data Analysis (51:12), pp. 5828-5846.
[48]
Zhang, T., Agarwal, R., and Lucas, H., Jr. 2011. "The Value of IT-Enabled Retailer Learning: Personalized Product Recommendations and Customer Store Loyalty in Electronic Markets," MIS Quarterly (35:4), pp. 859-882.

Cited By

View all
  • (2021)Understanding Inconsistent Employee Compliance with Information Security Policies Through the Lens of the Extended Parallel Process ModelInformation Systems Research10.1287/isre.2021.101432:3(1043-1065)Online publication date: 1-Sep-2021
  • (2021)With Great Power Comes Great ResponsibilityACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3505639.350564352:SI(10-23)Online publication date: 28-Dec-2021
  • (2021)The Agile Success ModelACM Transactions on Software Engineering and Methodology10.1145/346493830:4(1-46)Online publication date: 23-Jul-2021
  • Show More Cited By
  1. Does PLS have advantages for small sample size or non-normal data?

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image MIS Quarterly
    MIS Quarterly  Volume 36, Issue 3
    September 2012
    338 pages

    Publisher

    Society for Information Management and The Management Information Systems Research Center

    United States

    Publication History

    Published: 01 September 2012

    Author Tags

    1. Monte Carlo simulation
    2. PLS
    3. non-normal distributions
    4. partial least squares
    5. regression
    6. small sample size
    7. statistical power
    8. structural equation modeling

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 14 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Understanding Inconsistent Employee Compliance with Information Security Policies Through the Lens of the Extended Parallel Process ModelInformation Systems Research10.1287/isre.2021.101432:3(1043-1065)Online publication date: 1-Sep-2021
    • (2021)With Great Power Comes Great ResponsibilityACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3505639.350564352:SI(10-23)Online publication date: 28-Dec-2021
    • (2021)The Agile Success ModelACM Transactions on Software Engineering and Methodology10.1145/346493830:4(1-46)Online publication date: 23-Jul-2021
    • (2021)Understanding Customers' Continuance IntentionACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3462766.346277152:2(68-93)Online publication date: 28-Apr-2021
    • (2021)PLS-SEM for Software Engineering ResearchACM Computing Surveys10.1145/344758054:4(1-38)Online publication date: 3-May-2021
    • (2020)Conceptual Modelling of Supplier Loyalty and Buyer-Supplier Relationship for MediationProceedings of the 3rd Asia Pacific Conference on Research in Industrial and Systems Engineering10.1145/3400934.3400988(295-299)Online publication date: 16-Jun-2020
    • (2020)Modeling Dyslexic Students’ Motivation for Enhanced Learning in E-learning SystemsACM Transactions on Interactive Intelligent Systems10.1145/334119710:3(1-34)Online publication date: 9-Nov-2020
    • (2020)Data generation for composite-based structural equation modeling methodsAdvances in Data Analysis and Classification10.1007/s11634-020-00396-614:4(747-757)Online publication date: 1-Dec-2020
    • (2020)Moderating effect of innovation consciousness and quality consciousness on intention-behaviour relationship in E-learning integrationEducation and Information Technologies10.1007/s10639-019-09960-w25:1(329-350)Online publication date: 1-Jan-2020
    • (2020)Structural reliability analysis via dimension reduction, adaptive sampling, and Monte Carlo simulationStructural and Multidisciplinary Optimization10.1007/s00158-020-02633-062:5(2629-2651)Online publication date: 20-Jul-2020
    • Show More Cited By

    View Options

    View options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media