Abstract
Affect describes any feelings, emotions, or moods that a person experiences and is generally divided into two broad dimensions—positive affect and negative affect. The most widely used measure of affect, the Positive and Negative Affect Schedule (PANAS), has recently been translated to Arabic (see Appendix), yet the psychometric equivalence of this adapted measure is not fully understood. Using a series of multigroup confirmatory factor analyses, the current study examined measurement invariance of the English and adapted Arabic versions of the PANAS among 979 American and 1470 Arab university students. Although the two-factor structure of the 20-item PANAS was observed in both groups (configural variance), results did not support full invariance of factor loadings (metric invariance). A partial metric invariance model, however, revealed invariant loadings for all positive affect items and all but four negative affect items; dissimilar factor loadings emerged between groups for irritable, nervous, scared, and jittery. Evidence did not support scalar invariance of the 16 metric-invariant items, with only ten items demonstrating equivalent intercepts across groups. Finally, tests for strict invariance indicated nine of the ten scalar-invariant items had equivalent residual variances across groups.
All told, results suggest that the PANAS is partially invariant in American and Arab groups.
Similar content being viewed by others
References
Bodenhausen, G. V., Sheppard, L. A., & Kramer, G. P. (1994). Negative affect and social judgment: The differential impact of anger and sadness. European Journal of Social Psychology, 24(1), 45–62. https://doi.org/10.1002/ejsp.2420240104.
Bryan, T., Sullivan-Burstein, K., & Mathur, S. (1998). The influence of affect on social information processing. Journal of Learning Difficulties, 31, 418–426. https://doi.org/10.1177/002221949803100501.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5.
Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43(3), 245–265. https://doi.org/10.1348/0144665031752934.
Díaz-García, A., González-Robles, A., Mor, S., Mira, A., Quero, S., García-Palacios, A., Baños, R. M., & Botella, C. (2020). Positive and Negative Affect Schedule (PANAS): Psychometric properties of the online Spanish version in a clinical sample with emotional disorders. BMC Psychiatry, 20(1), 56. https://doi.org/10.1186/s12888-020-2472-1.
Dockray, S., & Steptoe, A. (2010). Positive affect and psychobiological processes. Neuroscience and Biobehavioral Reviews, 35(1), 69–75. https://doi.org/10.1016/j.neubiorev.2010.01.006.
Estévez-López, F., Pulido-Martos, M., Armitage, C. J., Wearden, A., Álvarez-Gallardo, I. C., Arrayás-Grajera, M. J., Girela-Rejón, M. J., Carbonell-Baeza, A., Aparicio, V. A., Geenen, R., Delgado-Fernández, M., & Segura-Jiménez, V. (2016). Factor structure of the Positive and Negative Affect Schedule (PANAS) in adult women with fibromyalgia from Southern Spain: The al-Ándalus project. PeerJ, 4, e1822. https://doi.org/10.7717/peerj.1822.
Joiner Jr., T. E., Sandín, B., Chorot, P., Lostao, L., & Marquina, G. (1997). Development and factor analytic validation of the SPANAS among women in Spain: (More) Cross-cultural convergence in the structure of mood. Journal of Personality Assessment, 68(3), 600–615. https://doi.org/10.1207/s15327752jpa6803_8.
Lee, S. T. H., Hartanto, A., Yong, J. C., Koh, B., & Leung, A. K. (2019). Examining the cross-cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample. Asian Journal of Social Psychology, 23, 109–116. https://doi.org/10.1111/ajsp.12390.
Lin, M., Lucas Jr., H. C., & Shmueli, G. (2013). Too big to fail: Large samples and the p-value problem. Information Systems Research, 24(4), 906–917. https://doi.org/10.1287/isre.2013.0480.
Little, T. D., Card, N. A., Slegers, D. W., & Ledford, E. C. (2007). Representing contextual effects in multiple-group MACS models. In T. D. Little, J. A. Bovaird, & N. A. Card (Eds.), Modeling contextual effects in longitudinal studies (p. 121–147). Lawrence Erlbaum Associates Publishers.
McNeish, D. M., & Stapleton, L. M. (2016). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28(2), 295–314. https://doi.org/10.1007/s10648-014-9287-x.
Megreya, A. M., Latzman, R. D., Al-Attiyah, A. A., & Alrashidi, M. (2016). The robustness of the nine-factor structure of the Cognitive Emotion Regulation Questionnaire across four Arabic-speaking Middle Eastern countries. Journal of Cross-Cultural Psychology, 47(6), 875–890. https://doi.org/10.1177/0022022116644785.
Megreya, A. M., Latzman, R. D., Al-Emadi, A. A., & Al-Attiyah, A. A. (2018). An integrative model of emotion regulation and associations with positive and negative affectivity across four Arabic speaking countries and the USA. Motivation and Emotion, 42(4), 566–575. https://doi.org/10.1007/s11031-018-9682-6.
Merz, E. L., Malcarne, V. L., Roesch, S. C., Ko, C. M., Emerson, M., Roma, V. G., & Sadler, G. R. (2013). Psychometric properties of Positive and Negative Affect Schedule (PANAS) original and short forms in an African American community sample. Journal of Affective Disorders, 151(3), 942–949. https://doi.org/10.1016/j.jad.2013.08.011.
Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111–130. https://doi.org/10.21500/20112084.857.
Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus user’s guide. Eighth Edition. Los Angeles: Muthén & Muthén.
Pandey, R., & Shrivastava, N. (2008). Psychometric evaluation of a Hindi version of Positive and Negative Affect Schedule. Industrial Psychiatry Journal, 17(1), 49–54.
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004.
Raykov, T. (2012). Scale construction and development using structural equation modeling. In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 472–492). New York, NY: The Guilford Press.
Rigdon, E. E. (1998). Structural equation modeling. In G. A. Marcoulides (Ed.), Methodology for business and management. Modern methods for business research (p. 251–294). Lawrence Erlbaum Associates Publishers.
Serafini, K., Malin-Mayor, B., Nich, C., Hunkele, K., & Carroll, K. M. (2016). Psychometric properties of the Positive and Negative Affect Schedule (PANAS) in a heterogeneous sample of substance users. The American Journal of Drug and Alcohol Abuse, 42(2), 203–212. https://doi.org/10.3109/00952990.2015.1133632.
Terraciano, A., McCrae, R. R., & Costa Jr., P. T. (2003). Factorial and construct validity of the Italian Positive and Negative Affect Schedule (PANAS). European Journal of Psychological Assessment, 19(2), 131–141. https://doi.org/10.1027//1015-5759.19.2.131.
Thompson, E. R. (2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. https://doi.org/10.1177/0022022106297301.
Tuccitto, D. E., Giacobbi, P. R., & Leite, W. L. (2010). The internal structure of positive and negative affect: A confirmatory factor analysis of the PANAS. Educational and Psychological Measurement, 70(1), 125–141. https://doi.org/10.1177/0013164409344522.
van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis of comparative research. In J. W. Berry, Y. H. Poortinga, & J. Pandey (Eds.), Handbook of cross-cultural psychology (2nd ed., pp. 257–300). Boston: Allyn & Bacon.
Watson, D., Clark, L. A., & Carey, G. (1988a). Positive and negative affectivity and their relation to anxiety and depressive disorders. Journal of Abnormal Psychology, 97(3), 346–353. https://doi.org/10.1037/0021-843X.97.3.346.
Watson, D., Clark, L. A., & Tellegen, A. (1988b). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000.
Informed Consent
Informed consent was obtained from all patients for being included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Appendix 1
Rights and permissions
About this article
Cite this article
Davis, R.C., Arce, M.A., Tobin, K.E. et al. Testing Measurement Invariance of the Positive and Negative Affect Schedule (PANAS) in American and Arab University Students. Int J Ment Health Addiction 20, 874–887 (2022). https://doi.org/10.1007/s11469-020-00411-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11469-020-00411-z