Skip to main content
SpringerLink
Log in

Evaluating Measurement Equivalence in Cross-Cultural Stress Research

  • Living reference work entry
  • First Online:
Handbuch Stress und Kultur

Abstract

It is proposed that cultural validity is an essential element of the assessment of stress across cultures. The use of tests and measures needs to be evaluated in terms of their measurement equivalence. From the perspective of cross-cultural psychology, measurement equivalence needs to be examined in terms of linguistic equivalence, functional equivalence, conceptual equivalence and metric equivalence. The definitions, methods, and challenges of each of these equivalences are discussed in relation to the relevant measures and cross-cultural studies. Non-equivalence of the measures across these dimensions can affect both the assessment of stress and our conclusions regarding their antecedents and consequences. Finally, it is noted that there are two forms of validity related to tests and measures, namely internal validity and external validity. In examining the measurement equivalence of stress measures, this chapter deals mainly with the internal validity aspects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Similar content being viewed by others

References

  • Anastasi, A. (1976). Psychological testing (4th ed.). New York: Macmillan.

    Google Scholar 

  • Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25, 3186–3191. 

    Google Scholar 

  • Berry, J. W. (1980). Introduction to methodology. In H. Triandis & J. Berry (Eds.), Handbook of cross-cultural psychology: Volume 2 methodology (pp. 1–28). Boston: Allyn and Bacon.

    Google Scholar 

  • Brislin, R. (1970). Back translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185–216.

    Google Scholar 

  • Brislin, R. (1980). Translation and content analysis of oral and written materials. In H. Triandis & J. Berry (Eds.), Handbook of cross-cultural psychology: Volume 2 methodology (pp. 389–444). Boston: Allyn and Bacon.

    Google Scholar 

  • Byrne, B. M. (2016). Adaptation of assessment scales in cross-national research: Issues, guidelines, and caveats. International Perspectives in Psychology: Research, Practice, Consultation, 5, 51–65.

    Google Scholar 

  • Carver, C. S., Scheier, M. F., & Weintraub, J. K. (1989). Assessing coping strategies: A theoretically based approach. Journal of Personality and Social Psychology, 58, 844–854.

    Google Scholar 

  • Cervantes, R. C., Padilla, A. M., & Salgado de Snyder, N. (1990). Reliability and validity of the Hispanic Stress Inventory. Hispanic Journal of Behavioral Sciences, 121, 76–82.

    Google Scholar 

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504.

    Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255.

    Google Scholar 

  • Cheung, F. M., van de Vijver, F. J. R., & Leong, F. T. L. (2011). Toward a new approach to the study of personality in culture. American Psychologist, 66, 593–603.

    PubMed  Google Scholar 

  • Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24, 385–396.

    PubMed  Google Scholar 

  • Connor-Smith, J., & Calvete, E. (2004). Cross-cultural equivalence of coping and involuntary responses to stress in Spain and the United States. Anxiety, Stress, and Coping, 17, 163–185.

    Google Scholar 

  • Connor-Smith, J. K., Compas, B. E., Wadsworth, M. E., Thomsen, A. H., & Saltzman, H. (2000). Responses to stress in adolescence: Measurement of coping and involuntary responses to stress. Journal of Consulting and Clinical Psychology, 68, 976–992.

    PubMed  Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.

    PubMed  Google Scholar 

  • Drasgow, F. (1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues. Psychological Bulletin, 95(1), 134–135. https://doi.org/10.1037/0033-2909.95.1.134.

    Article  Google Scholar 

  • Garfield, S. (1984). Methodological problems in clinical diagnosis. In H. E. Adams & P. B. Sutker (Eds.), Comprehensive handbook of psychopathology (pp. 27–44). New York: Plenum.

    Google Scholar 

  • Goh, J. O., & Park, D. C. (2009). Culture sculpts the perceptual brain. Progress in Brain Research, 178, 95–111.

    PubMed  Google Scholar 

  • Hecker, T., Barnewitz, E., Stenmark, H., & Iversen, V. (2016). Pathological spirit possession as a cultural interpretation of trauma-related symptoms. Psychological Trauma: Theory, Research, Practice, and Policy, 8, 468–476.

    Google Scholar 

  • Hewitt, P. L., Flett, G. L., & Mosher, S. W. (1992). The Perceived Stress Scale: Factor structure and relation to depression symptoms in a psychiatric sample. Journal of Psychopathology and Behavioral Assessment, 14, 247–257.

    Google Scholar 

  • Hinton, D. E., & Lewis-Fernández, R. (2011). The cross-cultural validity of posttraumatic stress disorder: implications for DSM-5. Depression and Anxiety, 28(9), 783–801.

    PubMed  Google Scholar 

  • Holmes, T. H., & Rahe, R. H. (1967). The social readjustment rating scale. Journal of Psychosomatic Research, 11, 213–218.

    PubMed  Google Scholar 

  • Hult, G. T. M., Ketchen, D. J., Griffith, D. A., Finnegan, C. A., Gonzalez-Padron, T., Harmancioglu, N., … Cavusgil, S. T. (2008). Data equivalence in cross-cultural international business research: Assessment and guidelines. Journal of International Business Studies, 39(6), 1027–1044.

    Google Scholar 

  • International Test Commission (2018). ITC guidelines for translating and adapting tests. International Journal of Testing, 18, 101–134. https://doi.org/10.1080/15305058.2017.1398166.

    Article  Google Scholar 

  • Johnson, T. P. (1998). Approaches to equivalence in cross-cultural and cross-national survey research. ZUMA-Nachrichten Spezial Band 3: Cross-Cultural Survey Equivalence. Retrieved Feb 9, 2002, from https://www.ssoar.info/ssoar/handle/document/49730

  • Jun, D., Johnston, V., Kim, J.-M., & O’Leary, S. (2018). Cross-cultural adaptation and validation of the Depression, Anxiety and Stress Scale-21 (DASS-21) in the Korean working population. Work: Journal of Prevention, Assessment & Rehabilitation, 59(1), 93–102. https://doi.org/10.3233/WOR-172661.

    Article  Google Scholar 

  • Kim, I., Kim, L. I. C., & Kelly, J. G. (2006). Developing cultural competence in working with Korean immigrant families. Journal of Community Psychology, 34(2), 149–165.

    Google Scholar 

  • Klassen, R. M., Usher, E. L., & Bong, M. (2010). Teachers’ collective efficacy, job satisfaction, and job stress in cross-cultural context. Journal of Experimental Education, 78(4), 464–486. https://doi.org/10.1080/00220970903292975.

    Article  Google Scholar 

  • Laungani, P. (1996). Cross-cultural investigations of stress: Conceptual and methodological considerations. International Journal of Stress Management, 3, 25–35.

    Google Scholar 

  • Leong, F. T. L., & Kalibatseva, Z. (2016). Threats to cultural validity in clinical diagnosis and assessment: Illustrated with the case of Asian Americans. In N. Zane, G. Bernal, & F. T. L. Leong (Eds.), Culturally informed evidence nased practices for ethnic minorities: Challenges and solutions (pp. 57–74). Washington, DC: American Psychological Association.

    Google Scholar 

  • Leong, F. T. L., Leung, K., & Cheung, F. M. (2010). Integrating cross-cultural psychology research methods into ethnic minority psychology. Cultural Diversity and Ethnic Minority Psychology, 16(4), 590–597.

    PubMed  Google Scholar 

  • Lin, L.-C., Snyder, M., & Egan, E. C. (1996). The development of the Taiwanese Elderly Stressor Inventory. International Journal of Nursing, 33, 29–36.

    Google Scholar 

  • Liu, H. Y., Lu, F. J. H., Zhang, X., Gill, D. L., Chiu, Y. H., & Chan, S. W. (2018). Cross-cultural adaptation of the Organizational Stressor Indicator for Sport Performers (OSI-SP) in Taiwan. Measurement in Physical Education and Exercise Science, 22, 263–274.

    Google Scholar 

  • Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568.

    PubMed  Google Scholar 

  • Meadows, K., Bentzen, N., & Touw-Otten, F. (1996). Cross-cultural issues: An outline of the important principles in establishing cross-cultural validity in health outcome assessment. In A. Hutchinson, N. Bentzen, & C. König-Zahn (Eds.), Cross cultural health outcome assessment: A user’s guide (pp. 34–40). Odense: European Research Group on Health Outcomes.

    Google Scholar 

  • Mimura, C., & Griffiths, P. (2004). A Japanese version of the Perceived Stress Scale: Translation and preliminary test. International Journal of Nursing Studies, 41, 379–385.

    PubMed  Google Scholar 

  • Mimura, C., & Griffiths, P. (2008) A Japanese version of the perceived stress scale: Cross-cultural translation and equivalence assessment. BMC Psychiatry, 8, Article 85.

    Google Scholar 

  • Nastasi, B. K., Hitchcock, J. H., Burkholder, G., Varjas, K., Sarkar, S., & Jayasena, A. (2007). Assessing adolescents’ understanding of and the reactions to stress in different cultures: Results of a mixed-methods approach. School Psychology International, 28(2), 163–178.

    Google Scholar 

  • Nishida, H. (1999). A cognitive approach to intercultural communication based on schema theory. International Journal of Intercultural Relations, 23, 753–777.

    Google Scholar 

  • Nye, C. D., & Drasgow, F. (2011). Effect size indices for analyses of measurement equivalence: Understanding the practical importance of differences between groups. Journal of Applied Psychology, 96(5), 966.

    PubMed  Google Scholar 

  • Nye, C. D., Brummel, B. J., & Drasgow, F. (2010). Too good to be true? Understanding change in organizational outcomes. Journal of Management, 36(6), 1555–1577.

    Google Scholar 

  • Nye, C. D., Bradburn, J., Olenick, J., Bialko, C., & Drasgow, F. (2019). How big are my effects? Examining the magnitude of effect sizes in studies of measurement equivalence. Organizational Research Methods, 22(3), 678–709.

    Google Scholar 

  • Oei, T. P. S., Sawang, S., Goh, Y. W., & Mukhtar, F. (2013). Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures. International Journal of Psychology, 48, 1018–1029.

    PubMed  Google Scholar 

  • Prelow, H. M., Tein, J.-Y., Roosa, M. W., & Wood, J. (2000). Do coping styles differ across socio-cultural groups? The role of measurement equivalence in making this judgment. American Journal of Community Psychology, 28, 225–244.

    PubMed  Google Scholar 

  • Ramirez, M. T. G., & Hernandez, R. L. (2007). Factor structure of the Perceived Stress Scale (PSS) in a sample from Mexico. Spanish Journal of Psychology, 10, 199–206.

    PubMed  Google Scholar 

  • Remor, E. (2006). Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS). The Spanish Journal of Psychology, 9, 86–93.

    PubMed  Google Scholar 

  • Robert, C., Lee, W. C., & Chan, K. Y. (2006). An empirical analysis of measurement equivalence with the indcol measure of individualism and collectivism: Implications for valid cross-cultural inference. Personnel Psychology, 59(1), 65–99.

    Google Scholar 

  • Romero, A. J., & Roberts, R. E. (2003). Stress within a bicultural context for adolescents of Mexican descent. Cultural Diversity and Ethnic Minority Psychology, 9, 171–184.

    PubMed  Google Scholar 

  • Rosenhan, D. L. (1973). On being sane in insane places. Science, 179, 250–258.

    PubMed  Google Scholar 

  • Sanchez, J. I., Spector, P. E., & Cooper, C. L. (2006). Frequently ignored methodological issues in cross-cultural stress research. In P. T. P. Wong & L. C. J. Wong (Eds.), Handbook of multicultural perspectives on stress and coping (pp. 187–201). New York: Springer.

    Google Scholar 

  • Sawang, S., Oei, T. P. S., Goh, Y. W., Mansoer, W., Markhum, E., & Ranawake, D. (2010). Confirmatory factor analysis of the Way of Coping Checklist-Revised (WCCL-R) in the Asian context. Applied Psychology: An International Review, 59(2), 202–219.

    Google Scholar 

  • Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18, 210–222.

    Google Scholar 

  • Stark, S., Chernyshenko, O. S., & Drasgow, F. (2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy. Journal of Applied Psychology, 91(6), 1292.

    PubMed  Google Scholar 

  • Toderi, S., Balducci, C., Edwards, J. A., Sarchielli, G., Broccoli, M., & Mancini, G. (2013). Psychometric properties of the UK and Italian versions of the HSE Stress Indicator Tool: A cross cultural investigation. European Journal of Psychological Assessment, 29, 72–79.

    Google Scholar 

  • Usunier, J. C. (1998). International & cross-cultural management research. London: Sage.

    Google Scholar 

  • van de Vijver, F. J. R., & Hambelton, R. K. (1996). Translating tests: Some practical guidelines. European Psychology, 1, 89–99.

    Google Scholar 

  • van de Vijver, F. J. R., & Leung, K. (2011). Equivalence and bias: A review of concepts, models, and data analytic procedures. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Culture and psychology. Cross-cultural research methods in psychology (pp. 17–45). Cambridge: Cambridge University Press.

    Google Scholar 

  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70.

    Google Scholar 

  • Wadsworth, M. E., Rieckmann, T., Benson, M. A., & Compas, B. E. (2004). Coping and responses to stress in Navajo adolescents: Psychometric properties of the Responses to Stress Questionnaire. Journal of Community Psychology, 32, 391–411.

    Google Scholar 

  • Wang, K., Shi, H.-S., Geng, F.-L., Zou, L.-Q., Tan, S.-P., Wang, Y., & Chan, R. C. K. (2016). Cross-cultural validation of the Depression Anxiety Stress Scale-21 in China. Psychological Assessment, 28, 88–100.

    Google Scholar 

  • West, S. G., Taylor, A. B., & Wu, W. (2012). Model fit and model selection in structural equation modeling. Handbook of Structural Equation Modeling, 1, 209–231.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Michigan State University, East Lansing, MI, USA

    Frederick T. L. Leong

  2. Stockton University, Galloway, NJ, USA

    Zornitsa Kalibatseva

  3. Michigan State University, East Lansing, MI, USA

    Ajay Somaraju

Authors
  1. Frederick T. L. Leong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zornitsa Kalibatseva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ajay Somaraju
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frederick T. L. Leong .

Editor information

Editors and Affiliations

  1. Department of Public Administration, Berlin School of Economics and Law, Berlin, Berlin, Germany

    Tobias Ringeisen

  2. Fakultät Wirtschafts- und Sozialwissenschaften, Hochschule Osnabrück, Osnabrück, Germany

    Petia Genkova

  3. Department of Psychology, Michigan State University, East Lansing, MI, USA

    Frederick T. L. Leong

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Leong, F.T.L., Kalibatseva, Z., Somaraju, A. (2020). Evaluating Measurement Equivalence in Cross-Cultural Stress Research. In: Ringeisen, T., Genkova, P., Leong, F. (eds) Handbuch Stress und Kultur. Springer, Wiesbaden. https://doi.org/10.1007/978-3-658-27825-0_13-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-658-27825-0_13-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Wiesbaden

  • Print ISBN: 978-3-658-27825-0

  • Online ISBN: 978-3-658-27825-0

  • eBook Packages: Springer Referenz Psychologie

Publish with us

Policies and ethics

Search

Navigation