Abstract
Survey research with diverse cultural and ethnic minority groups is a complex and challenging endeavor that confronts the researcher with problems related to linguistic and conceptual equivalence and measurement as well as problems related to difficulties that respondents have with the sociocultural dimensions of the survey/interview process. One way to improve the quality of cross-cultural surveys and to insure that the findings are culturally relevant and accurate is to combine qualitative and quantitative methods. This paper proposes that certain qualitative techniques from cognitive science, specifically cognitive anthropology and cognitive psychology, are particularly well suited to being combined with survey research. These techniques provide information corresponding to the underlying thought processes of respondents and enable researchers to better understand how different cultural and ethnic groups construe the world. The information obtained can be used improve the formulation of survey questions, design and structure questionnaire formats to coincide with the way particular groups organize concepts, and help researchers understand difficulties respondents may have with the survey/interview process. In addition, the techniques produce data that are easily codifiable and more manageable than traditional qualitative techniques including participant observation and in-depth interviews.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Abelson, R. (1981). Psychological status of the script concept.American Psychologist, 36, 715–729.
Bacerra, R. M., & Zambrana, R. E. (1985). Methodological approaches to research on Hispanics.Social Work Research and Abstracts, pp. 42–49.
Bernard, H. R. (1988).Research methods in cultural anthropology. Beverly Hills, CA: Sage.
Blumer, H. (1979). Methodological principles of empirical science. In N. K. Denzin (Ed.),Sociological methods: A sourcebook. New York: McGraw-Hill.
Bowman, P. J. (1983). Significant involvement and functional relevance: Challenges to survey research.Social Work Research and Abstracts, pp. 21–26.
Bradburn, N. M., Rips, L. J., & Shevell, S. K. (1987). Answering autobiographical questions: the impact of memory and inference on surveys.Science, 236, 157.
Brislin, R. W., Lonner, W. J., & Thorndike, R. M. (1973).Cross-cultural research methods. New York: Wiley.
Brislin, R. W. (1986). The wording and translation of research instruments. In W. J. Lonner & J. W. Berry (Eds.),Field methods in cross-cultural research. Beverly Hills: Sage.
Carroll, W. K., & Irvine, S. H. (1980). Testing and assessment across cultures: Issues in methodology and theory. In H. C. Triandis & J. W. Berry (Eds.),Handbook of cross-cultural psychology: Vol. 2, Methodology (pp. 181–244). Boston: Allyn & Bacon.
Cook, T. D., & Reichardt, C. S. (Eds.). (1979).Qualitative and quantitative methods in evaluation research. Beverly Hills: Sage.
Deutcher, I. (1973). Asking questions: Linguistic comparability. In D. Warwick & S. Osherson (Eds.),Comparative research methods (pp. 163–186). Englewood Cliffs, NJ: Prentice Hall.
DeVos, G. (1973).Socialization for achievement. Berkeley: University of California Press.
Ericcson, K. A., & Simon, H. A., (1984).Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
Filstead, W. J. (1979). Qualitative methods: A needed perspective in evaluation research. In T. D. Cook & C. S. Reichardt (Eds.),Qualitative and quantitative methods in evaluation research. Beverly Hills: Sage.
Garro, L. C. (1986). Intracultural variation in folk medicine knowledge: A comparison between curers and noncurers.American Anthropologist, 88, 351–370.
Gilbert, M. J. (1993). Ethnographic research strategies in the cross-cultural substance use and abuse field. In J. E. Trimble, C. S. Bolek, & S. Niemcryk (Eds.),Conducting cross-cultural substance abuse research: Emerging strategies and methods. Newbury Park, CA: Sage.
Glaser, B. G., & Strauss, A. L. (1967).Discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine.
Goodenough, W. (1980). Ethnographic field techniques. In H. Triandis et al. (Eds.),Handbook of cross-cultural psychology (Vol. 6). Boston: Allyn & Bacon.
Hines, A. M., & Snowden, L. R. (1993). Survey and interviewing procedures: cross-cultural validity and the use of protocol analysis. In J. E. Trimble, C. S. Bolek, & S. Niemcryk (Eds.),Conducting cross-cultural substance abuse research: Emerging strategies and methods. Newbury Park, CA: Sage.
Hurh, W. M., & Kim, K. C. (1981). Methodological problems in cross-cultural research: A Korean study in the United States.California Sociol., 4, 17–33.
Iani, F. A., & Orr, M. T. (1979). Rapprochement of quantitative and qualitative approaches. In T. D. Cook & C. S. Reichardt (Eds.),Qualitative and quantitative methods in evaluation research (pp. 87–97). Beverly Hills: Sage.
Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. (Eds.). (1984).Cognitive aspects of survey methodology: Building a bridge between disciplines, Washington, DC: National Academy Press.
Jick, T. B. (1979). Mixing qualitative and quantitative methods: Triangulation in action. In J. Van Maanen (Ed.),Qualitative methodology (pp. 135–148). Beverly Hills: Sage.
Kinzie, D., Kinzie, J. D., Mason, S. M., Vinh, D. T., Tolan, N. T., Ahn, B., & Pho, T. N. (1982). Development and validation of a Vietnamese language depression rating scale.American Journal of Psychiatry, 139, 1276–1281.
Kleinman, A., & Good, B. (Eds.) (1985).Culture and depression. Berkeley, CA: University of California Press.
Knapp, M. S. (1979). Basic elements of ethnographic research. In T. D. Cook & C. S. Reichardt (Eds.),Qualitative and quantitative methods in evaluation research. Beverly Hills: Sage.
Lessler, J. T., & Sirken, M. G. (1985). Laboratory-based research on the cognitive aspects of survey methodology: the tools and methods of the National Center for Health Statistics study.Milbank Memorial Fund Quarterly, 63, 565–581.
Lessler. J. T., Tourangeau, R., & Salter, W. (1989). Questionnaire design in the cognitive research laboratory: Results of an experimental prototype.National Center for Health Statistics. Vital Health Statistics, Vol. 6. Washington, DC: U.S. Government Printing Office.
Liu, W. (1982).Methodological problems in minority research. Chicago: PAAMHRC.
Lofland, J. (1971).Analyzing social settings. Belmont, CA: Wadsworth.
Loftus, E. F., Feinberg, S. E., & Tanur, J. M. (1985). Cognitive psychology meets the national survey.American Psychologist, 40, 175–180.
Loo, C. (1980). Community research among Asian-Americans: Problematic issues and resolutions. In A. K. Murata & J. Salvador-Burris (Eds.),Issues in community research: Asian-American perspectives. Chicago: PAAMHRC.
Marsella, A. J., Kinzie, D., & Gordon, P. et al. (1973). Ethnocultural variations in expression of depression.Journal of Cross-Cultural Psychology, 4, 435–458.
Marsella, A. J., Hirschfield, R. M., & Katz, M. (Eds.) (1987).Measurement of depression. New York: Guilford.
McClintock, C. C., Brannon, D., & Maynard-Moody, S. (1983). Applying the logic of sample surveys to qualitative case studies: The case cluster method. In J. Van Maanen,Qualitative methodology. Beverly Hills: Sage.
Mechanic, D. (1989). Medical sociology: Some tensions among theory, method, and substance.Journal of Health and Social Behavior, 30, 147–160.
Midanik, L. T. (1989).The use of protocol analysis in alcohol research. Paper presented at the 15th Annual Alcohol Epidemiology Symposium, the Kettil Bruun Society for Social and Epidemiological Research on Alcohol, Maastricht, the Netherlands.
Midanik, L. T., & Hines, A. M. (1991). “Unstandard” ways of answering standard questions: protocol analysis in alcohol survey research.Drug and Alcohol Dependence, 27, 245–252.
Miles, M. B., & Huberman, A. M. (1984).Qualitative data analysis. Beverly Hills: Sage.
Myers, V. (1977). Toward a synthesis of ethnographic and survey methods.Human Organization, 36, 244–251.
Myers, V. (1979). Survey methods and socially distant respondents.Social Work Research and Abstracts, pp. 3–9.
Patton, M. Q. (1980).Qualitative evaluation methods. Beverly Hills: Sage.
Payne, J. W., Braustein, M. L., & Carroll, S. S. (1978). Exploring predecisional behavior: an alternative to decision research.Organizational Behavior, 22, 17–44.
Rumelhart, D., & Ortony, A. (1977). The representation of knowledge in memory. In R. Spiro & W. Montague (Eds.),Schooling and the acquisition of knowledge. Hillsdale, NJ: Erlbaum.
Schuman, H. (1973). Random probe: A technique for evaluating the validity of closed questions. In D. P. Warwick & S. Osherson (Eds.),Comparative research methods. Englewood Cliffs, NJ: Prentice Hall.
Sieber, S. D. (1973). The integration of fieldwork and survey methods.American Journal of Sociology, 78, 1335–1359.
Sirken, M. G., Mingay, D. J., Royston, P. N., Bercini, D. H., & Jobe, J. B. (1986).Interdisciplinary research in cognition and survey measurement. Questionnaire Design Research Laboratory. Hyattsville, MD: National Center for Health Statistics.
Strauss, A. L. (1987).Qualitative analysis for social scientists. Cambridge: Cambridge University Press.
Trend, M. G. (1978). On the reconciliation of qualitative and quantitative analyses: A case study.Human Organization, 37, 345–354.
Trotter, R. T. (1993). Ethnography: Preparation for fieldwork. In J. E. Trimble, C. S. Bole, & S. Niemcryk (Eds.),Conducting cross-cultural substance abuse research: Emerging strategies and methods. Newbury Park, CA: Sage.
Trow, M. (1957). Comment on participant observation and interviewing: A comparison. In W. J. Filstead (Ed.),Qualitative methodology. Chicago: Markham.
Van Maanen, J. (Ed.). (1983).Qualitative methodology. Beverly Hills: Sage.
Warwick, D. P. (1973). Survey research and participant observation. In D. P. Warwick & S. Osherson (Eds.),Comparative research methods. Englewood Cliffs, NJ: Prentice Hall.
Weller, S. (1984). Cross-cultural concepts of illness: Variation and validation.American Anthropologist, 86, 341–351.
Weller, S., & Romney, A. (1988).Systematic data collection. Beverly Hills: Sage.
Weller, S., & Romney, A. (1990).Metric scaling: Correspondence analysis. Newbury Park, CA: Sage.
Yu, E. (1982). Problems in Pacific/Asian American community research. In W. Liu (Ed.),Methodological problems in minority research. Chicago: PAAMHRC.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hines, A.M. Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science. Am J Commun Psychol 21, 729–746 (1993). https://doi.org/10.1007/BF00942245
Issue Date:
DOI: https://doi.org/10.1007/BF00942245