Abstract
This study provided the first examination of the psychometric properties of the 6-item Daily Spiritual Experiences Scale (DSES) in a large African American sample, the Jackson Heart Study (JHS). The JHS included measures of spiritual (DSES) and religious practices. Internal reliability, dimensionality, fit indices, and correlation were assessed. DSES scores reflected frequent daily spiritual experiences (12.84 ± 4.72) and reliability scores were high (α = 0.85; 95% CI 0.84–0.86). The DSES loaded on a single factor, with significant goodness-of-fit scores (RMSEA = 0.094, P < 0.01). Moderate significant correlations were noted among DSES items. Our findings confirm that the 6-item DSES had excellent psychometric properties in this sample.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Health disparities among African Americans have been well-documented (U.S. Department of Health and Human Services 2009). Identifying and examining factors that may aid in reducing or eliminating disparities is a national priority (U.S. Department of Health and Human Services 2000). Spirituality and religion are hypothesized as buffers for negative health outcomes, particularly among African Americans. Higher levels of spirituality and religion have been associated with numerous positive physiologic, psychosocial, and mental health outcomes, and have been conceptualized to have protective properties among their attributes (Koenig et al. 2001; Powell et al. 2003). The lack of a standard for assessing spirituality and religion has been a limitation of this work. For many studies, spirituality and religion have not been conceptually differentiated (Koenig et al. 2001). Conceptually grounded and psychometrically sound measures are needed to advance our understanding of how these factors influence health outcomes, particularly among high-risk populations including African Americans (Hill and Pargament 2003). Spiritual and religious influences are hypothesized to differentially affect health outcomes in this group (Levin et al. 2005; Lincoln and Mamiya 1990; Livingston et al. 1991; Lewis and Taylor 2009) further substantiating the need for well-validated instruments.
The Daily Spiritual Experiences Scale (DSES), a 16-item measure of ordinary daily spiritual experiences, was developed by Underwood as part of a multidimensional measure of spirituality and religion (Fetzer Institute 1999). A shortened 6-item version was developed for use in the General Social Survey (1998, 2004). Both versions of the DSES have shown promising results in psychometric testing with predominantly white populations (Ellison and Fan 2008; Maselko and Kubzansky 2006; Underwood and Teresi 2002).
DSES Cronbach’s alpha (α) levels have been high, ranging from 0.94 to 0.96 for the total scale (Ellison and Fan 2008; Underwood and Teresi 2002). Specifically theistic and non-theistic items included in both versions have led some researchers to separate the DSES into two subscales. High Cronbach’s α have been found for the theistic and non-theistic items within both the 6- and 16-item scales (0.95, 0.90, respectively) (Ellison and Fan 2008). Factor analyses using the 16-item scale demonstrated a single factor structure—spirituality (Ellison and Fan 2008; Underwood and Teresi 2002), confirming the original intent of the instrument (Underwood 2008). Some sex and racial differences have been noted. Loustalot et al. (2006) demonstrated a similar single-factor structure and adequate content and construct validity, stability, internal consistency, and equivalence of the 6- and 16-item versions over time with a small African American sample. Researchers have noted more frequent DSES among African Americans compared to other racial/ethnic groups in small samples (McCauley et al. 2008). Additional evaluation is needed in larger African American populations to further ground this instrument and identify discernable trends among subpopulations.
The Jackson Heart Study (JHS), a cohort study of the risk factors and causes of cardiovascular disease in a large, all-African American population provided a unique opportunity to examine the psychometric properties of the DSES and associated measures of religion and religious coping. This paper reports the reliability, confirms the dimensions, and assesses the discriminant validity of the DSES in the JHS cohort.
Methods
The JHS is an all-African American, single-site prospective, longitudinal cohort study of cardiovascular disease conducted in 5,302 community-dwelling men and women residing in the Jackson, Mississippi Metropolitan Statistical Area. Participant recruitment and baseline examination were completed between September 2000 and March 2004 (Taylor et al. 2005; Fuqua et al. 2005). The study was approved by the Institutional Review Boards of the participating institutions: the University of Mississippi Medical Center, Jackson State University, and Tougaloo College. All participants provided informed consent.
Details of the study design and data collection have been reported elsewhere (Taylor et al. 2005; Payne et al. 2005; Carpenter et al. 2004). The religious and spiritual questionnaires of the JHS were provided to the participants at the conclusion of the home induction interview as part of a larger, self-administered questionnaire. The measures consisted of six spiritual items, which comprised the DSES, and three individual religious items [organized religion (OR), non-organized religion (NOR), and religious coping (RC)]. Trained interviewers instructed participants to answer the questions at their leisure, and return the completed booklet to the JHS Exam Center on or near the time of the initial clinic exam. Data were transferred from the paper forms into the JHS Clintrial® data management system by trained staff; a double data entry procedure assured quality control. All participants who returned the completed religious and spiritual measures were included in the data analysis (n = 3,985), and those included in this study had comparable demographic characteristics to the overall JHS population (Fuqua et al. 2005).
Measurement of Spiritual Experiences
Spiritual experiences were measured using the DSES. The DSES has been described as a measure of ‘mundane’ or ordinary daily spiritual experiences defined as the “…individual’s perception of the transcendent (God, the divine) in daily life and the perception of interaction with, or involvement of, the transcendent in daily life” (Fetzer Institute 1999, p. 11). The goal was to assess “the experiential and emotional…feelings and sensations [of daily life]…rather than cognitive awareness of specific beliefs” (Underwood 2006, p. 186). Underwood and Teresi (2002) and Underwood (2006) developed specific items from findings of detailed qualitative research. An introductory statement endorsed consideration of either God or another appropriate indication of the holy or divine in keeping with the participant’s belief system.
The JHS used the 6-item version of the DSES (Table 1). Participants were requested to indicate how often they experienced each item using a 6-point Likert-type scale (1 = many times a day, 2 = every day, 3 = most days, 4 = some days, 5 = once in a while, 6 = never). A total DSES score was calculated by adding individual item responses with a possible range of 6–36. Total DSES scores were further categorized into tertiles based on the distribution of responses [high (6–10), medium (11–14), and low (15–36)]. A total theistic DSES score was calculated by adding individual item responses for the three theistic items (feel God’s presence, desire closer union with God, feel God’s love) with a range of 3–18. Similarly, a total non-theistic DSES score was calculated by adding the non-theistic items (feel strength, feel deep inner peace, spiritually touched by creation). Lower scores on the total, theistic, and non-theistic DSES represented more reported daily spiritual experiences.
Measurement of Religious Practices
Organizational and Non-Organizational Religion
Two measures were included to assess religious practices within or emanating from a formal religious setting (church, mosque, synagogue, or temple) (OR), and those more private activities that occur outside the confines of that organization (NOR). These items were selected from the Fetzer Multidimensional Measurement of Religiousness/Spirituality compilation of instruments assessing religious and spiritual constructs (Fetzer Institute 1999). Limited information on their psychometric properties is available, however, these items have been used extensively in previous research to assess OR and NOR (Hill and Hood 1999; Koenig et al. 2001). Church-related activity or OR (Koenig et al. 2001), was assessed by the statement: “In general, how often do you attend the main worship service of your church or otherwise participate in organizational religion (such as watching services on TV, listening to services on the radio, participating in Bible study groups, etc.)?” Respondents were requested to indicate the extent of this practice with a 6-point Likert-type scale, which was later subdivided into 3 categories: (1) high (1 = nearly every day, 2 = at least once a week), (2) medium (3 = a few times a month, 4 = a few times a year), and (3) low (5 = less than once a year, 6 = not at all). Private religious practices or NOR (Koenig et al. 2001; Plante and Sherman 2001), were assessed by the statement: “Within your religious or spiritual tradition, how often do you pray privately or meditate in places other than at church, mosque, temple, or synagogue?” Respondents were requested to indicate the extent of this practice with a 8-point Likert-type scale, which was later subdivided into 3 categories: (1) high (1 = more than once a day, 2 = once a day), (2) medium (3 = a few times a week, 4 = once a week, 5 = a few times a month), and (3) low (6 = once a month, 7 = less than once a month, 8 = never).
Religious Coping
Religious coping, the use of religious beliefs or practices in adapting to difficult life situations and stressful events (Koenig et al. 2001), was assessed by the item: “To what extent is your religion or spiritual tradition involved in understanding or dealing with stressful situations in any way?” The item was adapted from the RCOPE (i.e., religious coping) instrument developed by Pargament et al. (2000). The complete RCOPE contained an extensive list of positive and negative religious coping practices, with acceptable psychometric properties (α > 0.80) (Pargament et al. 2000). In the JHS, a single item from the RCOPE was used based on content and face validity, and consideration of participant burden. Respondents were requested to indicate the extent of this practice with a 4-point Likert-type scale, which was later subdivided into 3 categories: (1) high (1 = very involved), (2) medium (2 = somewhat involved), and (3) low (3 = not very involved, 4 = not involved at all).
Data Analysis
Data were analyzed using the Statistical Package for the Social Sciences (SPSS) version 15 (Statistical Package for the Social Sciences 2006). Participant characteristics, religious practices, and spiritual experiences were described using means and percentages. Associations among demographic characteristics (age, sex) and outcome measures were determined using Chi-square (χ2). Cronbach’s α coefficients were used to assess internal reliability, the extent to which the construct was accurately measured, first with the DSES alone and then including all the religious measures to determine reliability and correlation. Maximum likelihood factor analysis (MLFA), a method similar to confirmatory factor analysis, was conducted on the 6-item DSES and other religious measures to present a confirmatory factor model for the entire measure. The three religious variables (OR, NOR, RC) were secondarily added to the factor model. A supplemental analysis was conducted using exploratory principal components analysis (PCA) with a varimax rotation with the entire factor model to determine fit and to establish the factors produced in the MLFA (data not shown). Fit indices, including Chi-square significance tests and Root Mean Square Error of Approximation (RMSEA) were explored with the DSES and religious measures. Lastly, the discriminant validity, or degree of correlation among the items, of the DSES was assessed with Pearson’s correlations.
Results
Table 1 depicts the sample characteristics and distribution of religious practices and spiritual experiences by age and sex. The mean age of the sample was 54.37 ± 12.57 and 64.0% were women (n = 3,985), which is reflective of the overall JHS cohort (Fuqua et al. 2005). Spiritual experiences and religious practices were high for men and women and all age ranges (P < 0.01). Increasing age and female sex were associated with more participation in DSES, OR, NOR, and RC (P < 0.01).
Individual item, subscale, and total mean DSES scores were reported by age and sex in Table 2. For individual items, the theistic item 4 (“I desire to be closer to or in union with God”) had the lowest mean score (1.86 ± 0.84) while the non-theistic item 3 (“I feel deep inner peace and harmony”) had the highest (2.60 ± 1.13). Women and older participants reported lower DSES theistic scores compared to non-theistic scores (data not shown). The total mean DSES score was low, reflecting more frequent DSES, and was lower for women than men.
Table 3 depicts findings from analyses of internal reliability. Cronbach’s α was high for all DSES items (α = 0.85; 95% CI 0.84–0.86) and acceptable (Nelson et al. 2001) for the theistic (α = 0.73) and non-theistic (α = 0.76) items. Alpha levels and correlations among variables were relativity low among other religious and spiritual measures. However, the correlations between religious and spiritual variables consistently reached statistical significance (P < 0.01).
The 6-item DSES loaded on one factor (daily spirituality) with scores ranging from 0.620 to 0.817 (Table 4). After OR, NOR, and RC were added to the factor model, a second factor (religiosity) loaded (0.150–0.474) (Table 5). Supplemental PCA with varimax rotation further segregated the two factors with OR, NOR, and RC loading consistently on the second religiosity factor (data not shown).
Table 6 depicts the goodness-of-fit indices for the JHS religious practices and spiritual experiences measures. The highly significant Chi-square (χ2 = 300.431, P < 0.01) and RMSEA (0.094) of the DSES denoted a good fit among the 6-items. The Chi-square remained statistically significant with the inclusion of all religious and spiritual variables (χ2 = 448.672, P < 0.01), while the RMSEA was lower (0.079).
Table 7 depicts the discriminant validity among the DSES items using Pearson’s correlations. While each of the six items in the DSES was statistically significant (P < 0.01), they maintained only moderately strong correlations (0.376–0.624).
Discussion
This study was the first to explore the psychometric properties of the DSES and associated measures of OR, NOR, and RC in a large all-African American sample. Findings among JHS African Americans are comparable to those in other ethnic groups and provide evidence that the DSES and other measures of religion are reliable and valid for use in this population.
African Americans have traditionally reported high levels of religious practices and spiritual experience (Taylor et al. 2007; McCauley et al. 2008). Our study substantiated these findings for adult men and women across all ages. As noted in prior research (McCauley et al. 2008; Taylor et al. 2004; Underwood and Teresi 2002), women and older participants reported significantly higher levels of religious participation and spiritual experience. Nearly all JHS participants attended religious services at least weekly, participated in prayer or meditation once or more a day, and reported high involvement of religion in coping with daily stressors. The mean DSES score (12.84 ± 4.72) in JHS was slightly higher than our preliminary work in a similar population (11.30 ± 3.43) (Loustalot et al. 2006) but lower (indicating more frequent DSES) than reported among African American participants in the General Social Survey 1997–1998 (14.93 ± 6.37) (Underwood and Teresi 2002). As anticipated, DSES scores for JHS participants were much lower than reported in previous assessments among whites (19.28 ± 7.91) (Underwood and Teresi 2002). The JHS was conducted in a geographic region characterized as the “Bible belt” where higher participation in religious practices and spiritual experiences compared with the rest of the US has been reported (Gallup and Lindsay 1999).
The reliability levels in the 6-item DSES were comparable to those reported in previous research in African Americans (Loustalot et al. 2006) and predominantly white populations (Davis et al. 2004, [General Social Survey], α = 0.91). Fit indices noted the goodness of fit among the DSES items. As expected, there was some degree of correlation among the DSES items. The degree of correlation was moderate ranging from 0.376 to 0.624 and was lower than the consistent 0.60–0.80 range reported with the 16-item DSES (Underwood and Teresi 2002). Higher correlations would indicate items measuring the same concept, and would therefore be redundant.
The 6-item DSES loaded on a single factor (daily spirituality) in the JHS, and previous research support these findings (Ellison and Fan 2008; Mofidi et al. 2006). Underwood and Teresi (2002) has reported a second factor loading on the 16-item DSES in previous research, but only two items loaded on the separate factor and the majority of the factor analyses “tended to be unidimensional” (p. 28). Subdividing the DSES into theistic and non-theistic subscales did not alter the factor analysis results, and the subscales maintained a high degree of correlation. Previous research has noted differing relationships with the theistic and non-theistic subscales. Ellison and Fan (2008) noted that the non-theistic subscale of the DSES was a better predictor of psychological well-being (e.g., happiness, excitement with life, self-esteem, and optimism), than was the non-theistic subscale. Underwood (2008) continues to recommend the use of the original 16-item DSES, and utilizing these theistic and non-theistic subscales for supplemental analyses may be beneficial for future research to assess unique influences within the DSES.
The addition of OR, NOR, and RC used in the JHS produced a second factor (religiosity), reflecting the conceptual separation of the religious and spiritual measures. Most JHS participants reported high levels of religious participation, in addition to high levels of spiritual practice. Principal components analysis with a varimax rotation provided further confirmation that the variables loaded on two separate factors. These findings support the use of separate religious and spiritual instruments in future research, as the health-protective properties of the constructs may differ.
This study was not without limitations. The JHS is a single-site study located in a southeastern metropolitan area and our promising findings cannot be generalized to African Americans in other regions of the country. Religious practices and spiritual experiences tend to be higher in the southern US, and that phenomenon was reflected in this study. The limited variability of the religious and spiritual responses also presented a limited distribution for comparison analyses. Final limitations were the usual biases introduced by self-report and cross-sectional data as well as the proportion of the JHS participants who did not return the completed instruments measuring spiritual experiences and religious practices and participation to the JHS clinic. While these participants had a similar demographic profile to those who completed the questionnaire, their responses may have altered the results. Despite these limitations, this psychometric assessment of the DSES within a large, all-African American cohort provided substantial confirmation for its use within this population and sets the stage for much-needed longitudinal research (Ellison and Fan 2008; Mofidi et al. 2006; Sims et al. 2009) within this and other African American cohorts.
This study furthers the growing body of literature supporting the use of the DSES in numerous populations and provides important evidence that measures of religion and spirituality, often referred to as interchangeable concepts, are clearly demarcated by the JHS measures. To understand how religion and spirituality influence health outcomes, studies such as these are necessary to ground the field in psychometrically sound assessment tools.
References
Carpenter, M., Crow, R., Steffes, M., Rock, W., Heilbraun, J., Evans, G., et al. (2004). Laboratory, reading center, and coordinating center data management methods in the Jackson Heart Study. American Journal of Medical Sciences, 328(3), 131–144.
Davis, J., Smith, T., & Marsden, P. (2004). General social surveys: Cumulative codebook, 1972–2004. Chicago: National Opinion Research Center.
Ellison, C., & Fan, D. (2008). Daily spiritual experiences and psychological well-being among US adults. Social Indicators Research, 88(2), 247–271.
Fuqua, S., Wyatt, S., Andrew, M., Sarpong, D., Henderson, F., Cunningham, M., et al. (2005). Recruiting African-American research participation in the Jackson Heart Study: Methods, response rates, and sample description. Ethnicity & Disease, 15(6), S6-18–S16-29.
Gallup, G., & Lindsay, D. (1999). Surveying the religious landscape: Trends in US beliefs. Harrisburg: Morehouse.
Hill, P., & Hood, R. (1999). Measures of religiosity. Birmingham, AL: Religious Education Press.
Hill, P., & Pargament, K. (2003). Advances in the conceptualization and measurement of religion and spirituality. American Psychologist, 58(1), 64–74.
Institute, Fetzer. (1999). Multidimensional measurement of religiousness/spirituality for use in health research. Kalamazoo: John E. Fetzer Institute.
Koenig, H., McCullough, M., & Larson, D. (2001). Handbook of religion and health. New York: Oxford University Press.
Levin, J., Chatters, L., & Taylor, R. (2005). Religion, health, and medicine in African Americans: Implications for physicians. Journal of the National Medical Association, 97(2), 237–249.
Lewis, R., & Taylor, J. (2009). The social significance of religious resources in the prediction of mattering to others: African Americans and white contrasts. Sociological Spectrum, 29, 273–294.
Lincoln, C., & Mamiya, L. (1990). The black church in the African American experience. Durham, NC: Duke University Press.
Livingston, I., Levine, D., & Moore, R. (1991). Social integration and black interracial variation in blood pressure. Ethnicity & Disease, 1, 135–149.
Loustalot, F., Wyatt, S., Boss, B., May, W., & McDyess, T. (2006). Psychometric examination of the Daily Spiritual Experiences Scale. Journal of Cultural Diversity, 13(3), 162–167.
Maselko, J., & Kubzansky, L. (2006). Gender differences in religious practices, spiritual experiences and health: Results from the US General Social Survey. Social Science and Medicine, 62(11), 2848–2960.
McCauley, J., Tarpley, M., Haaz, S., & Bartlett, S. (2008). Daily spiritual experiences of older adults with and without arthritis and the relationship to health outcomes. Arthritis and Rheumatism, 59(1), 122–128.
Mofidi, M., DeVellis, R., Blazer, D., DeVellis, B., Panter, A., & Jordan, J. (2006). Spirituality and depressive symptoms in a racially diverse US sample of community-dwelling adults. Journal of Nervous and Mental Disease, 194(12), 975–977.
Nelson, D., Holtzman, D., Bolen, J., Stanwyck, C., & Mack, K. (2001). Reliability and validity of measures from the Behavioral Risk Factor Surveillance System (BRFSS). Social and Preventive Medicine, 46(Suppl 1), S03–S42.
Pargament, K., Koenig, H., & Perez, L. (2000). The many methods of religious coping: Developing and initial validation of the RCOPE. Journal of Clinical Psychology, 56(4), 519–543.
Payne, T., Wyatt, S., Mosley, T., Dubbert, P., Guiterrez-Mohammed, M., Calvin, R., et al. (2005). Sociocultural methods in the Jackson Heart Study: Conceptual and descriptive overview. Ethnicity and Disease, 15(Suppl 6), S38–S48.
Plante, T., & Sherman, A. (2001). Faith and health: Psychological perspectives. New York: Guilford Press.
Powell, L., Shahabi, L., & Thoresen, C. (2003). Religion and spirituality: Linkages to physical health. American Psychologist, 58(1), 36–52.
Sims, M., Wyatt, S. B., Guitierrez, M. L., Taylor, H. A., & Williams, D. R. (2009). Development and psychometric testing of a multi-dimensional instrument of perceived discrimination in the Jackson Heart Study. Ethnicity and Disease, 19, 56–64.
Statistical Package for the Social Sciences. (2006). SPSS base (15th ed.). Chicago: SPSS, Inc.
Taylor, R., Chatters, L., & Jackson, J. (2004). Religion in the lives of African Americans. Thousand Oaks, CA: Sage.
Taylor, R., Chatters, L., & Jackson, J. (2007). Religious and spiritual involvement among older African Americans, Caribbean blacks, and non-Hispanic whites: Findings from the National Survey of American Life. Journal of Gerontology, 62B(4), S238–S250.
Taylor, H., Wilson, J., Jones, D., Sarpong, D., Srinivasan, A., Garrison, R., et al. (2005). Toward resolution of cardiovascular disparities in African Americans: Design and methods of the Jackson Heart Study. Ethnicity and Disease, 15(Suppl 6), S4–S17.
Underwood, L. (2006). Ordinary spiritual experience: Qualitative research, interpretive guidelines, and population distribution for the daily spiritual experience scale. Archive for the Psychology of Religion, 28, 181–218.
Underwood, L. (2008). Measuring spirituality. Journal of Nervous and Mental Disease, 196(9), 715–716.
Underwood, L., & Teresi, J. (2002). The Daily Spiritual Experience Scale: Development, theoretical description, reliability, exploratory factor analysis, and preliminary construct validity using health related data. Annals of Behavioral Medicine, 24(1), 22–33.
United States Department of Health and Human Services. (2000). Healthy People 2010: With understanding and improving health and objectives for improving health (2nd ed.). Washington, DC: U.S. Government Printing Office.
United States Department of Health and Human Services. (2009). Health disparities: A case for closing the gap. Washington, DC. Accessed June 12, 2009 http://www.healthreform.gov/reports/healthdisparities/index.html.
Acknowledgments
This research was supported by NIH contracts N01-HC-95170, N01-HC-95171, and N01-HC-95172 that were provided for the Jackson Heart Study by the National Heart, Lung, and Blood Institute and the National Center for Minority Health and Health Disparities, and an Ambassadorial Scholarship from Rotary International.
Author information
Authors and Affiliations
Corresponding author
Additional information
An erratum to this article can be found at http://dx.doi.org/10.1007/s10943-009-9289-z
Rights and permissions
About this article
Cite this article
Loustalot, F., Wyatt, S.B., Sims, M. et al. Psychometric Testing of the Daily Spiritual Experiences Scale Among African Americans in the Jackson Heart Study. J Relig Health 50, 675–685 (2011). https://doi.org/10.1007/s10943-009-9278-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10943-009-9278-2