Abstract
This study reports on the development and initial psychometric properties of the Children’s Saving Inventory (CSI), a parent-rated measure designed to assess child hoarding behaviors. Subjects included 123 children and adolescents diagnosed with primary Obsessive–Compulsive Disorder (OCD) and their parents. Trained clinicians administered the Children’s Yale-Brown Obsessive–Compulsive Scale (CY-BOCS), items assessing Family Accommodation and the Clinical Global Impressions—Severity index. Parents completed the CSI, Child Obsessive–Compulsive Impact Scale (COIS)—Parent Version and Child Behavior Checklist. Youth completed the COIS—Child Version, Obsessive–Compulsive Inventory Child Version (OCI-CV), Multidimensional Anxiety Scale for Children, and Children’s Depression Inventory—Short Form. A four factor solution was identified; factors were named Discarding, Clutter, Acquisition, and Distress/Impairment. Internal consistency for the CSI Total and factor scores were good. One-week test–retest reliability (n = 31) from a random subsample was excellent. Known groups validity was supported vis-à-vis higher CSI scores for those endorsing hoarding on the CY-BOCS Symptom Checklist. Convergent and discriminant validity was evidenced by weak relationships with OCI-CV Checking and Contamination factors but strong relationships with the OCI-CV Hoarding factor and with hoarding obsession/compulsions on the CY-BOCS. These findings provide initial support for the reliability and validity of the CSI for the assessment of hoarding behaviors among youth with OCD. Future studies are needed to extend these findings to non-OCD samples of youth.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Hoarding, among both adults and children, is characterized by the excessive and active acquisition of possessions, failure to discard possessions when appropriate, and associated impairment and distress [1, 2]. Considerable debate exists regarding its diagnostic classification; to date, hoarding is included within obsessive–compulsive disorder (OCD), although it is widely recognized that pathological hoarding can exist separate from the disorder [3, 4]. Although hoarding in adults has received increased scholarly attention in recent years [5, 6], there is very little available data on hoarding behaviors in children and adolescents. Yet, as many as 80% of individuals with hoarding experience symptom onset before the age of 18 years [7]. Additionally, youth and adults with OCD present with hoarding symptoms at similar rates [8, 9] with incidence of problematic hoarding among youth with OCD ranging from 26 to 42% [9–11] and as high as 58% in other non-OCD clinical populations (e.g., Prader-Willi Syndrome; [12, 13]).
One of the primary issues limiting investigation into hoarding among youth is the absence of a psychometrically sound instrument that can measure the multiple domains of hoarding in a developmentally sensitive manner. To date, hoarding has been assessed with two items on the Children’s Yale-Brown Obsessive–Compulsive Scale Symptom Checklist that query the presence/absence of hoarding obsessions/compulsions [CY-BOCS; [14] or through several items on child-report and parent-report questionnaires of obsessive–compulsive symptoms that query the degree to which items are acquired and collected in an excessive fashion (e.g., Children’s Obsessional Compulsive Inventory [CHOCI; [15]; Children’s Florida Obsessive–Compulsive Scale [C-FOCI; [16]; Obsessive Compulsive Inventory—Child Version [OCI-CV; [17]). The CY-BOCS items are limited in scope (i.e., do not assess clutter) and do not provide an index of hoarding severity as the CY-BOCS Severity Scale is rated based on all endorsed obsessive–compulsive symptoms. The child- and parent-report measures do not capture the range of hoarding behaviors (e.g., CHOCI, C-FOCI, OCI-CV) and the CHOCI and C-FOCI do not allow for calculation of a separate hoarding index. With this in mind, we developed a parent-rated index of hoarding behaviors in their child that was based on the Saving Inventory-Revised [SI-R; [18, 19].
The SI-R is a self-report questionnaire designed for adults that assesses three domains of hoarding, namely difficulty discarding (i.e., difficulty parting with unneeded items), compulsive acquisition (i.e., acquiring items that are not needed or have limited value), and clutter (i.e., clutter within the home). The current version, which is based on the Saving Inventory [19], consists of 23-items anchored on 0 to 4 scales. Widely used, the SI-R has excellent psychometric properties including strong internal consistency [α = .91–.94; [20]; convergent and divergent validity [20, 21]; known groups validity (i.e., hoarders scored higher than non-hoarders; [22]); and treatment sensitivity [23, 24].
This study reports on the development and preliminary evaluation of psychometric properties of the Children’s Saving Inventory (CSI) in a relatively large sample of youth with OCD. We chose to study the initial psychometric properties of the CSI in youth with OCD given the relatively high rates of hoarding symptoms in pediatric OCD patients [9–11] that would allow for increased variance in subject responses. As well, although hoarding may be removed from within OCD in the forthcoming version of the Diagnostic and Statistical Manual for Mental Disorders—Fifth Edition, this would not impinge on the utility of the CSI as the measure was designed to assess the child’s difficulty discarding, compulsive acquisition, and overall clutter independent of diagnostic status. On this note, there exists no measure of hoarding symptoms among youth at this time, which will be critical for assessing this construct should a separate ‘hoarding disorder’ be instituted in the Diagnostic and Statistical Manual for Mental Disorders—Fifth Edition. The following questions were addressed in this study: (1) What is the factor structure of the CSI? (2) What is the internal consistency of the CSI Total Score and resultant factors? (3) Are CSI scores stable over a one-week period? (4) Does the CSI correlate with other measures of hoarding symptoms, OCD severity, and OCD-related impairment? (5) Is the CSI more strongly associated with child-rated hoarding symptoms than other OCD symptom dimensions? (6) Is the CSI able to provide meaningful differentiation between subjects rated by the clinician as exhibiting hoarding symptoms versus those who are not?
Method
Participants and Procedures
Participants included 123 youth (ages 8–17 years) diagnosed with OCD and their parents who were seen in one of two OCD specialty clinical research centers for treatment planning evaluations between October 2007 and July 2009 (Universities of South Florida/Florida [n = 87] and Massachusetts General Hospital [n = 36]). All participants had a primary diagnosis of OCD according to the Diagnostic and Statistical Manual Fourth Edition Text Revision [25]. Diagnoses were made based on a semi-structured clinical interview by an experienced clinical psychologist or board certified child psychiatrist. In addition, diagnoses were confirmed in a subset of the sample (n = 95) by administration of a widely accepted structured diagnostic interview (i.e., Anxiety Disorders Interview Schedule for Children [26]; Kiddie-Schedule for Affective Disorders and Schizophrenia [27]) by a trained research assistant. The diagnostic measure was administered within ten days following the semi-structured clinical interview as part of the child’s involvement in research studies unrelated to the present investigation. Only youth for whom the OCD diagnosis was made with 100% certainty were included in this study. Status as a primary diagnosis was determined by assessing which illness was associated with the greatest level of impairment and distress per clinician judgment (which integrated parent and child-report, responses on clinical measures, and clinician impressions). Youth were excluded from participation if they had a diagnosis of psychosis, substance abuse, or bipolar disorder; a primary diagnosis other than OCD; or their parent/guardian was unable to provide appropriate consent for them due to cognitive functioning. Concurrent medication use was not exclusionary. Sample demographic and clinical characteristics did not differ across collection sites and are shown in Table 1. The majority of families were relatively affluent (46% reported a family income above $100,000; 16% reported an income of $76,000–100,000; 18% reported an income of $51,000–75,000, 20% reported an income of $26,000–50,000, and only 2% reported incomes of less than $25,000). Ten families declined reporting income. Forty-one percent of participants endorsed hoarding symptoms on the Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS).
Institutional ethics boards at the respective sites approved all data collection procedures. Approximately 90% of families who were approached about study involvement provided informed consent and assent for their participation (there were no site differences in participation rates). Participants completed an assessment that lasted approximately one hour in duration involving the CY-BOCS, CSI, items assessing family accommodation, and parent- and child-rated measures. Following the clinical interview, the CY-BOCS was completed; thereafter, the parent and child independently completed questionnaires. Training of study raters at both sites included didactics on the measure and common symptom presentations; observation of experienced clinicians administering the CY-BOCS; and administering the CY-BOCS under direct supervision. Inter-rater reliability calculated on a random subsample of youth at the Universities of South Florida/Florida was high (n = 31; r = .99; p < .001). Approximately one week later, a subsample of parents completed the CSI a second time. The one week interval was chosen as families were seeking treatment, which may have confounded later stability estimates.
Measures
Child Saving Inventory (CSI) Footnote 1
The CSI is the experimental measure under development in this study. At the time of administration, the CSI was a 23-item parent-rated scale with five ordinal response choices (None, A little/Minimal, Some/Moderate, Most/Much, Almost all/Completely). The CSI is based on the SI-R [19], a widely used adult self-report measure with well-established psychometric properties that are detailed above [20, 21]. Items from the SI-R were revised by several of the authors so that content would be applicable and appropriately worded for completion by parents of a child sample. Subsequently, an expert panel of clinical psychologists and psychiatrists with expertise in hoarding reviewed the items for initial content validity as well as for clarity. Revisions were made accordingly and items were re-screened by the panel for final review. Scale format and response choices were kept consistent with the SI-R. Higher scores suggest more hoarding behaviors.
Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS)
The CY-BOCS [14] is a clinician administered semi-structured interview and consists of a Symptom Checklist and Severity Scale. The parent and child were interviewed together. The Symptom Checklist measures the presence or absence of 54 OCD symptoms. Several studies have used the Symptom Checklist to derive measurements of symptom dimensions. Generally, the symptom dimensions of contamination/washing, symmetry/ordering, and hoarding were consistently found across studies. However, some studies found that the aggressive/checking and sexual/religious dimensions form a single factor [28, 29] whereas others found support for separate factors [30–32]. Given that the evidence reviewed in Mataix-Cols et al. [32] supports the validity of a five-factor model of symmetry/ordering, contamination/cleaning, sexual/religious obsessions, aggressive/checking, and hoarding, we chose to use the five-factor dimensional model of OCD for later analyses. Consistent with Storch et al. [33], the current presence of a primary symptom on the CY-BOCS Symptom Checklist was coded as 1; its absence was coded as 0. Scores on the five-factor analytically derived symptom dimensions (symmetry/ordering, contamination/cleaning, sexual/religious obsessions, aggressive/checking, and hoarding) were derived by summing the scores of the symptom categories for each dimension. The Severity Scale consists of 10-items that measure obsession and compulsion severity over the previous week on a five-point scale. Obsession and Compulsion Severity Scores are derived by summing the applicable five-items; a Total Score is derived by summing all ten items (higher scores suggest greater OCD severity). Ratings were made based on parent and child responses to items, together with clinical judgment and behavioral observations of any overt symptoms. Excellent psychometric properties and treatment sensitivity of the CY-BOCS have been shown [14, 34, 35]. Internal consistency for the Severity Scale in the present sample was α = .88.
Clinical Global Impression: Severity Scale (CGI)
The CGI [36, 37] is a clinician-rated, single-item global scale with scores ranging from 0 (“no illness”) to 6 (“serious illness”).
Child Obsessive Compulsive Impact Scale-Child and Parent Versions (COIS-C and COIS-P)
The COIS-C/P [38–40] are parallel child- or parent-rated questionnaires that assess OCD related impairment across four primary domains: school activities, social activities, daily living, and family activities over the previous month. Four questions assess global impairment related to school, social activities, going places, and home/family activities. The COIS-C/P has demonstrated adequate psychometric properties, such as high internal consistency, convergence with OCD symptom severity [38, 41]; test–retest stability [40]; and treatment sensitivity [42]. Internal consistency was strong for the present sample (α = .96 for both parent and child forms). Higher scores suggest elevated impairment.
Obsessive–Compulsive Inventory: Child Version (OCI-CV)
The OCI-CV [17] is a 21-item child self-report measure of obsessive–compulsive symptomology. Each item is rated on a 3-point scale that yields symptom severity scores across six factorially derived domains (e.g., Washing, Checking, Ordering, Obsessing, Hoarding, and Neutralizing). The OCI-CV is internally consistent (α > .81; α = .88 in the present sample) and shows strong test–retest reliability [17]. Higher scores suggest greater symptomology.
Family Accommodation (FA)
Family accommodation was assessed using the 13-items used by Calvocoressi et al. [43] to measure the degree to which family members have accommodated the child’s OCD symptoms during the previous month (9 items) and the level of distress/impairment that the respondent and child experience due to accommodating behaviors (4 items). The parent/primary caregiver was administered these items in this study. The FA items have demonstrated good psychometric properties, including adequate internal consistency, and positive correlations with symptom severity, family relationships, and caregiver distress [44]. Strong internal consistency (α = .92) was obtained in this study sample. Higher scores suggest increased family accommodation.
Children’s Depression Inventory: Short Form (CDI-S)
The CDI-S [45] is a 10-item child-report questionnaire that is derived from the full 27-item measure that assesses the presence and severity of cognitive, affective, or behavioral symptoms of depression (e.g., negative mood, anhedonia, poor self-esteem) experienced by the child over the previous two weeks. In addition to a large normative database [45], studies have supported the psychometric properties of the CDI/CDI-S documenting adequate internal consistency, test–retest reliability, construct validity [45, 46] and treatment sensitivity [47]. Our sample yielded good internal consistency (α = .83). Higher scores suggest more depressive symptomology.
Multidimensional Anxiety Scale for Children (MASC)
The MASC [48] is a 39-item youth-completed questionnaire that assesses a range of anxiety symptoms (e.g., Physical Symptoms, Social Anxiety Scale, Harm Avoidance, Separation/Panic Scale). Each item is answered on a 4-point scale (0 = never true about me, 1 = rarely true about me, 2 = sometimes true about me, 3 = often true about me), with a total score comprising the sum of all items. Excellent psychometric properties have been reported including high internal consistency [α = .90; 48]; high test–retest reliability at intervals of three-weeks and three-months [r = .88 and .87; [48, 49]; and convergence with measures of anxiety and divergence with measures of depressive symptoms [48]. Internal consistency for the present sample was strong (α = .90). Higher scores suggest a greater endorsement of anxiety symptoms.
Child Behavior Checklist (CBCL)
The CBCL [50] is a 113-item questionnaire completed by parents that assesses behavior problems and social competencies of youth ages 4 to 18 years. Questions are answered on a 3-point scale (0 = never true, 1 = sometimes true, 2 = always true). The CBCL provides Internalizing and Externalizing Problem Scales, as well as eight subscales: Aggressive, Delinquent, Attention Problems, Thought Problems, Social Problems, Anxiety/Depression, Somatic Symptoms, and Withdrawn Behavior (higher scores suggest more problematic symptoms). Excellent psychometric properties have been reported, including good test–retest reliability, inter-parent agreement, internal consistency, and construct validity [50].
Data Analysis
Although the CSI is similar in content and scope to the SI-R, there are several key differences between the two measures, such as item content, wording, and the parent-report nature. Additionally, two previous psychometric studies of the SI-R yielded inconsistent factor solutions [19]. Specifically—in one analysis, distress/interference items loaded separately whereas in the other study they did not. Given this, we chose to use exploratory factor analysis (EFA) for scale identification rather than confirmatory factor analysis. Exploratory factor analysis with promax rotation was performed to determine the optimal factor structure. The oblique (promax) rotation was implemented to allow potential factors to correlate given the authors’ a priori expectation that various aspects of hoarding behaviors would be interrelated. Criteria for identifying the factors were based on: (1) Glorfeld’s [51] version of parallel analysis [52]; (2) the minimum average partials (MAP) method [51–54]; (3) examination of the scree plot. Parallel analysis and MAP are considered among the most accurate procedures for determining factor retention [55]. A minimum loading of greater than 0.32 was required for each item as it equates to approximately 10% overlapping variance with other items on the factor [55] although higher loading was required in cross-loading cases. Specifically, items cross- loading ≥0.5 on multiple factors would be permitted if the items correspond to each factor conceptually [55, 56].
Validity and reliability were assessed for the CSI Total score via correlations and t-tests. Given the ordinal nature of the CSI, Spearman’s correlations were used in analyses; p-values ≤ .05 were interpreted as significant. Fisher’s r to z transformations were used to contrast correlations to demonstrate convergent and discriminant validity. The internal consistency of the CSI scores was evaluated using Cronbach’s α coefficient [57]. For identifying differences in sample characteristics between the test–retest group and the overall sample, multivariate analysis of variance (MANOVA) was utilized.
Results
Scale Development and Factor Analysis
Two items from the 23-item CSI were deleted prior to EFA due to low item-to-total correlations (below r = .20; see Table 2 footnote; [58–61]). Subsequently, EFA with promax rotation was performed to determine the optimal factor structure for this sample.
Factor Retention
Parallel analysis identified that real-data eigenvalues must exceed random data eigenvalues 0.89, 0.71, 0.61, and 0.51 for factors 1 through 4, respectively. Similarly, MAP indicated four factors for our sample size of N = 123 and k = 21 variables (eigenvalues must be at least 11.2 for the first component, 1.6 for the second component, 1.0 for the third component and 1.1 for the fourth component using the 95th percentile and 1000 replications. Consequently, the authors accepted the four-component solution, produced by EFA, accounting for 75.8% of the variance (eigenvalues were 11.2, 1.6, 1.3, and 1.1) and was consistent with the scree plot. Data are presented in Table 2.
The first factor (6 items), identified as Discarding, produced uniformly strong factor loadings that ranged from .68 to .92. The 2nd factor also contained 6 items and was labeled Clutter. High factor loadings were obtained, ranging from .59 to .93. The 3rd factor contained 5 items that can be described as Acquisition; factor loading were high, ranging from .54 to .84. The final factor, labeled Distress/Impairment, contained 4 items. Loadings were also high for this factor, ranging from .50 to .94 [62]. Overall, no loading or crossloadings in this model were below .506 (loadings of at least .50 are considered strong loadings [55]). Communalities are markedly strong for this model (.2–.4 are adequate; .6 or higher are excellent [63]). In fact, approximately half of the communalities can be considered high [64]. One item (‘Attachment to items interfering with functioning’) was deleted given two loadings of inadequate strengths based on our proposed analytical strategies. Accordingly, all subsequent analyses will present data based on a 20-item measure with one item loading on two factors (Acquisition and Distress/Impairment). This item was counted in both factor scores, but only once in the CSI Total Score.
Face-Validity
Examination of respective item loadings appear logical and related to the factor content. Further, inter-correlations between CSI factor scores (see Table 3) suggest separate yet related constructs. Further, the factors are consistent with prior research using the SI-R in adult samples [18, 19].
Reliability
Internal Consistency
Strong internal consistency was found for each CSI scale: CSI Total Score (α = .96), Discarding (α = .95), Clutter (α = .90), Acquisition (α = .94) and Distress/Impairment (α = .84). Within scale inter-item correlations range as follows: Total Score (.22–.84), Discarding (.60–.89), Clutter (.41–.75), Acquisition (.69–.84) and Distress/Impairment (.46–.79), p < .001 for all values.
Test–Retest Reliability
One-week test–retest data were collected for a random sample representing 25% (n = 31) of subjects participating in this research. MANOVA, used to analyze differences between subjects completing test–retest data and youth in the overall sample who did not complete the test–retest, was non-significant for group differences suggesting that these groups did not differ on symptom measures and demographic variables (including the CSI). Strong, positive correlations between the original administration and the retest administration were observed for the CSI Total Score (r = .92), Discarding (r = .85), Clutter (r = .89), Acquisition (r = .86) and Distress/Impairment (r = .90) (all p < .001).
Criterion-Related Validity
Convergent Validity
Correlations between CSI scores and extant measures of hoarding suggest convergent validity. For example, the CSI Total Score related strongly with the OCI-CV Hoarding factor (Child Rated), r = .69, p < .001 and with hoarding obsession/compulsions on the CY-BOCS (r = .53, p < .001).
Discriminant Validity
Lower correlations were found between the CSI Total Score and other OCI-CV factors (e.g., OCI-CV Checking factor r = .12, p = .23 and OCI-CV Washing factor r = .23 p = .02). Using Fisher’s r to z transformation, both relationships were significantly lower than the relation between the OCI-CV Hoarding factor and the CSI Total Score (z = 5.04 and 4.13, both p < .001 for OCI-CV Checking and Washing factors respectively).
Construct Validity
Means and standard deviations for the CSI Total and factor scores are in Table 3. The CSI differed based on the subject’s present endorsement of both hoarding obsessions [t(71) = −4.2, p < .001] and hoarding compulsions [t(71) = −7.2, p < .001] on the CY-BOCS. The mean CSI Total Score for those endorsing hoarding compulsions (26% of participants) was 44.7 (SD = 17.7) versus 17.9 (SD = 12.1) for those not endorsing hoarding compulsions on the CY-BOCS. Similarly, the mean CSI Total Score for those endorsing hoarding obsessions (30% of participants) was 37.1 (SD = 19.5) versus 19.4 (SD = 14.5) for those not endorsing hoarding obsessions on the CY-BOCS.
Clinical Correlates
Demographics
No gender differences were identified on the CSI Total Score [t(103) = 1.5, p = .12], Acquisition factor [t(103) = −.59, p = .55] or the Distress/Impairment factor [t(103) = .42, p = .68]. Girls had more problems with Discarding [t(103) = −2.1, p = .04] and Clutter [t(103) = 2.1, p = .04] than did boys. Scores on the CSI Total Score (r = −.21, p = .03), Discarding factor (r = −.28, p = .004), and Acquisition factor (r = −.28, p = .003) were inversely correlated with age.
Relations with OCD and Other Clinical Symptoms
No significant associations between the CSI Total Score and CY-BOCS Obsession (r = .04, p = .73) and Compulsion (r = .15, p = .16) scales were identified. Similarly, the CSI did not relate to CGI-Severity ratings (r = .07, p = .50). The CSI Total Score was modestly associated with child-reported anxiety on the MASC (r = .23, p = .02) but not with child-rated depressive symptoms on the CDI-S (r = .19, p = .06). Notably, hoarding rated on the CSI was directly correlated with OCD-specific impairment (child and parent rated) on the COIS-C/P (see Table 4), a number of behavioral and emotional domains on the CBCL (see Table 5), and with family accommodation (r = .27, p = .01).Footnote 2
Discussion
In the absence of a sound measure of hoarding symptoms in youth, we developed the CSI, a parent-rated inventory of child hoarding behaviors. The development and evaluation of the CSI followed an empirical/statistically-based approach for measure development, including optimizing scale length (rejecting items with poor item-to-total correlations) and evaluation of validity/reliability [61]. Overall, initial results were promising and suggest that the CSI is a psychometrically sound and valid measure for use with pediatric OCD patients. Factor analysis produced a four-factor solution representing four distinct but related areas: Discarding, Clutter, Acquisition, and Distress/Impairment. These factors were consistent with previous findings in adults using the SI-R. In a non-clinical population, Coles et al. [18] found a similar four-factor solution: Difficulty Discarding, Clutter, Interference/Distress and Acquisition Problems. Frost and colleagues [19] obtained similar results in a more clinical population except for the lack of the Interference/Distress Factor. Good to strong internal consistency was found for each of the CSI factors suggesting that items within each scale contribute to the overall scale’s score. Similarly, one-week test–retest reliability was also excellent for the CSI Total and factor scores with correlations ranging from .85 to .92.
In addition to its factorial validity, analysis of the CSI’s construct validity was also favorable. First, concurrent validity was assessed via comparisons with other measures of hoarding, yielding strong, significant relations in the expected direction. Second, discriminant validity was also demonstrated in that the CSI correlated with extant measures covering similar content (e.g., hoarding) but not with dissimilar content (e.g., checking, contamination). Finally, construct validity was supported vis-à-vis robust group differences on the CSI Total Score on the basis of endorsing hoarding items on the CY-BOCS Symptom Checklist.
In addition to the psychometric results, data on the phenomenology and prevalence of various hoarding behaviors in a clinical sample was gathered. Younger children exhibited greater problems with acquisition and discarding. This may be explained by increased acquisition of items and difficulty discarding them in younger children and/or increased recognition of developmentally abnormal hoarding-related behavior by parents as their child ages, which may result in limit setting or seeking treatment. Gender differences were noted in that girls exhibited more problems with discarding possessions and overall clutter; this is roughly consistent with some adult findings of gender differences [65] but not others [66]. The reasons for the gender differences are unclear. It may be that girls exhibit stronger emotional attachment to possessions than boys, resulting in difficulty parting with such possessions and associated clutter [67].
Hoarding was not related with OCD symptom severity. This was expected given that the CY-BOCS and CGI-S provide an aggregate assessment of overall symptom severity versus solely hoarding. However, these findings also suggest that hoarding among children occurs independent of other OCD symptoms, consistent with findings in the adult literature [68]. Overall, hoarding related to increased heightened parent ratings of externalizing and internalizing behavior problems. A weak but significant correlation between hoarding and anxiety symptoms was noted. This may reflect pathological attachments experienced by hoarders with hoarded possessions [69, 70]. Clinically, we have seen a number of youth who hoard display strong attachments to their possessions and experience anxiety or disruptive behavior when confronted with the risk of removal.
Not surprisingly, hoarding symptoms related to both youth and parent reports of impairment. Hoarding symptoms were associated with all impairment domains except social impairment. Such significant relations likely reflect the impact of hoarding on academic and family functioning. In academic realms, hoarding may exert a direct impact on school functioning (e.g., impacting organization) or indirectly through executive functioning deficits [71]. Within the home, hoarding is likely associated with clutter and family discord when parents discard or refuse to accommodate hoarded possessions. That hoarding was not related to social impairment may reflect efforts by the child to minimize the effects of hoarding on peer relationships, perhaps related to anxiety about others’ perceptions. If true, this holds similarity to adults who hoard who tend to exhibit high rates of social anxiety [72]. Given that children’s environment are often controlled by parents, the hoarding behavior may not be evident to or interfere with a friend coming over. Interestingly, one item—Difficulty walking in home due to child’s clutter—exhibited a very strong factor loading relative to other items (e.g., ‘Playroom clutter’) raising the question of how many parents had serious hoarding problems themselves versus the extent to which parents did not exercise control over the child’s hoarding. Unfortunately, our data do not directly address the extent to which parents control their child’s clutter and its impact on the home and thus, future research on this question is needed.
Although this study had notable strengths (e.g., a relatively large sample of youth with OCD, two study sites, multiple reporters), certain methodological shortcomings should be considered when interpreting the results. First, the generalizability of our findings may be limited as the sample consisted of youth with OCD who were primarily Caucasian, treatment-seeking, and of middle or upper-middle class. Recruitment of more diverse samples is a critical issue in psychiatric/psychological research to foster enhanced generality of study results [73]. Second, we only sampled parents of youth who exhibited considerable heterogeneity in their obsessive–compulsive symptoms. Other physical and psychiatric conditions have elevated rates of hoarding (e.g., Prader-Willi Syndrome; [12]) and thus, the CSI may not be appropriate for use in other populations. It would have been ideal to examine the CSI in a non-OCD psychiatric sample, which we highlight as a direction for future study. On balance, the CSI was assigned to assess hoarding behaviors independent of diagnosis and thus, would be expected to operate similarly across clinical presentations. Third, a youth report version would allow for parent–child comparisons and could provide additional perspectives on childhood hoarding (e.g., insight). Child-reports, combined with independent observer ratings, would provide information about the child’s awareness of hoarding behaviors. Fourth, although our sample may be appropriate for validation, a larger, representative sample is needed for normative purposes and replication of the factor structure using confirmatory techniques. Fifth, inter-rater reliability for the CY-BOCS was not collected at the Massachusetts General Hospital site; on balance, ratings were confirmed by an experienced board certified child psychiatrist. Finally, the retest interval was relatively short (one-week) and the longer-term reliability of the CSI remains unclear.
Implications for Research and Practice
Overall, the CSI is a new parent-report measure with promising reliability and validity that is designed to assess both the presence and severity of hoarding symptoms in youth. Although the present results were supportive of the initial psychometric properties of the CSI, there are a number of areas in need of further empirical attention. First, the measure’s treatment sensitivity has not been documented. It is unclear if the CSI will appropriately reflect response to evidence-based therapies targeting hoarding behaviors. Second, the CSI has not been tested in non-OCD samples. As noted, hoarding may be present in other clinical disorders as a central or ancillary feature and the psychometric properties of the CSI may operate differently as a function of population. Related to this, the validity of the CSI as a screener has yet to be determined and normative data in clinical and non-clinical samples is not yet available. This avenue of research is of great clinical import, as the availability of a quick and convenient measure for clinical and community screenings could improve the identification of youth in need of intervention, as well as assist in monitoring treatment progress and outcome.
Summary
This study examined the development and psychometric properties of a parent-rated measure of child hoarding behaviors in 123 children and adolescents with OCD. The CSI demonstrated good internal consistency for both the Total Score and factor scores, excellent one-week test–retest reliability, and convergent and divergent validity with subscales of the OCI-CV and CY-BOCS. Known groups validity was supported vis-à-vis higher CSI scores for those endorsing hoarding on the CY-BOCS Symptom Checklist. Although this study is limited by demographic homogeneity and the use of a sample of children with OCD, these findings provide initial support for the reliability and validity of the CSI for the assessment of hoarding behaviors. Future studies are needed to extend these findings to non-OCD samples of youth.
Notes
A copy of the CSI can be obtained by contacting the corresponding author at the address provided.
As the nature of the paper is measure development, only correlations with the CSI Total Score are provided to avoid spurious findings due to multiple comparisons.
References
Frost RO, Gross RC (1993) The hoarding of possessions. Behav Res Ther 31:367–381
Frost RO, Steketee G (1998) Hoarding: clinical aspects and treatment strategies. In: Jenike MA, Baer L, Minichiello WE (eds) Obsessive compulsive disorder: practical management, 3rd edn. Mosby Inc, St Louis
Ayers CR, Saxena S, Golshan S, Wetherell JL (2009) Age at onset and clinical features of late life compulsive hoarding. Int J Geriatr Psychiatry 25(2):142–149
Rachman S, Elliott CM, Shafran R, Radomsky AS (2009) Separating hoarding from OCD. Behav Res Ther 47:520–522
Abramowitz JS, Wheaton MG, Storch EA (2008) The status of hoarding as a symptom of obsessive-compulsive disorder. Behav Res Ther 46:1026–1033
Saxena S (2008) Recent advances in compulsive hoarding. Curr Psychiatry Rep 10:297–303
Grisham JR, Frost RO, Steketee G, Kim HJ, Hood S (2006) Age of onset of compulsive hoarding. J Anxiety Disord 20:675–686
Hanna GL (1995) Demographic and clinical features of obsessive-compulsive disorder in children and adolescents. J Am Acad Child Adolesc Psychiatry 34:19–27
Leonard HL, Goldberger EL, Rapoport JL, Cheslow DL, Swedo SE (1990) Childhood rituals: normal development or obsessive-compulsive symptoms? J Am Acad Child Adolesc Psychiatry 29:17–23
Stewart SE, Rosario MC, Brown TA, Carter AS, Leckman JF, Sukhodolsky D, Katsovitch L, King R, Geller D, Pauls DL (2007) Principal components analysis of obsessive-compulsive disorder symptoms in children and adolescents. Biol Psychiatry 61:285–291
Storch EA, Lack CW, Merlo LJ, Geffken GR, Jacob ML, Murphy TK, Goodman WK (2007) Clinical features of children and adolescents with obsessive-compulsive disorder and hoarding symptoms. Compr Psychiatry 48:313–318
Dykens EM, Kasari C (1997) Maladaptive behavior in children with Prader–Willi syndrome Down syndrome and nonspecific mental retardation. Am J Ment Retard 102:228–237
Dykens EM, Leckman JF, Cassidy SB (1996) Obsessions and compulsions in Prader-Willi Syndrome. J Child Psychol Psychiatry 37:995–1002
Scahill L, Riddle MA, McSwiggin-Hardin M, Ort SI, King RA, Goodman WK, Cicchetti D, Leckman JF (1997) Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity. J Am Acad Child Adolesc Psychiatry 36:844–852
Shafran R, Frampton I, Heyman I, Reynolds M, Teachman B, Rachman S (2003) The preliminary development of a new self-report measure for OCD in young people. J Adolesc 26:137–142
Storch EA, Khanna M, Merlo LJ, Loew BA, Franklin M, Reid JM, Goodman WK, Murphy TK (2009) Children’s Florida obsessive compulsive inventory: psychometric properties and feasibility of a self-report measure of obsessive–compulsive symptoms in youth. Child Psychiatry Hum Dev 40:467–483
Foa EB, Coles ME, Huppert JD, Pasupuleti R, Franklin ME, March JS (2010) Development and validation of a child version of the Obsessive Compulsive Inventory. Behav Ther 41:121–132
Coles ME, Frost RO, Heimberg RG, Steketee G (2003) Hoarding behaviors in a large college sample. Behav Res Ther 41:179–194
Frost RO, Steketee G, Grisham J (2004) Measurement of compulsive hoarding: saving inventory revised. Behav Res Ther 42:1163–1182
Frost RO, Steketee G, Tolin DF, Renaud S (2008) Development and validation of the Clutter Image Rating. J Psychopathol Behav Assess 30:180–192
Hayward LC, Coles ME (2009) Elucidating the relation of hoarding to obsessive compulsive disorder and impulse control disorders. J Psychopathol Behav Assess 31:220–227
Wheaton M, Timpano KR, Lasalle-Ricci VH, Murphy D (2008) Characterizing the hoarding phenotype in individuals with OCD: associations with comorbidity severity and gender. J Anxiety Disord 22:243–252
Muroff J, Steketee G, Rasmussen J, Gibson A, Bratiotis C, Sorrentino C (2009) Group cognitive and behavioral treatment for compulsive hoarding: a preliminary trial. Depress Anxiety 26:634–640
Tolin DF, Frost RO, Steketee G (2007) An open trial of cognitive-behavioral therapy for compulsive hoarding. Behav Res Ther 45:1461–1470
American Psychiatric Association (2000) Diagnostic and statistical manual of mental disorders DSM-IV-TR 4th ed Text Revision. American Psychiatric Association, Washington DC
Silverman WK, Albano AM (1996) The anxiety disorders interview schedule for DSM-IV—child and parent versions. Graywinds Publications, San Antonio TX
Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, Williamson D, Ryan N (1997) Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version: initial reliability and validity data. J Am Acad Child Adolesc Psychiatry 36:980–988
Leckman JF, Grice DE, Boardman J, Zhang H, Vitale A, Bondi C, Alsobrook J, Peterson BS, Cohen DJ, Rasmussen SA, Goodman WK, McDougle CJ, Pauls DL (1997) Symptoms of obsessive-compulsive disorder. Am J Psychiatry 154:911–917
Summerfeldt LJ, Richter MA, Antony MM, Swinson RP (1999) Symptom structure in obsessive-compulsive disorder: a confirmatory factor-analytic study. Behav Res Ther 37:297–311
Baer L (1994) Factor analysis of symptom subtypes of obsessive compulsive disorder and their relation to personality and tic disorders. J Clin Psychiatry 55:18–23
Foa EB, Huppert JD, Leiberg S, Langner R, Kichic R, Hajcak G, Salkovskis P (2002) The obsessive-compulsive inventory: development and validation of a short version. Psychol Assess 14:485–496
Mataix-Cols D, Rosario-Campos MC, Leckman JF (2005) A multidimensional model of obsessive-compulsive disorder. Am J Psychiatry 162:228–238
Storch EA, Milsom VA, Merlo LJ, Larson M, Geffken GR, Jacob ML, Murphy TK, Goodman WK (2008) Insight in pediatric obsessive-compulsive disorder: associations with clinical presentation. Psychiatry Res 160:212–220
Storch EA, Murphy TK, Geffken GR, Soto O, Sajid M, Allen P, Roberti JW, Killiany E, Goodman WK (2004) Psychometric evaluation of the children’s yale-brown obsessive compulsive scale. Psychiatry Res 129:91–98
Pediatric OCD Treatment Study Team (2004) Cognitive-Behav Ther sertraline and their combination for children and adolescents with obsessive-compulsive disorder: the Pediatric OCD Treatment Study randomized controlled trial. JAMA 292:1969–1976
Guy W (1976) Clinical global impressions. In: ECDEU (ed) Assessment manual for psychopharmacology. National Institute for Mental Health, Rockville MD, pp 218–222
National Institute of Mental Health (1985) Clinical global impression scale. Psychopharmacol Bull 21:839–844
Piacentini J, Bergman RL, Keller M, McCracken J (2003) Functional impairment in children and adolescents with obsessive-compulsive disorder. J Child Adolesc Psychopharmacol 13(Suppl 1):S61–S69
Piacentini J, Jaffer M (1999) Manual for the Child OCD impact scale: unpublished manuscript. University of California at Los Angeles
Piacentini J, Peris TS, Bergman RL, Chang S, Jaffer M (2007) Functional impairment in childhood OCD: development and psychometrics properties of the Child Obsessive-Compulsive Impact Scale-Revised. J Clin Child Adolesc Psychol 36:645–653
Valderhaug R, Ivarsson T (2005) Functional impairment in clinical samples of Norwegian and Swedish children and adolescents with obsessive–compulsive disorder. Eur Child Adolesc Psychiatry 14:164–173
Storch EA, Geffken GR, Merlo LJ, Mann G, Duke D, Munson M, Adkins J, Grabill K, Murphy TK, Goodman WK (2007) Cognitive-behavioral therapy for pediatric obsessive-compulsive disorder: comparison of intensive and weekly approaches. J Am Acad Child Adolesc Psychiatry 46:469–478
Calvocoressi L, Lewis B, Harris M, Trufan SJ, Goodman WK, McDougle CJ et al (1995) Family accommodation in obsessive–compulsive disorder. Am J Psychiatry 152:441–443
Storch EA, Merlo LJ, Larson MJ, Fernandez M, Jacob ML, Geffken GR, Grabill K, Murphy TK, Goodman WK (2007) Family accommodation in pediatric obsessive-compulsive disorder. J Clin Child Adolesc Psychol 36:207–216
Kovacs M (1985) Children’s depression inventory. Psychopharmacol Bull 21:995–998
Timbremont B, Braet C, Dreessen L (2004) Assessing depression in youth: relation between the Children’s Depression Inventory and a structured interview. J Clin Child Adolesc Psychol 33:149–157
Rofey DL, Szigethy EM, Noll RB, Dahl RE, Lobst E, Arslanian SA (2009) Cognitive-behavioral therapy for physical and emotional disturbances in adolescents with polycystic ovary syndrome: a pilot study. J Pediatr Psychol 34:156–163
March JS, Parker JD, Sullivan K, Stallings P, Conners CK (1997) The multidimensional anxiety scale for children: factor structure reliability and validity. J Am Acad Child Adolesc Psychiatry 36:554–565
March JS, Sullivan K, Parker J (1999) Test–retest reliability of the multidimensional anxiety scale for children. J Anxiety Disord 13:349–358
Achenbach TM (1994) Child Behavior Checklist and related instruments. In: Maruish ME (ed) The use of psychological testing for treatment planning and outcome assessment. Lawrence Erlbaum Associates Inc, Hillsdale NJ, pp 517–549
Glorfeld LW (1995) An improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educ Psychol Meas 55:377–393
O’Connor BP (2000) SPSS and SAS programs for determining the number of components using parallel analysis and velicer’s MAP test. Behav Res Methods 32:396–402
Velicer WF (1976) Determining the number of components from the matrix of partial correlations. Psychometrika 41:321–327
Velicer WF, Jackson DN (1990) Component analysis versus common factor analysis: some issues in selecting an appropriate procedure. Multivariate Behav Res 25:1–28
Costello AB, Osborne JW (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. PARE 10:1–9
Zwick WR, Velicer WF (1986) Comparison of five rules for determining the number of components to retain. Psychol Bull 99:432–442
Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334
Clark LA, Watson D (1995) Constructing validity: basic issues in objective scale development. Psychol Assess 7:309–319
Comrey AL (1988) Factor-analytic methods of scale development in personality and clinical psychology. J Consult Clin Psychol 56:754–761
DeVellis RF (2003) Scale development: theory and applications, vol 26. Sage Publications, Thousand Oaks CA
Worthington RL, Whittaker TA (2006) Scale development research: a content analysis and recommendations for best practices. Couns Psychol 34:806–838
Floyd FJ, Widaman KF (1995) Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess 7:286–299
MacCallum RC, Widaman KF, Zhang S, Hong S (1999) Sample size in factor analysis. Psychol Methods 4:84–99
Velicer WF, Fava JL (1998) Effects of variable and subject sampling on factor pattern recovery. Psychol Methods 3:231–251
Steketee G, Frost RO, Kim H (2001) Hoarding by elderly people. Health Soc Work 26:176–184
Samuels JF, Bienvenu OJ, Grados MA, Cullen B, Riddle MA, Liang K, Eaton WW, Nestadt G (2008) Prevalence and correlates of hoarding behavior in a community-based sample. Behav Res Ther 46:836–844
Plimpton E, Frost RO, Abbey BC, Dorer W (2010) Compulsive hoarding in children: six case studies. Int J Cog Ther 2:88–104
Pertusa A, Fullana MA, Singh S, Alonso P, Menchon JM, Mataix-Cols D (2008) Compulsive hoarding: OCD symptom distinct clinical syndrome or both? Am J Psychiatry 165:1289–1298
Frost RO, Hartl TL, Christian R, Williams N (1995) The value of possessions in compulsive hoarding: patterns of use and attachment. Behav Res Ther 33:897–902
Nedelisky A, Steele M (2009) Attachment to people and to objects in obsessive-compulsive disorder: an exploratory comparison of hoarders and non-hoarders. Attachment Hum Dev 11:365–383
Grisham JR, Brown TA, Savage CR, Steketee G, Barlow DH (2007) Neuropsychological impairment associated with compulsive hoarding. Behav Res Ther 45:1471–1483
Samuels JF, Bienvenu OJ, Riddle MA, Cullen B, Grados MA, Liang K, Hoeh-Saric R, Nestadt G (2002) Hoarding in obsessive compulsive disorder: results from a case-control study. Behav Res Ther 40:517–528
Williams M, Powers M, Yun YG, Foa E (2010) Minority participation in randomized controlled trials for obsessive-compulsive disorder. J Anx Dis 24:171–177
Acknowledgments
Portions of this paper were supported by a grant from the National Institutes of Health to the first author (L40 MH081950-02).
Author information
Authors and Affiliations
Corresponding author
Additional information
Portions of this paper were supported by a grant from the National Institutes of Health to the first author (L40 MH081950-02).
Rights and permissions
About this article
Cite this article
Storch, E.A., Muroff, J., Lewin, A.B. et al. Development and Preliminary Psychometric Evaluation of the Children’s Saving Inventory. Child Psychiatry Hum Dev 42, 166–182 (2011). https://doi.org/10.1007/s10578-010-0207-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10578-010-0207-0