Abstract
The aim of this study was to assess test-retest reliability and diagnostic validity of self-report instruments of depression and anxiety in autistic youth. Participants were 55 autistic youth aged 8–17 years presenting with depressive or anxiety symptoms. They were interviewed with the Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS-PL) and completed the Children’s Depression Inventory, Second Edition – Self Report Short (CDI 2:SR[S]) and the Revised Child Anxiety and Depression Scale (RCADS) twice, separated by a two-week interval. Test-retest reliability was measured with intraclass correlation coefficients (ICCs), and diagnostic validity was assessed using receiver operating characteristic (ROC) curves with the summary ratings on the K-SADS-PL as the criterion. The effect of participant characteristics was analyzed through a moderation analysis. Generalized anxiety (GAD) and social anxiety disorder (SOC) were the two most prevalent disorders in the sample. Test-retest reliability for most of the subscales was good (ICC = 0.74 − 0.87), with the exception of the RCADS obsessive-compulsive disorder (OCD) and GAD. The Adaptive Behavior conceptual score was a significant moderator of the reliability of the CDI 2:SR[S]. The ROC analysis suggested the RCADS SOC and the CDI 2:SR[S] to be good screening tools with inadequate specificity when appropriately sensitive cutoff scores are used. Optimal cutoff scores in this sample were lower than originally published. The findings suggest that autistic youth can provide stable reports of anxiety and depressive symptoms over time. Diagnostic validity varied according to the construct and instrument.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by persistent impairment in reciprocal social communication and interaction across multiple contexts, and restricted, repetitive patterns of behavior, interests, or activities (American Psychiatric Association [APA], 2022). Studies suggest that between 55 and 94% of autistic individuals have at least one co-occurring psychiatric disorder (See Hossain et al., 2020). The prevalence of anxiety disorders in clinical and epidemiological samples reported in the scoping review by Vasa and colleagues (2020) ranged from 20 to 35% and the prevalence of depressive disorders was estimated to be between 11 and 23% (Hollocks et al., 2019; Hudson et al., 2019; Lai et al., 2019), which are both higher than the prevalence reported in the general child and adult population in the United States (Bitsko et al., 2022; Brody et al., 2018).
Phenomenology of Internalizing Symptoms in ASD
The study of internalizing disorders in ASD has been complicated by their phenomenology. Indeed, the presentation of depression often seems to overlap with the social, cognitive, and communicative impairments that characterize ASD (Magnuson & Constantino, 2011; Pezzimenti et al., 2019; Stewart et al., 2006). For example, social withdrawal and abnormal speech patterns in ASD may be confused with fatigue or psychomotor retardation, and frequently associated symptoms such as sleep difficulties, food selectivity, and poor adaptive skills may mimic depression (Pezzimenti et al., 2019; Stewart et al., 2006). Likewise, the similarities in presentations and close associations between anxiety and core ASD symptoms are well-documented (Lecavalier et al., 2014; Wigham & McConachie, 2014). For instance, insistence on sameness, one of the core symptoms of ASD, is also commonly observed in those with anxiety and closely related to intolerance of uncertainty (Jenkinson et al., 2020). Moreover, sensory processing abnormalities have been identified to have a complex relationship with intolerance of uncertainty, anxiety, and restricted and repetitive behaviors in ASD (Hwang et al., 2020; Neil et al., 2016; South & Rodgers, 2017; Wigham et al., 2015).
In addition to the similarities and the associations between internalizing symptoms and autistic traits, accumulated evidence suggests atypical ASD-specific psychiatric symptoms that do not neatly fit in the DSM-5 framework yet elicit clinically significant level of distress (Chandrasekhar & Sikich, 2015; Kerns et al., 2014; Stewart et al., 2006). When depressed, autistic children may experience distinct symptoms such as exacerbation of self-injury and aggression, change in stereotypic behaviors or restricted interests, or even catatonia (Magnuson & Constantino, 2011; Perry et al., 2001; Stewart et al., 2006), and unique patterns of symptoms within the context of the DSM-5 such as prominent anhedonia (Kim & Lecavalier, 2021) and insomnia and restlessness (Montazeri et al., 2020). Similarly, in a series of studies, Kerns and colleagues (Kerns et al., 2014, 2017, 2021; Kerns & Kendall, 2012) reported that ASD-specific symptoms such as circumscribed worries, social fearfulness without fear of negative evaluation, distress related to change in routine, and unusual phobias are prevalent (Lau et al., 2020). Due to the complex interaction of the diagnostic overlap and the distinct presentations of internalizing disorders in the context of ASD, it is a conundrum whether the anxiety or depressive symptoms reflect a true separate co-occurring condition, an extension of varied ASD presentations, or a co-occurring condition not independent of ASD (Kerns & Kendall, 2012; Lecavalier et al., 2014; Wood & Gadow, 2010).
Due to such a complex clinical picture of depression and anxiety in ASD, relying on measures which were not developed for autistic individuals can be problematic as they may not take into consideration the unique phenomenology in ASD. In addition, previous reviews indicated that the psychometric properties of common measures are poorly understood, especially when it comes to self-reported instruments (Kim & Lecavalier, 2021, 2022; Wigham & McConachie, 2014).
Potential Utility of Self-Report Measures
Historically, psychiatric assessments of individuals with ASD have relied heavily on informants despite the long-standing issue of informant discrepancy and the importance of multi-informant data in clinical decision making (See De Los Reyes & Epkins, 2023). The tendency to rely on informants was also an artifact of concerns regarding the accuracy of self-report measures in autistic individuals, especially in describing internal states (Kinnaird et al., 2019; Mazefsky et al., 2011). Recent studies, however, have shown that autistic individuals may be more capable of reporting their internal state than previously understood. For instance, studies examining the relationship between self-report and biological measures in autistic individuals revealed promising results (e.g., Keith et al., 2019; Rosen & Lerner, 2018; Sapey-Triomphe et al., 2019). Keith and colleagues (2019) found significant associations of self-reported but not parent-reported anxiety and auditory sensitivity with autonomic arousal at rest and autonomic reactivity during an aversive noise task. Similarly, Rosen and Lerner (2018) found that greater self-reported social anxiety was associated with an increased neural response to errors. Despite such evidence suggesting the potential utility of self-report measures in autistic youth, only a few studies have assessed important measurement properties in the context of psychiatric assessments (See Kim & Lecavalier, 2022).
Psychometric Properties of Self-Report Measures
Kim and Lecavalier (2022) recently reviewed the literature on the psychometric properties of self-reported psychiatric tools in ASD. The vast majority of studies (28/35) focused on parent-child agreement with a pooled effect size of r = .42 for anxiety suggesting autistic individuals and their parents agree on anxiety symptoms just as much as neurotypical individuals and their parents do (Achenbach et al., 1987; Grills & Ollendick, 2002; Phares et al., 1989). However, far fewer studies assessed other psychometric properties such as test-retest reliability or diagnostic validity, and most of the studies that did were of low quality. There were no studies that were rated as strong that examined short-term test-retest reliability, limiting greatly our understanding of whether or not autistic individuals can provide consistent responses over short periods of time (e.g., Schiltz et al., 2017; Sharpley et al., 2019). Nine studies assessed diagnostic validity, mostly reporting sensitivity and specificity lower than indicated in the literature. Lower optimal cutoffs than originally suggested in the general child or non-ASD population were reported for self-report instruments (e.g., Carruthers et al., 2020; Mazefsky et al., 2011).
In addition to the paucity of studies establishing psychometric properties, the field has a limited understanding of the moderators of these psychometric properties of self-reported instruments. For example, although IQ is often hypothesized as a key moderator of the accuracy of instruments, there are insufficient data to reach conclusions due to frequent exclusion of individuals with intellectual or language impairment (Kim & Lecavalier, 2022). Existing studies have focused on the moderator of parent-child agreement with findings suggesting higher level of functioning associated with better informant agreement in internalizing symptoms (Burrows et al., 2018; Kaat & Lecavalier, 2015; Ooi et al., 2016; Stratis & Lecavalier, 2015).
The Current Study
There is a need to assess the psychometric properties of self-report anxiety and depression instruments in autistic youth. Specifically, the primary aims of this study were to investigate the test-retest reliability and diagnostic validity of commonly used measures of anxiety and depression. The Children’s Depression Inventory, Second Edition – Self Report Short (CDI 2: SR[S]) and the Revised Children’s Anxiety and Depression Scale (RCADS) were selected as they are two of the most commonly used measures in research for both general child and autistic population. The Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS-PL) was used to support a gold standard clinical diagnosis. Based on the literature, we hypothesized at least moderate test-retest reliability (i.e., ICC > 0.50) and lower cutoff scores than originally published for optimal sensitivity and specificity. Secondary aims were to evaluate whether age, cognitive ability, and adaptive behavior conceptual skills impact test-retest reliability, and to examine the symptom endorsement of anxiety and depression in ASD.
Methods
Participants
Participants were 55 children and 53 parents (children age in years range = 8–17, M = 13.7, SD = 2.7). There were two sets of sibling participants (i.e., four children with two parents). All youth had a previous diagnosis of ASD by a licensed professional, which was confirmed by the research team by reviewing the original documentation, and a score of 10 or higher on the Social Communication Questionnaire – Current version (SCQ – Current; Berument et al., 1999). All youth reportedly experienced at least a mild level of anxiety or depressive symptoms and had a standard score above 50 on the Kaufman Brief Intelligence Test – Second Edition (KBIT-2; Kaufman & Kaufman, 2004) brief IQ or on the adaptive behavior (AB) conceptual domain score on the Adaptive Behavior Assessment System – Third Edition (ABAS-3; Harrison & Oakland, 2015). We deemed this as the minimum level to understand simple questions/statements on the self-report questionnaires. We also selected this criterion to include youth with a wide range of levels of functioning.
Procedure
Participants were recruited through university clinics, a tertiary diagnostic center of a children’s hospital, and online databases. Participants were offered to choose between in-person appointments at the university clinic or virtual appointments via an online teleconference platform due to the ongoing COVID-19 restrictions. Most of the data were collected virtually (n = 49), however six children and five parents participated in person. For virtual data collection, participants were required to have access to the internet, a quiet space, an electronic device with at least a 9.7” screen, a web camera, a microphone, and a speaker or a headphone. All measures were presented visually and were read aloud by the experimenter. Participants had two separate visits, approximately two weeks apart.
First Assessment (Time 1)
The first visit consisted of administration of a cognitive test, completion of self-report instruments with youth, a structured interview with the child and parent, and completion of the demographics form and adaptive behavior scale by the parent. Time 1 lasted approximately 1.5–2 h. Parents could remain in the room with the child, but any assistance with the assessment protocol beyond technical help was not allowed.
Second Assessment (Time 2)
The second appointment was held approximately 2 weeks after from the first one (Minterval = 15.0 days, SDinterval = 2.5 days, range = 11–23 days) and lasted 15–30 min for most participants. The purpose of this visit was to gather test-retest data for the self-report measures.
Guidelines for Preventing Fraudulent Participants
To ensure integrity of virtual data collection, the following guidelines were used. First, the documentation of participant’s previous professional evaluation was thoroughly reviewed for its legitimacy (e.g., name of the agency, name and credential of the professional, tests administered, matching demographic characteristics for the participant). Second, the participants were required to keep the camera on for the entire visit. Finally, major inconsistencies on patient demographic characteristics, background information, developmental history, or reported symptoms between the provided documents for study eligibility and parent or child’s accounts of their own experiences were reviewed.
Measures
Demographics Form
This form requested information about the child’s age, sex, gender, race/ethnicity, school placement, current psychiatric diagnoses, medications, and treatments along with parent’s age, sex, race/ethnicity, annual household income, and highest level of education.
Social Communication Questionnaire – Current (SCQ – Current)
The SCQ – Current (Berument et al., 1999) is a 40-item parent-report checklist of current symptoms of autism derived from the Autism Diagnostic Interview - Revised (ADI-R; Rutter et al., 2003). Berument et al. (1999) initially established a cutoff score of 15, however a number of studies have suggested using a lower cutoff to maximize sensitivity and specificity (e.g., Allen et al., 2007; Norris & Lecavalier, 2010; Schendel et al., 2012; Wiggins et al., 2015). This study used a cutoff score of 10, as suggested by Barnard-Brak and colleagues (2016).
Kaufman Brief Intelligence Test, Second Edition (KBIT-2)
The KBIT-2 (A. S. Kaufman & Kaufman, 2004) is a brief measure of verbal and nonverbal intelligence used with individuals of age 4 through 90 years. The Verbal scale measures receptive vocabulary, general knowledge, and expressive reasoning. The Nonverbal scale measures understanding of relations between concrete or abstract stimuli. The KBIT-2 yields a Verbal Standard Score, a Nonverbal Standard Score, and an IQ Composite (M = 100, SD = 15, range = 40–160). The KBIT-2 was not standardized for telepractice assessment, but it provides an online stimulus book to aid the administration process. Evidence supports score equivalence between in-person and telepractice administration modes (A. S. Kaufman & Kaufman, 2022).
Adaptive Behavior Assessment System, Third Edition (ABAS-3) Conceptual Domain
The ABAS-3, Parent Form, Ages 5–21 (Harrison & Oakland, 2015) measures adaptive behaviors in multiple settings for individuals of age 5 to 21 years. The instrument consists of items on a scale of 0 to 3, 0 being “Is not able to perform this behavior” and 3 being “Always or almost always performs the behavior when needed”. The ABAS-3 showed excellent internal consistency (α = 0.94 – 0.99) and good test-retest reliability (r = .80 – 0.86) in the standardization and the mixed clinical sample (Harrison & Oakland, 2015). In the current study, the three skill areas (i.e., Communication, Functional Academics, and Self-Direction) that comprise the Conceptual domain were used.
Children’s Depression Inventory, Second Edition – Self Report Short (CDI 2:SR[S])
The CDI 2:SR[S] is a 12-item self-report inventory assessing depressed mood in children and adolescents of age 7 through 17 years (Kovacs, 1992; Kovacs & MHS Staff, 2011). Respondents are asked to choose one description out of three that best fits how they have been feeling over the past 2 weeks (e.g., “I am sad once in a while”; “I am sad many times”; “I am sad all the time”). Responses are scored on a scale of 0 to 2, with total scores ranging between 0 and 24. The CDI 2:SR[S] showed acceptable internal consistency (α = 0.82), excellent test-retest reliability across a 2- to 4-week interval (obtained r = .77, corrected r = .92), and accurately classified depression compared to matched controls (Sensitivity 84%, Specificity 77%) or other clinical cases (Sensitivity 73.8%, Specificity 68.5%; Kovacs & MHS Staff, 2011). A T-score of 65 or higher is suggested by authors as indicative of elevated number of depressive symptoms. Both the previous and the current versions of the CDI have been used in multiple studies with autistic youth (see Kim & Lecavalier, 2021). To our knowledge, however, when it comes to the short versions, the current version has not been used in ASD (e.g., Greenaway & Howlin, 2010; Mazefsky et al., 2011).
Revised Children’s Anxiety and Depression Scale (RCADS)
The RCADS (Chorpita et al., 2000, 2005) is a self-report questionnaire, consisting of 47 items distributed along six subscales including separation anxiety disorder (SAD), social phobia (SOC), generalized anxiety disorder (GAD), panic disorder (PD), obsessive compulsive disorder (OCD), and major depressive disorder (MDD). It is scored on a four-point Likert scale (0 “never” – 3 “always”). Total raw scores range from 0 to 141, and T-scores are generated based on sex and grade level. In the initial study by Chorpita and colleagues (2000), the RCADS showed fair 1-week test-retest reliability (0.65 – 0.80), good internal consistency (α = 0.71 – 0.85), and good convergent and divergent validity in a non-clinical sample. Chorpita and colleagues (2005), then in a clinical sample, found optimal cutoff scores of 11 for MDD, 10 for SOC, 7 for GAD, 5 for SAD, 5 for OCD, and 12 for PD, yielding a sensitivity ranging from 0.59 to 0.78 and a specificity ranging from 0.64 to 0.92. When using the T-scores, the RCADS suggest a score of 65 as a borderline clinical and a score of 70 as a clinical threshold (Chorpita et al., 2005). The RCADS has been used in multiple studies with autistic youth (see Kim & Lecavalier, 2022).
Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS-PL)
The K-SADS-PL (J. Kaufman et al., 1997, 2016) is a semi-structured diagnostic interview that is designed to be administered in a conversational style to parent and child by the same clinician. It assesses symptoms of child psychiatric disorders according to DSM-5 criteria and includes probes to guide and illustrate ways to elicit the information necessary to score each item. Final diagnoses are based on summary ratings integrating information derived from all sources of information. The initial study by J. Kaufman and colleagues (1997) found excellent interrater reliability, fair-to-good test-retest reliability, and good concurrent validity. The K-SADS-PL has been frequently used in studies with autistic children and adolescents (e.g., Caamaño et al., 2013; Mattila et al., 2012) although how the measure performs psychometrically in this population has not been assessed. In the current study, the screen interview and the diagnostic supplements that are required to diagnose Major Depression (MDD) and Anxiety Disorders (i.e., Panic Disorder (PD), Separation Anxiety (SAD), Social Anxiety (SOC), Specific Phobia (SP), Generalized Anxiety (GAD), Obsessive-Compulsive Disorder (OCD) of the most recent version, K-SADS-PL DSM-5 November 2016 (J. Kaufman et al., 2016), were administered by the lead author, a psychology doctoral student, under the supervision of the second author, a licensed psychologist.
Statistical Analyses
All data analyses were conducted using R. First, the prevalence and the presentation of anxiety and depressive symptoms in autistic youth was examined by the number of participants receiving an above threshold rating on each item on the K-SADS-PL.
Test-retest reliability was measured through a mixed effect, absolute agreement, single measurement intraclass correlation coefficients (ICCs) between the data from two time points (McGraw & Wong, 1996). We used the guidelines suggested by Koo and Li (2016) to interpret values (i.e., 0.5 ≤ ICC < 0.75 moderate reliability, 0.75 ≤ ICC < 0.9 good reliability, and 0.9 < ICC excellent reliability). Internal consistency was examined by measuring Cronbach’s alpha.
Diagnostic validity was assessed by examining the cutoffs using the receiver operating characteristic (ROC) analysis and measuring sensitivity, specificity, positive predictive values (PPV), and negative predictive values (NPV) when compared with the criterion, the summary ratings on the K-SADS-PL. Areas under the ROC curve (AUCs) were also calculated. For the self-report measures, both raw scores and T-scores were used in identifying the best cutoff. The RCADS does not generate T-scores above 80 and therefore a score of 80 was used when the participant obtained a score of > 80. First, the Youden Index was utilized to determine the cutoff (Fluss et al., 2005; Youden, 1950), then for the scales with an acceptable AUC value (i.e., AUC = 0.70 or higher), a range of cutoff scores were analyzed to assess the sensitivity, specificity, PPV, and NPV tradeoffs with cutoff selections. The effect of demographic variables as moderators to the test-retest reliability was examined. The data from Time 2 was regressed on data from Time 1, age, and the interaction between data from Time 1 and age. Same procedure was repeated with scores on IQ and AB conceptual.
Results
Table 1 shows demographic data for children and parents participating in the study. The final sample was characterized by a mean IQ of 93.4 (SD = 21.2) and a mean AB conceptual score of 78.3 (SD = 10.1). The majority of the sample was male (n = 39, 71%) and White (n = 43, 78%). Figure 1 depicts the distribution of participants’ age, IQ, and AB conceptual scores.
Symptom Endorsement of Anxiety Disorders and Depression
All parent-child dyads participated in the K-SADS-PL except for one youth whose parent indicated too much social anxiety. For this participant, clinical judgement was based on parent report and direct observation. Based on the K-SADS-PL summary ratings, GAD (n = 20, 36%) and SOC (n = 16, 29%) were the two most prevalent disorders, followed by MDD (n = 9, 16%), SP (n = 6, 11%), SAD (n = 4, 7%), OCD (n = 4, 7%), and PD (n = 1, 2%).
The item endorsements of anxiety and depression on the K-SADS-PL were examined for GAD, SOC, and MDD. Twenty-two participants completed the GAD supplement and overconcern about competence (n = 10), marked self-consciousness (n = 9) were the most endorsed types of worries, with difficulty concentrating (n = 19), restlessness (n = 17), sleep disturbance (n = 13), and irritability (n = 13) being the most frequently endorsed associated symptoms. Seventeen participants completed the SOC supplement and nearly all participants endorsed all items (i.e., social situations elicit distress, exposure almost always elicits anxiety, avoidance of social situations or endures with intense anxiety, and fears humiliation, embarrassment, or rejection). Seventeen participants completed the MDD supplement and fatigue (n = 8), decreased concentration (n = 6), and indecision (n = 5) were the most endorsed symptoms in addition to depressed and irritable mood.
Reliability
Table 2 shows the test-retest and internal consistency values for the RCADS and CDI 2:SR[S]. The RCADS SAD, PD, SOC, and MDD scores and the RCADS total anxiety and internalizing scores showed good test-retest reliability with ICCs above 0.80. The RCADS OCD (ICC = 0.60), GAD (ICC = 0.65), and the CDI 2:SR[S] (ICC = 0.74) showed test-retest reliability in the moderate range. Additionally, the RCADS showed acceptable-to-good internal consistency for individual subscales (α = 0.74 − 0.88) whereas the CDI 2:SR[S] showed poor-to-acceptable internal consistency at Time 1 and Time 2 (α = 0.67 − 0.71).
The Effect of Age, Cognitive Ability, and AB on Test-Retest Reliability
Moderation analysis identified higher AB Conceptual as a significant moderator for the CDI 2:SR[S] total scores at Time 1 predicting scores at Time 2. No other moderators were identified in predicting the association between self-reported anxiety or depressive symptoms at Time 1 and Time 2. Table 3 shows the results of the moderation analysis. Figure 2 illustrates the interaction between AB conceptual and CDI 2:SR[S] scores.
Diagnostic Validity
There were too few participants endorsing symptoms of OCD, SAD, and PD subscales of the RCADS to assess diagnostic validity (n = 4, 4, and 1, respectively). Table 4 shows the results based on the Youden Index for GAD, SOC, and MDD, and Fig. 3 depicts the respective ROC curves. Using clinical judgement based on the K-SADS-PL summary rating as the criterion, when raw scores were used, the Youden Index identified cutoff points of 6 for CDI 2:SR[S] (sensitivity = 0.89, specificity = 0.54), 8 for RCADS GAD (sensitivity = 0.25, specificity = 0.83), 8 for RCADS SOC (sensitivity = 0.88, specificity = 0.51), and 4 for RCADS MDD (sensitivity = 1.00, specificity = 0.13). With T-scores, the ROC analysis identified cutoff points of 56 for CDI 2:SR[S] (sensitivity = 1.00, specificity = 0.43), 38 for RCADS GAD (sensitivity = 0.80, specificity = 0.26), 48 for RCADS SOC (sensitivity = 0.94, specificity = 0.64), and 45 for RCADS MDD (sensitivity = 1.00, specificity = 0.28).
The RCADS SOC and the CDI 2:SR[S] yielded an AUC value above 0.70. Table 5 presents a range of cutoff scores for these two scales. For the RCADS SOC, T-scores performed better than raw scores with a higher AUC value. For the CDI 2:SR[S], both raw scores and T-scores performed similarly. The raw score cutoff indicated by the Youden Index (raw score = 6) showed higher sensitivity and NPV and a lower specificity and PPV. A cutoff of 8, which has a lower Youden Index, was associated with more balanced metrics and higher specificity (sensitivity = 0.67, specificity = 0.74, PPV = 0.33, NPV = 0.92). The T-score indicated by the Youden Index (T-score = 56) yielded a perfect sensitivity and NPV, yet much lower specificity and PPV. A slightly higher T-score of 60 (sensitivity = 0.89, specificity = 0.54, PPV = 0.28, NPV = 0.96) or 64 (sensitivity = 0.67, specificity = 0.63, PPV = 0.26, NPV = 0.91) was associated with higher specificity.
Discussion
This is the first study to examine both the test-retest reliability and diagnostic validity of self-report instruments of anxiety and depressive symptoms in autistic youth. The findings provide insight into the nature of how autistic youth report their own internalizing symptoms and into the strengths and challenges of using self-reported instruments to measure different anxiety and depressive symptoms.
Test-Retest Reliability
Data indicated moderate-to-good level of test-retest reliability in autistic youth when reporting anxiety and depressive symptoms. Considering previous findings that autistic children’s ratings concur with their parents just as much as neurotypical children (Kim & Lecavalier, 2022), it appears as though autistic youth are, in general, reliable reporters of their inner state. Specifically, the RCADS overall showed good test-retest reliability (ICC = 0.81 – 0.87), and the CDI 2:SR[S] showed comparable test-retest reliability (ICC = 0.74) to what has been reported in the scale development study (Kovacs & MHS Staff, 2011; obtained r = .77). It is important to take into consideration the time-dependent nature of depression in interpreting these results. MDD, by definition, consists of a Major Depressive Episode which lasts for two or more weeks which means depending on the duration or severity of the episode, the 2-week interval implemented in this study may have been enough to see meaningful changes in the symptoms. Disentangling the temporal stability of the measurement from the stability of the construct is a complex task which future studies must contend with. Temporal stability, that is, showing that an instrument is not vulnerable to random fluctuations, is a prerequisite to measuring change.
There were exceptions to the good test-retest reliability with a few scales. The RCADS OCD scale showed the poorest reliability with an ICC of 0.60. This is in line with previous findings from the initial study by Chorpita and colleagues (2000) and studies in ASD (Kaat & Lecavalier, 2015). More research is needed on the overlapping phenomenology and the adaptation of instruments to differentiate OCD from ASD symptoms. The RCADS GAD scale also showed a relatively poorer ICC of 0.65, lower than the 0.79 originally reported by Chorpita and colleagues (2000) for a one-week interval. This inconsistency may be due to the differences in the time interval or potentially related to the poor validity observed in this study.
Diagnostic Validity
Diagnostic Validity of Self-Reported Social Anxiety
The RCADS SOC showed the best performance in predicting diagnoses, in fact, better than originally reported by Chorpita and colleagues (2005). However, it is noteworthy that the identified cutoff was a T-score of 48. As expected, with a cutoff this low, sensitivity is much higher than specificity (0.94, 0.64, respectively), suggesting utility as a screening tool, rather than a diagnostic one. The low cutoff score suggests that contrary to parent report which often leads to an over-reporting of social anxiety due to the overlapping nature of constructs (Kaat & Lecavalier, 2015; Renno & Wood, 2013), the opposite may be true with self-report (Carruthers et al., 2020). Contrary to previous reports on atypical presentation of social anxiety (Kerns et al., 2014; Kerns & Kendall, 2012; Lau et al., 2020), experiencing fear of negative evaluation was in fact frequently endorsed by participants in this study, and therefore the absence of this fear did not appear to be the cause of the observed low cutoff score.
Diagnostic Validity of Self-Reported Depression
The CDI 2:SR[S] performed significantly better in predicting diagnoses than the RCADS MDD in autistic youth. A raw score cutoff of 6 and a T-score cutoff of 56 were identified by the Youden Index, although a slightly higher cutoff (T-score 60 or 64) may be more desirable in situations where a more balanced sensitivity and specificity are needed. The sensitivity and NPV of CDI 2:SR[S] were comparable but the specificity and PPV were considerably lower than previous reports (Cho et al., 2022; Kovacs & MHS Staff, 2011). On the other hand, the RCADS MDD showed poor accuracy in predicting diagnoses. This is inconsistent with previous findings from a non-ASD clinical sample as Chorpita and colleagues (2005) found the MDD scale to show the most favorable prediction above chance. The CDI 2:SR[S] differs from the RCADS in two important ways: having a time frame of two weeks instead of one and having individuals pick one sentence in a group of three instead of a Likert scale, which is known to be more challenging for children (Mellor & Moore, 2014). The discrepant results between these two measures may therefore in part be due to the structure of the measures.
Diagnostic Validity of Self-Reported Generalized Anxiety
The RCADS GAD showed the worst diagnostic accuracy with an AUC value close to 0.50, suggesting no discrimination power. Few participants obtained above threshold ratings on the specific K-SADS-PL items (e.g., preoccupation with past behavior, worries about future), despite GAD being the most prevalent diagnosis in our sample. This may be explained by circumscribed worries, or atypical worries related to individuals’ circumscribed interests (Kerns et al., 2014, 2021; Kerns & Kendall, 2012). In other words, the poor diagnostic validity could be related to the RCADS GAD items not encompassing enough variability in the content of the assessed worries. Future research using different instruments is needed to further determine whether poor validity with generalized anxiety exists beyond the RCADS.
The Effect of Age, Cognitive Ability, and AB on Test-Retest Reliability
Overall, data suggested a potential relationship with AB Conceptual and the psychometric properties of depressive symptoms. Higher AB conceptual skills led to higher test-retest reliability of depressive symptoms, similar to the previously reported relationship between IQ and inter-rater reliability (Kaat & Lecavalier, 2015; Stratis & Lecavalier, 2015). We interpret this association with caution as the effect was marginal and the results should not be generalized outside of the score range of the current sample (i.e., 57 to 97). Further caution is warranted as this relationship was not observed across different measures (i.e., CDI 2:SR[S] and RCADS MDD). Further investigation is required to examine the role of age, practical and social adaptive skills, IQ, and other potential predictors of reliability and validity in self-reported internalizing symptoms using a larger sample.
Implications
This study has several implications for clinicians and researchers. There have been few studies investigating the psychometric properties of instruments for internalizing symptoms in autistic children. To our knowledge, this was the first study to examine the test-retest reliability and the diagnostic validity of the RCADS and the CDI 2:SR[S], two widely used instruments. This is also the first study to use the K-SADS-PL as a reference standard for exploring diagnostic validity in autistic youth in the US. This study included children with a wide range of functioning which allows to examine the effect of participant characteristics on psychometric properties. The inclusion of individuals with a wide range of cognitive ability may help to decrease the selection bias inherent in limiting studies to those individuals with average to above average cognitive functioning.
Limitations
Results of the current study should be interpreted in light of several considerations. This study was conducted with a relatively small sample of convenience. Nevertheless, it was well-powered to assess temporal stability and compared favorably to several other diagnostic validity studies. The use of the K-SADS-PL in establishing clinical diagnoses may have precluded the investigation of atypical presentations given that it is based on the DSM-5. Along these lines, only 11% of the current sample presented with a specific phobia which is inconsistent with the literature (See van Steensel & Heeman, 2017; Vasa et al., 2020; White et al., 2009). Additionally, this study did not include prior psychiatric diagnoses as moderators of psychometric properties. Prior diagnoses may affect the level of insight into participants’ current symptoms and future studies are encouraged to take this into consideration.
Conclusions
In conclusion, findings of this study suggest autistic youth to be reliable reporters of internalizing symptoms over time. The data also question the validity of existing cutoffs. The RCADS is not recommended to be used in screening for or measuring symptoms of generalized anxiety or major depression, although it shows promise as a screening tool for social anxiety when using lower cutoffs than established for the general population. With respect to depression, the CDI 2:SR[S] may be used as a screener, but also with a lower cutoff than previously recommended. Given the variability in findings, future research is warranted to better understand the validity of autistic youth’s self-report of internalizing symptoms. Future directions in studying diagnostic validity include replicating these results with different measures, including parent-report rating scales for richer interpretation, and using both traditional and autism-specific instruments to assign diagnoses.
References
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232. https://doi.org/10.1037/0033-2909.101.2.213.
Allen, C., Silove, N., Williams, K., & Hutchins, P. (2007). Validity of the social communication questionnaire in assessing risk of autism in preschool children with developmental problems. Journal of Autism and Developmental Disorders, 37, 1272–1278. https://doi.org/10.1007/s10803-006-0279-7.
American Psychiatric Association (2022). Diagnostic and statistical manual of mental disorders (5th ed., text rev.). https://doi.org/10.1176/appi.books.9780890425787.
Barnard-Brak, L., Brewer, A., Chesnut, S., Richman, D., & Schaeffer, A. M. (2016). The sensitivity and specificity of the social communication questionnaire for autism spectrum with respect to age. Autism Research, 9(8), 838–845. https://doi.org/10.1002/aur.1584.
Berument, S., Rutter, M., Lord, C., Pickles, A., & Bailey, A. (1999). Autism screening questionnaire: Diagnostic validity. The British Journal of Psychiatry: The Journal of Mental Science, 175, 444–451. https://doi.org/10.1192/bjp.175.5.444.
Bitsko, R. H., Claussen, A. H., Lichtstein, J., Black, L. J., Everett Jones, S., Danielson, M. D., Hoenig, J. M., Jack, D., Brody, S. P., Gyawali, D. J., Maenner, S., Warner, M. M., Holland, M., Perou, K. M., Crosby, R., Blumberg, A. E., Avenevoli, S. J., Kaminski, S., J. W., & Ghandour, R. M. (2022). Mental health surveillance among children—United States, 2013–2019. MMWR Supplements, 71(2), 1–42.
Brody, D. J., Pratt, L. A., & Hughes, J. P. (2018). Prevalence of depression among adults aged 20 and over: United States, 2013–2016. Nchs Data Brief, 303.
Burrows, C. A., Usher, L. V., Becker-Haimes, E. M., McMahon, C. M., Mundy, P. C., Jensen-Doss, A., & Henderson, H. A. (2018). Profiles and correlates of parent–child agreement on social anxiety symptoms in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 48(6), 2023–2037. https://doi.org/10.1007/s10803-018-3461-9.
Caamaño, M., Boada, L., Merchán-Naranjo, J., Moreno, C., Llorente, C., Moreno, D., Arango, C., & Parellada, M. (2013). Psychopathology in children and adolescents with ASD without mental retardation. Journal of Autism and Developmental Disorders, 43(10), 2442–2449. https://doi.org/10.1007/s10803-013-1792-0.
Carruthers, S., Kent, R., Hollocks, M. J., & Simonoff, E. (2020). Brief report: Testing the psychometric properties of the spence children’s anxiety scale (SCAS) and the screen for child anxiety related emotional disorders (SCARED) in autism spectrum disorder. Journal of Autism and Developmental Disorders, 50(7), 2625–2632. https://doi.org/10.1007/s10803-018-3774-8.
Chandrasekhar, T., & Sikich, L. (2015). Challenges in the diagnosis and treatment of depression in autism spectrum disorders across the lifespan. Dialogues in Clinical Neuroscience, 17(2), 219–227. https://doi.org/10.31887/DCNS.2015.17.2/tchandrasekhar.
Cho, Y., Lee, E. H., Hong, S. H., Joung, Y. S., & Kim, J. H. (2022). Reliability and validity of the Korean version of children’s depression inventory 2 short version as a screening tool: A comparison with the standard 28-Item version. Psychiatry Investigation, 19(1), 54–60. https://doi.org/10.30773/pi.2021.0296.
Chorpita, B. F., Yim, L., Moffitt, C., Umemoto, L. A., & Francis, S. E. (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behaviour Research and Therapy, 38(8), 835–855. https://doi.org/10.1016/S0005-7967(99)00130-8.
Chorpita, B. F., Moffitt, C. E., & Gray, J. (2005). Psychometric properties of the revised child anxiety and depression scale in a clinical sample. Behaviour Research and Therapy, 43(3), 309–322. https://doi.org/10.1016/j.brat.2004.02.004.
De Los Reyes, A., & Epkins, C. C. (2023). Introduction to the special issue. A dozen years of demonstrating that informant discrepancies are more than measurement error: Toward guidelines for integrating data from multi-informant assessments of youth mental health. Journal of Clinical Child & Adolescent Psychology, 52(1), 1–18. https://doi.org/10.1080/15374416.2022.2158843.
Fluss, R., Faraggi, D., & Reiser, B. (2005). Estimation of the Youden Index and its associated cutoff point. Biometrical Journal, 47(4), 458–472. https://doi.org/10.1002/bimj.200410135.
Greenaway, R., & Howlin, P. (2010). Dysfunctional attitudes and perfectionism and their relationship to anxious and depressive symptoms in boys with autism spectrum disorders. Journal of Autism and Developmental Disorders, 40, 1179–1187. https://doi.org/10.1007/s10803-010-0977-z.
Grills, A. E., & Ollendick, T. H. (2002). Issues in parent–child agreement: The case of structured diagnostic interviews. Clinical Child and Family Psychology Review.
Harrison, P. L., & Oakland, T. (2015). Adaptive behavior assessment system manual (3rd ed.).). Psychological Corporation.
Hollocks, M. J., Lerh, J. W., Magiati, I., Meiser-Stedman, R., & Brugha, T. S. (2019). Anxiety and depression in adults with autism spectrum disorder: A systematic review and meta-analysis. Psychological Medicine, 49(4), 559–572. https://doi.org/10.1017/S0033291718002283.
Hossain, M. M., Khan, N., Sultana, A., Ma, P., McKyer, E. L. J., Ahmed, H. U., & Purohit, N. (2020). Prevalence of comorbid psychiatric disorders among people with autism spectrum disorder: An umbrella review of systematic reviews and meta-analyses. Psychiatry Research, 287, 112922. https://doi.org/10.1016/j.psychres.2020.112922.
Hudson, C. C., Hall, L., & Harkness, K. L. (2019). Prevalence of depressive disorders in individuals with autism spectrum disorder: A meta-analysis. Journal of Abnormal Child Psychology, 47(1), 165–175. https://doi.org/10.1007/s10802-018-0402-1.
Hwang, Y. I. (Jane), Arnold, S., Srasuebkul, P., & Trollor, J. (Eds.). (2020). Understanding anxiety in adults on the autism spectrum: An investigation of its relationship with intolerance of uncertainty, sensory sensitivities and repetitive behaviours. Autism, 24(2), 411–422. https://doi.org/10.1177/1362361319868907.
Jenkinson, R., Milne, E., & Thompson, A. (2020). The relationship between intolerance of uncertainty and anxiety in autism: A systematic literature review and meta-analysis. Autism, 24(8), 1933–1944. https://doi.org/10.1177/1362361320932437.
Kaat, A. J., & Lecavalier, L. (2015). Reliability and validity of parent- and child-rated anxiety measures in autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(10), 3219–3231. https://doi.org/10.1007/s10803-015-2481-y.
Kaufman, A. S., & Kaufman, N. L. (2004). Kaufman brief intelligence test, second edition (KBIT-2). Pearson.
Kaufman, A. S., & Kaufman, N. L. (2022). Kaufman brief intelligence test, second edition (KBIT-2) revised. NCS Pearson.
Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., Williamson, D., & Ryan, N. (1997). Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36(7), 980–988. https://doi.org/10.1097/00004583-199707000-00021. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL).
Kaufman, J., Birmaher, B., Axelson, D., Perepletchikova, F., Brent, D., & Ryan, N. (2016). Schedule for affective disorders and schizophrenia for school-aged children: Present and lifetime version (K-SADS-PL) DSM-5 November 2016. Child and Adolescetn Research and Education (CARE) Program, Yale University.
Keith, J. M., Jamieson, J. P., & Bennetto, L. (2019). The importance of adolescent self-report in autism spectrum disorder: Integration of questionnaire and autonomic measures. Journal of Abnormal Child Psychology, 47(4), 741–754. https://doi.org/10.1007/s10802-018-0455-1.
Kerns, C. M., & Kendall, P. C. (2012). The presentation and classification of anxiety in autism spectrum disorder. Clinical Psychology: Science and Practice, 19(4), 323–347. https://doi.org/10.1111/cpsp.12009.
Kerns, C. M., Kendall, P., Berry, L., Souders, M., Franklin, M., Schultz, R., Miller, J., & Herrington, J. (2014). Traditional and atypical presentations of anxiety in youth with autism spectrum disorder. Journal of Autism & Developmental Disorders, 44(11), 2851–2861. https://doi.org/10.1007/s10803-014-2141-7.
Kerns, C. M., Renno, P., Kendall, P. C., Wood, J. J., & Storch, E. A. (2017). Anxiety disorders interview schedule–autism addendum: Reliability and validity in children with autism spectrum disorder. Journal of Clinical Child & Adolescent Psychology, 46(1), 88–100. https://doi.org/10.1080/15374416.2016.1233501.
Kerns, C. M., Winder-Patel, B., Iosif, A. M., Nordahl, C. W., Heath, B., Solomon, M., & Amaral, D. G. (2021). Clinically significant anxiety in children with autism spectrum disorder and varied intellectual functioning. Journal of Clinical Child & Adolescent Psychology, 50(6), 780–795. https://doi.org/10.1080/15374416.2019.1703712.
Kim, S. Y., & Lecavalier, L. (2021). Depression in young autistic people: A scoping review. Research in Autism Spectrum Disorders, 88, 101841. https://doi.org/10.1016/j.rasd.2021.101841.
Kim, S. Y., & Lecavalier, L. (2022). Evaluating the use of self-reported measures in autistic individuals in the context of psychiatric assessment: A systematic review. Journal of Autism and Developmental Disorders, 52(10), 4355–4374. https://doi.org/10.1007/s10803-021-05323-y.
Kinnaird, E., Stewart, C., & Tchanturia, K. (2019). Investigating alexithymia in autism: A systematic review and meta-analysis. European Psychiatry, 55, 80–89. https://doi.org/10.1016/j.eurpsy.2018.09.004.
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012.
Kovacs, M. (1992). The children’s depression inventory (CDI) technical manual update. Multi-Health System Inc.
Kovacs, M., & MHS Staff. (2011). Children’s derpession inventory (CDI 2), 2nd edition: Technical manual. Multi-Health Systems.
Lai, M. C., Kassee, C., Besney, R., Bonato, S., Hull, L., Mandy, W., Szatmari, P., & Ameis, S. H. (2019). Prevalence of co-occurring mental health diagnoses in the autism population: A systematic review and meta-analysis. The Lancet Psychiatry, 6(10), 819–829. https://doi.org/10.1016/S2215-0366(19)30289-5.
Lau, B. Y., Leong, R., Uljarevic, M., Lerh, J. W., Rodgers, J., Hollocks, M. J., South, M., McConachie, H., Ozsivadjian, A., Van Hecke, A., Libove, R., Hardan, A., Leekam, S., Simonoff, E., & Magiati, I. (2020). Anxiety in young people with autism spectrum disorder: Common and autism-related anxiety experiences and their associations with individual characteristics. Autism, 24(5), 1111–1126. https://doi.org/10.1177/1362361319886246.
Lecavalier, L., Wood, J. J., Halladay, A. K., Jones, N. E., Aman, M. G., Cook, E. H., Handen, B. L., King, B. H., Pearson, D. A., Hallett, V., Sullivan, K. A., Grondhuis, S., Bishop, S. L., Horrigan, J. P., Dawson, G., & Scahill, L. (2014). Measuring anxiety as a treatment endpoint in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(5), 1128–1143. https://doi.org/10.1007/s10803-013-1974-9.
Magnuson, K. M., & Constantino, J. N. (2011). Characterization of depression in children with autism spectrum disorders. Journal of Developmental & Behavioral Pediatrics, 32(4), 332–340. https://doi.org/10.1097/DBP.0b013e318213f56c.
Mattila, M. L., Jussila, K., Linna, S. L., Kielinen, M., Bloigu, R., Kuusikko-Gauffin, S., Joskitt, L., Ebeling, H., Hurtig, T., & Moilanen, I. (2012). Validation of the Finnish autism spectrum screening questionnaire (ASSQ) for clinical settings and total population screening. Journal of Autism and Developmental Disorders, 42, 2162–2180. https://doi.org/10.1007/s10803-012-1464-5.
Mazefsky, C. A., Kao, J., & Oswald, D. P. (2011). Preliminary evidence suggesting caution in the use of psychiatric self-report measures with adolescents with high-functioning autism spectrum disorders. Research in Autism Spectrum Disorders, 5(1), 164–174. https://doi.org/10.1016/j.rasd.2010.03.006.
McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. https://doi.org/10.1037/1082-989X.1.1.30.
Mellor, D., & Moore, K. A. (2014). The use of likert scales with children. Journal of Pediatric Psychology, 39(3), 369–379. https://doi.org/10.1093/jpepsy/jst079.
Montazeri, F., de Bildt, A., Dekker, V., & Anderson, G. M. (2020). Network analysis of behaviors in the depression and autism realms: Inter-relationships and clinical implications. Journal of Autism and Developmental Disorders, 50(5), 1580–1595. https://doi.org/10.1007/s10803-019-03914-4.
Neil, L., Olsson, N. C., & Pellicano, E. (2016). The relationship between intolerance of uncertainty, sensory sensitivities, and anxiety in autistic and typically developing children. Journal of Autism and Developmental Disorders, 46(6), 1962–1973. https://doi.org/10.1007/s10803-016-2721-9.
Norris, M., & Lecavalier, L. (2010). Screening accuracy of level 2 autism spectrum disorder rating scales: A review of selected instruments. Autism, 14(4), 263–284. https://doi.org/10.1177/1362361309348071.
Ooi, Y. P., Weng, S. J., Magiati, I., Ang, R. P., Goh, T. J., Fung, D. S., & Sung, M. (2016). Factors influencing agreement between parent and child reports of anxiety symptoms among children with high-functioning autism spectrum disorders. Journal of Developmental and Physical Disabilities, 28(3), 407–424. https://doi.org/10.1007/s10882-016-9481-5.
Perry, D. W., Marston, G. M., Hinder, S. A. J., Munden, A. C., & Roy, A. (2001). The phenomenology of depressive illness in people with a learning disability and autism. Autism, 5(3), 265–275. https://doi.org/10.1177/1362361301005003004.
Pezzimenti, F., Han, G. T., Vasa, R. A., & Gotham, K. (2019). Depression in youth with autism spectrum disorder. Child and Adolescent Psychiatric Clinics of North America, 28(3), 397–409. https://doi.org/10.1016/j.chc.2019.02.009.
Phares, V., Compas, B. E., & Howell, D. C. (1989). Perspectives on child behavior problems: Comparisons of children’s self-reports with parent and teacher reports. Psychological Assessment, 1(1), 68–71.
Renno, P., & Wood, J. J. (2013). Discriminant and convergent validity of the anxiety construct in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 43(9), 2135–2146. https://doi.org/10.1007/s10803-013-1767-1.
Rosen, T. E., & Lerner, M. D. (2018). Error-related brain activity and anxiety symptoms in youth with autism spectrum disorder. Autism Research, 11(2), 342–354. https://doi.org/10.1002/aur.1898.
Rutter, M., Le Couteur, A., & Lord, C. (2003). Autism diagnostic interview-revised (ADI-R). Western Psychological Services.
Sapey-Triomphe, L. A., Lamberton, F., Sonié, S., Mattout, J., & Schmitz, C. (2019). Tactile hypersensitivity and GABA concentration in the sensorimotor cortex of adults with autism. Autism Research, 12(4), 562–575. https://doi.org/10.1002/aur.2073.
Schendel, D. E., DiGuiseppi, C., Croen, L. A., Fallin, M. D., Reed, P. L., Schieve, L. A., Wiggins, L. D., Daniels, J., Grether, J., Levy, S. E., Miller, L., Newschaffer, C., Pinto-Martin, J., Robinson, C., Windham, G. C., Alexander, A., Aylsworth, A. S., Bernal, P., Bonner, J. D., & Yeargin-Allsopp, M. (2012). The study to explore early development (SEED): A multisite epidemiologic study of autism by the centers for autism and developmental disabilities research and epidemiology (CADDRE) network. Journal of Autism and Developmental Disorders, 42(10), 2121–2140. https://doi.org/10.1007/s10803-012-1461-8.
Schiltz, H., McIntyre, N., Swain-Lerro, L., Zajic, M., & Mundy, P. (2017). The stability of self-reported anxiety in youth with autism versus ADHD or typical development. Journal of Autism and Developmental Disorders, 47(12), 3756–3764. https://doi.org/10.1007/s10803-017-3184-3.
Sharpley, C. F., Bitsika, V., Sarmukadam, K., McMillan, M. E., & Agnew, L. L. (2019). A brief report on the 2.4-year test-retest agreement of morning cortisol and anxiety in boys with autism spectrum disorder. Journal of Developmental and Physical Disabilities, 31(1), 103–114. https://doi.org/10.1007/s10882-018-9633-x.
South, M., & Rodgers, J. (2017). Sensory, emotional and cognitive contributions to anxiety in autism spectrum disorders. Frontiers in Human Neuroscience, 11(20), 1–7. https://doi.org/10.3389/fnhum.2017.00020.
Stewart, M. E., Barnard, L., Pearson, J., Hasan, R., & O’Brien, G. (2006). Presentation of depression in autism and Asperger syndrome: A review. Autism, 10(1), 103–116. https://doi.org/10.1177/1362361306062013.
Stratis, E. A., & Lecavalier, L. (2015). Informant agreement for youth with autism spectrum disorder or intellectual disability: A meta-analysis. Journal of Autism and Developmental Disorders, 45(4), 1026–1041. https://doi.org/10.1007/s10803-014-2258-8.
van Steensel, F. J. A., & Heeman, E. J. (2017). Anxiety levels in children with autism spectrum disorder: A meta-analysis. Journal of Child and Family Studies, 26(7), 1753–1767. https://doi.org/10.1007/s10826-017-0687-7.
Vasa, R. A., Keefer, A., McDonald, R. G., Hunsche, M. C., & Kerns, C. M. (2020). A scoping review of anxiety in young children with autism spectrum disorder. Autism Research, 13(12), 2038–2057. https://doi.org/10.1002/aur.2395.
White, S. W., Oswald, D., Ollendick, T., & Scahill, L. (2009). Anxiety in children and adolescents with autism spectrum disorders. Clinical Psychology Review, 29(3), 216–229. https://doi.org/10.1016/j.cpr.2009.01.003.
Wiggins, L. D., Reynolds, A., Rice, C. E., Moody, E. J., Bernal, P., Blaskey, L., Rosenberg, S. A., Lee, L. C., & Levy, S. E. (2015). Using standardized diagnostic instruments to classify children with autism in the study to explore early development. Journal of Autism and Developmental Disorders, 45(5), 1271–1280. https://doi.org/10.1007/s10803-014-2287-3.
Wigham, S., & McConachie, H. (2014). Systematic review of the properties of tools used to measure outcomes in anxiety intervention dstudies for children with autism spectrum disorders. Plos One, 9(1), e85268. https://doi.org/10.1371/journal.pone.0085268.
Wigham, S., Rodgers, J., South, M., McConachie, H., & Freeston, M. (2015). The interplay between sensory processing abnormalities, intolerance of uncertainty, anxiety and restricted and repetitive behaviours in autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(4), 943–952. https://doi.org/10.1007/s10803-014-2248-x.
Wood, J. J., & Gadow, K. D. (2010). Exploring the nature and function of anxiety in youth with autism spectrum disorders. Clinical Psychology: Science and Practice, 17(4), 281–292. https://doi.org/10.1111/j.1468-2850.2010.01220.x.
Youden, W. J. (1950). Index for rating diagnostic tests. Cancer, 3(1), 32–35. https://doi.org/10.1002/1097-0142(1950)3:1%3C32::aid-cncr2820030106%3E3.0.co;2-3.
Funding
Partial funding to support this project was received from the Ohio State University Nisonger Center Research Fund.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
Approval was obtained from the Human Subjects Research Committee of the Ohio State University (IRB ID# 2021B0236).
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Competing Interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kim, S.Y., Lecavalier, L. Stability and Validity of Self-Reported Depression and Anxiety in Autistic Youth. J Autism Dev Disord (2024). https://doi.org/10.1007/s10803-024-06456-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10803-024-06456-6