Abstract
Purpose
Classification is the cornerstone of clinical diagnostic practice and research. However, the extant psychiatric classification systems are not well supported by research evidence. In particular, extensive comorbidity among putatively distinct disorders flags an urgent need for fundamental changes in how we conceptualize psychopathology. Over the past decade, research has coalesced on an empirically based model that suggests many common mental disorders are structured according to two correlated latent dimensions: internalizing and externalizing.
Methods
We review and discuss the development of a dimensional-spectrum model which organizes mental disorders in an empirically based manner. We also touch upon changes in the DSM-5 and put forward recommendations for future research endeavors.
Results
Our review highlights substantial empirical support for the empirically based internalizing–externalizing model of psychopathology, which provides a parsimonious means of addressing comorbidity.
Conclusions
As future research goals, we suggest that the field would benefit from: expanding the meta-structure of psychopathology to include additional disorders, development of empirically based thresholds, inclusion of a developmental perspective, and intertwining genomic and neuroscience dimensions with the empirical structure of psychopathology.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Classification is fundamental to the quantitative study of psychiatric phenomena. Just as a building requires a solid foundation to support its framework and remain upright, in mental health, a valid classification system provides the fundamental building block of diagnosis, assessment, intervention, and research. In psychiatry, the two leading classification systems are the Diagnostic and Statistical Manual of Mental Disorders (DSM) and the International Classification of Diseases (ICD). The release of the DSM-III in 1980 and ICD-10 in 1992 heralded a major advance for the psychiatric field by providing standardized diagnostic criteria for the first time [1].
The DSM and ICD facilitate communication across users (e.g., clinicians, researchers, judicial systems, and insurance companies) [2]. From a clinical perspective, they promote consistent descriptions and reliable diagnostic assessment. From a research point-of-view, they facilitate comparative analyses, systematic recording, and analysis and interpretation of data from different countries. From an educational perspective, they provide a means of delivering standardized training. With such a wide range of applications, it is critical that our classification systems reflect an accurate description of mental illness. Empirical research from clinical and community populations, however, highlights significant flaws in assumptions underlying the DSM and ICD. Crucially, extensive comorbidity among putatively distinct disorders has challenged the traditional view that disorders are discrete entities. Comorbidity patterns are considered to reflect the underlying structure of psychopathology; accordingly, over the last decade extensive structural investigations have been conducted to elucidate the natural classification of mental disorders.
Our companion report [3] provides a comprehensive review of the transdiagnostic factor literature that has emerged in the search for an empirically based nosology. This review outlines future directions and implications of transdiagnostic approaches to mental disorder classification. Due to space restrictions, we focus on the DSM, although the issues are equally pertinent to the ICD, which shares a similar structure [4].
Flaws in the DSM rubric
Historically, the DSM was developed on the basis of consensus among clinicians appointed to specific workgroups, and mental disorders were conceptualized as polythetic, categorical concepts. Polythetic means that disorders are defined by multiple symptoms, but not all symptoms are required to meet a diagnostic threshold. Categorical means that disorders are considered to be absent or present.
In the 30 years following the release of DSM-III, major scientific advances have been made. Large genetic and community studies have been conducted and longitudinal studies, beginning in the 1970s and 1980s, have matured. New statistical techniques have emerged, providing important insights into patterns of disorders, natural history, and trajectories over time, ultimately advancing our understanding of the nature of mental illness. As its architects concede, this work has increasingly cast the spotlight on problems inherent in the assumptions underlying the DSM [5].
First, a polythetic-categorical approach gives rise to significant heterogeneity within diagnostic groupings as it does not account for differences in clinical presentation (e.g., symptoms, age-of-onset, and stage of illness) [6–8].
Second, the categorical system is often criticized for being rigid and reductionist in practice, leading to frustration among clinicians, poor application of diagnostic guidelines, and limited clinical utility [9]. By placing an over-emphasis on reliability, highly specific, and narrow criteria have been identified that fail to cover the spectrum of symptoms. Consequently, many patients are classified under the vague ‘not otherwise-specified’ category [10, 11].
Third, valuable clinical information is lost when adhering to a categorical, diagnostic threshold. This contrasts with clinical medicine where the clinical significance of subthreshold symptoms is well recognized. For example, ‘undifferentiated connective tissue disease’ refers to patients who are in the early stages but do not meet diagnostic criteria for a well-defined connective tissue disease (e.g., rheumatoid arthritis) [12]. Revolutionizing psychiatric classification to include dimensions would align the field with other medicine areas [13].
Fourth and the focus of this review, converging lines of research indicate that disorders co-occur more often than expected by chance, challenging the DSM conceptualization that disorders are discrete entities. Dimensionality also exists between disorders, reflecting shared underlying genetic and environmental liabilities. Based on this evidence, and recognition of the benefits of dimensions, widespread international calls have been made to restructure nomenclature in light of scientific evidence [14].
A quantitative nosology: disorders without borders
To better understand why multiple diagnoses share common risk factors and clinical correlates, latent variable modeling techniques have been applied to diagnostic data. Seminal work by Krueger [15], examining the underlying structure of common mental disorders, indicates that relations between disorders reflect two genetic and environmental dimensions: internalizing and externalizing (see Fig. 1). Internalizing reflects a propensity to experience distress inwards. Internalizing may be conceptualized as a unitary dimension [16, 17], but some research suggests it may also have meaningful subcomponents [4, 18–20], bifurcating into two lower-order sub-dimensions: (1) distress (or anxious-misery), including disorders such as major depression, dysthymia, and generalized anxiety disorder, and (2) fear, including disorders such as panic, social phobia, and specific phobia. Externalizing indicates a tendency to experience distress outwards, and includes substance use disorders (e.g., alcohol, nicotine, cannabis, and drug abuse/dependence) and behavioral problems (e.g., conduct disorder, oppositional defiant disorder, and antisocial personality disorder). For a more in-depth discussion of these latent transdiagnostic dimensions, and those underlying the comorbidity among less common disorders, see our companion review [3] and previous reviews [20, 21]. Overall, the implicit assumption underlying this quantitative, organizational meta-structure of psychopathology is that certain disorders are reflections of a few core psychopathological dimensions. Thus, disorders indicating a particular latent dimension are more likely to be closely related in clinical presentation, likelihood of co-occurrence, shared variance, etiology, and treatment response [22].
DSM syndrome comorbidity has revealed a structure similar to what was already known in Achenbach’s work with young people. Early research on transdiagnostic comorbidity factors in children [23, 24] and adults [18, 25] was seminal in developing a dimensional-spectrum model. Today, the internalizing–externalizing model has accumulated robust, independent support. It has demonstrated invariance across cultures [4, 16–18, 26, 27], gender [28], ethnicity [29], age [30], sexual orientation [31], and time [18, 26, 30, 32]. The model also provides insight into how key psychopathological processes map onto unique components of individual disorders versus shared pathology [33–35]. Furthermore, genetic and environmental risk factors for experiencing psychopathology are parsimoniously accounted for in this model, and internalizing–externalizing mediate the likelihood of developing additional related diagnoses across the lifespan [17, 36–39]. Indeed, Lahey and colleagues [40] found evidence for widespread heterotypic continuity of mental disorders during adulthood, indicating that mental disorders are not fixed, independent entities. Rather, disorders are robustly related to one another in a correlational structure that is manifested both concurrently and across time. This literature has important clinical relevance; rather than focusing on individual disorders, consideration of underlying liabilities may be a useful avenue for identifying appropriate treatment approaches.
While the majority of published structural psychopathology research supports the internalizing–externalizing model, one study failed to replicate this structure. Wittchen et al. [41] failed to replicate the bifurcated internalizing–externalizing model, or any structure, across their age cohorts, concluding that “psychopathology cannot be reduced to any simple structure” (p. 189). In the same year, this research group re-evaluated their findings, finding evidence of a three-factor (distress-fear-externalizing) model, but not for a higher order internalizing factor [42]. Further, Seeley et al. [42] found that while the bifurcated internalizing model fitted their data well, it did not fit notably better than a single-factor or DSM-IV-based model.
A dimensional nosology of mental disorders
Behavior genetic modeling of comorbidity
Findings from behavior genetic modeling of comorbidity suggest that the internalizing–externalizing spectra are etiologically coherent, providing further support for a liability-spectrum model. Kendler and colleagues [36–38, 43, 44] have conducted the most comprehensive multivariate behavior genetic studies to date. This research provides support for a genetic basis underlying the internalizing–externalizing spectra, in addition to a genetic basis for the distress and fear subdimensions. It also supports a hierarchical structure of comorbidity as a number of individual disorders (e.g., alcohol dependence)—though linked to broad liability dimensions—was also characterized by genetic factors unique to each disorder.
Relatedly, disorders, and traits which optimally reflect the underlying genetic risk of externalizing and internalizing psychopathology appear to differ by gender [36] and mothers appear to confer a general propensity to transit internalizing disorders to their offspring, rather than risk for a specific disorder [45].
The role of personality in dimensional spectra
One key question concerns the underlying psychological reasons that psychopathology spectra have a particular structure. For example, why are antisocial problems and substance use problems so closely connected? Evidence suggests that psychopathology spectra derive their organization from the role personality plays in conveying risk for psychopathology in a coherent, psychologically meaningful manner. For example, externalizing derives its coherence from the role disinhibitory personality traits play in seemingly diverse antisocial and substance use behaviors [46]. Similarly, internalizing derives its coherence from the role negative affect (also termed neuroticism) plays in diverse disorders involving mood and anxiety disturbances [36]. Indeed, negative affect is relevant to most forms of psychopathology, such that it increases risk for both internalizing and externalizing disorders, thereby providing the psychological basis for the general factor that ties these spectra together [47]. Conversely, disinhibition is linked to risk for externalizing rather than internalizing syndromes [46]. This helps explain why the structure of psychopathology has reliable hierarchical features, involving an overarching general factor that bifurcates into internalizing–externalizing and further into more even more specific aspects.
Additional higher order aspects of psychopathology structure
Recently, it has been speculated that the meta-structure may encompass an overarching, general factor [48]. This stems from observations that disorders and the internalizing–externalizing spectra are substantially correlated. Capsi et al. [49] labeled this dimension the ‘p factor’, suggesting it can be best understood as a general factor—analogous to the g factor of general intelligence—which summarizes individuals’ propensity to develop any and all forms of common psychopathologies. The authors suggest the p factor may account for the difficultly in identifying causes, consequences, biomarkers, and treatments with specificity to individual disorders. Research by Lahey and colleagues exploring the etiologic structure of child, adolescent [39], and adult [48] psychopathology provides evidence for a broad general factor (a bifactor in factor analytic terms), with higher order internalizing and externalizing factors reflecting additional shared variance in symptoms.
Caveats of dimensions
While dimensions overcome many problems associated with categories, they also have caveats. First, dimensions are less familiar than categories in mental health settings and may therefore be more difficult to use, at least initially, leading to concerns about difficulties in clinical communication and user acceptability [50]. Second, no single dimensional model has achieved universal acceptance. Third, given a historical emphasis on categories, there is only a nascent literature demonstrating the clinical utility of dimensions [5, 51].
Interim summary: a point of reorientation and look toward the future
The internalizing–externalizing model can accommodate comorbidity. It is robustly supported and offers a promising avenue for better understanding etiology, natural history, treatment use, and developing targeted treatment and prevention approaches. From a practical perspective, however, work remains to derive a valid, empirically based psychiatric classification system. In the following section, we discuss challenges and future research directions.
Contemporary and newer directions for the future
Categorical vs. continuous vs. hybrid models
To date, researchers have largely made a priori assumptions about the latent structure of psychopathology. Studies have characterized internalizing as a unidimensional structure [18, 30, 52], two-dimensional structure [4, 15, 26, 28], and set of distinct classes [53, 54]. To our knowledge, limited studies have directly compared continuous, categorical, and hybrid models [55–59].
Continuous (latent trait) models account for patterns of co-occurrence among disorders with reference to a dimension(s). Using factor analytic techniques, individuals are arrayed along a continuum of mild, moderate, and severe pathology. Theoretically, a continuous conceptualization is plausible if the underlying etiologies of the externalizing/internalizing disorders reflect a mixture of genetic polymorphisms and environmental stressors.
Conversely, categorical models—investigated using latent class analysis—account for observed patterns of comorbidity by reference to a finite number of mutually exclusive classes. This approach presumes that individuals within a given class have the same probability of experiencing the disorders. Theoretically, a categorical conceptualization of externalizing and internalizing liabilities is plausible if the underlying etiologies are discrete in nature. Along these lines, for example, specific genetic polymorphisms (distinct forms of genes) may be related to externalizing liability, leading to discrete classes of individuals who experience externalizing behaviors and those who do not.
Alternatively, the latent structure may compose continuous and categorical components—investigated using factor mixture modeling. Hybrid models are categorical insofar as they group individuals into categories. They are also dimensional because once individuals are assigned to liability classes, differences in severity between classes are modeled through continuous latent variables [60]. Hybrid models facilitate meaningful distinctions between homogeneous groups while allowing for different levels of severity.
Although successful, the majority of structural analyses have focused on syndromal-level indicators, which are often heterogeneous. Since symptoms are more homogeneous, extending the existing framework to incorporate symptoms could help delineate lower levels of the hierarchy. Indeed, Markon’s [61] symptom-level analysis replicated the internalizing–externalizing meta-structure and found novel thought disorder and pathological introversion spectra. It is possible that such analyses could produce a proliferation of multiple fine-grained constructs, and it is critical to focus not only on construct identification but also on how these constructs can be incorporated into overarching hierarchical structures and embedded in broader nomological networks.
Relatedly, most research to date has relied on latent variable mixture modeling, taxometric procedures, and model-based clustering. These methods differ in their assumptions and selection should be empirically guided [62]. Future research should explore other analytic options, such as network analysis [63, 64].
Lumping versus splitting
Designing an optimal nosology will be challenging and associated with advantages and disadvantages [65]. The meta-structure provides a succinct means of grouping disorders according to shared commonalities and has given rise to transdiagnostic treatment approaches, offering efficient means of addressing multiple problems in a single framework. Division of disorders could be argued to result in unnecessary complexity and splitting. That being said, the unique features of some disorders, which have a corresponding need for differential treatment, highlights instances where it may be useful to assign labels to reflect heterogeneity [65]. Indeed, while DSM-5 incorporates the internalizing–externalizing meta-structure it also comprises meaningful subtyping distinctions, including a dissociative subtype of PTSD.
Expanding the meta-structure
Much of the research to date has focused on common disorders. To increase utility, it is important to include additional and severe types of mental illness (e.g., schizophrenia, schizoaffective disorder, and autism). As highlighted below, some researchers have begun this process.
Additional spectra
The inclusion of more extreme forms of psychopathology has highlighted novel dimensions spectra. For example, Keyes et al. [66] investigated the location of disorders characterized by detachment and/or psychoticism (i.e., schizotypal, schizoid, avoidant and paranoid personality disorder, manic episodes, and bipolar disorder) in the meta-structure. They found that detachment and psychoticism represented a unique subdimension of internalizing (labeled ‘thought disorder’). Additionally, manic episodes and bipolar disorder demonstrated substantial associations with the distress subdimension and thought disorder dimension. Caspi et al. [49] also found evidence for a thought disorder spectrum, which—together with internalizing and externalizing—was best captured by a general psychopathology dimension (discussed earlier).
The inclusion of schizophrenia and schizotypal personality disorder led Kotov et al. [67] to identify internalizing, externalizing, and psychosis dimensions. In a separate study [68], these authors integrated personality pathology into the model and identified additional dimensions, including thought disorder (e.g., mania, schizotypal personality disorder), somatoform (e.g., hypochondriasis) and antagonism (e.g., histrionic and narcissistic personality disorders) spectra. Markon [61] identified novel thought disorder and pathological introversion dimensions. Finally, Røysamb et al. [27] identified two novel spectra: cognitive-relational disturbance (e.g., histrionic, narcissistic, paranoid, schizotypal, obsessive–compulsive, and borderline personality disorders) and anhedonic introversion (e.g., avoidant and dependent personality disorders, schizoid personality disorder, depressive personality disorder, and dysthymia). Finally, Noordhof et al. [69] found support for a bi-factor model, including one non-specific factor and four specific factors, including two novel spectra—internalizing, externalizing, attention and orientation, and autism spectrum problems.
Bipolar pathology
Evidence for the location of bipolar pathology—conceptualized as a disorder [70], manic episodes [25, 68], or manic symptoms [61]—within the meta-structure has suggested a number of possibilities, consistent with the way in which these phenomena have internalizing and psychotic aspects (i.e., are interstitial). Research indicates that bipolar pathology loads onto internalizing [17, 25, 28, 70] and psychosis [68]. Others suggest that irritability facet loads onto internalizing to a much stronger extent than the expansive mood facet of mania [56].
While some disorders such as bipolar disorder are distinguished on the basis of episodic course, this does not invalidate the basic observations underlying this review that the close relationships between disorders are meaningful. That is, course information is incorporated in the DSM diagnoses that are the focus of meta-structure research, by definition. Indeed, Eaton et al. [55] found that almost 50 % of bipolar’s diagnostic variance were accounted for by internalizing liability which predicted for future internalizing disorders, suicide attempts, angina, and ulcers.
ADHD
Attention deficit hyperactivity disorder (ADHD) [57] has been found to load on externalizing for men and women. The observation that externalizing liability encompasses childhood ADHD provides support for a degree of developmental continuity such that a childhood diagnosis of ADHD predicts the later development of other externalizing disorders in adulthood.
Gambling
Pathological gambling has been found to load onto externalizing for men and women. However, among women, pathological gambling demonstrated best fit when loading on externalizing and the distress subdimension of internalizing [71].
Sexual dysfunction
Forbes and Schniering [72] found that sexual problems represent an additional subfactor of internalizing amongst females. However, no models including sexual problems provided an adequate fit to males.
PTSD
Post-traumatic stress disorder (PTSD) is less often included in structural investigations. Cox et al. [73] found PTSD loaded on the distress factor, and Wolf et al. [74] found that while PTSD covaried strongly with internalizing it also demonstrated a significant, more modest relationship with externalizing.
Borderline personality disorder
BPD appears to be interstitial, loading on internalizing and externalizing [19, 27, 68, 75]. Eaton et al. [19] found that, across males and females, BPD loaded on the distress subdimension of internalizing and externalizing. James and Taylor [75] observed the same finding among males, however, among females this model and an alternative model—in which BPD only loaded on the distress subdimension of internalizing—fit equally well. Sharp and colleagues [76] found that adolescent BPD loaded on internalizing and externalizing across males and females. However, divergent from Eaton et al. [19] and James and Taylor [75] (who both found that BPD demonstrated higher factor loadings on internalizing compared to externalizing in adults) [19, 75], Sharp et al. [76] reported opposite results for adolescents. The authors suggest this indicates a pattern of heterotypic continuity in the development of BPD. Finally, Hudson and colleagues [77] found that familial internalizing and externalizing liabilities were associated with BPD, which may help explain the pattern of comorbidity between BPD and internalizing and externalizing disorders.
Eating disorders
The location of eating disorders in the meta-structure has been recently investigated. Forbush et al. [78] demonstrated that, amongst females, eating pathology represents a distinct subdimension of internalizing. This finding was replicated by Forbush and Watson [70] using data from both males and females. Overall, the authors found evidence of five subdimensions within internalizing: distress, fear, eating pathology, dysphoria, and bipolar. Further, impulse control disorders loaded onto externalizing; and factor analytically derived personality disorder scales split between the internalizing–externalizing spectra. Conversely, Mitchell et al. [79] found that, across genders, anorexia nervosa, bulimia nervosa, and binge eating disorder load on the distress subdimension of internalizing.
OCD
Only a small number of structural studies have included obsessive–compulsive disorder (OCD). Overall, Krueger et al. [18] found that OCD loaded on internalizing. For the bifurcated internalizing–externalizing model, OCD has been found to load onto the fear subdimension [4] and distress subdimension [80] of internalizing.
Somatic disorders
Somatic disorders/symptoms have received some attention. Krueger et al. [16] found that somatization, hypochondriasis, and neurasthenia load on internalizing, an observation that was robust across 14 countries. Simms and colleagues [81] found that somatic symptoms loaded onto internalizing, with specific factors also present for somatic symptoms, reflecting symptoms that are independent of internalizing. As mentioned earlier, somatoform disorders have been found to represent a distinct dimension [68].
Other disorders
Research suggests that relational aggression [82] represents a distinct subdimension of externalizing. Nonmedical prescription drug use has been found to load on externalizing and, to a small extent, on the fear subdimension of internalizing, across men and women [83].
DSM-5
The most recent iteration of the DSM [5] included a number of evidence-based changes. Of relevance to this review, the axial system was removed and disorders were re-organized, with externalizing disorders placed next to one another and internalizing disorders adjacent to one another. The new structure reflects recognition of the utility of common underlying liabilities (or transdiagnostic dimensions) in explaining differences within and communalities between diagnostic categories. This is explicitly documented in the manual’s Preface [5]. Further, Section III of the DSM-5—entitled “emerging models and measures”—includes a maladaptive personality trait model, which can be assessed with the Personality Inventory for DSM-5 (PID-5) [5, 84]. This is the first empirical model of personality in the pathological range included in the DSM. The PID-5 was developed by the DSM-5 Personality and Personality Disorder Workgroup to address criticisms of personality pathology in previous iterations. In this hybrid model, functional impairment criteria and dimensional personality traits map onto one of six categorical personality disorders, and a seventh diagnosis (Personality Disorder-Trait Specified) replaces Personality Disorder Not Otherwise Specified. The PID-5 trait domains can be broadly conceptualized as maladaptive variants of the Five-Factor Model traits [85] and characterized by an overarching personality factor which subsumes internalizing and externalizing [86]. These observations highlight continuity between personality and psychopathology.
The PID-5 is copyrighted by the American Psychiatric Association and freely available (http://www.psychiatry.org/practice/dsm/dsm5/online-assessment-measures#Personality). In this way, it provides a formal bridge for potential scaffolding in future meta-structure endeavors and a vehicle for steering the DSM further away from categorical diagnoses—based on political processes and clinical authority—toward an empirically based dimensional model of personality and psychopathology [87].
Identification of empirically based thresholds
As highlighted above, a wealth of literature has identified continua underlying psychopathology. While a dimensional-spectrum approach offers a number of benefits, it is important to consider practical utility and feasibility. The categorical system has occupied a central position in our knowledge base for over 30 years. It frames training textbooks in the mental health professions, treatment guidelines, epidemiological surveys, service use, and medical economic data [51]. Therefore, a complete shift from a strictly categorical to strictly dimensional system would disrupt the activities of a range of professionals and require significant retraining. It would also warrant revisions of research assessment tools; complicate research involving diagnostic groupings across studies and diagnostic change over time; and create administrative barriers to medical record keeping and collection of vital statistics [51]. Categories also offer ease of communication.
We suggest that the combined goals of validity and utility could be best served by combining dimensions with categories. This hybrid approach holds promise for overcoming inherent limitations in the DSM, while achieving a balance between including new components urgently called for by the field (e.g., scientific foundation, dimensions). Ultimately, by preserving continuity with the extant system and using an intuitive, user-friendly format with minimal disruption, a hybrid approach would be more likely to be adopted in practice [14]. In fact, a categorical-dimensional psychiatric classification would draw closer parallels to practice in other medicine areas. For example, a diagnosis of hypertension is accompanied by systolic and diastolic blood pressure reading and a diagnosis of breast cancer is augmented by noting the Stage and/or Karnofsky score [13].
A dimensional classification system with the flexibility to set different diagnostic cut-points is likely to be more useful than the current system and satisfy different users’ needs [88]. For example, cut-points on the basis of symptom severity could be identified; e.g., a patient might be described as experiencing a moderate level of depressive symptomatology and a severe level of anxiety symptoms. The use of severity labels serves as a subtle reminder that we are not dealing with natural categories [14]. Further, severity cut-points explicitly acknowledge dimensions and move away from traditional single disorder models and treatment silos. While the architects of DSM-5 have—conservatively—retained the categorical diagnostic structure, they have introduced a severity component for some disorders. In the case of alcohol use disorder (AUD), a tri-categorized severity scale distinguishes mild (2–3 AUD symptoms), moderate (4–5 symptoms), and severe (6 + symptoms) dependence [5].
Additionally, a single, evidence-based diagnostic threshold—indicating absence or presence of a disorder—could be identified. This cut-point, likely to lie somewhere between the moderate and severe cut-points, could be identified for each disorder. Suggested guidelines informing the derivation of empirically based cut-points are provided elsewhere [50].
Both types of thresholds would mark significant advances over DSM thresholds and dimensional scales elsewhere in the literature as they would be empirically derived and underpinned by theoretical constructs and a conceptual rationale. This has particular relevance to clinical practice as relating pathology to a theoretically meaningful framework improves clinical utility [89].
A developmental perspective
Much of the structural research on the internalizing–externalizing model has been confined to adults. This work is not developmentally informed as the meaning, age-of-onset, and expression of mental disorders differ for children, adolescents, young adults, and older adults [90, 91]. Surprisingly, although the terms ‘internalizing’ and ‘externalizing’ originate from the child and adolescence literature [23, 24], comparatively less attention has focused on structural investigations of DSM disorders in youth [92]. Of those studies that have been conducted, most have relied on epidemiological samples from the United States [39, 41, 59, 90, 92–98].
The importance of incorporating a developmental perspective in diagnoses was reflected in the research agenda and priorities of the DSM-5 workgroups [99, 100]. Indeed, extending structural accounts of psychopathology to youth is important for several reasons. First, adolescence and young adulthood are periods of major neurobiological, psychosocial, and hormonal changes [101, 102], and mark first onset of the majority of high-prevalence mental and substance use disorders. For instance, 31.9 % of US adolescents aged 13–18 years have anxiety disorders, 14.3 % have mood disorders, and 11.4 % have substance use disorders. Moreover, 40 % of adolescents with one class of mental disorder meet criteria for another disorder class. Median age of onset is 6 years for anxiety disorders, 13 years for mood disorders, and 15 years for substance use disorders [103]. The presence of psychopathology during adolescence and young adulthood may portend persistence of symptoms in adulthood. Indeed, longitudinal research indicates that 50 % of adults with a mental disorder had a diagnosable disorder at age 11–15, and 75 % had a first diagnosis before age 18 [104].
Second and relatedly, given that the phenotypic expression of mental disorders changes in both nature and intensity across development [105], the etiology of comorbid mental disorders may be unique during different age periods. For instance, a large developmental twin study examining anxiety and depressive symptoms from childhood to early adulthood highlighted that genetic risk factors play a developmentally dynamic role, varying across early adolescence, late adolescence, and early adulthood [106]. In particular, with the onset of substance abuse problems during adolescence, the phenotypic expression of psychopathology is likely to alter [18]. Increased understanding of the etiology underlying adult psychopathology has informed the development of evidence-based pharmacological and psychological intervention programs to effectively treat symptoms already present. It follows that a more thorough understanding of the internalizing–externalizing liabilities among youth holds promise for developing approaches designed to prevent initial symptom presentation [93]. Further, understanding causal pathways among disorders, and potentially reciprocal causation, over time will be a key future direction, and time-sensitive designs will be critical [17].
It is also critical to examine psychiatric classification in older adults. Given that current nosological systems show age bias in many diagnostic criteria [107], it is important to expand evidence-based classification systems across the lifespan. Little research has examined this issue, although evidence suggests potential invariance of internalizing across age cohorts and within individuals as they age [22]. Understanding relatively undifferentiated, core phenomena, such as personality traits and these latent psychopathology dimensions, has been identified as an important avenue for future studies of successful aging and later life development [108].
Biomarkers
A promising avenue of future research involves incorporating genetic, neuroimaging and neurophysiology research findings into psychopathology structural accounts [109, 110]. Identifying the genetic underpinnings of disorders holds much promise for improving our understanding of biological mechanisms linked with disorders. The Research Domain Criteria Project (RDoC) emerged out of recognition for the need for alternative approaches to psychiatric classification and aims to develop new approaches to classifying mental disorders on the basis of dimensions of observable behavior and neurobiological measures [111, 112]. At present, the search for biomarkers remains in its infancy and laboratory tests of the genetic and molecular signatures of mental disorders have not yet emerged. The internalizing–externalizing model provides an empirical, coherent framework for integrating biological findings, to accommodate comorbidity and improve ecological validity [113].
Conclusion
Our review indicates that the internalizing–externalizing model offers a parsimonious framework for accommodating comorbidity and can provide a better understanding of etiology and natural history. In this way, the meta-structure holds much promise for informing the development of more targeted and effective treatment and prevention approaches based on a solid empirical foundation. These benefits were recognized—at least in part—in DSM-5, with the introduction of a new organizational structure reflecting internalizing–externalizing liabilities.
Unlike its predecessors, DSM-5 is intended to be a living document, incorporating changes to reflect advances in research and knowledge. Thus, as psychopathology classification continues to evolve, we hope that its development and refinement relies on the accumulation of empirical research evidence, rather than clinical authority, to derive a system that is more valid, reliable, better suited to research biological underpinnings, and better reflects how psychopathology is structured in nature.
References
Blashfield RK, Keeley JW, Flanagan EH, Miles SR (2014) The cycle of classification: DSM-I through DSM-5. Annu Rev Clin Psychol 10:25–51
Stahl SM (2013) The last Diagnostic and Statistical Manual (DSM): replacing our symptom-based diagnoses with a brain circuit-based classification of mental illnesses. CNS Spectr 18:65–68
Eaton NR, Rodriguez-Seijas C, Carragher N, Krueger RF (2015) Transdiagnostic factors of psychopathology and substance use disorders: a review. Soc Psychiatry Psychiatr Epidemiol. doi:10.1007/s00127-014-1001-2
Slade T, Watson D (2006) The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychol Med 36:1593–1600
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (DSM-5), 5th edn. American Psychiatric Publishing, Washington DC
Hickie IB, Scott J, McGorry PD (2013) Clinical staging for mental disorders: a new development in diagnostic practice in mental health. Med J Aust 198:461–462
Krueger R, Bezdjian S (2009) Enhancing research and treatment of mental disorders with dimensional concepts: toward DSM-V and ICD-11. World Psychiatry 8:3–6
Carragher N, Adamson G, Bunting B, McCann S (2009) Subtypes of depression in a nationally representative sample. J Affect Disord 113:88–99
Roberts MC, Reed GM, Medina-Mora ME, Keeley JW, Sharan P, Johnson DK et al (2012) A global clinicians’ map of mental disorders to improve ICD-11: analysing meta-structure to enhance clinical utility. Int Rev Psychiatry 24:578–590
Verheul R, Widiger TA (2004) A meta-analysis of the prevalence and usage of the personality disorder not otherwise specified (PDNOS) diagnosis. J Pers Disord 18:309–319
Verheul R, Bartak A, Widiger T (2007) Prevalence and construct validity of Personality Disorder Not Otherwise Specified (PDNOS). J Pers Disord 21:359–370
Szodoray P, Nakken B, Barath S, Gaal J, Aleksza M, Zeher M et al (2008) Progressive divergent shifts in natural and induced T-regulatory cells signify the transition from undifferentiated to definitive connective tissue disease. Int Immunol 20:971–979
Kraemer HC (2007) DSM categories and dimensions in clinical and research contexts. Int J Methods Psychiatr Res 16:S8–S15
Kamphuis JH, Noordhof A (2009) On categorical diagnoses in DSM-V: cutting dimensions at useful points? Psychol Assess 21:294–301
Krueger RF (1999) The structure of common mental disorders. Arch Gen Psychiatry 56:921–926
Krueger RF, Chentsova-Dutton YE, Markon KE, Goldberg DP, Ormel J (2003) A cross-cultural study of the structure of comorbidity among common psychopathological syndromes in the general health care setting. J Abnorm Psychol 112:437–447
Kessler RC, Ormel J, Petukhova M, McLaughlin KA, Green JG, Russo LJ et al (2011) Development of lifetime comorbidity in the World Health Organization world mental health surveys. Arch Gen Psychiatry 68:90–100
Krueger RF, Caspi A, Moffitt TE, Silva PA (1998) The structure and stability of common mental disorders (DSM-III-R): a longitudinal-epidemiological study. J Abnorm Psychol 107:216–227
Eaton NR, Krueger RF, Keyes KM, Skodol AE, Markon KE, Grant BF et al (2011) Borderline personality disorder co-morbidity: relationship to the internalizing–externalizing structure of common mental disorders. Psychol Med 41:1041–1050
Krueger RF, Markon KE (2006) Reinterpreting comorbidity: a model-based approach to understanding and classifying psychopathology. Annu Rev Clin Psychol 2:111–133
Eaton NR, South SC, Krueger RF (2010) The meaning of comorbidity among common mental disorders. In: Millon T, Krueger RF, Simonsen E (eds) Contemporary directions in psychopathology: scientific foundations of the DSM-V and ICD-11, 2nd edn. Guilford Publications, New York, pp 223–241
Blanco C, Krueger RF, Hasin DS, Liu SM, Wang S, Kerridge BT et al (2013) Mapping common psychiatric disorders: structure and predictive validity in the national epidemiologic survey on alcohol and related conditions. JAMA Psychiatry 70:199–208
Achenbach TM, Edelbrock CS (1978) The classification of child psychopathology: a review and analysis of empirical efforts. Psychol Bull 85:1275–1301
Achenbach TM, Edelbrock CS (1984) Psychopathology of childhood. Annu Rev Psychol 35:227–256
Wolf AWSD, Patterson MB, Grande TP, Brocco KJ, Pendleton L (1988) Associations among major psychiatric diagnoses. J Consult Clin Psychol 56:292–294
Vollebergh WA, Iedema J, Bijl RV, de Graaf R, Smit F, Ormel J (2001) The structure and stability of common mental disorders: the NEMESIS study. Arch Gen Psychiatry 58:597–603
Røysamb E, Kendler KS, Tambs K, Ørstavik RE, Neale MC, Aggen SH et al (2011) The joint structure of DSM-IV axis I and axis II disorders. J Abnorm Psychol 120:198–209
Eaton NR, Keyes KM, Krueger RF, Balsis S, Skodol AE, Markon KE et al (2012) An invariant dimensional liability model of gender differences in mental disorder prevalence: evidence from a national sample. J Abnorm Psychol 121:282–288
Eaton NR, Keyes KM, Krueger RF, Noordhof A, Skodol AE, Markon KE et al (2013) Ethnicity and psychiatric comorbidity in a national sample: evidence for latent comorbidity factor invariance and connections with disorder prevalence. Soc Psychiatry Psychiatr Epidemiol 48:701–710
Eaton NR, Krueger RF, Oltmanns TF (2011) Aging and the structure and long-term stability of the internalizing spectrum of personality and psychopathology. Psychol Aging 26:987–993
Eaton NR (2014) Transdiagnostic psychopathology factors and sexual minority mental health: evidence of disparities and associations with minority stressors. Psychol Sex Orientat Gend Divers 1:244–254
Measelle JR, Stice E, Hogansen JM (2006) Developmental trajectories of co-occurring depressive, eating, antisocial, and substance abuse problems in female adolescents. J Abnorm Psychol 115:524–538
South SC, Krueger RF, Iacono WG (2011) Understanding general and specific connections between psychopathology and marital distress: a model based approach. J Abnorm Psychol 120:935–947
South SC, Miller ML (2014) Measuring momentary stress, affect, and cognition: relationships with the internalizing and externalizing spectra. J Psychopathol Behav Assess 36:9–104
Conway C, Hammen C, Brennan PA (2012) Expanding stress generation theory: test of a transdiagnostic model. J Abnorm Psychol 121:754–766
Kendler KS, Myers J (2014) The boundaries of the internalizing and externalizing genetic spectra in men and women. Psychol Med 44:647–665
Kendler KS, Aggen SH, Knudsen GP, Røysamb E, Neale MC, Reichborn-Kjennerud T (2011) The structure of genetic and environmental risk factors for syndromal and subsyndromal common DSM-IV axis I and all axis II disorders. Am J Psychiatry 168:29–39
Kendler KS, Prescott CA, Myers JM, Neale MC (2003) The structure of genetic and environmental risk factors for common psychiatric and substance use disorders in men and women. Arch Gen Psychiatry 60:929–937
Lahey BB, van Hulle C, Singh AL, Waldman ID, Rathouz PJ (2011) Higher-order genetic and environmental structure of prevalent forms of child and adolescent psychopathology. Arch Gen Psychiatry 68:181–189
Lahey BB, Zald DH, Hakes JK, Krueger RF, Rathouz PJ (2014) Patterns of heterotypic continuity associated with the cross-sectional correlational structure of prevalent mental disorders in adults. JAMA Psychiatry 71:989–996
Wittchen HU, Beesdo-Baum K, Gloster AT, Höfler M, Klotsche J, Lieb R et al (2009) The structure of mental disorders re-examined: is it developmentally stable and robust against additions? Int J Methods Psychiatr Res 18:189–203
Seeley JR, Kosty DB, Farmer RF, Lewinsohn PM (2011) The modeling of internalizing disorders on the basis of patterns of lifetime comorbidity: associations with psychosocial functioning and psychiatric disorders among first-degree relatives. J Abnorm Psychol 120:308–321
Kendler KS, Neale MC, Kessler RC, Heath AC, Eaves LJ (1992) Major depression and generalized anxiety disorder. Same genes, (partly) different environments? Arch Gen Psychiatry 49:716–722
Kendler KS (1996) Major depression and generalised anxiety disorder. Same genes, (partly) different environments—revisited. Br J Psychiatry Suppl 168:68–75
Starr L, Conway CC, Hammen CL, Brennan PA (2014) Transdiagnostic and disorder-specific models of intergenerational transmission of internalizing pathology. Psychol Med 44:161–172
Krueger RF, South SC (2009) Externalizing disorders: cluster 5 of the proposed meta-structure for DSM-V and ICD-11. Psychol Med 39:2061–2070
Tackett JL, Lahey BB, van Hulle C, Waldman I, Krueger RF, Rathouz PJ (2013) Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. J Abnorm Psychol 122:1142–1153
Lahey BB, Applegate B, Hakes JK, Zald DH, Hariri AR, Rathouz PJ (2012) Is there a general factor of prevalent psychopathology during adulthood? J Abnorm Psychol 121:971–977
Caspi A, Houts RM, Belsky DW, Goldman-Mellor S, Harrington HL, Israel S et al (2014) The p factor: one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci 2:119–137
Helzer JE, Kraemer HC, Krueger RF (2006) The feasibility and need for dimensional psychiatric diagnoses. Psychol Med 36:1671–1680
First MB (2005) Clinical utility: a prerequisite for the adoption of a dimensional approach in DSM. J Abnorm Psychol 114:560–564
Fergusson DM, Horwood LJ, Boden JM (2006) Structure of internalising symptoms in early adulthood. Br J Psychiatry 189:540–546
Ferdinand RR, de Nija PF, van Lier P, Verhulst FC (2005) Latent class analysis of anxiety and depressive symptoms in referred adolescents. J Affect Disord 88:299–306
Vaidyanathan Patrick CJ, Iacono WG (2011) Patterns of comorbidity among mental disorders: a person-centered approach. Compr Psychiatry 52:527–535
Eaton N, Krueger RF, Markon KE, Keyes KM, Skodol AE, Wall M et al (2013) The structure and predictive validity of the internalizing disorders. J Abnorm Psychol 122:86–92
Wright AG, Krueger RF, Hobbs MJ, Markon KE, Eaton NR, Slade T (2013) The structure of psychopathology: toward an expanded quantitative empirical model. J Abnorm Psychol 122:281–294
Carragher N, Krueger RF, Eaton NR, Markon KE, Keyes KM, Blanco C et al (2014) ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample. Soc Psychiatry Psychiatr Epidemiol 49:1307–1317
Witkiewitz K, King K, McMahon RJ, Wu J, Luk J, Bierman KL (2013) Evidence for a multi-dimensional latent structural model of externalizing disorders. J Abnorm Child Psychol 41:223–237
Walton K, Ormel J, Krueger RF (2011) The dimensional nature of externalizing behaviors in adolescence: evidence from a direct comparison of categorical, dimensional, and hybrid models. J Abnorm Child Psychol 39:553–561
Muthén B (2006) Should substance use disorders be considered as categorical or dimensional? Addiction 101:6–16
Markon KE (2010) Modeling psychopathology structure: a symptom-level analysis of axis I and II disorders. Psychol Med 40:273–288
Lubke GH, Miller PJ (2014) Does nature have joints worth carving? A discussion of taxometrics, model-based clustering and latent variable mixture modeling. Psychol Med (in press)
Borsboom D, Cramer AO (2013) Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol 9:91–121
Cramer AO, Waldorp LJ, van der Maas HL, Borsboom D (2010) Comorbidity: a network perspective. Behav Brain Sci 33:137–193
Stein DJ, Craske MG, Friedman MJ, Phillips KA (2011) Meta-structure issues for the DSM-5: how do anxiety disorders, obsessive–compulsive and related disorders, post-traumatic disorders, and dissociative disorders fit together? Curr Psychiatry Rep 1:248–250
Keyes KM, Eaton NR, Krueger RF, Skodol AE, Wall MM, Grant B et al (2013) Thought disorder in the meta-structure of psychopathology. Psychol Med 43:1673–1683
Kotov R, Chang SW, Fochtmann LJ, Mojtabai R, Carlson GA, Sedler MA et al (2011) Schizophrenia in the internalizing–externalizing framework: a third dimension? Schizophr Bull 37:1168–1178
Kotov R, Ruggero CJ, Krueger RF, Watson D, Yuan Q, Zimmerman M (2011) New dimensions in the quantitative classification of mental illness. Arch Gen Psychiatry 68:1003–1011
Noordhof A, Krueger RF, Ormel J, Oldehinkel AJ, Hartman CA (2014) Integrating autism-related symptoms into the dimensional internalizing and externalizing model of psychopathology. The TRAILS Study. J Abnorm Child Psychol 8:8
Forbush K, Watson D (2013) The structure of common and uncommon mental disorders. Psychol Med 43:97–108
Oleski J, Cox BJ, Clara I, Hills A (2011) Pathological gambling and the structure of common mental disorders. J Nerv Ment Dis 199:956–960
Forbes M, Schniering CA (2013) Are sexual problems a form of internalizing psychopathology? A structural equation modeling analysis. Arch Sex Behav 42:23–34
Cox BJ, Clara IP, Enns MW (2002) Posttraumatic stress disorder and the structure of common mental disorders. Depress Anxiety 15:168–171
Wolf EJ, Miller MW, Krueger RF, Lyons MJ, Tsuang MT, Koenen KC (2010) Posttraumatic stress disorder and the genetic structure of comorbidity. J Abnorm Psychol 119:320–330
James LM, Taylor J (2008) Revisiting the structure of mental disorders: borderline personality disorder and the internalizing/externalizing spectra. Br J Clin Psychol 47:361–380
Sharp C, Elhai J, Kalpacki A, Michonski J, Pavlidis I (2014) Locating adolescent BPD within the internalizing–externalizing spectrum in adolescents. Paper presented at the annual meeting of the National Association for the Study of Personality Disorder, Boston
Hudson J, Zanarini MC, Mitchell KS, Choi-Kain LW, Gunderson JG (2014) The contribution of familial internalizing and externalizing liability factors to borderline personality disorder. Psychol Med (in press)
Forbush KT, South SC, Krueger RF, Iacono WG, Clark LA, Keel PK (2010) Locating eating pathology within an empirical diagnostic taxonomy: evidence from a community-based sample. J Abnorm Psychol 119:282–292
Mitchell KS, Wolf EJ, Reardon AF, Miller MW (2014) Association of eating disorder symptoms with internalizing and externalizing dimensions of psychopathology among men and women. Int J Eat Disord 47:860–869
Cox BJ, Clara IP, Hills AL, Sareen J (2010) Obsessive–compulsive disorder and the underlying structure of anxiety disorders in a nationally representative sample: confirmatory factor analytic findings from the German Health Survey. J Anxiety Disord 24:30–33
Simms LJ, Prisciandaro JJ, Krueger RF, Goldberg DP (2012) The structure of depression, anxiety and somatic symptoms in primary care. Psychol Med 42:15–28
Tackett JL, Daoud SL, De Bolle M, Burt SA (2013) Is relational aggression part of the externalizing spectrum? A bifactor model of youth antisocial behavior. Aggress Behav 39:149–159
Ofrat S, Krueger RF, Eaton NR, Keyes KM, Skodol AE, Grant BF et al (2014) Nonmedical prescription drug use comorbidity: developing a cohesive risk model. J Psychopathol Behav Assess 36:371–379
Krueger RF, Derringer J, Markon KE, Watson D, Skodol AE (2012) Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychol Med 42:1879–1890
Zimmermann J, Altenstein D, Krieger T, Holtforth MG, Pretsch J, Alexopoulos J et al (2014) The structure and correlates of self-reported DSM-5 maladaptive personality traits: findings from two German-speaking samples. J Pers Disord 28:518–540
Morey LC, Krueger RF, Skodol AE (2013) The hierarchical structure of clinician ratings of proposed DSM-5 pathological personality traits. J Abnorm Psychol 122:836–841
Krueger RF, Markon KE (2014) The role of the DSM-5 personality trait model in moving toward a quantitative and empirically based approach to classifying personality and psychopathology. Annu Rev Clin Psychol 10:477–501
Mullins-Sweatt SN, Widiger TA (2009) Clinical utility and DSM-V. Psychol Assess 21:302–312
Berghuis H, Kamphuis JH, Verheul R, Larstone R, Livesley J (2013) The General Assessment of Personality Disorder (GAPD) as an instrument for assessing the core features of personality disorders. Clin Psychol Psychother 20:544–557
Beesdo-Baum K, Höfler M, Gloster AT, Klotsche J, Lieb R, Beauducel A (2009) The structure of common mental disorders: a replication study in a community sample of adolescents and young adults. Int J Methods Psychiatr Res 18:204–220
Knäuper B, Wittchen HU (1994) Diagnosing major depression in the elderly: evidence for response bias in standardized diagnostic interviews? J Psychiatr Res 28:147–164
Verona E, Javdani S, Sprague J (2011) Comparing factor structures of adolescent psychopathology. Psychol Assess 23:545–551
Cosgrove VE, Rhee SH, Gelhorn HL, Boeldt D, Corley RC, Ehringer MA et al (2011) Structure and etiology of co-occurring internalizing and externalizing disorders in adolescents. J Abnorm Child Psychol 39:109–123
Kessler RC, Avenevoli S, McLaughlin KA, Green JG, Lakoma MD, Petukhova M et al (2012) Lifetime co-morbidity of DSM-IV disorders in the US National Comorbidity Survey Replication Adolescent Supplement (NCS-A). Psychol Med 42:1997–2010
Lahey BB, Applegate B, Waldman ID, Loft JD, Hankin BL, Rick J (2004) The structure of child and adolescent psychopathology: generating new hypotheses. J Abnorm Psychol 113:358–385
Lahey BB, Rathouz PJ, van Hulle C, Urbano RC, Krueger RF, Applegate B (2008) Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. J Abnorm Child Psychol 36:187–206
Verona E, Sachs-Ericsson N, Joiner TE (2004) Suicide attempts associated with externalizing psychopathology in an epidemiological sample. Am J Psychiatry 161:444–451
Yoder KA, Longley SL, Whitbeck LB, Hoyt DR (2008) A dimensional model of psychopathology among homeless adolescents: suicidality, internalizing, and externalizing disorders. J Abnorm Child Psychol 36:95–104
Wittchen HU, Höfler M, Gloster AT, Craske MG, Beesdo K (2011) Options and dilemmas of dimensional measures for DSM-5: which types of measures fare best in predicting course and outcome. In: Regier DA, Narrow WE, Kuhl EA, Kupfer DJ (eds) Options and dilemmas of dimensional measures for DSM-5: which types of measures fare best in predicting course and outcome. American Psychiatric Publishing, Arlington, pp 119–146
Regier DA, Narrow WE, First MB, Marshall T (2002) The APA classification of mental disorders: future perspectives. Psychopathology 35:166–170
Walker EF, Sabuwalla Z, Huot R (2004) Pubertal neuromaturation, stress sensitivity, and psychopathology. Dev Psychopathol 16:807–834
Paus T, Keshavan M, Giedd JN (2008) Why do many psychiatric disorders emerge during adolescence? Nat Rev Neurosci 9:947–957
Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L et al (2010) Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication—Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry 49:980–989
Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R (2003) Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Arch Gen Psychiatry 60:709–717
Hudziak JJ, Achenbach TM, Althoff RR, Pine DS (2007) A dimensional approach to developmental psychopathology. In J Methods Psychiatr Res 16:S16–S23
Kendler KS, Gardner CO, Lichtenstein P (2008) A developmental twin study of symptoms of anxiety and depression: evidence for genetic innovation and attenuation. Psychol Med 38:1567–1575
Balsis S, Gleason ME, Woods CM, Oltmanns TF (2007) An item response theory analysis of DSM-IV personality disorder criteria across younger and older age groups. Psychol Aging 22:171–185
Eaton NR, Krueger RF, South SC, Gruenewald TL, Seeman TE, Roberts BW (2012) Genes, environments, personality, and successful aging: toward a comprehensive developmental model in later life. J Gerontol A Biol Sci Med Sci 67:480–488
Phillips ML, Vieta E (2007) Identifying functional neuroimaging biomarkers of bipolar disorder: toward DSM-V. Schizophr Bull 33:893–904
Kupfer D (2014) DSM-5: new opportunities and challenges for teaching and training. Acad Psychiatry 38:58–60
Sanislow CA, Pine DS, Quinn KJ, Kozak MJ, Garvey MA, Heinssen RK et al (2010) Developing constructs for psychopathology research: research domain criteria. J Abnorm Psychol 119:631–639
Cuthbert BN, Kozak MJ (2013) Constructing constructs for psychopathology: the NIMH research domain criteria. J Abnorm Psychol 122:928–937
Ofrat S, Krueger RF (2012) How research on the meta-structure of psychopathology aids in understanding biological correlates of mood and anxiety disorders. Biol Mood Anxiety Disord 2:13
Conflict of interest
None declared.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Carragher, N., Krueger, R.F., Eaton, N.R. et al. Disorders without borders: current and future directions in the meta-structure of mental disorders. Soc Psychiatry Psychiatr Epidemiol 50, 339–350 (2015). https://doi.org/10.1007/s00127-014-1004-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00127-014-1004-z