Cognitive models of anxiety have viewed distorted threat appraisals as core etiological factors in anxiety (Rapee & Heimberg, 1997; Clark & Beck, 2010). For example, Beck’s influential cognitive model states that anxious individuals overestimate the probability of occurrence, the severity or cost, and the imminence of threatened events while underestimating their personal resources for coping with the events. Their faulty appraisals and threat estimation are thought to involve logical thinking errors characterized by using evidence to jump to arbitrary conclusions, using biased evidence/or discounting evidence, overgeneralizing, and catastrophizing.

The looming vulnerability model (Riskind et al., 2000; Riskind & Rector, 2018) augments Clark and Beck (2010) and comparable models by stressing dynamic aspects of threat in anxiety. When individuals perceive (or misperceive) threats as dynamic, changing, and swiftly advancing, they experience more anxiety, fear, and urgency. A person can have the subjective impression that danger is dynamic, swiftly progressing, and rising in risk because the threat seems to be getting closer in space, time, or certainty (likelihood). Such perceptions function as powerful warning signals, because such threats require rapid action to prevent damage or harm. Slow, static, or receding stimuli reduce anxiety and urgency since they don’t require fast action.

The looming vulnerability model is founded on a large body of evidence gathered from research in experimental, developmental, cognitive neuroscience, social psychology, and animal studies (Riskind & Rector, 2018). This work has repeatedly shown that dynamic objects, particularly approaching and looming objects, serve as important warning cues of imminent danger. Numerous studies, for example, have demonstrated that rapidly approaching looming stimuli preferentially capture attention, are better remembered, and elicit more negative emotional reactions and distinctive patterns of brain activation on imaging tasks than static and receding stimuli. (e.g., Franconeri & Simons, 2003; Judd et al., 2004; Mobbs et al., 2010; Parker & Alais, 2007; Pilz et al., 2011; Van Wassenhove et al., 2011). Furthermore, animal and developmental studies indicate that virtually all vertebrate animals, including human newborns and adults, as well as invertebrates of all types, show defensive reactions to looming stimuli, such as escaping, hiding, ducking, or fleeing (e.g., Gwilliam, 1963; Ball & Tronick, 1971; Dill, 1990; Westby et al., 1990; Card & Dickenson, 2008).

Thus, it appears that practically all animals have evolved adaptive strategies to prevent being caught unprepared by rapidly approaching dangers. In addition, perceptual and cognitive biases that even overestimate the apparent speed with which threats may approach may also have evolutionary advantages, because false negatives (e.g., underestimating the speed of a predator) are considerably more dangerous to survival than false positives (overestimating the speed) (Haselton & Buss, 2000). However, any chronic or extreme bias by to overestimate the rapid approach of threat might generate an excessive predisposition for anxiety and extreme threat reactions that are dysfunctional and unwarranted (Riskind & Rector, 2018).

The “Looming Cognitive Style”

Why are some individuals more likely to get anxious than others? A variety of factors contribute to these differences, including stressful life events, but cognitive factors are also important. According to the looming vulnerability model, some individuals are especially at risk of anxiety because they have a trait-like vulnerability known as the looming cognitive style (or LCS; Riskind et al., 2000; Riskind & Rector, 2018). The LCS assesses an exaggerated tendency to perceive mental simulations and images of potential threats as rapidly progressing and approaching and expanding in their negative consequences, even when they aren’t. Individuals with this LCS are also more likely to suffer from depression under particular circumstances, such as when thinking they are unable to leave a bad situation (Kleiman & Riskind, 2012). The LCS is thought to be a core aspect of vulnerability to anxiety that develops as a result of inadequate parenting and faulty attachment bonds, as well as previous life traumas and abuse. Several studies have found evidence for these developmental antecedents (González-Diez et al., 2016; Riskind et al., 2017a, 2017b; Altan-Atalay & Ayvaşık, 2019; Greenblatt-Kimron & Cohen, 2020; Milovanović et al., 2022).

Yeo et al. (2020) conducted a meta-analysis that synthesized 141 effect sizes from 61 articles and 69 independent samples. This meta-analysis demonstrated strong associations between the LCS and general anxiety, simple and social phobias, and OCD symptoms (counting OCD as anxiety-related). While LCS was linked to depression, it was significantly weaker than its link to anxiety. LCS scores are related to heightened memory biases, perceptual, and interpretive biases for threatening stimuli (Riskind et al., 2000, 2014), as well as self-reported sleep disruption (Zamani et al., 2021), freeze responses to threatening stimuli (Riskind et al., 2016), and stress generation (Kleiman & Riskind, 2014; Riskind et al., 2010). Moreover, more than ten prospective studies have shown that LCS acts as a risk factor that can drive subsequent anxiety, worry, and spontaneous threat cognitions throughout time periods ranging from one week to a year (Adler & Strunk, 2010; Calvete et al, 2016; Carnahan et al., 2022; González-Díez et al., 2015; Riskind et al., 2000; ; Kleiman & Riskind, 2012; Sica et al., 2012).

Beyond the LCS: Devising a Measure of Looming Vulnerability Distortions

Regarding the present research, a theoretical expectation of the looming vulnerability model is that anxiety and the LCS are linked to a range of cognitive-perceptual distortions of time, space, size, closeness, and movement (Riskind & Williams, 1999; Riskind et al., 2012; Riskind & Rector, 2018). These are also known in the broader literature as estimation biases (Givon-Benjio & Okon-Singer, 2020). In the model, such distortions are referred to as “looming vulnerability” distortions (or biases) because they can all contribute to a distorted impression that threat is dynamic and quickly coming and rising in risk and urgency,

According to research, people overestimate the time of arrival and speed of approaching stimuli, especially when the stimuli are seen as threatening and fear-relevant (e.g., spiders or snakes) rather than neutral or benign (butterflies, bunnies) (Vagnoni et al., 2012; Basanovic et al., 2019; McGuire et al., 2021). Rachman and Cuk (1992) found that people experiencing spider and snake phobias overestimate how often the animals jumped or moved toward them (see also Riskind et al., 1992, for a different nonverbal demonstration). Persons who are terrified of spiders perceive them as dynamic and rapidly approaching (Riskind et al., 1992, 1995), whereas people who are afraid of germs and contaminants imagine them rapidly increasing and spreading towards them (Riskind et al., 1997; Tolin et al., 2004; Riskind & Rector, 2007; Elwood et al., 2011).

Additional research shows that people perceive threatening stimuli such as spiders or menacing strangers as closer and larger than they are (Vasey et al., 2012; Leibovich et al., 2016; Shiban et al., 2016). Cole et al. (2013) found that respondents exposed to threatening stimuli (e.g., a tarantula or a belligerent confederate) judged them to be closer than neutral stimuli but did not do this for disgusting stimuli. As compared to less anxious people, Givon-Benjio and Okon-Singer (2020) found that individuals with social anxiety seem to overestimate the physical proximity of strangers.

When threatened, people also experience time as passing more swiftly, judging that more time as passed. They do this when blindfolded and travelling in a cart on an elevated rather than flat stage (Langer et al., 1961, 1965), when exposed to spiders (Watts & Sharrock, 1984), or when encountering threatening images (Effron et al., 2006; Bar-Haim et al., 2010; Droit-Volet et al., 2011; Fayolle et al., 2015). Asking individuals to focus on competing goals makes them feel like their time is more inadequate than telling them to simply list their goals (Etkin et al., 2015).

These repeatedly demonstrated estimation biases are cognitive-perceptual distortions of size, time, proximity, and threat movement rather than logical errors. It seems plausible that many of these distortions would tend to co-occur as indicators of a more general tendency because they would functionally serve to heighten a perception of looming vulnerability to help keep individuals safe and out of the reach of possible dangers. This idea is in keeping with findings of Langer et al. (1961, 1965) that participants overestimated both their physical proximity to threat as well as the elapsed time of their exposure to it (experiencing time as moving more swiftly than it was).

Given the wealth of evidence that has amassed demonstrating estimation errors and cognitive-perceptual distortions, it is remarkable that so little effort has made to bring these perceptual distortions together into a coherent integrative framework. Few attempts have been made to build a battery of lab-based activities to measure these distortions, and it would be onerous to administer. Furthermore, few attempts have been made to construct an easy-to-implement and administer self-report instrument for assessing these distortions. It should be noted that the looming maladaptive style questionnaire is used to assess the LCS (LMSQ; Riskind et al., 2000). The LCS, as assessed by the LMSQ, should predict more looming vulnerability distortions on such an instrument, but it was never designed to assess the distortions in a more fine-grained, nuanced, and richly textured manner.

Purpose of the Present Research

Given the abundance of evidence associating anxiety and lab-based threat estimation measures involving cognitive-perceptual distortions, a psychometrically validated self-report measure of such distortions could be useful for both researchers and practitioners. For example, an easy-to-administer and easy-to-implement self-report measure might help advance understanding of perceptual distortions in estimation biases in anxiety and fear and have clinical utility for screening, assessing, and offering more personalized therapy interventions.

Based on these considerations, the present study aimed to develop and psychometrically validate such a measure. Drawing on empirical studies on estimation biases and clinical observations (Riskind & Williams, 1999; Riskind et al., 2012; Riskind & Rector, 2018), we designed the “Looming Vulnerability Distortions Questionnaire” (LVDQ) to assess 10 suspected expected estimation errors and perceptual distortions.

The cognitive-perceptual distortions include perceiving threatening stimuli as closer in space than they are (Space Compression), as larger than they are (Size Distortion) and as closer in time than they are (Time Compression). We’ve also noticed that anxious people tend to perceive too many threats as coming at once (All-at-Once Distortion), probably because they compress the future time horizon, bringing many possible threats closer. Anxious individuals also seem to experience the chances or probabilities of dangerous events as growing swiftly and advancing towards more certainty, even when they aren’t (Rapidly Rising Odds Distortion). Due to these perceptual distortions, anxious people often overwhelm themselves because they underestimate the time they have left to cope and feel more overwhelmed and powerless than they are (Minimizing Coping Time). Since their inner clocks speed up during threat, anxious people seem to think time is passing more quickly (Rapid Time). They may also experience time as drastically slowing down or standing still (Slowing Time) when they feel helpless to leave an unfolding threat situation (e.g., a car accident). Riskind and Rector (2018) postulated that this may be a reaction to an accelerated internal clock when compensatory self-protective action is not possible.

Importantly, we designed the LVDQ to measure cognitive-perceptual distortions using the same self-report format as prior measures of cognitive distortions that assess logical errors, particularly the Cognitive Distortions Scale (Covin et al., 2011). We used the same format as this existing, cognitive distortions self-report questionnaire in order to evaluate if the LVDQ contributes anything incremental or unique beyond what that measure explains. Additionally, we included a measure of social desirability responding (Paulhus, 1988) to address a possible limitation of self-report measures of distorted cognitions and perceptions. If such measures just rely on verbal self-reports, outcomes might be skewed by social desirability responding or mood.

Finally, we sought to address the possibility that there may well be discrepancies between how individuals might report they tend to perceive stimuli when they respond to the new LVDQ and how they might experience these. To do this, we included a quasi-in vivo lab-based task to cross-validate the LVDQ by assessing whether participants reported specific perceptual distortions for a series of standardized potential threat situations (e.g., a video of an approaching spider, an image of someone holding a knife, or two people having a potential romantic quarrel).

Given that we expected that these distortions can work in concert to create a sense of looming vulnerability, it was expected that many of the perceptual distortions would co-occur as part of a more general tendency (e.g., an approaching threat will be seen as closer and larger). The primary hypothesis investigated in this study was that the LVDQ would be strongly associated with the LCS, as well as anxiety and related constructs (worry, intolerance of uncertainty), and the lab-based cross-validation task. Based on past findings for the LCS, we also expected comparable, albeit lower, associations between the LVDQ and depression and hostility (Riskind et al., 2013; Yeo et al., 2020). A critical prediction in this study was that the LVDQ will make unique contributions that account for an additional, distinct, and unique portion of the variance in LCS, anxiety, and related measures, over and above what can be accounted for by the standard thinking errors in logic and social desirability responding. Finally, we examined the structure of the LVDQ. As this is a newly constructed questionnaire, we adopted an integrative strategy that included the evaluation of several measurement models to test the existence of the 10 specific dimensions of LVD as well as the existence of a generic dimension that account for the specific dimensions.

Method

Participants

Seven hundred and fifty-one college students aged between 18 and 62 years old (mean age = 20.53, SD = 3.37) participated in an online study for course credit. Regarding gender, approximately 27% identified themselves as male, 71% as female, and 2% indicated different gender identities (non-binary and transgender). Approximately 48% of the sample identified themselves as Caucasian, 22.6% Asian, 16.4% African American, and 13% as another ethnicity.

Procedure

All participants completed a questionnaire on demographic information and the following self-report measures. Because the whole sample for the study was drawn from several subsamples, some participants differed in whether they completed the whole set of measures in the questionnaire packet. In addition, 241 participants completed a shorter version of the survey that did not include the cross-validation task.

Measures

The Looming Vulnerability Distortions Questionnaire (LVDQ). The LVDQ is a new instrument devised for this study to measure cognitive and perceptual distortions of time, space, and movement. The scenarios and items were developed from small focus groups of clinical professionals and graduate students and researchers in the field of anxiety disorders. It is a 30-item measure that assesses the frequency of 10 types of “looming” distortions (Size Overestimation, Space Compression, Misperceiving Threats as Physically Moving Closer, Time Compression, All-At-once, Experiencing Time as Moving Faster than It Is, Odds Rising Too Rapidly, Time Moving Too Slowly, Minimizing Intervening Events, Minimizing Coping Time) across both social, achievement (e.g., school or work), and physical threat domains. Respondents are presented with a definition of a distortion or type of thinking following the example of Covin et al. (2011) in the Cognitive Distortions Scale (see below) to reduce defensiveness. They are then provided with an example of each distortion in three domains (see Appendix for full questionnaire). As an example, for Time Compression, the following definition is provided: “People sometimes experience the closeness (or distance) in time between themselves and an event that is threatening to them or that makes them uncomfortable as smaller than is true.” The corresponding example for social contexts is: “Monty just remembers that he has forgotten to get his good friend a gift for his wedding that is coming up in three weeks. Despite the fact that Monty has plenty of time, he experiences the wedding as if it were going to occur more soon than is true.” The example in an achievement situation is: “Erica has weeks to finish a project for work that is important to her career. Despite the fact that she has plenty of time, she experiences the deadline as it were only a week away,” and the example in a physical situation is:” Julia is terrified of flying and has an airplane flight ticket to fly in three weeks. Despite the three weeks, she experiences the date of her flight as if it were much closer than is true.” Participants indicate the frequency with which they engage in the type of thinking in each situation on a seven-point Likert-type scale (1 = Never, 7 = All the time) in each type of situation.

Cognitive Distortions Scale (CDS; Covin et al., 2011). The CDS is a 20-item self-report measure that assesses the frequency of 10 types of logical errors (mindreading, catastrophizing, all-or-nothing thinking, emotional reasoning, labeling, mental filtering, overgeneralization, personalization, should statements, minimizing or disqualifying the positive) across both social and achievement related (e.g., school or work) situations. Participants are presented with a definition of the distortion or “thinking type” and provided with an example of that distortion in an interpersonal and achievement context. For example, the following definition is provided: “People sometimes think that things should or must be a specific way” and the example for interpersonal contexts is: “Anne believes that she must be funny and interesting when socializing.” Participants indicate the frequency with which they engage in the type of thinking on a seven-point Likert-type scale (1 = Never, 7 = All the time) in social and achievement situations. Total, social, and achievement scores are obtained by adding items. Past research has indicated that the CDS has good psychometric properties in undergraduate (Covin et al., 2011) and clinical samples (Özdel et al., 2014), including internal consistency, test–retest reliability over two weeks, and construct, discriminant, convergent, and divergent validity. The CDS showed excellent internal reliability. α coefficients were 0.93 for the total scale, 0.86 and 0.87 for the social and achievement scales, and between 0.60 and 0.78 for the subscales.

Looming Maladaptive Style Questionnaire-Revised (LMSQ-R; Riskind et al., 2000). LMSQ-R is a well-validated measure that is designed to assess a person’s tendency to interpret and perceive mentally simulated threats as rapidly progressing and approaching and as expanding in risk and negative consequences (i.e., the looming cognitive style). The LMSQ requires participants to read six brief vignettes describing potentially stressful situations (e.g., threat of a car accident; perceiving odd looks from a lover) and then complete three questions for each vignette using a five-point Likert scale (1–5) (i.e., (1) “In this scene are the chances of your having difficulty decreasing or expanding with each moment?” (2) “Is the level of threat in the encounter staying fairly constant or is it growing rapidly larger with each passing moment?” (3) “How much do you visualize your problem as in the act of becoming progressively worse?”). Thus, the questions on the LMSQ-R assess the extent to which individuals perceive the probability, proximity, and rate of approach of potential harm as increasing dynamically with each moment (or “looming”) not just as low or high in terms of absolute values. A total looming cognitive style (LCS) score is calculated by aggregating responses to these three items across the six vignettes. Although separate indices of social looming (i.e., LCS social) and physical looming (LCS physical) can be derived by aggregating responses to their three vignettes, only the total LCS score was used for purposes of the present study. Riskind et al. (2000) provided evidence for the predictive, convergent, and discriminant validity of the measure, as well as its internal consistency and test–retest stability over 7-months (r = 0.72). In the present study, the alpha coefficient for the LMSQ total scale score was 0.91.

The Brief Symptom Inventory (BSI; Derogatis, 1992). The anxiety, depression, and hostility subscales of the BSI were used to measure the severity of these symptoms. Each subscale is composed of five-six 5-Likert-Type items (1 = Not at all, 5 = Extremely) assessing the severity of the symptoms over the past week. The subscales yield satisfactory levels of internal consistency (ranging between 0.70 and 0.89, Derogatis & Melisaratos, 1983; Boulet & Boss, 1991). Validation studies of the BSI (Boulet & Boss, 1991) find strong reliability and convergent validity in both inpatient and outpatient samples. In the present study, adequate internal consistency was found for each of these three subscales of the BSI (α coefficients: 0.84–0.87).

The Beck Anxiety Inventory (BAI; Beck et al., 1988) is a 21-item self-report scale with excellent psychometric properties that measures cognitive and physiological symptoms of anxiety on a 4-point Likert scale (0 = Not at all, 3 = Severely, it bothered me lot). While not assessing primary symptoms of panic disorder such as the frequency or severity of panic attacks, it measures somatic symptoms associated with severe anxiety and panic disorder (Cox et al., 1996). In the present study, the α coefficient for the BAI total scale score was 0.94.

The Penn State Worry Questionnaire (PSWQ; Meyer et al., 1990) is a well-validated 16-item inventory designed to assess chronic worry and to capture the generality, excessiveness, and uncontrollability characteristics of pathological worry. Each item is rated on 1 (Not at all typical of me) to 5 (Very typical of me) Likert-type scale. In the present study, the α coefficient for the PSWQ was 0.83.

The Balanced Inventory of Desirable Responding (Paulhus, 1988) is a commonly used self-report measure of social desirability responding, and it contains a self-deception (SDE) and an impression management subscale. In this study, only the SDE was used (α = 0.92). Self-deception is conceptualized as the unconscious process of deceiving the self to protect against threat; it assesses the stable characteristic of implicitly maintaining a self-protective (and self-serving) stance. Each item is rated on a 1(Not true) to 7 (Very true) Likert-type scale.

The Intolerance of Uncertainty Scale (IU; Freeston et al., 1994; Buhr & Dugas, 2002) is a well-studied measure of the tendency to find uncertainty uncomfortable and threatening. The 27 items of the scale concern the idea that uncertainty is unacceptable, reflects badly on a person, and leads to frustration, stress, and the inability to take action. Items are rated on a five-point Likert scale ranging from ‘‘not at all characteristic of me’’ to ‘‘entirely characteristic of me.’’ The IUS shows excellent internal consistency, good test–retest reliability over a 5-week period, and convergent and divergent validity when assessed with measures of worry, depression, and anxiety (Buhr & Dugas, 2002). In the present study, the α coefficient was 0.92.

The Cross-validation Lab Task. A possible constraint on self-report measures of cognitive distortions is that they rely entirely on self-reports of how often they typically think in those ways. A possible limitation of such ratings may be colored by the bias created by current moods or by social desirability responding. To partially get around such limitations, we constructed a lab-based task to cross-validation the LVDQ. This task presented the participants with two video clips (on an approaching spider or a potential automobile accident) and eight other images of potential threats (e.g., a romantic conflict, a dangerous person with a knife, a business meeting with supervisors) and asking them to respond to eight questions in each situation on 1–5 scales about their visual-spatial and temporal experience when imagining themselves in the situation. An example of the questions asked are as follows.

  1. 1.

    As you imagine yourself in this scene, how close or far away from you does it feel that the person with the knife is to you? (Not Close/Very Close).

  2. 2.

    How large or big does it feel to you that the person and his knife are (Not big at all/Very Large).

  3. 3.

    How massive? (Not massive at all/Very Massive).

  4. 4.

    How urgent does it feel that you that must immediately do something to respond or act? (Not Urgent at All/Very Urgent).

  5. 5.

    Does it feel like you have enough time to respond or do something to escape harm? (Not Enough Time/ More than Enough Time).

  6. 6.

    How quickly does it seem to you that the person with the knife is approaching and moving towards you? (Not Quickly at All/Very Quickly).

  7. 7.

    To what extent does it feel that you are facing many different problems in the future coming towards you all at once? (Not At All/Very Much Like This).

To ensure that participants adequately performed the task, we specifically asked participants questions such as “Were you able to play the video before scoring it?” Participants who were unable to play the video adequately were discarded for analyses. In addition, we excluded participants who completed the study with unrealistic short times. A total of 58 participants were eliminated for the above reasons leaving 452 participants for the analyses of the cross-validation task.

Data Analysis

Studying the factor structure of the LVDQ involved the estimation of several alternative models (see Fig. 1). First, we conducted confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) analysis of the LVDQ items to test the fit of 10-dimensional (i.e., one factor per distortion type) models. In the CFA model, each item specifically loaded only on the factor it was designed to measure, and correlations between the factors were freely estimated. The ESEM model was specified with similar factor loading patterns as its CFA analog. However, instead of setting the cross-loadings to zero, we used the target rotation, such that all cross-loadings were freely estimated but “targeted” to be as close to zero as possible (Asparouhov & Muthén, 2009). Next, we estimated bifactor models, which represent a top-down paradigm in which a general factor explains the highest variance of observed variables, and specific factors explain residual variances that are not explained by the general factor (Markon, 2019). Support for a bifactor model allows for the reporting of scores for both a general factor and sub-scores for specific factors of the questionnaire.

Fig. 1
figure 1

Conceptual models of the looming vulnerability distortions questionnaire. SD size distortion, SC space compression, TC time compression, PMC physically moving closer, ALLA all-at-once distortion, RT rapid time, ST slowing time, OD odds distortion, MCT minimizing coping time, MIE minimizing intervening events

All factor analyses on the LVDQ were conducted with Mplus Version 8.9 (Muthén & Muthén, 2021) using the weighted least square mean and variance adjusted (WLSMV) estimator. The goodness of model fit was evaluated using the comparative fit index (CFI), the Tucker–Lewis index (TLI), the standardized root-mean-square residual (SRMR), and the root-mean-square error of approximation (RMSEA). CFI and TLI values of 0.95 or higher indicate an excellent fit. SRMR and RMSEA values lower than 0.08 indicate a good fit. Following prior recommendations, we considered changes in RMSEA greater than 0.015 and changes in CFI and TLI greater than 0.01 to be significant when comparing measurement models (Cheung & Rensvold, 2002; Chen, 2007). The quality of the factor loadings was also examined; values above 0.60 were considered very good, above 0.45 were adequate, and below 0.30 were poor (Comrey & Lee, 1992). In order to study the measurement model of the questionnaire, the sample was randomly divided into two subsamples. Thus, the models were estimated in subsample 1 (N = 375) and then replicated in subsample 2 (N = 376). These subsamples were similar in age and gender.

The Ordinal alpha coefficient was used to estimate the reliability of the correlational models whereas the Omega coefficients (ω), using the Omega program (Watkins, 2013), were obtained to assess the reliability of the bifactor models. Total omega (ω) indicated the proportion of the total variance attributable to all sources of common variance. The Omega of a subscale (ωs) indicated the proportion of the variance of the subscale score that could be attributed to all common factors (i.e., the general factor plus the specific factors). The hierarchical omega (ωH) indicated the proportion of the variance of the total score that could be attributed to the general factor after accounting for all specific factors. The hierarchical subscale omega (ωHS) indicated the proportion of the variance of the subscale score that could be attributed to a specific factor after accounting for an overall factor. It has been suggested that ωH and ωHS should be above 0.50 and preferably close to 0.75 (Reise et al., 2013). ωHS values below 0.50 indicate that most of a specific subscale score’s variance was due to a general factor (Hammer & Toland, 2016). We computed H, the percentage of uncontaminated correlations (PUC), and the explained common variance (ECV). High values of H (> 0.70) indicate higher replicability between samples (Rodriguez et al., 2016). The PUC indicates the proportion of correlations explained by the overall factor. The LCA is the proportion of the variance explained by all the factors that is explained by the overall factor. If both the PUC and the ECV are high (> 0.70), a unidimensional model is supported (Rodriguez et al., 2016).

To examine the validity of the LVDQ, we used Mplus Version 8.9’s path analysis and the robust maximum likelihood (MLR) estimation method to examine the associations between the LVDQ scores and measures of anxiety and depressive symptoms, worry, looming cognitive style, and uncertainty. We included the score on the CDQ in the model to check whether the LVDQ contributed significant, distinct, and unique variance to the prediction of the other variables beyond the CDS. Moreover, social desirability was controlled in the model to determine whether the LVDQ predicted variance in the other variables beyond mere social desirability responding. Finally, the associations between the LVDQ scores and the scores of the additional lab-based cross-validation task were examined by path analysis.

Results

Factorial Structure of the LVDQ

Following the recommendations of Morin et al. (2016), we began by comparing the CFA model with the equivalent ESEM model and next we estimated the bifactor models. The analyses were first performed in subsample 1 and then replicated in subsample 2.

CFA and ESEM models: Fit indices were adequate for both the 10-correlated-factor CFA model and its corresponding ESEM model, although the ESEM model represented an improvement in CFI and TLI indices (∆CFI = 0.033; ∆TLI = 0.025, Table 1). Factor loadings are shown in Table 2. In the CFA model, factor loadings were adequate for all specific factors (|λ| range: 0.60–0.85, M = 0.74). In the ESEM model, factor loadings were statistically significant (|λ| range: 0.22–0.88, M = 0.48). Items of value lower than the cut-off of 0.46 (Comrey & Lee, 1992) belonged to the subscales of Size Distortion (2 items), Space Compression (2 item), Threats as Physically Moving Closer (1 item), and Physically Moving Closer (1 item). Several items were cross loaded significantly in the other subscales. The correlation coefficients between specific factors ranged between 0.64 and1.00 in the CFA model and between 0.02 and 0.66 in the ESEM model. The ordinal alpha coefficients for the CFA-based subscales ranged between 0.73 and 0.87, except for Size Distortion, which obtained a lower value (0.67). In the ESEM model, ordinal alpha coefficients ranged between 0.34 and 0.78.

Table 1 Fit indices of the estimated models
Table 2 ESEM and CFA models in subsample 1

Bifactor models: In the next step, we estimated bifactor models to test whether a general looming distortion factor could explain the data. Both the bifactor CFA and the bifactor ESEM model obtained adequate fit indices (Table 1). The bifactor ESEM model did not increase fit indices compared to the ESEM model ∆RMSEA = 0.006; ∆TLI = 0.007; ∆CFI = 0.004). However, the bifactor ESEM model improved the fit indices in comparison with the bifactor CFA model (∆RMSEA = 0.025; ∆TLI = 0.037; ∆CFI = 0.044). As can be seen in Table 3, in the bifactor CFA model, factor loadings supported the existence of a strong general factor of looming distortions (|λ| range: 0.49–0.74, M = 0.64). Factor loadings for specific subscales were poorer (|λ| range: 0.01–0.79, M = 0.38), suggesting that the general factor accounted for the majority of the variance of several items in the LVDQ. In the bifactor ESEM model all factor loadings on the general factor were adequate (|λ| range: 0.52–0.75, M = 0.63). As in the ESEM model, factor loadings on the specific subscales were lower (|λ| range: −0.18 to 0.77, M = 0.38). In short, these results suggest that, for most purposes, the bifactor ESEM model is preferable because, unlike the ESEM model, it allows for the reporting of scores for both the general and the specific subscales of the LVDQ.

Table 3 Bifactor ESEM and CFA models in subsample 1

Table 4 shows the omega coefficients for the bifactor models. Except for the Size Distortion subscale, all ω and ωs values were greater than 0.70, indicating that the proportion of the variance of both the general and specific factors explained by all common sources of variance was high. The hierarchical ω was high only for the general factor, whereas the ωhs values were low (< 0.50), indicating that the reliability of the specific subscales was low once the variance of the general factor was controlled. In both models, H values were greater than 0.70 for the general factor but not for the specific subscales. Therefore, replicability between samples was supported only for the general factor. Finally, the PUC and ECV values tended to be high (> 0.70), indicating that the use of a general score for the LVDQ was appropriate.

Table 4 Omega coefficients for bifactor models

Importantly, all models were next estimated in subsample 2. The results, which are displayed in Table 1, replicated the excellent psychometric characteristics of the LVDQ obtained in subsample 1. Finally, examined two additional structural models that focus on three LVD domains: social, achievement, and physical. The first is a three-factor CFA model (S1), and the second is a hierarchical CFA model in which a general factor explains the scores of the three specific domains (S2). Because of space constraints, we offer only a brief summary of these results; however, the corresponding tables and figures are provided in the Supplemental Materials. Both models obtained excellent fit indices and high factor loadings. α coefficients for the social, achievement, and physical domains were ranged between 0.87 and 0.90 in both subsamples. These models can be useful to clinicians and researchers interested in specific anxiety problems.

Associations Between LVDQ Scores and Other Variables

After establishing the robustness and reliability of the general looming vulnerability distortions factor, we examined whether the scores could explain a unique, distinct portion of variance in anxiety and related constructs not accounted for by either the CDS measure of the familiar cognitive distortions in logic or social desirability responding. To this effect, we saved the factor scores obtained in the bifactor ESEM model and, using path analysis, estimated associations between the scores on the general looming distortions factor and the numerous indicators (looming cognitive style, anxiety and depressive symptoms, hostility, worry, and uncertainty). Scores for social desirability and CDS were also included in the model as predictors. The results indicated that the general looming vulnerability distortions factor was significantly associated with all indicators. The model displayed excellent fit indices [χ2 (8, n = 510) = 8.40; RMSEA = 0.010 (0.000–0.053); CFI = 1.000; TLI = 0.999]. Table 5 displays the regression coefficients of the model. Correlation coefficients between the study variables and their descriptive statistics are provided in the Supplementary Materials (S3). All correlation coefficients were statistically significant, and the total score of the LVDQ showed high correlations with the rest of the variables. Correlation coefficients between the subscales of the LVDQ and the CDS are included in S4. The coefficients were all statistically significant, with medium to high values.

Table 5 Associations between the looming vulnerability distortions questionnaire and indicators of anxiety, depression, hostility, and other cognitive vulnerabilities

Associations Between LVDQ Scores and Lab-Based Measure

Then, we looked at whether the perceptual distortions assessed by the questionnaire items on the LVDQ and the LCS predicted the perceptual distortions on the lab-based cross-validation task. Evidence for the cross-validation task can be seen in its consistent significant correlations with anxiety and the anxiety-related constructs. For instance, the correlation coefficients were 0.50, 0.35, and 0.33, with the LCS, worry, and BAI-Anxiety (see Supplemental Table S5). We conducted a regression model to determine whether the LVDQ and LCS scores explained the scores obtained in the lab-based cross-validation task. The first step of the model included all of, the variables of the study as predictors except for the LVDQ (i.e., depressive and anxiety symptoms, worry, hostility, uncertainty, social desirability, looming cognitive style, and logical errors on the CDS) and accounted for significant variance in scores on the cross-validation task (31%). Of the predictors, only the other measures of “distortions,” the CDS (β = 0.15, t = 2.49, p = 0.013) and LMSQ (β = 0.38, t = 7.66, p < 0.001), were significant unique predictors. As expected, when, the LVDQ was added as predictor in the second step of the model, only the LVDQ (β = 0.33, t = 6.23, p < 0.001) and the LMSQ (β = 0.33, t = 6.60, p < 0.001) were significantly associated with the score on the cross-validation task. Hence, CDS was no longer significantly associated with the cross-validation task when LVDQ was included in the model. The final model explained 36% of the variance of the cross-validation task score.

Considered together, the present findings provide evidence that the LVDQ scores make a unique distinct contribution to variance in emotional variability, irrespective of other anxiety-linked distortions. Furthermore, they demonstrate a robust relationship between the LVDQ questionnaire items and the face-valid lab-based measure of looming vulnerability distortions.

Discussion

The current study developed and psychometrically validated the “Looming Vulnerability Distortions Questionnaire,” (i.e., LVDQ) a self-report assessment of cognitive-perceptual threat distortions that create the perception that the danger is dynamic and rapidly approaching and escalating in risk and urgency (or “looming”). A key feature of this new measure is that it measures perceptual distortions rather than logical distortions.

This study confirmed the excellent psychometric characteristics of the LVDQ, which were replicated on a second independent subsample. Consistent with expectations of the looming vulnerability model, the results support the validity of the LVDQ and these dynamic cognitive-perceptual distortions and of the LVDQ as representing a novel and unique construct. The LVDQ accounted for unique variance in anxiety and related constructs, as well as scores on the face-valid cross-validation.

The psychometric properties of the LVDQ were evaluated by a series of factor analyses. The results supported a bifactor ESEM model where a general factor for looming vulnerability distortions is interpretable and accounts for the majority of the variance. As expected, these results reflected a general tendency for people who report some of the perceptual (i.e., looming vulnerability) distortions to exhibit many others. The excellent fit indices of the bifactor model and the excellent reliability of the general looming vulnerability distortions score justify its use. In addition, a conventional CFA supported individual scores for each perceptual distortion on the LVDQ. The subscales for the individual distortions had adequate ordinal alpha coefficients and may conceivably prove to be useful in research or clinical settings when there is interest in identifying or addressing specific perceptual distortion. Furthermore, adequate fit indices and excellent reliability indices were also found for additional domain analyses of the LVDQ that were provided as supplemental owing to space limitations. These domain analyses were replicated in both subsamples, and we think that the support for these domain analyses can be useful for clinicians.

The results revealed that the general score on the LVDQ was strongly associated with the LCS, anxiety, and worry, as well as with the logical errors (such as jumping to conclusions, black-white thinking, catastrophizing) on the CDS (Covin et al., 2011). Of note, we purposely adopted the same structure and self-report format as the CDS to more stringently investigate whether looming vulnerability to threat distortions add anything incrementally to the assessment of cognitive distortions in anxiety. We defined each distortion in the measure, provided examples from several domains (e.g., social, achievement), and asked participants to assess their likelihood of expressing that reaction. The critical difference in the measures is that the LVDQ incorporated cognitive-perceptual and phenomenological threat distortions rather than logical errors; also, we enlarged the LVDQ’s scope by introducing a third target domain (apart from accomplishment and social) for physical dangers not captured on the CDS.

Despite the common method variance and the strong correlation discovered between the LVDQ and the CDS, the findings revealed that the LVDQ accounts for a significant and unique portion of the variance in anxiety, worry, depression, and hostility that the CDS does not. In combination with this finding, to cross-validate the LVDQ, we additionally incorporated a face-valid lab-based task to measure looming vulnerability threat distortions. We found consistent significant links between the score on the cross-validation task and all anxiety related variables and, in the regression model, where all the variables were included as predictors of that score, only the LCS (LMSQ) and the LVDQ remained significantly associated with the cross-validation task. Thus, consistent with theoretical expectations, the general score for looming vulnerability distortions on the LVDQ as well as the LCS both accounted for significant unique variance in the overall score on the face-valid lab-based task; this contrasted sharply with the scores for the CDS logical errors of distortions in reasoning, as well as intolerance of uncertainty, anxiety, and worry, which did not predict significant unique variance on the lab-based task (beyond the variance explained by the LVDQ and LCS).

Theoretical Considerations

Consistent with the looming vulnerability model, the results are in accord with the proposition that the dynamic aspects of threat are a crucial component of threat appraisal. This significantly extends the scope of the potential content that cognitive models explicitly target, which have largely assumed that threat is defined by judgements about parameters such as probability (or certainty, cost, and proximity) (e.g., Carr, 1974; Foa & Kozak, 1986; Rapee & Heimberg, 1997; Clark & Beck, 2010). By contrast, the looming vulnerability paradigm is unique from other models in emphasizing that this almost universally accepted set of acknowledged threat parameters such as the likelihood and severity or proximity are not always the same; rather, threats are “moving targets” that must increase in proximity and move towards greater certainty to bring about harm. Therefore, the perception that threats are dynamic and approaching in space and time and rising in risk and urgency are a critical source of information and of potential alarm and warning signals.

The current results are also in accordance with the looming vulnerability model’s hypothesis that the LCS, which is a putative core aspect of cognitive vulnerability, is linked to a suite of interrelated cognitive-perceptual distortions. Consistent with this idea, individuals with higher scores on the LCS were more likely to report cognitive-perceptual distortions on the LVDQ and lab-based task of threats as physically larger and closer in space and time, as dynamic and moving towards them, as coming all at once, and as coming too quickly to deploy effective responses to cope.

Moreover, in line with the idea that the perceptual distortions are unique and nonredundant with logical distortions, the LCS and LVDQ independently predicted a significant portion of variance in anxiety. The influence of perceived dynamic parameters of threat are compatible with a large amount of empirical data from the clinical and social cognitive literatures, as well as the animal and cognitive neuroscience literatures. In addition, there are multiple studies using lab-based tasks that have repeatedly reported them (e.g., Langer et al., 1961; Rachman & Cuk, 1992; Bar-Haim et al., 2010; Leibovich et al., 2016; Shiban et al., 2016; Givon-Benjio & Okon-Singer, 2020).

Despite the relative paucity of evidence at the current time that perceptual distortions measured by the LVDQ as well as those on lab-based tasks have any direct causal impact on anxiety and fear, there is substantial evidence that indicates that mental images have emotional impact (Holmes & Mathews, 2010; Shafir et al., 2013; Ji et al., 2016). Furthermore, Davis et al. (2011) found that teaching people to imagine unpleasant stimuli as expanding and approaching caused them to have more negative emotional reactions than picturing them as static or as shrinking and moving away. These effects were the same as those observed in other studies (e.g., Muhlberger et al. (2008); Davis et al., 2011), when experimentally altering the pictures’ actual direction of motion. Likewise, video-clips of approaching spiders trigger greater anxiety and unique brain activation signatures than static or receding spiders (Riskind et al., 1992; Mobbs et al., 2010).

Future Research Questions

Future research investigating the LVDQ could benefit from exploring several interesting questions. For example, do perceptual distortions and estimation biases arise before and help drive subsequent distortions in logical reasoning or merely reflect them? Tentatively suggesting that perceptual distortions can sometimes come first, research has previously found that college students exhibited more primitive thinking during the week of an impending major exam than the previous week before the exam or after (Paulhus & Lim, 1994). Prospective investigations could explore this question as well as explore whether LVDQ distortions potentially contribute to inducing anxiety or whether they merely reflect anxiety symptoms.

As another example of future questions, a previous study by Katz et al. (2017) discovered that a 12-week standard CBT protocol reduced the LCS scores of anxiety disorder patients. Moreover, they found that after adjusting for pre-treatment anxiety, LCS-change predicted end-treatment anxiety. Thus, future research could explore whether LVDQ distortions function as cognitive mediators or markers of therapeutic change. Another question that logically requires further attention is whether perceptual distortions on the LVDQ like time or space compression in social interaction versus physical threat situations differ by disorders (e.g., social anxiety versus panic, OCD, or simple phobias).

Regarding these issues, it should be noted that the LVDQ was not intended to measure every threat estimation bias or perceptual and phenomenological distortion. For instance, numerous studies have found that fear of heights is associated with an overestimation of the distance between the tops of buildings, balconies, or other high points and the ground (Teachman et al., 2008; Dreyer-Oren et al., 2019), whereas anxiety related to anorexia nervosa and body dysmorphic disorder may be related to perceptual distortions of body size or physical body characteristics (Feusner et al., 2011; Waldman et al., 2013). While many of these estimation biases may be seen as versions of the size distortion (where the greater the distance to the ground or the larger the size of a body component, the more threatening), the LVDQ clearly does not assess them. With that said, future studies could explore the possibility that many people with these disorders may have high LVDQ scores.

It could also be reasonable to question whether it is possible that a general tendency to perceive looming vulnerability distortions simply reflects the influence of underlying trait neuroticism. However, in four studies, Liu et al. (2013) found evidence that individuals with higher levels of neuroticism viewed rescheduled events as occurring further away in the future, and therefore as being more distant from the self’s need to deal with them. In addition, they judged the sizes of words with varied font sizes to be smaller, even when negative in valence, and viewed words that appeared to shrink or expand to shrink faster than they expanded. Therefore, any effect of neuroticism in this study, which Lin et al. suggest is associated with “distancing” motivation, would have worked in the opposite direction than presently observed for the LVDQ.

Relation to Other Current Distortion Concepts and Related Constructs in Anxiety

Although there are several current measures of cognitive distortions, what makes the LVDQ unique is that it emphasizes the importance of perceptual and phenomenological distortions rather than in illogical reasoning. Current measures assume that anxiety and related disorders are heightened by distortions in logical reasoning such as “jumping to conclusions,” “either-or” thinking, or “catastrophizing.” We hypothesize that anxiety is not just influenced by such distortions in reasoning or in language-based cognitive representations, but by cognitive-perceptual distortions of threats that heighten the impression that they are rapidly increasing and coming, even when they aren’t.

Recently, considerable attention has also been directed to estimation biases (Clerkin et al., 2009; Vasey et al., 2012; Witt & Sugovic, 2013; Leibovich et al., 2016; Shiban et al., 2016; Givon-Benjio & Okon-Singer, 2020), which are typically assessed with lab-based tasks. Even though such estimation biases aren’t typically considered as logical thinking distortions, they are usually evaluated using discrete or separate disorder-specific tasks. Such estimation biases have not typically been thought of as parts of a more general tendency, as was found by the bi-factor analysis. However, such a general tendency would seem theoretically expected if it is assumed that perceptual threat distortions have a functional role in protecting individuals from keeping out of reach of possible dangers.

There has also been much attention to another line of research on the relationship between distortions in mental imagery and anxiety (Holmes & Mathews, 2010). In many circumstances, images are more vivid and disturbing if they are seen from a field perspective as if through the person’s eyes instead of an external or observer perspective. It would be interesting to see whether looming vulnerability distortions are present in the disturbing mental imagery associated with anxiety, and if so, whether such distortions contribute to the vividness or negative impact of the imagery. A field perspective (viewing threats as if through the person’s own eyes) would likely increase the perception of looming vulnerability, much as an observer perspective (seeing threat in the image from external perspective) might often reduce it. Likewise, a perception of looming vulnerability would also likely increase the tendency to take a first-person viewpoint.

Despite the intriguing and novel findings, the present study has limitations. First, generalizability of the findings is limited by the fact that it did not use a clinical sample with anxiety disorders and the sample was made up of undergraduate students at a university in the United States. Thus, future research in other cultures is needed but the present study sample was recruited from one of the most diverse institutions in the country and includes many international students. Nevertheless, future studies should examine the structure of the questionnaire in other samples, including clinical and gender-balanced samples.

While self-report measures might be influenced by social desirability, the current findings were obtained even when social desirability responding was controlled for. Additionally, we included a face-valid, “quasi-in-vivo” lab-based task to rule out that there may be substantial discrepancies between what people report about how they tend to perceive stimuli on the LVDQ and how they might actually experience these. While the results for this lab-tased task strongly supported the validity of the questionnaire items on the LVDQ, a caveat is that it still used a verbal response format and future studies could be done to replicate these findings using methods that do not require verbal self-reports. In addition, the lab-based task is also limited because we had no prior evidence for the task’s validity. Nonetheless, as we have indicated, numerous independent studies utilizing lab-based nonverbal tasks and responses have demonstrated that anxiety and fear are associated with comparable threat estimation biases (Langer et al., 1961; 1965; Rachman & Cuk, 1992; Clerkin et al., 2009; Bar-Haim et al., 2010; Vasey et al., 2012; Witt & Sugovic, 2013; Leibovich et al., 2016; Shiban et al., 2016; Givon-Benjio & Okon-Singer, 2020). Thus, those studies lend indirect support to the LVDQ.

A further issue is that we did not examine the relevance, salience and imaginability of the various scenarios on the LVDQ to participants. In addition, the LVDQ assumes that the corresponding social, achievement and physical threat scenarios for each distortion subscale (e.g., time compression or rapidly rising odds) are sufficiently similar in other ways that they are equivalent. Other studies could explore this further in the future. However, it should be noted that the scenarios used in this questionnaire are typically elicitors of anxiety in people with anxiety problems and that in some ways they are similar to those used in other questionnaires that use multiple scenarios such as the CDS (Covin et al., 2011) Moreover, the use of scenarios is a usual method in numerous measures designed to assess cognitive and emotional vulnerabilities, such as social information processing (e.g., Crick & Dodge, 1996; Calvete et al., 2015) and inferential styles (Haeffel et al., 2008).

Despite these limitations the current study’s results are novel and indicate that the LVDQ provides a promising and innovative new method for assessing cognitive- perceptual distortions in threat-overestimation in anxiety. Better understanding of the role of dynamic perceptual distortions in threat might help in developing cognitive models of anxiety and afford new possibilities for personalized assessment and treatment. Moreover, having an easy-to-administer and implement self-report assessment of such cognitive-perceptual distortions might be beneficial in research where a battery of lab-based experimental tasks is more difficult to perform. In addition, from a clinical standpoint, it may be necessary to assess the potential value of the LVDQ as a tool for treatment evaluation and the development of personalized assessment and treatment plans.