Abstract
This study involved a psychometric analysis of the 10-item Perceived Stress Scale (PSS-10). To investigate the Russian version of the PSS-10 for adolescents, 3530 adolescents aged 13–17 years were recruited. Confirmatory factor analysis revealed that the data corresponded to the expected two-factor configuration. Psychometric properties and factor structure were evaluated. As expected, the PSS-10 included two factors: perceived helplessness and perceived self-efficacy. Internal consistency demonstrated acceptable values (Cronbach’s alpha was 0.82 for perceived helplessness, 0.77 for perceived self-efficacy, and 0.80 for the overall PSS score). Measurement invariance across sexes was assessed, and configural and metric invariance were confirmed. The developed diagnostic tool can be used both in the school system to alleviate the negative consequences of academic stress in adolescents and, in the future, in other areas, particularly in clinical practice.
Similar content being viewed by others
Introduction
Stress is often linked to harmful or dangerous events, which can cause unpleasant feelings and moods1. However, stress is also a natural human response to both internal and external threats2. Perceived stress is the result of an individual's assessment of the stressor (as threatening or nonthreatening), along with their ability to cope with it. Accurately assessing stress levels is important for developing effective strategies to manage stress. Stress causes a nonspecific physiological reaction3, and in psychological and physiological research, this is typically referred to as distress4. The physiological effects of stress are associated with the functioning of the autonomic nervous system and the hypothalamic‒pituitary‒adrenal axis5. Chronic stress negatively affects the immune system, increasing the likelihood of infections and chronic diseases and increasing the risks of cardiovascular disease, depression, drug addiction, and other conditions6,7,8,9. A number of studies have found that stress can also affect epigenetic mechanisms, such as DNA methylation (e.g.,10,11). In addition, stress can impact psychological characteristics, including learning and self-control12,13.
Adolescents are not immune to stress; moreover, they are particularly susceptible to academic stress. The COVID-19 pandemic resulted in a transition to remote learning, which has led to an increase in stress levels in schoolchildren, as demonstrated by various studies. A review of 72 studies showed the impact of remote learning (caused by factors including the COVID-19 pandemic) on children's psychological well-being as well as emotional (e.g., stress, anxiety) and behavioral problems14. Remote learning is a specific circumstance that creates additional stress, as demonstrated in a number of studies, mainly in adult (student and teacher) samples15,16,17. Diagnostic tools to measure stress and coping strategies in adolescent schoolchildren are needed necessary. Even under normal circumstances, academic stress can occur, especially in adolescents with object and test anxiety. High levels of cortisol, a stress hormone, are observed in students with poor academic performance in math, and a lack of coping strategies is associated with an increase in cortisol levels during knowledge testing situations18. An increase in the level of cortisol predicts a decrease in the rates of successfully solving problems involving numerical skills19. Math anxiety is a specific form of stress that affects learning success20. Remote learning has also introduced new stressors that impact learning success14,16. Researchers have found that stress, combined with feelings of inferiority and low self-esteem, contribute to academic failure among children with learning difficulties. Effective interventions are needed to reduce the influence of stressors and increase academic success21. Cross-cultural differences in stress manifestations among adolescents have been identified, especially in certain groups of stressors. For instance, Chinese adolescents are more susceptible to academic achievement-related stress22. In recent years, Russian schools have reported an increase in bullying cases, causing additional stress among school children23. Special questionnaires have been developed to assess the school environment, coping strategies, and manifestations of stress24,25,26. In such situations, it is crucial to evaluate not only the psychological climate of the school but also the stress manifestations and coping strategies employed by adolescents. However, a stress questionnaire specifically designed for adolescent groups has not yet been developed or adapted.
One of the well-established scales aimed at assessing stress is the Perceived Stress Scale (PSS). The PSS was designed to measure respondents' feelings of lack of control and predictability as well as being overburdened in their lives. The Perceived Stress Scale was first proposed by Cohen et al.27 and originally included 14 items. The PSS-14 has been validated in various countries and populations, including adults28,29,30, women with postnatal distress31, city dwellers32, working adults33, relatives of suicide survivors34, female police officers35, patients with cardiovascular disease36, elderly service workers37, asthma patients38, patients with chronic disease39, postpartum women with and without preeclampsia40 (Torres-Lagunas et al., 2015), dementia patients41, university students42, and nursing professionals43. Additionally, the PSS-14 has been validated for use in adolescents44,45,46. A brief version of the PSS, which is a 4-item adaptation, has also been developed47. Based on the PSS-14, a 10-item adaptation was developed by Cohen48 and has become common for use with adult respondents across countries and populations28,29,49,50,51. The PSS-10 was adapted into Russian by Ababkov et al.52, and it has a two-factor structure: perceived helplessness and perceived self-efficacy. The total score on the PSS-10 is also calculated.
However, validation of use of the PSS-10 in adolescents is limited, with only one known version assessed in Chinese adolescents22. The Russian version has not been validated for use with adolescents. Thus, the purpose of this study was to adapt the Russian version of the PSS-10 for use in adolescents and to evaluate its internal consistency, factor structure, external validity, and sex invariance.
Results
Confirmatory Factor Analysis (CFA)
CFA was conducted to confirm the two-factor structure of the questionnaire. The fit indices of the model indicated good fit to the data, supporting the conclusion that the two-factor configuration of the questionnaire was appropriate. The CFA results are presented in Table 1.
Based on the CFA results, we defined two scales: perceived helplessness (Items 1, 2, 3, 6, 9, 10) and perceived self-efficacy (Items 4, 5, 7, 8). Factor structure of PSS is presented on Fig. 1.
Reliability (Internal Consistency)
Regarding internal consistency, Cronbach's α values were calculated. The perceived helplessness subscale had a Cronbach’s α of 0.82, the perceived self-efficacy subscale had a Cronbach’s α of 0.77, and the PSS total score had a Cronbach’s α of 0.80. These values indicate high reliability for the questionnaire subscales.
Descriptive Statistics
Table 2 presents descriptive statistics for the PSS subscales, including the mean and standard deviation.
Construct validity
Construct (external) validity was also analyzed by exploring the correlations of scores on the PSS-10, brief COPE-A and MTQ-10. The results of the correlation analysis are presented in Tables 3 and 4.
As shown in Table 3, significant correlations were observed for all PSS-10 and COPE-A scales, excluding the correlation of the perceived helplessness subscale with problem-focused coping, and humor, as well as PSS total and acceptance. The magnitude of the correlations did not exceed 0.55 (for the perceived helplessness and avoidance subscales). Table 4 shows the significant negative correlations of perceived helplessness, perceived self-efficacy, PSS-10 total, and MTQ-10 scores.
Sex invariance
Measurement invariance across sexes was evaluated to assess the applicability of the PSS-10 in both male and female groups (see Table 5). Model 1 was used to assess configural invariance and demonstrated a good fit to the data (CFI = 0.986, RMSEA = 0.074). Model 2 was used to estimate metric invariance and demonstrated a good fit to the data (ΔCFI = 0.001, ΔRMSEA = 0.002, p = 1.000), indicating that the data are sex invariant in terms of factor loadings. Model 3 was used to evaluate scalar invariance and showed a good fit to the data (ΔCFI = 0.001, ΔRMSEA = 0.001, p < 0.001). Thus, the null hypothesis was rejected because the intercepts of the items were equal across the sexes at p < 0.001.
Discussion
The main goal of this study was to evaluate the psychometric properties of the Perceived Stress Scale in Russian-speaking adolescents. In this study, factor structure and reliability, external validity, and measurement invariance across sexes in terms of configural, metric and scalar invariance were assessed. Thus, the use of the Russian version of the PSS-10 in adolescents was confirmed.
Confirmatory factor analysis revealed an initial 2-factor structure, which demonstrated satisfactory model fit indices. The final version included 10 items and 2 subscales (perceived helplessness and perceived self-efficacy). The perceived helplessness subscale includes 6 items, and the perceived self-efficacy subscale consists of 4 items. Both scales have a high internal reliability, with Cronbach's alpha above 0.77. The results are consistent with other studies that have demonstrated a two-factor structure in adolescent samples, as shown by Kechter et al.53, Liu et al.22, and Whitney et al.54.
The study confirmed the construct validity of the PSS-10 by examining correlations of PSS-10 scores with scores on the COPE-A and MTQ-10 scales for adolescents. Positive correlations were found between the perceived self-efficacy subscale of the PSS-10 and the turning to religion and avoidance subscales of the COPE-A, while negative correlations of the perceived self-efficacy subscale with the humor, acceptance, socioemotional support and problem-focused coping subscales were observed. The positive relationship between the avoidance subscale and the perceived self-efficacy subscale may be explained by maladaptive coping behavior, which reflects the inability to manage stress. Although the size of the correlations was modest, similar results were reported in earlier study of adolescent groups55. Negative correlations were found for the perceived helplessness, perceived self-efficacy and total PSS-10 scores with scores on the mental toughness scale. Negative correlations of perceived stress and mental toughness have been demonstrated previously56. A negative relationship between stress and mental toughness was found, which indicates that mental toughness is an adaptation to stress, with low stress scores observed in individuals with high mental toughness57.
The measurement invariance of the PSS-10 was initially evaluated in a sample of Russian-speaking adolescents to determine the suitability of using the scale in both sexes. Three models were assessed: configural, metric, and scalar invariance. Configural and metric invariance were supported, which is consistent with findings from studies in other countries22,58,59,60,61. The configural invariance of the model demonstrates that the same constructs are measured by the PSS-10 in both sexes. Metric invariance indicates that the factor loadings are similar between males and females. The significance of the fit indices in the scalar invariance model indicates variance in the intercepts. However, it can be concluded that the PSS-10 can be used in both sexes due to the configural invariance, which indicates the unity of the construct.
The development of the PSS-10 for use in diagnosing stress in adolescents is important, as there is a lack of such tools available in Russia. This instrument has wide-ranging practical applications, and it is recommended for use by school psychological services, researchers, and administrators. The PSS-10 can be utilized to assess acute stress reactions resulting from communication problems in children's groups, bullying, and increased workloads in high school. The diagnostic results can be used to develop individual recommendations and training programs that teach effective coping strategies to adolescents, ultimately reducing the negative consequences of stress.
Moreover, the PSS-10 can be widely used in research due to its several advantages. First, it enables the comparison of perceived stress levels between adolescents and adults. Second, it can be used in various countries, allowing for cross-cultural analysis of perceived stress. Finally, its brevity makes it a time-saving tool, especially for large-scale testing.
The developed tool can be used in various groups in the future, including oncological patients. It is well known that cancer patients may experience negative psychological and psychophysiological symptoms such as increased stress levels, anxiety, depression, sleep disturbances, and reduced mental health. To alleviate stress, various coping strategies can be utilized, including behavioral and cognitive strategies that help to reduce the pressure of a stressful situation. However, different coping strategies have varying degrees of effectiveness. Therefore, assessing the level of stress and other psychological reactions is critical in developing effective measures for management. However, the diagnostic methods used by psychologists for these purposes are often based on outdated norms and need to be standardized. The PSS-10 has satisfactory psychometric properties and can be used for diagnostic purposes.
It is important to consider that stress can lead to serious disorders such as depression and posttraumatic stress disorder62. Timely diagnosis and the development of effective coping behavior can reduce the risk of developing these mental disorders, making the PSS-10 useful for professionals in the mental health field.
This study has an important limitation related to the age of the sample, which included only adolescents aged 13 and above. Further research is needed to validate and adapt the Perceived Stress Scale for use with younger adolescents.
Another limitation of the study may be that the type of stressor affecting adolescents was not assessed during the measurement. The type of stressor can be an important diagnostic criterion63, determining the response to stress. Moreover, the COVID-19 pandemic is a source of various types of stressors that affect the response of adolescents to stress in different ways64. In future research, it is important to assess the response to a specific type of stressor in adolescents in relevant situations.
The study confirms that the PSS-10 has satisfactory psychometric properties and can be used for stress assessment in adolescents. Its brevity makes it suitable for quick diagnostics and attractive to psychologists working with large groups of adolescents, such as those in schools. The questionnaire can be useful in various areas, including health care and academic environments where bullying may occur.
Methods
Participants
Participants in the study were 4834 adolescents between the ages of 13 and 17 years. Technical outliers were removed from the dataset during preparation. These outliers were identified and excluded based on the following criteria:
-
similarity of answers (the same answer was selected by the respondent for all items),
-
item response duration (less than 1.5 s),
-
total questionnaire duration (less than 400 s),
-
variability of item response duration (standard deviation of the item response duration less than 6 s or more than 60 s).
Regarding the item duration response, the left peak of the bimodal distribution was removed, as was the right peak for the total questionnaire duration. All observations identified under at least one of the above criteria were excluded. Subsequently, the Mahalanobis distance of the item response duration was assessed. Observations exceeding the 0.90 quantile were excluded. The final sample consisted of 3530 adolescents in grades 6–11 with a mean age of 15.3 years (SD = 1.05 years). The sample included 2192 girls, 1276 boys, and 62 participants who did not indicate their sex. The age composition of the sample included 13-year-olds (n = 65), 14-year-olds (n = 864), 15-year-olds (n = 1136), 16-year-olds (n = 933), and 17-year-olds (n = 532).
Procedure
The data were collected online using personal computers as a part of the study on stress and coping behavior in adolescents during the COVID-19 pandemic. Students were also asked about their sex, age, and socioeconomic status.
Ethics approval
The study was conducted according to the guidelines of the Declaration of Helsinki and was approved by the Ethics Committee of the Psychological Institute of the Russian Academy of Education.
Informed consent statement
The informed consent of all adolescents' parents was obtained.
Scales
Perceived Stress Scale (PSS-10)
The 10-item Perceived Stress Scale was developed by Cohen (1988)48 to measure the level of perceived stress. The scale consists of 10 questions, and in this study, the Russian version of the questionnaire52 was used. Translation and back translation of the questionnaire was provided in the study of Ababkov and colleagues52. Authors reported that translation and back translation were performed by professional translators. The Russian version also has 10 questions and a two-factor structure: perceived helplessness and perceived self-efficacy. The total score of the questionnaire is calculated by adding the scores of each item. Respondents are asked to indicate how often they experienced a certain condition in the last month using a Likert scale that ranged from 1 ("never") to 5 ("often"). Items 1, 2, 3, 6, 9, and 10 are part of the perceived helplessness subscale. Each item is rated on a scale of 1 to 5 points, and the scores are summed. Items 4, 5, 7, and 8 are part of the perceived self-efficacy subscale. Each item is rated on a scale from 1 to 5 points, but the scores on this subscale are reversed, such that 1 = 5, 2 = 4, 3 = 3, 4 = 2, and 5 = 1. The scores are then summed. To calculate the total score of the Perceived Stress Scale, the scores of all 10 questions (items) are summed. The scores of both subscales (perceived helplessness and perceived self-efficacy) can also be summed to obtain the total score of the questionnaire.
The brief version of the Coping Orientation for Problem Experiences for adolescents (Brief-COPE-A; 29 items)
In our study, we used the Brief-COPE-A version developed by Marakshina et al.26 for Russian adolescents. This version was based on the Russian version of the COPE65 using the translation by Rasskazova et al. The original Coping Orientation for Problem Experiences (COPE) questionnaire was developed by Carver et al.66. The Brief-COPE-A version was used to assess the external validity of the PSS-10 and is intended to diagnose coping strategies in adolescents aged 13–17. The questionnaire includes 29 items that assess six coping strategies: problem-focused coping, avoidance, socioemotional support, acceptance, turning to religion, and humor. Items with opposite meanings were reverse coded, with 1 = 4, 2 = 3, 3 = 2, and 4 = 1. The total score for each coping strategy was calculated as the average of all scores on that strategy.
Mental toughness questionnaire (MTQ-10)
The MTQ-10 is a brief version of the MTQ-48. The original version of the questionnaire was developed in 200267. The questionnaire is used to assess mental stability, especially in sports psychology. The original version includes 48 questions; brief versions have also been developed consisting of 18 and 10 items68. The 48-item version evaluates the 4 main components of psychological toughness (control, challenge, determination, and confidence)69. The 10-item version contains one scale70. The general component of psychological resilience reflects individual resilience and the ability to achieve success. Responses are indicated on a Likert scale from 1 (“strongly disagree) to 5 (“strongly agree”). The answers to questions 1, 4, 5, 8, 9, and 10 were coded on a scale from 1 to 5. Items 2, 3, 6, and 7 were reversed scored, with 1 = 5, 2 = 4, 4 = 2, and 5 = 1. Mental toughness was recorded as the sum of all scores on ten items. The MTQ-10 was used to assess the external validity of the PSS-10. Cronbach’s alpha in our sample of adolescents was 0.73.
Data analysis
Data analysis was performed in R version 4.1.2 (including dataset preparation, sampling procedure, reliability calculation, correlation analysis) and JASP 0.16.1.0 (confirmatory factor analysis, descriptive statistics, correlation analysis, reliability calculation, structural equation modeling, SEM for measurement invariance). Spearman's correlation analyses were conducted. Measurement invariance across sexes was evaluated using configural invariance, metric invariance, and scalar invariance.
Initially, skewness and kurtosis were calculated: for Total Perceived Stress Scale skewness was 0.160 and kurtosis was − 0.02. Values smaller than 1 indicated normal distribution of the data.
Our theoretical assumptions, based on a previous adaptation of the Perceived Stress Scale (PSS) in adults, included a two-factor model. We used confirmatory factor analysis to confirm the factorial structure of the questionnaire, and we evaluated the fit of the model data using fit indices such as values of the standardized root mean squared residual (SRMR) of < 0.08, Tucker–Lewis index (TLI) scores that approach 1, comparative fit index (CFI) > 0.95, and root mean square error of approximation (RMSEA) < 0.0871,72,73,74. We also evaluated configural, metric, and scalar invariance using the DWLS estimator in SEM. Fit indices such as ΔCFI and ΔRMSEA were assessed. Configural invariance was assessed by CFI and RMSEA values. We considered ΔCFI < 0.010 and ΔRMSEA < 0.015 to demonstrate metric and scalar invariance75,76.
To assess the reliability (internal consistency) of the scale, we used Cronbach's alpha. We considered a Cronbach's alpha value of 0.7 or higher to confirm the reliability of the scale77.
Data availability
The datasets used and analysed during the current study available from the corresponding author on reasonable request.
References
Baum, A., Trevino, L. A. & Dougall, A. L. Stress and the cancers. In The handbook of stress science: Biology, psychology, and health (eds Contrada, R. J. & Baum, A.) 411–424 (Springer Publishing Company, New York, 2011).
Lecic-Tosevski, D., Vukovic, O. & Stepanovic, J. Stress and personality. Psychiatriki. 22, 290–297 (2011).
Viner, R. Putting stress in life: Hans Selye and the making of stress theory. Soc. Stud. Sci. 29, 391–410. https://doi.org/10.1177/030631299029003003 (1999).
Selye, H. Confusion and controversy in the stress field. J. Hum. Stress. 1(37–44), 1975. https://doi.org/10.1080/0097840X.1975.9940406 (1975).
Ulrich-Lai, Y. M. & Herman, J. P. Neural regulation of endocrine and autonomic stress responses. Nat. Rev. Neurosci. 10, 397–409. https://doi.org/10.1038/nrn2647 (2009).
Sinha, R. How does stress increase risk of drug abuse and relapse?. Psychopharmacology. 158, 343–359. https://doi.org/10.1007/s002130100917 (2001).
Kendler, K. S., Kuhn, J. W., Vittum, J., Prescott, C. A. & Riley, B. The interaction of stressful life events and a serotonin transporter polymorphism in the prediction of episodes of major depression: A replication. Arch. Gen. Psychiat. 62, 529–535. https://doi.org/10.1001/archpsyc.62.5.529 (2005).
Spruill, T. M. Chronic psychosocial stress and hypertension. Curr. Hypertens. rep. 12, 10–16. https://doi.org/10.1007/s11906-009-0084-8 (2010).
Aguilera, G. HPA axis responsiveness to stress: Implications for healthy aging. Exp. Gerontol. 46, 90–95. https://doi.org/10.1016/j.exger.2010.08.023 (2011).
Perroud, N. et al. The Tutsi genocide and transgenerational transmission of maternal stress: Epigenetics and biology of the HPA axis. World J. Biol. Psychia. 15, 334–345. https://doi.org/10.3109/15622975.2013.866693 (2014).
Yehuda, R. et al. Holocaust exposure induced intergenerational effects on FKBP5 methylation. Biol. Psychiat. 80, 372–380. https://doi.org/10.1016/j.biopsych.2015.08.005 (2016).
Stansfeld, S. A. et al. Aircraft and road traffic noise and children’s cognition and health: A cross-national study. Lancet. 365, 1942–1949. https://doi.org/10.1016/S0140-6736(05)66660-3 (2005).
Sandi, C. & Pinelo-Nava, M. T. Stress and memory: Behavioral effects and neurobiological mechanisms. Neural Plast. https://doi.org/10.1155/2007/78970 (2007).
Viner, R. M. et al. Susceptibility to SARS-CoV-2 infection among children and adolescents compared with adults: A systematic review and meta-analysis. JAMA pediatrics. 175, 143–156. https://doi.org/10.1001/jamapediatrics.2020.4573 (2021).
Voronin, I. A. et al. Coping responses during the COVID-19 Pandemic: A cross-cultural comparison of Russia, Kyrgyzstan, and Peru. Psychol. Russia. State Art. 13, 55–74. https://doi.org/10.11621/PIR.2020.0404 (2020).
Hjiej, G. et al. Distant education in Moroccan medical schools following COVID-19 outbreak at the early phase of lockdown: Were the students really engaged?. Sci. African. 15, e01087. https://doi.org/10.1016/j.sciaf.2021.e01087 (2022).
Pavlova, A. et al. Factor structure and psychometric properties of Brief COPE in Russian schoolteachers. Edu. Sci. 12, 539. https://doi.org/10.3390/educsci12080539 (2022).
Lindahl, M., Theorell, T. & Lindblad, F. Test performance and self-esteem in relation to experienced stress in Swedish sixth and ninth graders—saliva cortisol levels and psychological reactions to demands. Acta Paediatr. 94, 489–495. https://doi.org/10.1111/j.1651-2227.2005.tb01922.x (2005).
MacKinnon McQuarrie, M. A., Siegel, L. S., Perry, N. E. & Weinberg, J. Reactivity to stress and the cognitive components of math disability in grade 1 children. J. Learn. Disabil. 47, 349–365. https://doi.org/10.1177/0022219412463436 (2014).
Maloney, E. A. & Beilock, S. L. Math anxiety: Who has it, why it develops, and how to guard against it. Trends. Cogn. Sci. 16, 404–406. https://doi.org/10.1016/j.tics.2012.06.008 (2012).
Burenkova, O. V., Naumova, O. Y. & Grigorenko, E. L. Stress in the onset and aggravation of learning disabilities. Dev. Rev. 61, 100968. https://doi.org/10.1016/j.dr.2021.100968 (2021).
Liu, X. et al. Factor structure of the 10-item perceived stress scale and measurement invariance across genders among Chinese adolescents. Front. Psychol. 11, 537. https://doi.org/10.3389/fpsyg.2020.00537 (2020).
OECD, Pisa,. Results (Volume III): What School Life Means for Students’ Lives (OECD Publishing, Paris, PISA, 2018). https://doi.org/10.1787/acd78851-en(2019).
Khlomov, K. D., Bochaver, A. A. & Korneev, A. A. Well-being and coping with stress among Russian adolescents in different educational environments. Psychol. Russia State Art. 14, 68–80. https://doi.org/10.11621/pir.2021.0305 (2021).
Bochaver, A. A., Korneev, A. A. & Khlomov, K. D. School Climate Questionnaire: A new tool for assessing the school environment. Front. Psychol. 3361, 2022. https://doi.org/10.3389/fpsyg.2022.871466 (2022).
Marakshina, J. et al. The brief COPE-A inventory in Russian for adolescents: Validation and evaluation of psychometric properties. Heliyon. https://doi.org/10.1016/j.heliyon.2023.e13242 (2023).
Cohen, S., Kamarck, T. & Mermelstein, R. A global measure of perceived stress. J. Health Soc. Behav. https://doi.org/10.2307/2136404 (1983).
Huang, F. et al. Psychometric properties of the perceived stress scale in a community sample of Chinese. BMC Psychiatry. 20, 1–7. https://doi.org/10.1186/s12888-020-02520-4 (2020).
Mondo, M., Sechi, C. & Cabras, C. Psychometric evaluation of three versions of the Italian Perceived Stress Scale. Curr Psychol. 40, 1884–1892. https://doi.org/10.1007/s12144-019-0132-8 (2021).
Figalová, N. & Charvát, M. The perceived stress scale: Reliability and validity study in the Czech Republic. Cesk. Psyhol. 65, 46–59. https://doi.org/10.51561/cspsych.65.1.46 (2021).
Chen, C. H., Tseng, Y. F., Chou, F. H. & Wang, S. Y. Effects of support group intervention in postnatally distressed women: A controlled study in Taiwan. J. Psychosom. Res. 49, 395–399. https://doi.org/10.1016/S0022-3999(00)00180-X (2000).
Yang, T. Z. & Huang, H. T. An epidemiological study on stress among urban residents in social transition period. Zhonghua liuxingbingxue zazhi. 24, 760–764 (2003).
Chu, L. & Kao, H. S. R. The moderation of meditation experience and emotional intelligence on the relationship between perceived stress and negative mental health. Chinese. J. Psychol. 47, 157. https://doi.org/10.6129/CJP.2005.4702.05 (2005).
Mitchell, A. M., Crane, P. A. & Kim, Y. Perceived stress in survivors of suicide: Psychometric properties of the Perceived Stress Scale. Res. Nurs. Health. 31, 576–585. https://doi.org/10.1002/nur.20284 (2008).
Wang, Z. et al. Psychometric properties of the Chinese version of the perceived stress scale in policewomen. PloS one. 6, e28610. https://doi.org/10.1371/journal.pone.0028610 (2011).
Leung, D. Y., Lam, T. H. & Chan, S. S. Three versions of Perceived Stress Scale: Validation in a sample of Chinese cardiac patients who smoke. BMC Public Health. 10, 1–7. https://doi.org/10.1186/1471-2458-10-513 (2010).
Ng, S. M. Validation of the 10-item Chinese perceived stress scale in elderly service workers: One-factor versus two-factor structure. BMC Psychol. 1, 1–8. https://doi.org/10.1186/2050-7283-1-9 (2013).
Maroufizadeh, S., Zareiyan, A. & Sigari, N. Psychometric properties of the 14, 10 and 4-item “Perceived Stress Scale” among asthmatic patients in Iran. Payesh (Health Monitor). 13, 457–465 (2014).
Lee, E. H., Chung, B. Y., Suh, C. H. & Jung, J. Y. Korean versions of the P erceived S tress S cale (PSS-14, 10 and 4): Psychometric evaluation in patients with chronic disease. Scand. J. Caring Sci. 29, 183–192. https://doi.org/10.1111/scs.12131 (2015).
Torres-Lagunas, M. A., Vega-Morales, E. G., Vinalay-Carrillo, I., Arenas-Montaño, G. & Rodríguez-Alonzo, E. Psychometric validation of scales PSS-14, AFA-R, HDRS, CES-D, EV in postpartum Mexican women with and without preeclampsia. Enfermería Universitaria. 12, 122–133. https://doi.org/10.1016/j.reu.2015.08.001 (2015).
Deeken, F. et al. Psychometric properties of the Perceived Stress Scale in a sample of German dementia patients and their caregivers. Int. Psychogeriatr. 30, 39–47. https://doi.org/10.1017/S1041610217001387 (2018).
Balgiu, B. A., Sfeatcu, R., Dumitrache, M. A., & Tribus, L. Construct validity and reliability of perceived stress scale (PSS-14) in a Romanian sample of dental students. Int. J. Med. Dent. 25. (2021).
Dominguez-Lara, S., Merino-Soto, C. & Torres-Villalobos, G. Structural analysis and reliability of the Perceived Stress Scale in nursing professionals from Peru. Enfermería Clínica. 32, 152–160. https://doi.org/10.1016/j.enfcle.2022.01.001 (2022).
Martin, R. A., Kazarian, S. S. & Breiter, H. J. Perceived stress, life events, dysfunctional attitudes, and depression in adolescent psychiatric inpatients. J. Psychopathol. Behav. 17, 81–95. https://doi.org/10.1007/BF02229205 (1995).
Yosipovitch, G. et al. Study of psychological stress, sebum production and acne vulgaris in adolescents. Acta Derm-venereol. 87, 135–139 (2007).
Edwards, M., Adams, E. M., Waldo, M., Hadfield, O. D. & Biegel, G. M. Effects of a mindfulness group on Latino adolescent students: Examining levels of perceived stress, mindfulness, self-compassion, and psychological symptoms. J. Spec. Group Work. 39, 145–163. https://doi.org/10.1080/01933922.2014.891683 (2014).
Demkowicz, O., Panayiotou, M., Ashworth, E., Humphrey, N. & Deighton, J. The factor structure of the 4-item Perceived Stress Scale in English adolescents. Eur. J. Psychol. Assess. https://doi.org/10.1027/1015-5759/a000562 (2019).
Cohen, S. Perceived stress in a probability sample of the United States. In The Claremont Symposium on Applied Social Psychology: The Social Psychology of Health (eds Spacapan, S. & Oskamp, S.) 31–68 (Sage Publications Inc, Thousand Oaks, 1988).
Anwer, S., Manzar, M. D., Alghadir, A. H., Salahuddin, M. & Abdul Hameed, U. Psychometric analysis of the perceived stress scale among healthy university students. Neuropsych. Dis. Treat. https://doi.org/10.2147/NDT.S268582 (2020).
Bastianon, C. D. et al. Perceived Stress Scale (PSS-10) psychometric properties in migrants and native Germans. BMC Psychiatry. 20, 1–9. https://doi.org/10.1186/s12888-020-02851-2 (2020).
Soria-Reyes, L. M., Cerezo, M. V., Alarcon, R. & Blanca, M. J. Psychometric properties of the perceived stress scale (pss-10) with breast cancer patients. Stress Health. 39, 115–124. https://doi.org/10.1002/smi.3170 (2023).
Ababkov, V. A., et al. Validation of the Russian version of the questionnaire “Scale of perceived stress–10”. https://doi.org/10.21638/11701/spbu16.2016.202 (2016).
Kechter, A. et al. Factors in the perceived stress scale differentially associate with mindfulness disposition and executive function among early adolescents. J. Child. Fam. Stud. 28, 814–821. https://doi.org/10.1007/s10826-018-01313-4 (2019).
Whitney, S., Luther, A. W. & Ferro, M. A. Psychometric properties of the perceived stress scale in youth with mental illness. J. Child. Fam. Stud. 31, 2801–2812. https://doi.org/10.1007/s10826-022-02387-x (2022).
Serrano, C., Andreu, Y., Martínez, P. & Murgui, S. Improving the comparability of brief-COPE results through examination of second-order structures: A study with Spanish adolescents. Psicol. Conduct. 29, 437–454 (2021).
Gerber, M. et al. Effects of stress and mental toughness on burnout and depressive symptoms: A prospective study with young elite athletes. J. Sci. Med. Sport. https://doi.org/10.1016/j.jsams.2018.05.018 (2018).
Cowden, R. G., Meyer-Weitz, A. & Oppong Asante, K. Mental toughness in competitive tennis: relationships with resilience and stress. Front. Psychol. 7, 320. https://doi.org/10.3389/fpsyg.2016.00320 (2016).
Barbosa-Leiker, C. et al. Measurement invariance of the perceived stress scale and latent mean differences across gender and time. Stress Health. 29, 253–260. https://doi.org/10.1002/smi.2463 (2013).
Taylor, J. M. Psychometric analysis of the ten-item perceived stress scale. Psychol. Assessment. 27, 90. https://doi.org/10.1037/a0038100 (2015).
Reis, D., Lehr, D., Heber, E. & Ebert, D. D. The German version of the Perceived Stress Scale (PSS-10): Evaluation of dimensionality, validity, and measurement invariance with exploratory and confirmatory bifactor modeling. Assessment. 26, 1246–1259. https://doi.org/10.1177/1073191117715731 (2019).
Denovan, A., Dagnall, N., Dhingra, K. & Grogan, S. Evaluating the Perceived Stress Scale among UK university students: Implications for stress measurement and management. Stud. High. Educ. 44, 120–133. https://doi.org/10.1080/03075079.2017.1340445 (2019).
Bremner, J. D. et al. Diet, stress and mental health. Nutrients. 12, 2428. https://doi.org/10.3390/nu12082428 (2020).
Gold, S. D., Marx, B. P., Soler-Baillo, J. M. & Sloan, D. M. Is life stress more traumatic than traumatic stress?. J. Anxiety Disord. 19, 687–698. https://doi.org/10.1016/j.janxdis.2004.06.002 (2005).
Kira, I. A. et al. The impact of COVID-19 traumatic stressors on mental health: Is COVID-19 a new trauma type. Int. J. Mental Health Addict. https://doi.org/10.1007/s11469-021-00577-0 (2021).
Rasskazova, E. I., Gordeeva, T. O. & Osin, E. N. Coping strategies in the structure of activity and self-regulation: Psychometric characteristics and possibilities of using the COPE methodology. Psychol. J. High. Sch. Econ. 10, 82–118 (2013).
Carver, C. S., Scheier, M. F. & Weintraub, J. K. Assessing coping strategies: A theoretically based approach. J. Pers. Soc. Psychol. 56, 267. https://doi.org/10.1037/0022-3514.56.2.267 (1989).
Clough, P., Earle, K. & Sewell, D. Mental toughness: the concept and its measurement. In Solutions in sport psychology (ed. Cockerill, I.) 32–43 (Thomson, London, 2002).
Denovan, A., Drinkwater, K., Dagnall, N., Hill-Artamonova, E., & Musienko, T. Nacional'naya' bezopasnost' i strategicheskoe planirovanie. Nacional'naya' bezopasnost' i strategicheskoe planirovanie 82–96 (Informacionnyj izdatel'skij uchebno-nauchnyj centr Strategiya budushchego, 2021).
Perry, J. L., Clough, P. J., Crust, L., Earle, K. & Nicholls, A. R. Factorial validity of the Mental Toughness Questionnaire-48. Pers. Indiv. Differ. 54, 587–592. https://doi.org/10.1016/j.paid.2012.11.020 (2013).
Dagnall, N. et al. Psychometric assessment of shortened mental toughness questionnaires (MTQ): Factor structure of the MTQ-18 and the MTQ-10. Front. Psychol. https://doi.org/10.3389/fpsyg.2019.01933 (2019).
Hu, L. T. & Bentler, P. M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 6, 1–55. https://doi.org/10.1080/10705519909540118 (1999).
Byrne, B. M. Structural equation modeling with AMOS, EQS, and LISREL: Comparative approaches to testing for the factorial validity of a measuring instrument. Int. J. Test. 1, 55–86. https://doi.org/10.1207/S15327574IJT0101_4 (2001).
Brown, T. A. Confirmatory factor analysis for applied research (New York, NY, US, 2006)
Kline, R. B. Principles and practice of structural equation modeling, 2nd (The Guilford Press, New York, 2005).
Cheung, G. W. & Rensvold, R. B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5 (2002).
Chen, F. F. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. Multidiscip. J. 14, 464–504. https://doi.org/10.1080/10705510701301834 (2007).
Nunnally, J. C. Psychometric Theory 2nd edn. (McGraw, 1978).
Author information
Authors and Affiliations
Contributions
J.M. conceived and designed the experiments, analyzed and interpreted the data; visualized the results; wrote the paper; T.A. analyzed and interpreted the data; G.V. analyzed and interpreted the data; V.I. conceived and designed the experiments, reviewed the manuscript; M.L. conceived and designed the experiments, reviewed the manuscript; A.M. collected the data; P.K. collected the data; A.T. collected the data; I.Z. collected the data; S.M. conceived and designed the experiments, reviewed the manuscript.
Corresponding author
Ethics declarations
Competing of interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Marakshina, J., Adamovich, T., Vasin, G. et al. Factor structure and psychometric properties of the Perceived Stress Scale in Russian adolescents. Sci Rep 14, 775 (2024). https://doi.org/10.1038/s41598-023-51104-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-51104-1
- Springer Nature Limited