Abstract
Quality of care is a multidimensional concept that should include the perspectives of all parties involved. There are few instruments with adequate psychometric properties for the assessment of the quality of psychiatric care in community mental health. Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) instrument has adequate psychometric properties to evaluate the quality of psychiatric care from the perspective of professionals. The aim of this study was to validate the Spanish version of the QPC-OPS instrument. The instrument was translated and back-translated, and then was administered to 260 professionals from distinct community mental health services. To assess test–retest reliability, it was re-administered after 7–14 days (n = 157). Confirmatory factor analysis revealed an 8-factor-structure identical to the original version, showing the good fit of the model. The internal consistency coefficient (Cronbach’s alpha) was 0.885. The intraclass correlation coefficient was 0.847 (95% IC 0.790–0.888), which was higher than 0.70 in all factors bar one. The NT394 General Satisfaction Scale was used for analysis of convergent validity showing a rho correlation of 0.31 (p < 0.0001). Results show that the Spanish version of the QPC-OPS instrument is valid and reliable for the assessment of the quality of psychiatric care in the community setting.
Similar content being viewed by others
Introduction
Since the year 1986, with General Health Law 14/1986 of the 25th April, the Spanish Ministry of Health has focused its efforts on promoting community care in mental health and today this remains one of the pillars of mental health strategies in the National Health System quality plan. This aims to avoid segregating those receiving care from the community and to provide care in a location close to their home1,2.
Quality of care can be defined in several ways. Donabedian maintains that the essence of care lies in the balance between benefit and harm3. Later authors, however, defined quality of care in terms of care efficiency and access to health resources for both users and their families4,5. The concept of quality of care, within current standards in the field of mental health, includes the therapeutic setting, the assessment, the therapeutic relationship and counseling, professional performance, practice evaluation, and environmental health as key criteria in quality6,7.
Quality of care is a multidimensional concept8 that is perceived by users as something positive9. However, unlike the concept of patient satisfaction, quality of care must include the perspectives of all parties involved10. However, job satisfaction is an element to take into account in the assessment of professionals, given the influence it can have not only on their perception of their health but also on the performance of their work11. Of the instruments used in the assessment of job satisfaction, the NTP 394 scale created by Warr et al.11 and subsequently validated in Spanish by Pérez and Fidalgo12, stands out as it is one of the most frequently used instruments in our setting for the evaluation of job satisfaction in various environments, including health care13.
Professionals have already been described as an essential element in ensuring high standards of quality of care in current approaches such as person-centered care14. The combination of the perspectives of professionals and users in the community setting is necessary and provides complementary information of great value15. Consequently, the perspective of mental health professionals should be taken into account and used as an additional indicator of care quality in mental health10,16. This would help to identify quality improvement strategies17 and to detect factors that can have a negative impact on the quality of care, such as burnout or work overload among care professionals18,19,20. Nevertheless, it has been observed that professionals from distinct disciplines involved in psychiatric care have differing points of view on what characterizes quality of care4,21,22.
Separately, there is a lack of comparative studies on the perceptions of quality of care among patients and professionals23, mainly due to the absence of standardized assessment instruments with adequate psychometric properties18. By way of illustration, a recent systematic review revealed that despite the considerable volume of existing instruments that evaluate the quality of psychiatric care or satisfaction with psychiatric care, their psychometric properties were not very robust and some validation processes involving these instruments were not completely satisfactory24.
One instrument that does possess adequate psychometric properties for the community mental health context is the Psychiatric Out-Patient Experiences Questionnaire (POPEQ). However, it only examines the user’s perspective25.
The only instrument found to have adequate psychometric properties applicable in the community mental health context, and which assesses the quality of psychiatric care from the perspective of both professionals and users, is the Quality in Psychiatric Care26 in its two versions: Quality in Psychiatric Care-Outpatient (QPC-OP) and Quality in Psychiatric Care-Outpatient Staff (QPC-OPS). The latter version has recently been validated in Norwegian27.
This instrument forms part of the family of instruments Quality in Psychiatric Care (QPC) that assess the quality of psychiatric care through its multiple versions in the hospital setting (Quality in Psychiatric Care-In-patients—QPC-IP)28, the community (Quality in Psychiatric Care-Outpatient—QPC-OP)26 and forensic (Quality in Psychiatric Care-Forensic In-patient QPC-FIP)29. The definition of care used to create the instrument was developed through a phenomenographic study9, it was evaluated for face validity in a pilot study and empirically tested in a sample of patients admitted to psychiatric hospital units in Sweden30.
This study is part of a wider international project to adapt the QPC-OPS instrument in a number of countries, test the psychometric properties and dimensional equivalence of the different versions according to language, and describe and compare the quality of psychiatric care in the community setting in these countries. In this context, the aim of the study was to adapt the QPC-OPS instrument into Spanish and analyze its reliability and validity.
Methods
Design
The study was conducted in two phases. In the first phase, the translation and adaptation of the QPC-OPS instrument into Spanish was carried out. In the second phase, the psychometric properties of the Spanish version of the QPC-OPS instrument were analyzed.
Participants and study setting (sample size)
The sample consisted of 260 professionals from different disciplines who work in community mental health services (nursing, psychiatry, social education, case management, social work, administration and occupational therapy), who were actively working in a community service at the time of the study (Outpatient Mental Health Center, Day Hospital, Labor Reintegration Service, Community Rehabilitation Service) and who participate voluntarily. Having less than one year’s experience in the area of mental health was established as an exclusion criterion. Non-probability convenience sampling was used.
Data collection was carried out between February, 2019 and February, 2020.
Calculation of the sample size was based on internal consistency, temporal stability and construct validity. Estimation of internal consistency was performed following the recommendations of Streiner et al., who considered that between 5 and 20 individuals should be included for each instrument item31. In this study, we agreed to include a minimum of five individuals for each item.
To analyze temporal stability, it was estimated that a minimum of 61 professionals would be needed to detect an intraclass correlation coefficient (ICC) around 0.70 between two administrations of the instrument, assuming a confidence level of 95% and a power of 80% in a bilateral comparison32.
For construct validity, it was established that the minimum number of subjects necessary would be 25033.
Variables and sources of information
As indicated, the QPC-OPS instrument assesses the quality of psychiatric care in the community setting from the perspective of the professionals working there.
It consists of a total of 30 items distributed across 8 factors as follows: encounter (6 items), participation-empowerment (3 items), participation-information (5 items), discharge (3 items), support (4 items), environment (3 items), next of kin (2 items), and accessibility (4 items). Each item begins with the words “I feel that…” and is scored on a Likert-type scale with four response options ranging from 1 (totally disagree) to 4 (totally agree) with a “not applicable” option for each if considered necessary. A global and per-factor score can be obtained; the maximum global score is 120 points and the minimum 30 points so that a high score on each factor or globally indicates a good perception of the quality of psychiatric care on the part of the professionals. Conversely, a low score justifies the need for an intervention designed to bring about improvements in the areas identified.
The General Satisfaction scale NTP 394 created by Warr et al.11 and validated in Spanish by Pérez and Fidalgo12 was used to analyze convergent validity. The Spanish version showed a Cronbach’s alpha (α) coefficient that ranged between 0.85 and 0.88 and an Intraclass Correlation Coefficient (ICC) of 0.63. This scale assesses intrinsic and extrinsic aspects of working conditions and consists of 15 items. Each item is evaluated through an ordinal scale that ranges from 1 (very dissatisfied) to 7 (very satisfied). The total score is obtained by summing the items, producing a final score between 15 and 105.
In addition, data were collected on other variables related to sociodemographic and labor characteristics of the sample: age, sex, nationality, professional category, service where currently working and number of years in the service.
Procedure
The translation and back-translation process was carried out following the Standards for Educational and Psychological Testing34.
First, the original version was translated into Spanish by two independent native-speaker translators who had no knowledge of the instrument or the aims of the study. A group of experts comprising nurses, psychiatrists and psychologists reviewed both translations and reached agreement on the first version of the instrument in Spanish. Subsequently, the Spanish version was back-translated into the original language to confirm that the Spanish translation corresponded to the original version in Swedish. In addition, the original authors of the QPC-OPS examined the back-translation and compared it with the original version, finding no discrepancies requiring modification. This version was then pilot tested in 30 professionals with the aim of assessing item comprehension and clarity, as well as the time needed to administer it. Following the debriefing, it was not considered necessary to make any changes to either format of content.
Statistical analysis
Construct validity
Construct validity was analyzed through confirmatory factor analysis (CFA) with estimated parameters using the method of least squares generalized with a polychoric correlation matrix. This method has the same properties as the maximum likelihood estimation, even though the criteria were less strict than the normal ones. It is mainly used to measure ordinal items35.
The following fit indices were calculated to determine the overall fit of the model: Bentler Bonnet Normed Fit Index (BBNFI), Bentler Bonnet Non-Normed Fit Index (BBNNFI), the Goodness-of-Fit Index (GFI), the Adjusted Goodness-of-Fit Index (AGFI), the Comparative Fit Index (CFI), the Root Mean Square Error of Approximation (RMSEA), the chi-squared goodness-of-fit test and the ratio between chi-squared and the degrees of freedom (χ2/df). The criteria for a good fit were an X2/df ratio < to 3 and BBNFI, BBNNFI, GFI, AGFI and CFI close to 0.9036,37,38, and a RMSEA value lower than 0.0839,40.
Convergent validity
Convergent validity was analyzed using the Spearman correlation coefficient with the NTP 394 General Satisfaction Scale.
As a complementary method, an analysis of the Spearman correlation was conducted between the QPC-OPS questionnaire factors to assess convergent validity based on the hypothesis that the correlation between each factor and the general instrument should be higher than the correlations between the factors41.
Reliability
The item analyses included calculation of item means, standard deviations and corrected item-total correlation.
Cronbach’s alpha was used to assess the internal consistency of the instrument globally and for each of the factors. Levels of reliability above 0.70 were considered adequate31.
Temporal stability or test–retest was evaluated after 7–14 days through the ICC in a sample of 157 professionals. The values of this coefficient range between 0 and 1. A value greater than or equal to 0.70 was considered an indicator of good agreement31. Composite reliability was also calculated.
The SPSS Statistics program version 26 was used for analyses, along with EQS program version 6.2 for the confirmatory factor analysis (CFA)42.
Ethics declarations
First, in order to be able to carry out the study, permission to translate and adapt the QPC-OPS instrument into Spanish was sought from the original authors.
This study was approved by the research ethics committee at Fundación Sant Joan de Déu, under code CEIC PIC-83-16. All research was performed in accordance with relevant guidelines and regulations. All participants and their guardians were informed about the aim of the study and gave verbal and written consent to voluntarily and anonymously take part.
Results
Participant characteristics
A total of 260 professionals participated, of whom 26.2% were men and 73.8% were women. Some 95.8% of participants had Spanish nationality and the remaining 4.2% were of different nationalities. The sample consisted of a variety of professional categories: nursing (29.61%), psychiatry (20.38%), psychology (16.53%), social education (8.84%), case management (7.7%), social work (7.30%), administration (5%) and occupational therapy (4.61%). The mean age was 40 ± 10.3 years, while the mean of years worked in community service was 8.68 ± 7.70 years.
Construct validity
Confirmatory factor analysis (CFA)
Confirmatory factor analysis was used to verify the internal structure of the instrument, in which an 8-factor model identical to the structure of the original instrument was proposed. Table 1 shows the fit of the model. All indices showed a reasonable fit.
All item saturations were equal to or greater than 0.50 with the exception of items 2 (0.40), 9 (0.44), 10 (0.46) and 17 (0.42). Correlations between factors in the Spanish version of the QPC-OPS are shown in Fig. 1.
Convergent validity
Convergent validity was analyzed using the Spearman correlation coefficient with the NTP 394 General Satisfaction Scale. The correlation obtained was rho = 0.31 (p < 0.0001).
The hypothesis was confirmed in the analysis of the correlations between the factors and the general instrument, with the strongest correlations found between the majority of factors and the general instrument. Factors 1 (Encounter) and 3 (Participation-Information) showed the strongest correlations with the total instrument (rho = 0.764 y rho = 0.755, respectively), while Factor 6 (Environment) had the weakest correlation (rho = 0.348). Table 2 shows the correlations of all the factors with the total instrument score.
Reliability
Cronbach’s alpha internal consistency coefficient for the whole instrument was 0.885, reaching values above 0.70 in five of the eight factors (Table 3). For the factors F4.Discharge, F6.Environment and F7.Next of Kin, Cronbach’s alpha values of 0.462, 0.537 and 0.440 were obtained, respectively. Internal consistency was not notably improved by excluding any of the items.
The mean item value ranged from 2.58 to 3.82 and the standard deviation ranged from 0.44 to 0.92. Only three items showed an item–total correlation under 0.20 (item 2: “Security in the center is high”, item 4: “Patients can feel safe along with other patients in the waiting room” and item 9: “Patients are not bothered by other patients in the waiting room”) (Table 4).
Appendix 1 shows inter-correlations between individual items for each QPC-OPS sub-scale. In factor 6 (Environment) the correlation between items 2 and 9 was 0.130.
The ICC analysis demonstrated that test–retest reliability was 0.847 (95% CI 0.790–0.888; n = 157), and this value was higher than 0.70 in all instrument factors, except D5 with a value of 0.681 (Table 3). Composite reliability was 0.957 for the whole instrument, reaching values higher than 0.70 in five of the eight factors. For the factors F4.Discharge, F6.Environment and F7.Next of Kin, composite reliability values of 0.473, 0.621 and 0.488 were obtained, respectively (Table 3).
Discussion
The aim of this study was to adapt the Quality in Psychiatric Care Outpatient Staff (QPC-OPS) instrument to Spanish and analyze its reliability and validity. This instrument allows assessment of the quality of community psychiatric care from the professionals’ perspective so that strong points and areas for improvements in care can be detected. On the other hand, it is a useful instrument for the evaluation of interventions focused on improving the quality of psychiatric care.
The adaptation process of the QPC-OPS involved a translation and back-translation to obtain the Spanish version. Other studies in the QPC family27,43,44,45,46,47,48 produced versions in other languages using a similar process. Results in this phase were satisfactory and there were no difficulties found with respect to the comprehension and administration of the instrument.
Results show that, at the psychometric level, the values for construct validity (Confirmatory factor analysis), internal consistency and temporal stability (test–retest) were adequate.
The confirmatory analysis performed that the Spanish version, like the Norwegian version27, has the same 8 factors on quality of care as the original Swedish QPC-OP26 version and no modification of any item was required.
For the analysis of reliability, internal consistency was analyzed using Cronbach’s alpha. A Cronbach’s alpha of 0.885 was obtained for the whole instrument and the factors in general showed values greater than 0.70, which is considered an adequate value according to Nunnally and Berstein49. The global Cronbach’s alpha is somewhat lower than the original version of the instrument26 and other versions of the QPC family28,29,43,44,48, although higher than the Norwegian community version27 and the hospital version for Indonesian users47 with a value identical to the hospital version for Indonesian professionals46. Cronbach’s alpha values lower than 0.70 were found for the factors F4.Discharge (0.462), F6.Environment (0.537) and F7.Next of kin (0.440), which are considered less adequate values. These low values are, in all likelihood, due to the reduced number of items that make up these factors (F4. Discharge: 3 items, F6.Environment: 3 items and F7.Next of kin: 2 items). Some of the inter-correlations between the individual items were low. Future research should assess the possibility of identifying other items that may better represent these factors to improve the psychometric properties.
In the original Swedish QPC-OP version26, the factors F4.Discharge and F7.Next of kin obtained values below 0.70, and the F6.Environment factor showed a value very close to 0.70.
Temporal or test–retest stability was also analysed in the study. This value was not calculated in the original Swedish QPC-OP version26, the other original versions of the QPC family28,29 or in the translated versions44,46,47, with the exception of the Spanish hospital versions of the QPC-IPS and QPC-IP43,48. The ICC for the whole instrument and for each of the factors was above 0.70 except in the case of F5.Support (0.681), which in general is considered good agreement31,32. For the Spanish QPC-IPS and QPC-IP, the ICC for the whole instrument was 0.91 and the factors had values above 0.70 except for the factor F6.Discharge43,48.
Convergent validity of the Spanish QPC-OPS in our study was calculated through the Spearman rho correlation coefficient with the NTP 394 General Satisfaction Scale. The correlation obtained was positive50, showing that the greater the job satisfaction, the higher the perception of the quality of psychiatric care provided. Of the studies related to the family of QPC instruments, this is the third study in which convergent validity is calculated, the first being the Spanish hospital version of the QPC-IPS43 and the second the Spanish hospital version of the QPC-IP48. The Spanish QPC-IPS calculated convergent validity using the same NTP 394 scale, obtaining a higher value (rho = 0.58); considered a moderate positive correlation. The Spanish QPC-IP calculated convergent validity using a 10-point numerical satisfaction scale, obtaining also a higher value (rho: 0.49); considered a moderate positive correlation.
At the same time, the correlation was analyzed between the total instrument score and each of its factors, showing that the correlation was higher between each factor and the general instrument than the correlations between the factors. This confirms the Fayer and Machin hypothesis41.
The limitations of this study arise from the lack of uniformity in the professional categories as each one has differing numbers of professionals and the concept of “community mental health professionals” is very wide, encompassing many health workers. However, this reflects the reality of the composition of Spanish community care teams. A further limitation is that this instrument was adapted in the community context so it should only be used in this population profile or a similar one. Another limitation that should be highlighted is that the NTP scale presented a low correlation with the total QPC-OPS score. This may be due to the fact that it is not the most appropriate gold standard for the assessment of the quality of care. Nevertheless, it is a widely-used instrument in our setting. Future research should take into account that there is a need for a more suitable instrument to function as the gold standard.
Finally, it should be emphasized that it was not possible to assess sensitivity to change or predictive validity given the cross-sectional design of the study. These limitations should be taken into account in the design of future studies.
Conclusions
The Spanish version of the QPC-OPS instrument is a simple, useful tool for the measurement of various aspects of the quality of community psychiatric care from the perspective of mental health professionals. Its 8-factor structure and psychometric properties are consistent and in agreement with the original version, allowing the instrument to be used to measure the quality of community psychiatric care from the perspective of professionals in the Spanish-speaking population. The results of these measurements can be used to increase the capacity to assess the quality of services provided.
Data availability
The data that support the findings of this study are available upon reasonable request from the corresponding author. The data are not publicly available due to privacy and ethical restrictions. The data was taken from our own study.
References
Agencia Estatal Boletin Oficial del Estado. Ley General de Sanidad 14/1986, 25 de abril. 15207–15224 (1986).: https://www.boe.es/eli/es/l/1986/04/25/14/con. (Accessed 23rd February 2021).
Ministerio de Sanidad de España. Plan de Calidad para el Sistema Nacional de Salud. (2020). https://www.mscbs.gob.es/organizacion/sns/planCalidadSNS/. (Accessed 23rd February 2020).
Donabedian, A. The quality of medical care: A concept in search of definition. J. Fam. Pract. 9, 277–284 (1979).
Campbell, S. M., Roland, M. O. & Buetow, S. A. Defining quality of care. Soc. Sci. Med. 51, 1611–1625 (2000).
Zastowny, T. R., Stratmann, W. C., Adams, E. H. & Fox, M. L. Patient satisfaction and experience with health services and quality of care. Qual. Manag. Health Care 3, 50–61 (1995).
Kane, C. The 2014 scope and standards of practice for psychiatric mental health nursing: Key updates. Online J. Issues Nurs.. 20, 1 (2015).
Sánchez Balcells, S., Puig Llobet, M., Lluch Canut, M. T. & Roldán Merino, J. F. Evolución del concepto de calidad de los cuidados en salud mental. Rev. Rol. Enferm. 43, 46–50 (2020).
Information Resources Management Association. Healthcare Ethics and Training: Concepts, Methodologies, Tools, and Applications (IGI Global, 2017).
Schröder, A., Ahlström, G. & Larsson, B. W. Patients’ perceptions of the concept of the quality of care in the psychiatric setting: A phenomenographic study. J. Clin. Nurs. 15, 93–102 (2006).
Farr, M. & Cressey, P. Understanding staff perspectives of quality in practice in healthcare. BMC Health Serv. Res. 15, 123 (2015).
Warr, P., Cook, J. & Wall, T. Scales for the measurement of some work attitudes and aspects of psychological well-being. J. Occup. Psychol. 52, 129–148 (1979).
Perez, J. & Fidalgo, M. NTP 394: Satisfacción laboral: escala general de satisfacción. (1994). https://saludlaboralydiscapacidad.org/wp-content/uploads/2019/05/NTP-394-Satisfacción-laboral-escala-general-de-satisfacción.pdf. (Accessed 15th March 2020).
Carrillo-García, C., Martínez-Roche, M. E., Gómez-García, C. I. & Meseguer-DePedro, M. Satisfacción laboral de los profesionales sanitarios de un Hospital Universitario: Análisis general y categorías laborales. An. Psicol. 31, 645–650 (2015).
Mead, N. & Bower, P. Patient-centredness: A conceptual framework and review of the empirical literature. Soc. Sci. Med. 51, 1087–1110 (2000).
Urben, S. et al. Patients’ satisfaction with community treatment: A pilot cross-sectional survey adopting multiple perspectives. J. Psychiatr. Ment. Health Nurs. 22, 680–687 (2015).
Arnetz, B. B. Staff perception of the impact of health care transformation on quality of care. Int. J. Qual. Heal. Care J. Int. Soc. Qual. Heal. Care 11, 345–351 (1999).
Nashrath, M., Akkadechanunt, T. & Chontawan, R. Perceived nursing service quality in a tertiary care hospital, Maldives. Nurs. Health Sci. 13, 495–501 (2011).
Salyers, M. P. et al. Burnout and self-reported quality of care in community mental health. Adm. Policy Ment. Health 42, 61–69 (2015).
Van Bogaert, P., Meulemans, H., Clarke, S., Vermeyen, K. & Van de Heyning, P. Hospital nurse practice environment, burnout, job outcomes and quality of care: Test of a structural equation model. J. Adv. Nurs. 65, 2175–2185 (2009).
Luther, L. et al. Working overtime in community mental health: Associations with clinician burnout and perceived quality of care. Psychiatr. Rehabil. J. 40, 252–259 (2017).
Bee, P., Brooks, H., Fraser, C. & Lovell, K. Professional perspectives on service user and carer involvement in mental health care planning: A qualitative study. Int. J. Nurs. Stud. 52, 1834–1845 (2015).
DeMarco, R. et al. Staff & client perceptions of unit quality: A pilot study. J. Psychosoc. Nurs. Ment. Health Serv. 42, 36–43 (2004).
Henderson, C., Hales, H. & Ruggeri, M. Cross-cultural differences in the conceptualisation of patients’ satisfaction with psychiatric services-content validity of the English version of the Verona Service Satisfaction Scale. Soc. Psychiatry Psychiatr. Epidemiol. 38, 142–148 (2003).
Sanchez-Balcells, S. et al. Psychometric properties of instruments measuring quality and satisfaction in mental health: A systematic review. J. Adv. Nurs. 74, 2497–2510 (2018).
Garratt, A. et al. The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): Data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord. J. Psychiatry 60, 89–96 (2006).
Schröder, A., Ahlström, G., Wilde-Larsson, B. & Lundqvist, L.-O. Psychometric properties of the quality in psychiatric care-outpatient (QPC-OP) instrument. Int. J. Ment. Health Nurs. 20, 445–453 (2011).
Moen, Ø. L., Skundberg-Kletthagen, H., Lundquist, L.-O., Gonzalez, M. T. & Schröder, A. The relationships between health professionals’ perceived quality of care, family involvement and sense of coherence in community mental health services. Issues Ment. Health Nurs. https://doi.org/10.1080/01612840.2020.1820119 (2020).
Schröder, A., Larsson, B. W., Ahlström, G. & Lundqvist, L.-O. Psychometric properties of the instrument quality in psychiatric care and descriptions of quality of care among in-patients. Int. J. Health Care Qual. Assur. 23, 554–570 (2010).
Schröder, A., Agrim, J. & Lundqvist, L.-O. The quality in psychiatric care-forensic in-patient instrument: Psychometric properties and patient views of the quality of forensic psychiatric services in Sweden. J. Forensic Nurs. 9, 225–234 (2013).
Schröder, A., Larsson, B. W. & Ahlström, G. Quality in psychiatric care: An instrument evaluating patients’ expectations and experiences. Int. J. Health Care Qual. Assur. 20, 141–160 (2007).
Streiner, D. L., Norman, G. R. & Cairney, J. Health Measurement Scales: A Practical Guide to their Development and Use (Oxford University Press, 2015).
Zou, G. Y. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Stat. Med. 31, 3972–3981 (2012).
Kline, P. An Easy Guide to Factor Analysis (Routledge, 1994).
American Educational Research Association. Standards for Educational and Psychological Testing (American Educational Research Association, 2014).
Rial, A., Varela, J., Abalo, I. & Levy, J. P. El análisis factorial confirmatorio. In Modelización con Estructuras de Covarianzas en Ciencias Sociales: Temas Esenciales, Avanzados y Aportaciones Especiales (ed. Varela Mallou, J.) 119–154 (Netbiblo, 2006).
Browne, M. W. & Cudeck, R. Alternative Ways of Assessing Model Fit (Sage, 1993).
Kline, R. B. Principles and Practice of Structural Equation Modeling. Structural Equation Modeling 3rd edn, Vol. 156, p 427 (Guildford Press, 2011).
Brown, T. Confirmatory Factor Analysis for Applied Research (The Guildford Press, 2015).
Byrne, B. Structural Equation Modeling With EQS (Routledge, 2013).
Byrne, B. Structural Equation Modeling With AMOS (Routledge, 2016).
Fayers, P. M. & Machin, D. Quality of Life: Assessment, Analysis and Interpretation (Wiley, 2000).
EQS 6.2 for Windows. (2006).
Sanchez-Balcells, S. et al. A Spanish adaptation of the Quality in Psychiatric Care-Inpatient Staff (QPC-IPS) instrument: Psychometric properties and factor structure. An. Sist. Sanit. Navar. 43, 307–321 (2020).
Lundqvist, L.-O., Lorentzen, K., Riiskjaer, E. & Schröder, A. A Danish adaptation of the quality in psychiatric care-forensic in-patient questionnaire: Psychometric properties and factor structure. J. Forensic Nurs. 10, 168–174 (2014).
Lin, E.C.-L. et al. Factors influencing patient-perceived quality of care in psychiatric hospitals in Taiwan. Arch. Psychiatr. Nurs. 35, 9–16 (2021).
Lundqvist, L.-O., Suryani Hermiati, D., Sutini, T. & Schröder, A. A psychometric evaluation of the Indonesian version of the Quality in Psychiatric Care-Inpatient Staff (QPC-IPS) instrument. Asian J. Psychiatr. 46, 29–33 (2019).
Lundqvist, L.-O., Suryani Anna, N., Rafiyah, I. & Schröder, A. Indonesian adaptation of the Quality in Psychiatric Care-Inpatient (QPC-IP) instrument: Psychometric properties and factor structure. Asian J. Psychiatr. 34, 1–5 (2018).
Sanchez-Balcells, S. et al. A Spanish adaptation of the Quality in Psychiatric Care-Inpatient (QPC-IP) instrument: Psychometric properties and factor structure. BMC Nurs. 20, 191 (2021).
Nunnally, J. & Bernstein, I. The theory of measurement error. Psychometric Theory (McGraw-Hill, 1994).
Martinez Gonzalez, M., Sanchez Villegas, A., Toledo Atucha, E. & Faulin Fajardo, J. Bioestadística amigable (Elsevier, 2014).
Funding
The present study was funded by a grant from the Hospital Universitario Marqués de Valdecilla, the Asociación Nacional de Enfermería de Salud Mental and Fundació Privada per a la Recerca i la Docència Sant Joan de Déu FSJD. The study was also funded in part by the Nurse and Society Foundation as part of the Nurse Research Projects Grants (PR-011/16).
Author information
Authors and Affiliations
Contributions
L.L. and A.S. conceived and designed the research. M.T., A.R.M., M.D.C. and S.S. research the literature and acquired the data. M.T., J.R., M.T.L. and M.P. analysed and interpreted the data. J.R. performed statistical analyses. M.T. and J.R. drafted the manuscript. All authors reviewed and edited the manuscript and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tomás-Jiménez, M., Roldán-Merino, J., Sanchez-Balcells, S. et al. Adaptation, psychometric properties and factor structure of the Spanish Quality in Psychiatric Care-Outpatient Staff (QPC-OPS) instrument. Sci Rep 12, 4018 (2022). https://doi.org/10.1038/s41598-022-08039-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-08039-w
- Springer Nature Limited
This article is cited by
-
Spanish adaptation of the quality in psychiatric care-outpatient (QPC-OP) instrument community mental health patients’ version: psychometric properties and factor structure
BMC Nursing (2022)
-
Cross-cultural adaptation and psychometric properties of the Spanish Quality in Psychiatric Care Forensic Inpatient Staff (QPC-FIPS) instrument
Scientific Reports (2022)