Abstract
To examine the agreement between patient and psychiatrist ratings of subjective well-being in people with schizophrenia using three well-being measurements: Satisfaction with Life, Subjective Happiness, and Subjective Well-being under Neuroleptic Treatment (SWN), including the SWN-subscale, and to investigate whether the psychiatrist’s judgement or the psychiatrist-rated SWN is better at defining patient well-being. Patients with schizophrenia (n = 150) completed the three well-being measurements, then met psychiatrists, and their well-being was judged as either ‘poor’ or ‘adequate’ via the usual clinical assessment before being assessed again by the psychiatrist using the same measurements. Intra-class correlation was used to analyze the absolute agreement between ‘patient-rated’ and ‘psychiatrist-rated’ scores. Agreements on ‘adequate’ well-being status between patient-rated SWN (≥ 80; gold standard), psychiatrist-rated SWN, and psychiatrist’s judgement were calculated using Kappa coefficients. We also calculated the sensitivity and specificity of the psychiatrist’s judgement and the psychiatrist-rated SWN to define adequate well-being. SWN showed the strongest absolute agreement between patient-psychiatrist ratings (ICC = 0.7, p = 0.005), with physical functioning yielding the highest and self-control the lowest coefficients. The psychiatrist-rated SWN showed a better Kappa coefficient (0.4, p < 0.001) than the psychiatrist’s judgement. Clinical judgement showed a 67% sensitivity and a 64% specificity, whereas the psychiatrist-rated SWN (score 93, AUC 81.4%) showed a 74% sensitivity and a 74% specificity for well-being prediction. The use of SWN by psychiatrists yielded a better alignment of well-being than the psychiatrist’s judgement alone. The SWN subscale could help fill the gap between clinician and patient views on well-being. Psychiatrists should upskill in assessing patient wellbeing for appropriate treatment provision.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Research investigating the level of well-being in people with schizophrenia has gained more attention since the awareness of self-rating in schizophrenia became available. The majority of patients with schizophrenia, if not acutely psychotic or suffering from severe cognitive impairment, are able to complete self-rating scales in a consistent and reliable manner (Lindstrom et al., 2009; Naber, 1995). Their subjective evaluations have been explored, and it has been found that their well-being was of a lower level than that of healthy controls (Fervaha et al., 2016). Moreover, having low well-being scores is significantly associated with clinical symptoms such as depression, negative symptoms, and low daily functioning ability (Agid et al., 2012).
The concept of well-being constitutes a core dimension of a person’s life and is based largely upon private internal psychological processes, mainly the values and subsequent goals of an individual (Diener et al., 1985, 1999; Kahneman & Tversky, 1984; Kim-Prieto et al., 2005). Recent evidence suggests that happy people generally engage in valued activities and goal-directed behaviors (Myers & Diener, 2018). Thus, recognizing the role of subjective views in promoting the sense of well-being is also important, and it would provide clinical usefulness in the management of people with schizophrenia by incorporating the patient’s subjectivity on this matter into the holistic approach.
However, previous research has revealed discrepancies between patient-rated and clinician-assessed well-being and quality of life (QoL) (Aunjitsakul et al., 2019; Eack & Newhill, 2007; Tolman & Kurtz, 2012; Wehmeier et al., 2007). Content structures and the psychometric properties of the measurement tools could explain this discordance. It has been suggested that the achievement of a better agreement around subjective well-being between the patient and clinician assessment should be explored in detail at the subscale or sub-item level (Aunjitsakul et al., 2019).
Attitudinal and practice issues such as the different valuations of the importance of some aspects between clinicians and patients could also impact upon these discrepancies. For example, clinicians may focus more on symptom management, while patients may value social connection more. When clinician practice does not involve queries about subjective experience or when patients under-report their subjective concerns, well-being may not be measured accurately (Aunjitsakul & Pitanupong, 2018; Aunjitsakul et al., 2019; Vothknecht et al., 2013). Therefore, the above issues should be examined to provide a stronger rationale for why the consistency of the two ratings needs to be compared as well as why the standardized tools and the clinician’s judgement be compared.
The present study aimed to explore the agreement between the patient and psychiatrist ratings of subjective well-being in people with schizophrenia using three well-being measurements: the Satisfaction with Life Scale (SWLS), the Subjective Happiness Scale (SHS), and the Subjective Well-being under Neuroleptic treatment Scale (SWN). Given that SWN has previously shown the highest correlation among these three instruments (Aunjitsakul et al., 2019) and that it has been designed for the self-rating of well-being under neuroleptic treatment, we explored further into its five subscales: mental functioning, self-control, emotional regulation, physical functioning, and social integration (Naber, 1995). These subscales would help to elucidate the major pitfalls common to clinicians in clinical settings. Moreover, we also investigated the performance of the psychiatrists’ clinical judgement on well-being in comparison to the psychiatrist-rated well-being measurement (i.e., SWN) in determining patient well-being. Finally, we assessed the extent to which the cut-off value of the psychiatrist-rated well-being measurement SWN score can predict the patient’s well-being accurately.
We hypothesized, firstly, that the use of well-being measurement tools by patients and psychiatrists would result in a high level of agreement, with SWN showing the highest agreement compared to SWLS and SHS. Secondly, we thought that the psychiatrist-rated SWN would provide a better agreement with the patient’s well-being (self-evaluation) than the psychiatrist’s clinical judgement. This aimed to evaluate whether the use of well-being measurement could be helpful to clinicians in obtaining a better alignment of their assessment with what patients want or how they feel.
Methods
Design and Setting
A cross-sectional study was conducted at the outpatient clinic, Department of Psychiatry, Songklanagarind Hospital, Prince of Songkla University, Southern Thailand between July 2017 and June 2018. This study was approved by the Ethics Committee of the Faculty of Medicine, Prince of Songkla University, which adheres to the provisions of the Declaration of Helsinki (REC: 60-197-03-1). All of the participants gave their informed consent before being interviewed.
Participants
People with schizophrenia, 18 years of age or older, and without active psychotic symptoms were included in this study. We excluded those with a history of hospitalization within 6 months prior to the study period, who could not communicate in Thai fluently, suffered from a serious or unstable physical illness, or were substance-dependent.
Measurement Tools
We employed three well-being measurements (SWLS, SHS and SWN) and one clinical opinion to assess well-being. The Thai version of SWLS is a self-reported questionnaire tapping into global evaluations of participants’ satisfaction with life, which uses a Likert scale with scores ranging from 1 to 7. The measurement consists of five items emphasizing a conscious evaluation of one’s satisfaction with life as a whole through cognitive components of subjective well-being. This scale has demonstrated good internal reliability (Cronbach alpha 0.79–0.89, mean 0.85) and temporal stability (coefficient of five items ranging 0.5–0.84, mean 0.70) (Pavot et al., 1991). SHS is also a self-reported questionnaire using a Likert scale consisting of four items regarding the global subjective evaluations of one’s happiness. Similarly, it has shown an excellent internal consistency (Cronbach alpha 0.52–0.72, mean 0.62) and a test–retest reliability (coefficient of four items ranging 0.55–0.90, mean 0.72) (Lyubomirsky & Lepper, 1999). The total scores of the SWLS and SHS are the sums of their items ranging from 5 to 35 and 4 to 28, respectively—the higher scores denote a greater satisfaction with life and happiness (Diener et al., 1985; Lyubomirsky & Lepper, 1999).
SWN is a 20-item clinical measurement, which has been developed to address well-being under neuroleptic treatment in patients with psychosis (de Haan et al., 2002). It includes five 4-item subscales: mental functioning (MF), self-control (SC), emotional regulation (ER), physical functioning (PF), and social integration (SI) (Naber, 1995); see details in Supplementary Table 1. Its responses range from 1 to 6 for each question item. Thus, each subscale score is the sum of its items, and ranges from 4 to 24. The total SWN score is the sum of all five subscales and ranges from 20 to 120 indicating poor to excellent well-being (Naber et al., 2001). The internal consistency of the SWN is good—the Cronbach alpha was found to be 0.95 for the total score and 0.73–0.88 for the five subfactors (Naber, 1995; Vothknecht et al., 2013). This scale has been proposed for defining patient well-being, i.e., either ‘adequate’ or ‘poor’ subjective well-being, using a standard cut-point score of ≥ 80 (Vothknecht et al., 2011).
Both SHS and SWN have been forward-translated into Thai by psychiatrists and then translated again into English via back-translation by an independent, professional translator. Any discrepancies were resolved by consensus with the author team. All of the translated instruments were pre-tested to assess their practical usage and understanding in terms of question wording, response choices, and question sequence.
Data Collection
Before collecting data, three psychiatrists were involved in a process to standardize the three well-being measurement questionnaires (SWLS, SHS, and SWN) and their clinical judgement on well-being. Regarding the psychiatrist’s judgement on well-being based on the patient’s clinical status, the psychiatrist would follow the usual routine practice employing a binary scale as either poor or adequate. A perfect agreement on clinical judgement of well-being (Kappa coefficient of 1, p < 0.001) was found among the three psychiatrists. The assessments of the SWLS, SHS, and SWN among the psychiatrists were also standardized; the intra-class correlation (ICC) coefficients were 0.953 (p < 0.001), 0.981 (p < 0.001) and 0.985 (p < 0.001), respectively.
During data collection, patients were invited to participate in the study at an outpatient clinic on the day of their appointments by a nurse at the clinic using the convenience sampling method; the nurse was not a part of the researcher team. The patients would freely decide whether or not they wished to take part. After signing a consent form, the patients’ demo-socio-economic-health information concerning gender, age, marital status, level of education, income, employment, caregiver dependence, ability to visit the clinic on their own, duration of illness, history of hospitalization, and antipsychotic drug use was obtained. The patients were then asked to complete the three well-being measurement questionnaires, named the patient-rated measurement (e.g., SWN); they were either assisted by a research assistant or self-administered. The psychiatrists were blinded to the patient-rated assessment. When the patients met the psychiatrists (each patient was assessed by a single psychiatrist), their well-being was judged as either ‘poor’ or ‘adequate’ following the usual clinical assessments, named the psychiatrist’s judgement on well-being. After that, they were also assessed by the same psychiatrist once more using the same well-being measurement questionnaires the patients had filled earlier, named the psychiatrist-rated measurement.
Statistical Analysis
The data entry was performed using EpiData version 3.1. The R software version 3.4.1 (R Development Core Team, 2012) was used for data analyses. Categorical variables were presented as both frequencies and percentages, whilst continuous variables were presented as means with standard deviations or median with inter-quartiles. The unpaired t-test and the rank-sum test were used to compare continuous data, including the wellbeing scale ratings. The Chi-square test and Fisher’s exact test were performed to compare categorical data. The absolute agreement of each well-being measurement (SWLS, SHS or SWN) and within the SWN subscales between patients and psychiatrists were analyzed using ICC coefficients (with the ‘two way’ model, ‘agreement’ type, and ‘average’ unit) (Hallgren, 2012).
To investigate which psychiatrist’s assessment provided a better performance regarding patient well-being, we calculated the Kappa coefficient of the (1) psychiatrist’s judgement on well-being and (2) the psychiatrist-rated SWN using the patient self-rated SWN as the gold standard (SWN total scores ≥ 80). The reason for this was the fact that the self-rated SWN has been developed specifically for the purpose of patients scoring their own subjective well-being. The implication would be useful to determine the best way—clinical judgement or SWN—clinicians could utilize in order to assess patient well-being as closely as possible to the self-rated one. The sensitivity and specificity values of the psychiatrist’s judgement versus the psychiatrist-rated SWN were also analyzed. Additionally, the inter-rater reliability was evaluated with an ICC of at least 0.70 considered an acceptable value (Polit, 2014), a Kappa coefficient of 0.21–0.39 representing the minimal value to indicate agreement, and a Kappa coefficient of 0.40–0.59 denoting a weak agreement (McHugh, 2012). A p-value of less than 0.05 was considered to indicate statistical significance.
To assess validity, subjective well-being scores (SWN scores rated by patients and psychiatrists) and the psychiatrist’s judgement on well-being were analyzed in relation to the objective measures of well-being (objective functioning), which are level of education, income, employment status, caregiver dependence, and ability to visit the clinic by oneself. The other demographic and health variables—gender, age, duration of illness, and history of hospitalization—were also analyzed, since work and living independence status have some potential in determining objective quality of life (Lehman, 1988), and the patients’ impression of well-being could be affected by their mood states or physical conditions (Strassnig et al., 2018). Therefore, further analysis using collected objective data is a worthwhile endeavor to help validate the assessment of subjective well-being. The linear regression model was used to evaluate associations between subjective well-being scores and objective functioning indicators, including other demographic and health variables. Meanwhile, the logistic regression model was employed to evaluate associations between the psychiatrist’s judgement on well-being and objective functioning indicators, including other demographic and health variables.
Results
Patient Characteristics
150 patients (50.7% male) with schizophrenia were included; their mean age (SD) was 42.7 (12.1) years, and it ranged from 18 to 70 years. More than half of the patients were single. The employed patients made up the greatest proportion, approximately three-fifths, compared to those who were unemployed. The majority of patients were able to visit the clinic by themselves (n = 86, 57.3%) and lived without a caregiver (n = 104, 69.3%). The median illness duration was 11 (IQR 5, 13) years (Table 1).
The patient characteristics between adequate and poor well-being were compared using a patient self-rated SWN score of ≥ 80 as an indication of an adequate status. It was found that being unemployed was significantly associated with a poor well-being status (X2(1, 150) = 4.73, p = 0.03) (Table 1).
The Scores of the Three Well-Being Measurements
The mean scores of the three well-being measurements (SWLS, SHS and SWN) between the patient and psychiatrist assessments are presented in Table 2. The means of patient self-rated SWLS and SWN scores were significantly lower than the psychiatrist-rated ones. Regarding the SWN subscales, all of the patient-rated scores were also significantly lower than the psychiatrist-rated scores. The self-control domain showed the widest difference gap in terms of the mean between the two raters, whereas physical functioning showed the smallest gap (Table 2). The detailed information related to SWN items between patient and psychiatrist assessments is presented in Supplementary Table1.
The ICCs of the Three Well-Being Measurements and the SWN Subscales
The absolute agreements analyzed using ICC coefficients were statistically significant in all measurements (Table 2). The SWN demonstrated an acceptable absolute agreement (ICC = 0.7, p = 0.005); it was the highest ICC value compared to that of SWLS (ICC = 0.6, p < 0.001) and SHS (ICC = 0.6, p < 0.001). With reference to the SWN subscales, PF presented the greatest absolute agreement (ICC = 0.8, p < 0.001), followed by MF (ICC = 0.7, p < 0.001), ER (ICC = 0.6, p < 0.001), SI (ICC = 0.6, p = 0.001), and SC (ICC = 0.4, p = 0.05).
Agreement on Classifying Patients into the Same Categories of Either Adequate or Poor Well-Being Between the Patient-Rated SWN and the Psychiatrist-Rated SWN, and the Psychiatrists’ Judgement on Well-Being
Of the 150 patients with schizophrenia, 89 (59.3%) had ‘adequate well-being’ (defined by a patient-rated SWN score of ≥ 80 as the gold standard). On the other hand, patients with adequate well-being accounted for 118 (78.7%) of the total, when a psychiatrist-rated SWN score of ≥ 80 was applied, and for 84 (56.0%) according to the psychiatrist’s judgement. The agreement between patient-rated SWN and psychiatrist-rated SWN on classifying patients into either adequate or poor well-being showed a Kappa coefficient of 0.4 (p < 0.001), which was higher than the one for the agreement between patient-rated SWN and the psychiatrist’s judgement (Kappa = 0.3, p < 0.001) (Table 3).
Sensitivity and Specificity of Psychiatrist’s Judgement on Well-Bring Versus Psychiatrist-Rated SWN, Taking the Patient-Rated SWN as the Gold Standard
The psychiatrist’s judgement on patient well-being (either ‘poor’ or ‘adequate’ status) showed low sensitivity (70%) and low specificity (64%) for well-being prediction (Table 4). On the other hand, the psychiatrist-rated SWN demonstrated a good ability to predict well-being. In the ROC curve analysis, the psychiatrist-rated SWN showed an area of 81.4% under the curve (95% CI 74.3–88.6, Fig. 1). A score of 93 showed the maximum sensitivity (74%) and specificity (74%), while a score of 73 showed the highest sensitivity (100%). We also calculated the sensitivity and specificity of the standard cut-point (score 80) of the psychiatrist-rated SWN, accounted for 97% and 43%, respectively.
Validity Assessment
Validity was assessed through regression analysis with key variables (Table 5). Among the objective functioning indicators, being employed was associated significantly with higher patient- and psychiatrist-rated SWN scores; it was also associated with an adequate well-being status determined by the psychiatrist’s judgement. Meanwhile, level of income was related to the psychiatrist’s judgement on well-being but not to the patient- or psychiatrist-rated SWN. In addition, neither one’s ability to visit the clinic on one’s own nor caregiver dependence were related to any of the well-being assessments. Lastly, gender, age, education, duration of illness, and history of hospitalization were also unrelated to any of the well-being assessments.
Discussion
This study aimed to determine the strongest agreement between patient and psychiatrist assessments of well-being using three well-being instruments; SWN showed the highest ICC value compared to SWLS and SHS. The second major finding was that discrepancies in the SWN subscales were detected; SC showed the lowest agreement, whereas PF exhibited the highest level. Notably, the psychiatrist ratings of the SWN subscales typically gave higher scores than did those of the patients themselves. Thus, the chief contribution of this study is the confirmation that there remains a gap in the perception of subjective well-being between the patients’ and the clinicians’ point of view. Regarding the Kappa analysis, the psychiatrist-rated SWN showed better agreement than the psychiatrist’s judgement; nevertheless, the Kappa values were considered to indicate weak agreement. We also assessed the usefulness of utilizing the psychiatrist-rated SWN in clinical practice; to that end, the ROC curve was analyzed, and cut-point values to assess patient well-being categorically were suggested.
In respect to the first research question—“Which of the well-being measurements would provide the best alignment between patient and psychiatrist ratings?”—as predicted, the SWN measurement showed the greatest absolute agreement (ICC 0.7, p = 0.005), which could be considered as an acceptable level of agreement. Our results showed a similar trend of well-being to those reported in an earlier study (Aunjitsakul et al., 2019). SWLS and SHS also showed a significant but unacceptable absolute agreement level.
Considering the ICC results, it could be said that the evaluation of patient well-being differs between assessors. The patients and psychiatrists showed fewer discrepancies on SWN than on the other measurement tools, which could be explained by the fact that this instrument is developed specifically for assessing the subjective well-being of people with schizophrenia under treatment with neuroleptic drugs (Naber et al., 2001), while the other two are designed to evaluate different psychometric constructs. It would be very helpful to us, clinicians or psychiatrists, to know that such a gap exists in the clinical management of patients in real-life practice.
Notably, our findings may help to fill the gap that make psychiatrists prone to be pitfall. Regarding this issue, the absolute agreement of the SWN subscales showed a diversity in ICCs (0.4 to 0.8); from the lowest to the highest, they were SC, SI, ER, MF, and PF. This finding is in accord with earlier observations, suggesting that people with schizophrenia are subjectively concerned about the effects of antipsychotic medications as demonstrated by their acute awareness regarding their daily functioning as well as their cognitive abilities (Naber et al., 2005; Ritsner et al., 2012). As a result, the patient’s health complaints, related to both physical and mental functioning, could be relatively well-represented in the clinician’s treatment plan.
Furthermore, all of the SWN subscale scores rated by the patients were lower than the scores rated by the psychiatrists, and the SC subscale presented the widest difference in the total mean scores among the two ratings (Table 2). These outcomes could clarify our view of the sense of well-being between raters. Besides, the higher scores rated by psychiatrists may reflect the already known pitfalls in practice, such as taking different valuations of symptoms or social connection information from the patient’s point of view, clinical evaluations not being able to measure accurately regardless of the consideration of subjective experiences, or the clinician’s lack of experience or evaluation skills related to patient well-being. These findings of differences in subscale scores raise intriguing issues regarding the well-being of people with schizophrenia by pointing toward the role of factors beyond merely biological aspects (i.e., PF and MF), such as psychosocial aspects like ER, SI and SC. Hence, more active collaboration and information sharing are required in practice to tackle this problem (Hamm et al., 2018).
Regarding the psychopathology of schizophrenia, those experiencing active psychoses might find it difficult to regulate themselves, while for those having negative symptoms, it might be hard to be aware of their exact emotions. Due to these clinical conditions, an agreement between the patient and the psychiatrist regarding ER, SI and SC might be arduous to reach. Similarly, former studies have had the tendency to partly miss this point owing to ignorance concerning the negative effects of antipsychotic drugs and different expectations regarding treatment between the patient and the psychiatrist (Chue, 2006; Seale et al., 2007). Patients may under-report subjective concerns due to fear of being labeled as difficult patients (Frosch et al., 2012). This might also affect the well-being assessments.
Since the SWN tool showed the strongest ICC correlation between patients and psychiatrists, it could be inferred that the objective well-being assessment by the psychiatrist was rather close to that of the subjective well-being assessment by the patient. In turn, when looking at classifying patients into an ‘adequate’ or ‘poor’ well-being status, the second research question asked whether psychiatrist-rated SWN provides a better agreement than the psychiatrist’s judgement, using the patient-rated SWN as a gold standard and a score of ≥ 80 to indicate adequate well-being. It was discovered that the psychiatrist-rated SWN was better than one’s self-judgement of well-being status; both Kappa coefficients were considered as weak (0.4, p < 0.001), and minimal agreement was observed (0.3, p < 0.001). These Kappa coefficient agreements could help guide the overall picture of well-being evaluated by patients and psychiatrists, but they also point to a substantial loss of information in relation to inter-rater agreement.
Regarding the important issue of the authoritarian practice (Frosch et al., 2012), clinicians may assume that they know about the patients’ well-being better than the patients themselves. Additionally, clinicians may judge patients in a stigmatizing manner—i.e., the patients cannot decide on their own how they were doing—and doubt their judgement on well-being. Our findings showed that the psychiatrist’s judgement was poor in determining patient well-being, highlighting the fact that clinicians are not always accurate in their assessments and, to some extent, tend to over- or under-estimate patient well-being. Thus, with recovery-oriented treatment it requires to move beyond positioning health care provider as experts and begin to more carefully study the views of recovering persons (Leonhardt et al., 2017) to create their own meanings of well-being experiences.
Furthermore, we analyzed descriptive values to gain a more complete picture of the information agreement by looking at the sensitivity and specificity, the positive predictive value, and the negative predictive value of our instruments. Regarding sensitivity, the psychiatrist-rated SWN with a cut-point of 80 was better than the psychiatrist’s judgement. Thus, we could imply that the psychiatrist-rated SWN score is more useful than using clinical judgement to assess patient well-being. Moreover, the ROC curve of the psychiatrist-rated SWN showed a good level of prediction (AUROC = 81.4%), meanwhile, the psychiatrist’s judgement had the poorest prediction power of determining patient well-being. The findings of the analyses of the ROC curve and the sensitivity or specificity of the psychiatrist-rated SWN by this study’s three psychiatrists may be suggestive of the inaccuracies being solely due to the practice particulars and experience level of the individual psychiatrist, and not due to use of the tool. It is appropriate to test the sensitivity and specificity of the psychiatrist’s judgement and the consistency of his/her scoring in order to determine a standard cut score that be applicable in wider settings and/or among different mental healthcare professionals. Nevertheless, the psychiatrist’s judgement might be affected by the pitfalls and the authoritarian issues discussed above.
We also found the cut-off values of the total score of SWN rated by psychiatrists, with 93 showing the maximum sensitivity and specificity, and 73 the only value showing maximum sensitivity. Meanwhile, the standard cut-point of 80, which fell between 73 and 93, showed a rather high sensitivity but low specificity. Taking these well-being prediction values into account, using only the psychiatrist’s judgement on well-being seems to be inadequate; therefore, integrating the SWN tool into routine practice could ensure a more accurate well-being prediction than the clinician’s opinion alone. Further details on the use of the psychiatrist-rated SWN score and the relevant cut-point values are presented in Table 6.
Another point of concern, regardless of reliability, is the validity of well-being assessment between patients and psychiatrists. Using observable objective data (e.g., current functioning, being employed, and living independence) (Lambert et al., 2006) or demographic or health data could improve the validity of the assessment. Nevertheless, objective data were not our primary concern because we believed that subjective views rather than measuring the individual’s functioning, work and social life, or impairment status have an important role to play in ascertaining well-being. Some patients may be happy with their current status, and some may not. For example, previous research examining QoL has shown that patients living with their parents did not see themselves as more disabled than those living on their own (Strassnig et al., 2018). However, it is still worthwhile to validate subjective outcomes with observable and objective data, since patients’ emotional and physical fitness could affect their perception of subjective experiences (Strassnig et al., 2018). Taking observable objective data into account (e.g., employment, ability to visit the clinic on one’s own, and caregiver independence), we found that being employed could play a role in indicating well-being status irrespective of patient or psychiatrist assessment. Previous work has also pointed out that employment could help assess the status of a patient’s well-being (Lambert et al., 2006). Additionally, visiting the clinic on one’s own and caregiver independence were not found to play a role in well-being assessment. Moreover, there is a tendency on the part of patients to ignore their life status, resulting in it having no association with well-being outcomes. These post-hoc findings warrant the employment of more observable and objective information in the clinical setting in order to improve the clinicians’ assessment of patient well-being. Meanwhile, functioning and impairment remain important issues to be addressed in future research.
There were some limitations to this study. Firstly, the patient-rated scores might have been affected by individual factors (e.g., patient’s mood/physical conditions), which could have compromised the validity of assessment between raters. Hence, we performed validity assessments by comparing objective data with well-being outcomes in order to ensure an improved validity. Secondly, considering the psychopathology of schizophrenia, some patients have problems with communication (Langdon et al., 2002), which may have led to unreliable data. Thirdly, there might have been some influence exerted by the judgment of the psychiatrist in regard to the sequential measurements in the questionnaires, as this study was not conducted in a totally blind fashion. Furthermore, the extent of one’s sense or feeling of well-being and its determinants needs to be investigated more longitudinally in order to examine subtle changes throughout the course of the mental illness.
To our knowledge, this is the first study to shed some light on the patient’s subjective well-being assessed by psychiatrists and to employ a large sample size. From the clinical point of vantage, it is really important to reassess patients systematically. This would lead to a better patient satisfaction with life and overall happiness, which would enhance their QoL (Aunjitsakul & Pitanupong, 2018; Wehmeier et al., 2007). The happiness of patients with schizophrenia could ensure a successful long-term management, which could yield better treatment outcomes as it would enable the psychiatrist to attend closely to the patients’ needs and have a meaningful relationship with them (Acosta et al., 2012; Gunnmo & Bergman, 2011; Higashi et al., 2013; Rettenbacher et al., 2004). This study could help heighten awareness regarding the need to finetune the assessment of the patient’s needs via a strong cooperation between the patient and the clinician. The importance of this is highlighted by literature on recovery which emphasizes that recovery has to be self-directed (Leonhardt et al., 2017) as such there is a need for more active collaboration and information sharing as suggested by our findings. The social relationships of the patient with others as well as health professionals could promote their overall satisfaction with life (Gunnmo & Bergman, 2011). Furthermore, the utilization of psychiatrist-rated well-being instruments with their appropriate cut-points could be useful in daily practice.
In conclusion, we found that SWN can be used by psychiatrists as an acceptable agreement level in total scores between psychiatrists and patients with schizophrenia was observed; however, the agreement between the two assessments on determining well-being status was weak. Three clinical implications emerge from the findings of the present study. Firstly, well-being is predicted more accurately by the psychiatrist-rated SWN than the psychiatrist’s judgement alone. Secondly, psychiatrists or clinicians should be trained adequately in order to ensure their ability to measure well-being accurately, and the well-being measurements employed should be standardized. Thirdly, psychiatrists may need to be upskilled in assessing patient well-being as a way to inform the appropriate treatment provision. Finally, the investigation of subjective well-being as well as the improvement of clinical outcomes and their evaluation along their longitudinal course should be further explored in the future.
Data Availability
The data that support the findings of this study are available from the corresponding author, WA, upon reasonable request.
References
Acosta, F. J., Hernandez, J. L., Pereira, J., Herrera, J., & Rodriguez, C. J. (2012). Medication adherence in schizophrenia. World Journal of Psychiatry, 2(5), 74–82. https://doi.org/10.5498/wjp.v2.i5.74
Agid, O., McDonald, K., Siu, C., Tsoutsoulas, C., Wass, C., Zipursky, R. B.,…Remington, G. (2012). Happiness in first-episode schizophrenia. Schizophrenia research, 141(1), 98–103.https://doi.org/10.1016/j.schres.2012.07.012
Aunjitsakul, W., & Pitanupong, J. (2018). Schizophrenias’ quality of life and emotional intelligence in Songklanagarind Hospital. Journal of Health Science and Medical Research, 36(1), 61–71.
Aunjitsakul, W., Teetharatkul, T., Vitayanont, A., & Liabsuetrakul, T. (2019). Correlations between self-reported and psychiatrist assessments of well-being among patients with schizophrenia. General Hospital Psychiatry, 56, 52–53. https://doi.org/10.1016/j.genhosppsych.2018.11.001
Chue, P. (2006). The relationship between patient satisfaction and treatment outcomes in schizophrenia. Journal of Psychopharmacology, 20(6 Suppl), 38–56. https://doi.org/10.1177/1359786806071246
de Haan, L., Weisfelt, M., Dingemans, P. M., Linszen, D. H., & Wouters, L. (2002). Psychometric properties of the subjective well-being under neuroleptics scale and the subjective deficit syndrome scale. Psychopharmacology (Berl), 162(1), 24–28. https://doi.org/10.1007/s00213-002-1054-x
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13
Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125(2), 276–302.
Eack, S. M., & Newhill, C. E. (2007). Psychiatric symptoms and quality of life in schizophrenia: A meta-analysis. Schizophrenia Bulletin, 33(5), 1225–1237. https://doi.org/10.1093/schbul/sbl071
Fervaha, G., Agid, O., Takeuchi, H., Foussias, G., & Remington, G. (2016). Life satisfaction and happiness among young adults with schizophrenia. Psychiatry Research, 242, 174–179. https://doi.org/10.1016/j.psychres.2016.05.046
Frosch, D. L., May, S. G., Rendle, K. A., Tietbohl, C., & Elwyn, G. (2012). Authoritarian physicians and patients’ fear of being labeled ‘difficult’ among key obstacles to shared decision making. Health Affairs (Project Hope), 31(5), 1030–1038. https://doi.org/10.1377/hlthaff.2011.0576
Gunnmo, P., & Bergman, H. F. (2011). What do individuals with schizophrenia need to increase their well-being. International Journal of Qualitative Studies on Health and Well-Being. https://doi.org/10.3402/qhw.v6i1.5412
Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23–34. https://doi.org/10.20982/tqmp.08.1.p023
Hamm, J. A., Buck, K. D., Leonhardt, B. L., Luther, L., & Lysaker, P. H. (2018). Self-directed recovery in schizophrenia: Attending to clients’ agendas in psychotherapy. Journal of Psychotherapy Integration, 28(2), 188–201. https://doi.org/10.1037/int0000070
Higashi, K., Medic, G., Littlewood, K. J., Diez, T., Granstrom, O., & De Hert, M. (2013). Medication adherence in schizophrenia: Factors influencing adherence and consequences of nonadherence, a systematic literature review. Therapeutic Advances in Psychopharmacology, 3(4), 200–218. https://doi.org/10.1177/2045125312474019
Kahneman, D., & Tversky, A. (1984). Choices, values, and frames. American Psychologist, 39(4), 341–350.
Kim-Prieto, C., Diener, E., Tamir, M., Scollon, C., & Diener, M. (2005). Integrating the diverse definitions of happiness: A time-sequential framework of subjective well-being. Journal of Happiness Studies, 6(3), 261–300.
Lambert, M., Schimmelmann, B. G., Naber, D., Schacht, A., Karow, A., Wagner, T., & Czekalla, J. (2006). Prediction of remission as a combination of symptomatic and functional remission and adequate subjective well-being in 2960 patients with schizophrenia. The Journal of Clinical Psychiatry, 67(11), 1690–1697. https://doi.org/10.4088/jcp.v67n1104
Langdon, R., Coltheart, M., Ward, P. B., & Catts, S. V. (2002). Disturbed communication in schizophrenia: The role of poor pragmatics and poor mind-reading. Psychological Medicine, 32(7), 1273–1284.
Lehman, A. F. (1988). A quality of life interview for the chronically mentally ill. Evaluation and Program Planning, 11(1), 51–62. https://doi.org/10.1016/0149-7189(88)90033-X
Leonhardt, B. L., Huling, K., Hamm, J. A., Roe, D., Hasson-Ohayon, I., McLeod, H. J., & Lysaker, P. H. (2017). Recovery and serious mental illness: A review of current clinical and research paradigms and future directions. Expert Review of Neurotherapeutics, 17(11), 1117–1130. https://doi.org/10.1080/14737175.2017.1378099
Lindstrom, E., Jedenius, E., & Levander, S. (2009). A symptom self-rating scale for schizophrenia (4S): Psychometric properties, reliability and validity. Nordic Journal of Psychiatry, 63(5), 368–374.
Lyubomirsky, S., & Lepper, H. S. (1999). A measure of subjective happiness: Preliminary reliability and construct validation. Social Indicators Research, 46(2), 137–155.
McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemical Medicine (Zagreb), 22(3), 276–282.
Myers, D. G., & Diener, E. (2018). The scientific pursuit of happiness. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 13(2), 218–225. https://doi.org/10.1177/1745691618765171
Naber, D. (1995). A self-rating to measure subjective effects of neuroleptic drugs, relationships to objective psychopathology, quality of life, compliance and other clinical variables. International Clinical Psychopharmacology, 10(Suppl 3), 133–138.
Naber, D., Karow, A., & Lambert, M. (2005). Subjective well-being under the neuroleptic treatment and its relevance for compliance. Acta Psychiatrica Scandinavica. Supplementum, 427, 29–34.
Naber, D., Moritz, S., Lambert, M., Pajonk, F. G., Holzbach, R., Mass, R., & Andresen, B. (2001). Improvement of schizophrenic patients’ subjective well-being under atypical antipsychotic drugs. Schizophrenia Research, 50(1–2), 79–88.
Pavot, W., Diener, E., Colvin, C. R., & Sandvik, E. (1991). Further validation of the satisfaction with life scale: Evidence for the cross-method convergence of well-being measures. Journal of Personality Assessment, 57(1), 149–161. https://doi.org/10.1207/s15327752jpa5701_17
Polit, D. F. (2014). Getting serious about test-retest reliability: A critique of retest research and some recommendations. Quality of Life Research, 23(6), 1713–1720. https://doi.org/10.1007/s11136-014-0632-9
Rettenbacher, M. A., Hofer, A., Eder, U., Hummer, M., Kemmler, G., Weiss, E. M., & Fleischhacker, W. W. (2004). Compliance in schizophrenia: Psychopathology, side effects, and patients’ attitudes toward the illness and medication. Journal of Clinical Psychiatry, 65(9), 1211–1218.
Ritsner, M. S., Lisker, A., & Arbitman, M. (2012). Ten-year quality of life outcomes among patients with schizophrenia and schizoaffective disorders: I. Predictive value of disorder-related factors. Quality of Life Research, 21(5), 837–847. https://doi.org/10.1007/s11136-011-9988-2
Seale, C., Chaplin, R., Lelliott, P., & Quirk, A. (2007). Antipsychotic medication, sedation and mental clouding: An observational study of psychiatric consultations. Social Science & Medicine, 65(4), 698–711. https://doi.org/10.1016/j.socscimed.2007.03.047
Strassnig, M., Kotov, R., Fochtmann, L., Kalin, M., Bromet, E. J., & Harvey, P. D. (2018). Associations of independent living and labor force participation with impairment indicators in schizophrenia and bipolar disorder at 20-year follow-up. Schizophrenia Research, 197, 150–155. https://doi.org/10.1016/j.schres.2018.02.009
Tolman, A. W., & Kurtz, M. M. (2012). Neurocognitive predictors of objective and subjective quality of life in individuals with schizophrenia: A meta-analytic investigation. Schizophrenia Bulletin, 38(2), 304–315. https://doi.org/10.1093/schbul/sbq077
Vothknecht, S., Schoevers, R. A., & de Haan, L. (2011). Subjective well-being in schizophrenia as measured with the subjective well-being under neuroleptic treatment scale: A review. Australian and New Zealand Journal of Psychiatry, 45(3), 182–192. https://doi.org/10.3109/00048674.2010.545984
Vothknecht, S., Meijer, C., Zwinderman, A., Kikkert, M., Dekker, J., van Beveren, N.,...For, Group. (2013). Psychometric evaluation of the Subjective Well-being Under Neuroleptic Treatment Scale (SWN) in patients with schizophrenia, their relatives and controls. Psychiatry Research, 206(1), 62–67.https://doi.org/10.1016/j.psychres.2012.09.004
Wehmeier, P. M., Kluge, M., Schacht, A., Helsberg, K., & Schreiber, W. (2007). Correlation of physician and patient rated quality of life during antipsychotic treatment in outpatients with schizophrenia. Schizophrenia Research, 91(1–3), 178–186. https://doi.org/10.1016/j.schres.2006.12.017
Acknowledgements
The authors wish to thank all patients, caregivers, research assistants, and nurses for their availability and ready cooperation in this research.
Funding
This research was supported by funding from the Faculty of Medicine, Prince of Songkla University, Thailand.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Consent for Publication
All authors agreed to submit this study for publication.
Ethical Approval
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation as well as the Helsinki Declaration of 1975, as revised in 2008. This study was approved by the Ethics Committee of the Faculty of Medicine, Prince of Songkla University (REC: 60-197-03-1).
Informed Consent
All the participants gave their informed consent before being interviewed.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Aunjitsakul, W., Teetharatkul, T., Vitayanont, A. et al. Does the Psychiatrist’s Use of Subjective Well-Being Measurement in People with Schizophrenia Provide a Better Alignment with the Patient’s Well-Being Perception than Clinical Judgement Alone?. Adm Policy Ment Health 48, 768–779 (2021). https://doi.org/10.1007/s10488-021-01127-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01127-5