Abstract
Objectives
This study was intended to present evidence for the reliability and validity of a Greek translation of the Medical Outcomes Study-HIV Health Survey (MOS-HIV). Design: Sample consisted of 154 HIV-positive men and women, regardless of disease stage, who are being followed at the department of Infectious Diseases of a tertiary hospital of Athens, Greece.
Methods
The translated Greek version of the MOS-HIV instrument, a brief, comprehensive 35-item health-related quality of life questionnaire, was used to assess ten dimensions of health including overall quality of life, pain, physical functioning, role functioning, social functioning, mental health, energy/fatigue, cognitive function, health distress, and health transition. Additional socio-demographic data and clinical parameters were also collected. Standard guidelines were followed for questionnaire translation to the Greek language. Internal consistency reliability using Cronbach’s alpha and the range of measurement of the MOS-HIV subscales were examined. Convergent validity was further examined with the intercorrelations of subscales. ROC analysis was used to estimate the ability of the subscales to discriminate patients according to the characteristics of the disease [i.e. asymptomatic, symptomatic and AIDS, CD4+ lymphocyte count (<200 cells/mm3 and >200 cells/mm3)] and assess concurrent validity.
Results
All the MOS-HIV scales exceeded the minimum reliability standard of 0.70. Physical functioning and health distress had the greatest reliability coefficient, equal to 0.87 and 0.88, respectively. Correlations among MOS-HIV scales were all significant. Physical functioning, pain, and physical health summary scales were significantly lower for AIDS patients compared to asymptomatic HIV+ individuals. All scales except for role functioning and health transition could discriminate well subjects with CD4+ lymphocyte count <200 cells/mm3 and >200 cells/mm3.
Conclusions
The Greek version of the MOS-HIV had good reliability and validity among patients with AIDS. Convergent and concurrent validity were generally confirmed. The MOS-HIV may be useful in assessing health-related quality of life in AIDS patients in Greece. Further research is needed for the evaluation of the Greek version of the MOS-HIV responsiveness to changes over time.
Avoid common mistakes on your manuscript.
Introduction
In recent years, there is an increasing interest in the measurement of health-related quality of life (HRQoL) of populations suffering from chronic diseases. In the case of HIV infection, the introduction of highly active antiretroviral therapy (HAART) changed the disease’s natural course, marking a considerable decline in disease mortality, in the incidence of opportunistic infections, the time of hospitalization, and the time interval until progression to AIDS [1]. With the use of antiretroviral drugs, AIDS is considered to be a chronic disease, and the clinicians’ efforts are focused in the accomplishment of long-term suppression of viral load, and the patients’ compliance to treatment which in some instances is low due to adverse drug reactions [2]. Under these circumstances, the recognition of strategies which will maximize this population’s HRQoL is inevitable as is the appreciation of the diseases aspects in patients’ lives when framing therapeutic strategies [3, 4].
Numerous studies have been conducted on HIV+ patients’ HRQoL, particularly in relation to medical (i.e. disease stages, viral burden, disease outcome, and therapeutic regimens) and social or demographic variables. The initial discord about the use of generic or disease-specific instruments for the measurement of HRQoL in chronic conditions [5] was followed by the development of disease-specific tools. In HIV-infected patients, most HRQoL instruments are multifactorial subjective scales that aim mainly in detecting the impact of the infection and its therapy in certain dimensions of everyday life and its possible changes during the disease’s natural course or the application of pharmaceutical regimens [5, 6]. The MOS-HIV instrument is a brief and comprehensive tool of HRQoL measurement in HIV+ and AIDS patients and contains 35 questions grouped into 10 health dimensions of HRQoL: general health (GH), physical functioning (PF), mental health (MH), role functioning (RF), social functioning (SF), vitality (VT), pain (PN), cognitive functioning (CF), health distress (HD), health transition (HT), and quality of life (QL) [7, 8]. The scores obtained for each dimension allow two global summary scores to be obtained (i.e. PHS: physical health summary score and MHS: mental health summary score). For the PHS score, the PF, PN, and RF scale scores contributed most strongly. For the MHS score, the MH, HD, QL, and CF scales contributed most strongly. The VT, GH, and SF scales contributed to both factors. The summary scores were transformed to t-scores with a mean of 50 and a standard deviation of 10 and were standardized to make it possible to compare between scales with different response formats, ranging from 0 to 100, with higher scores indicating better HRQoL [8, 9].
The MOS-HIV has been shown to be internally consistent, to correlate with concurrent measures of health (e.g. symptom scales), to discriminate among distinct groups (e.g. patients in different disease stages), to predict future outcomes (e.g. prediction of increased hazard of death in HIV+ individuals with CD4+ <100 cells/μl) and to be responsive to changes over time [8–10]. No research has been carried out on the assessment of HRQoL of HIV/AIDS patients in Greece, mainly due to the great lack of measurement instruments in Greek that have been developed or adapted against agreed scientific criteria and attributes. The present study aims at evaluating the reliability and validity of the translated in the Greek language MOS-HIV questionnaire in an urban population of HIV-infected individuals of different disease stages.
Methods
Participants and data collection
The sample consisted of HIV-positive men and women, of various disease stages, patients of the clinic of Infectious Diseases of a tertiary hospital in Athens, Greece. The patients, after being informed about the study’s content and goals, were asked to participate during their regular follow-up visit at the clinic. The inclusion criteria were age over 18 years and known HIV infection—with positive Elisa and Western Blot tests—for at least 3 months. Among the 185 randomly selected and eligible individuals, a number of 154 gave written informed consent to participate in the study (response rate 83.2%). The patients completed the self-reported questionnaire, during their visit at the clinic, usually before their scheduled doctor’s appointment. Additional information about socio-demographic data was also collected. Clinical data regarding HIV infection status were obtained from their medical files.
Instrument
The MOS-HIV was developed in response to the need for a comprehensive, rapid assessment of HIV/AIDS-specific HRQoL. Since 1997, it has been used in clinical trials [8] and cross-sectional and cohort studies (i.e. from PROMETHEUS [11] and PISCES study groups [12] to other investigators of HRQoL in HIV [2, 13], and it has numerous validated translations [14–19]). This questionnaire shares the same common pool of items with the SF-36 of the Medical Outcomes Study, but some additional domains of HRQoL measures were added to produce a 30-item form of the MOS-HIV [7]. In subsequent efforts to increase reliability of the initial MOS-HIV, 35 questions were included to assess 10 dimensions (or scales) of health, which included GH (5 items), PN (2 items), PF (6 items), RF (2 items), SF (1 item), MH (5 items), VT (4 items), HD (4 items), CF (4 items), QL (1 item), and HT (1 item) [8]. To score the MOS-HIV, the raw item scores of each scale were summed and transformed into a 0–100 scale, permitting comparisons between the constructs of with different response categories. The questionnaire takes about 5 min to complete. A higher score indicated better HRQoL.
Translation
The MOS-HIV used in this study was translated into Greek from the original questionnaire using international guidelines [20–23] and the internationally accepted translation method (i.e. the standard linguistic validation process) suggested by The Mapi Research Institute [24]. The standard linguistic validation process started with the conceptual analysis of the original instrument’s items. Upon agreement, two professional translators, native speakers of the Greek (i.e. target) language and fluent in the English (i.e. source) language, undertook independent forward translations into the target language. A reconciled version of the instrument was developed, and a backward translation of this reconciled version back into the original language was performed by a professional translator. The back-translation and the original one were compared, and any discrepancies between them led to changes to the reconciled translation in the Greek language. The clinic’s medical doctors participating in the research study reviewed this latest version and gave their feedback. At the next stage, the questionnaire was administered to a small group of the clinic’s patients who volunteer to take part at the cognitive debriefing phase in order to assess clarity and comprehension of the items. After this final feedback, the final Greek version was produced. The items and the categories of the Greek translation of MOS-HIV were in the same grouping and order, as in the original English version.
Socio-demographic and HIV/AIDS-related parameters
Social and demographic elements regarding age, sex, ethnicity (i.e. Greek/non-Greek), education (i.e. first, second, or third level of education), monthly income, current employment status, reception of disability benefits, and use of intravenous drugs were answered by the patients in a separate sheet. HIV/AIDS-related information that included a recent CD4+ cell count, the Karnofsky Performance Status, the disease stage (asymptomatic HIV, symptomatic HIV, or AIDS), the time since diagnosis, and the existence of other infections or chronic conditions that may influence their HRQoL was abstracted from their recent medical files.
Statistical analysis
Internal consistency reliability was determined by the calculation of Cronbach’s α coefficient. Scales with reliabilities equal to or greater than 0.70 were considered acceptable [25]. The floor and ceiling effects were also tested based on the percentages of scores at extremes of the scaling range in order to provide evidence that the scale has adequate variability in a range that is appropriate to its intended use [25]. Subscales are intended to contribute to the definition of a unique construct (i.e. HRQoL) yet at the same time to reflect distinct constructs. For this reason, convergent validity was tested through intercorrelations among the scales belonging to the same questionnaire. The values for intercorrelation (Pearson’s r) between scales should be between 0.40 and 0.80 [25]. Discriminant construct validity was evaluated by analyzing the association between scores and CD4+ cell count and disease stages. Based on previous literature [7, 14, 15, 26–28], it was anticipated that subjects with low CD4+ cell count would report lower values on the MOS-HIV scales. We also hypothesized that asymptomatic HIV+ patients would have the highest mean MOS-HIV scale scores, symptomatic HIV+ patients would have intermediate mean MOS-HIV scale scores, and AIDS patients would have the lowest mean MOS-HIV scale scores. We expected differences between disease stages would be greater for MOS-HIV scales that mainly measure physical health status (i.e. PHS, VT, PN, RF, and GH).
Analysis of variance (ANOVA) was used to compare mean scales between the three groups of patients (asymptomatic, symptomatic, and AIDS). In order to control for multiple testing, Bonferroni correction was used. The MOS-HIV scales were tested for their discriminative ability using receiver operating characteristic (ROC) curves. The overall performance of the ROC analysis was quantified by computing area under the curve (AUC). An area of 1 indicated perfect performance, while 0.5 indicated a performance that was not different than chance.
Results
Sample characteristics are presented in Table 1. Participants were generally of male gender (76.6%) and had Greek nationality (89.6%). A 50.6% was in asymptomatic disease stage. The mean CD4+ cell count was 516.2 cells/mm3, and 86.4% of the subjects had CD4+ cell count more than 200 cells/mm3. HIV-1 RNA level had a medial of 49.5 copies/mL.
Table 2 lists the summary of scales’ scores and floor and ceiling effects. Scores were generally well distributed over the range of possible values for the single scales. Floor effects ranged from 0.6% for CF, PN, MH, MHS, and PHS to 22.7% for RF scales. Ceiling effects ranged from 0% for MHS and PHS to 46.1% for PN.
Internal consistency reliability was good for each scale, with the α value always greater than 0.80. All the MOS-HIV scales exceeded the minimum reliability standard of 0.70 (Table 3). PF and HD had the greatest reliability coefficient, equal to 0.87 and 0.88, respectively.
Convergent and discriminant construct validity at the scale level were tested to determine whether the scales reflect different constructs of HRQoL. Correlations among MOS-HIV scales were all significant. The convergent validity analysis revealed that most of the correlations between pairs of scales were within the acceptable range (0.40–0.80). Lower correlations were observed between the HT scale and the scales for HD, CF, PN, GH, and VT, as identified also in another study [15]. PN scale had a low correlation (<0.30) with the RF and CF scales. The GH scale showed acceptable correlations with all scales except for CF, RF, and HT scales.
We measured discriminant construct validity for each scale (i.e. the level the scale scores could discriminate according to severity of the disease), using as validation variables CD4+ count and stage of disease severity [29]. We expected lower scale scores with more severe disease and with low level of CD4+ count [7, 26–28, 30].
Table 4 presents the mean scale scores for asymptomatic, symptomatic, and AIDS patients. Scores on GH, PF, PN, and PHS scales were significantly lower for AIDS patients compared to asymptomatic ones. Furthermore, scores on PF and PN were also significantly lower for AIDS patients compared to symptomatic HIV+ ones.
Table 5 indicates the ability of the MOS-HIV scales to discriminate between subjects that are characterized by differences in severity of disease, as defined by CD4+ cell count. All scales except for RF and HT could discriminate well subjects with CD4+ cell count less than 200 cells/mm3 and more than 200 cells/mm3. The AUC ranged from 0.67 for MH scale to 0.82 for GH scale.
Discussion
The Greek translation of the MOS-HIV instrument was found to be suitable and appropriate to assess HRQoL of HIV-infected individuals residing in Greece. These data provide evidence for applicability in patients in different stages of disease severity, as recorded in other similar international studies [14, 16, 25].
All scales exceeded the minimum reliability criterion of a Cronbach’s α coefficient over 0.70. The validity of this instrument was also supported by the observed relationship of HRQoL scale scores and CD4++ lymphocyte count and disease stages.
The scales for MH, HD, and HT displayed well-balanced distributions, with a slight skew toward higher scores for the PF, RF, SF, and PN scales. The ceiling effect was observed in the scales of SF and PN. This phenomenon is well explained by the fact that half of the patients (50.6%) were in asymptomatic HIV disease stage, and most of them were not receiving antiretroviral treatment at the time of the survey. Results of prior studies have also demonstrated that ceiling effects in the PF, RF, SF, CF, PN, and HT and in patients with more advanced disease stage, this was pronounced in the CF, PN, and HT scales [30]. In addition, the RF scale of the MOS-HIV has been found to have floor effects in patients with advanced HIV disease [16, 17, 28, 30].
All scales displayed satisfactory convergent validity except for RF scale. In particular, this scale showed correlations below the accepted level, except for the VT scale. It is possible that the translated version of one of the items may not have functioned as well as in the original English version, a finding also reported in the Italian psychometric trial [15]. Schiffano et al. [15] argued that the items on the RF subscale may not be adequate for describing the conditions of persons with AIDS, who are more likely to be incapable of conducting normal everyday activities. The SF scale also had acceptable correlation coefficients with respect to all scales, and the GH scale correlated well with all scales except for CF and HD.
Previous studies have shown that the MOS-HIV scales define, through a principal factor analysis, two correlated dimensions: a physical health dimension and a mental-emotional dimension [8, 9, 14]. As expected, scales that assess physical health, including PF and PN, were more strongly associated with severity of HIV disease [29]. We also observed that the above scales could discriminate well between individuals in different disease stages, as seen in numerous other studies of the MOS-HIV [7, 8, 26, 28, 30, 31]. The most significant comparisons in mean scores with the analysis of variance could be made between asymptomatic HIV and AIDS patients in the areas of GH, PF, and PN scales. Asymptomatic HIV+ patients exhibited much higher scores in the domains of GH, PF, and PN compared to symptomatic HIV+ and to AIDS patients.
Better HRQoL scores were reported to be seen in the HIV-infected individuals with higher CD4+ cell counts [16, 17, 32]. We also observed that individuals with more CD4+ had higher HRQoL scores particularly in the domains related to the physical health as described by Wu et al. [7], and other international validation studies [18] have previously reported. On the contrary, Paton et al. [19] had found that the differences between the disease stages and correlations with CD4+ cell counts extended to nearly all the subscales of Physical and Mental Health. In the Italian and UK English samples, CD4+ cell count was associated with physical and social/role-related facets of HRQoL [14].
Our study also supports the absence of a significant association between scores on Mental Health domains and stages of HIV infection, a common conclusion of some previous studies [8, 33]. In general, we would expect AIDS patients to report with worse HRQoL than patients with asymptomatic or symptomatic HIV infection, the pattern observed for most of the comparisons in this study. However, the unpredictable course of HIV infection allows an AIDS diagnosis on the basis of an opportunistic infection that subsequently may resolve, rendering the patient asymptomatic. In this case, an AIDS patient might be experiencing less somatic pain than many symptomatic HIV+ individuals. Similarly, AIDS patients’ psychological and social sense of well-being may not be as poor as for patients who have recently been diagnosed as seropositive [15].
In interpreting our results, some important limitations of the study must be taken into account. The analysis of scores variability over time was not performed, and the results of our study demonstrate the need to further investigate the performance of the scales among persons with HIV/AIDS, especially with regard to their responsiveness to changes over time. Longitudinal studies also need to be undertaken to assess the impact of introduction of ΗAART on disease progression and changes in HRQoL.
Our results compared favorably to those from previous studies, leading to the conclusion that the Greek translation of MOS-HIV questionnaire represents a useful tool for measuring data on the HRQoL, inclusively among Greek-speaking patients with AIDS. However, changes in some of the subscales, such as role functioning, might improve performance.
References
Krentz, H. B., & Gill, M. J. (2003). The impact on health related quality of life of treatment interruptions in HIV-1 infected patients. AIDS, 17, 631–633.
Wu, A. W. (2000). Quality of life assessment comes of age in the era of highly active antiretroviral therapy. AIDS, 14(10), 1449–1451.
Ruiz Perez, I., et al. (2005). Health-related quality of life of patients with HIV: Impact of sociodemographic, clinical and psychosocial factors. Quality of Life Research, 14, 1301–1310.
Henry, K. (2000). The case for more cautious, patient focused antiretroviral therapy. Annals of Internal Medicine, 132, 306–311.
Shumaker, S. A., Ellis, S., & Naughton, M. (1997). Assessing health-related quality of life in HIV disease: Key measurement issues. Quality of Life Research, 6, 475–480.
Skevington, S. M., & O’Connell, K. A. (2003). Measuring quality of life in HIV and AIDS: A review of the recent literature. Psychology & Health, 18(3), 331–350.
Wu, A. W., Rubin, H. R., Mathews, W. C., et al. (1991). A health status questionnaire using 30 items from the Medical Outcomes Study: Preliminary validation in persons with early HIV infection. Medical Care, 29, 786–798.
Wu, A. W., Revicki, D. A., Jacobson, D., et al. (1997). Evidence for reliability, validity and usefulness of the Medical Outcomes Study HIV Health Survey (MOS-HIV). Quality of Life Research, 6, 481–493.
Wu, A. W., Hays, R. D., Kelly, S., et al. (1997). Applications of the Medical Outcomes Study health-related quality of life measures in HIV/AIDS. Quality of Life Research, 6(6), 531–554.
Revicki, D. A., Sorensen, S., & Wu, A. W. (1998). Reliability and validity of physical health and Mental Health summary scores from the MOS HIV Health Survey. Medical Care, 36(2), 126–137.
Nieuwerk, P. T., Gisolf, E. H., Colebunders, R., Wu, A. W., Danner, S. A., & Sprangers, M. A. (2000). Quality of life in asymptomatic and symptomatic HIV-infected patients in a trial of ritonavir/saquinavir therapy. The Prometheus Study Group. AIDS, 14(2), 181–187.
Revicki, D. A., Moyle, G., Stellbrink, H. J., & Barker, C. (1999). Quality of Life outcomes of combination zalcitabine-zidovudine, saquinavir-zidovudine and saquinavir-zalcitabine-zidovudine therapy for HIV-infected adults with CD4 cell counts between 50 and 350 per cubic millimetre. PISCES(SV14604) Study Group. AIDS, 13(7), 851–858.
Weinfurt, K. P., Willke, R. J., Glick, H. A., Fremuth, W. W., & Schulman, K. A. (2000). Relationship between CD4 count, viral burden and quality of life over time in HIV-1 infected patients. Medical Care, 38(4), 404–410.
Scott-Lennox, J. A., Wu, A. W., Boyer, J., et al. (1999). Reliability and validity of French, German, Italian, Dutch, and UK English translations of the medical outcomes study HIV health survey. Medical Care, 37(9), 908–925.
Schifano, P., Borgia, P., Wu, A. W., et al. (2003). Validity and reliability of the Italian translation of the MOS-HIV health survey in persons with AIDS. Quality of Life Research, 12, 1137–1146.
Murri, R., Ammasari, A., Fantoni, M., et al. (1997). Disease-related factors associated with health-related quality of life in people with non-advanced HIV disease assessed using an Italian version of the MOS-HIV health survey. Journal of Acquired Immune Deficiency Syndromes and Human Retroviruses, 16(5), 350–356.
Badia, X., Podzamczer, D., Garcia, M., Lopez-Lavid, C. C., Consigliore, E., & The Spanish MOS-HIV and MQOL-HIV Validation Group. (1999). A randomised study comparing instruments for measuring health related quality of life in HIV-infected patients. AIDS, 13, 1727–1735.
Kohli, R. M., Sane, S., Kumar, K., et al. (2005). Modification of medical outcome study (MOS) instrument for quality of life assessment & its validation in HIV infected individuals in India. The Indian Journal of Medical Research, 122, 297–304.
Paton, N. I., Chapman, C. A., Chan, S. P., Karen, M. T., Tan, K. M., Leo, Y. S., et al. (2002). Validation of the medical outcome study HIV (1), health survey as a measure of quality of life in HIV infected patients in Singapore. International Journal of STD and AIDS, 13, 456–461.
Bullinger, M., Alonso, J., Apolone, G., et al. (1998). Translating health status questionnaires and evaluating their quality: The IQOLA Project approach. Journal of Clinical Epidemiology, 51, 913–923.
Guyatt, G. H. (1995). The philosophy of health-related quality of life translation. In S. A. Shumaker & R. A. Berzon (Eds.), The international assessment of health-related quality of life (pp. 139–143). Oxford, New York: Rapid Communications.
Bullinger, M., Anderson, R., Cella, D., & Aaronson, N. (1995). Developing and evaluating cross-cultural instruments from minimum requirements to optimal models. In S. A. Shumaker & R. A. Berzon (Eds.), The international assessment of health-related quality of life (pp. 83–91). Oxford, New York: Rapid Communications.
Herdman, M., Fox-Rushby, J., & Badia, X. (1997). “Equivalence” and the translation and adaptation of health-related quality of life questionnaires. Quality of Life Research, 6, 237–247.
Acquadro, C., Conway, K., Giroudet, C., et al. (2004). Linguistic validation manual for patient-reported outcomes (PRO) instruments (pp. 40–58). Lyon: Mapi Research Institute.
Lohr, K. N. (2002). Assessing health status and quality-of-life instruments: Attributes and review criteria Journal. Quality of Life Research, 11(3), 193–205.
Burgess, A., Dayer, M., Catalan, J., et al. (1993). The reliability and validity of two HIV-specific health-related quality of life measures: A preliminary analysis. AIDS, 7, 1001–1008.
Ganz, P. A., Schag, C. A., Kahn, B., & Petersen, L. (1994). Assessing the quality of life of HIV infected persons: Clinical and descriptive information from studies with the HOPES. Psychology & Health, 9, 93–110.
Copfer, A. E., Ampel, N. M., Hughes, T. E., et al. (1996). The use of two measures of health-related quality of life in HIV-infected individuals: A cross-sectional comparison. Quality of Life Research, 5, 281–286.
Mocroft, A., Johmson, M., Sabin, C., et al. (1995). Staging system for clinical AIDS patients. Lancet, 346, 12–17.
Holmes, W. C., & Shea, J. A. (1999). Two approaches to measuring quality of life in the HIV/AIDS population: HAT-QOL and MOS-HIV. Quality of Life Research, 8(6), 515–527.
Revicki, D. A., Wu, A. W., & Brown, R. (1995). Change in clinical status, health status and health 57 utility outcomes in HIV-infected patients. Medical Care, 33(4), AS173–AS182.
Campsmith, M. L., Nakashima, A. K., & Davidson, A. J. (2003). Self-reported health related quality of life in persons with HIV infection: Results from multi-sites interview project. Health and Quality of Life Outcomes, 1, 12.
Smith, M. Y., Feldmen, J., Kelly, P., Dehovitz, J. A., Chirgwin, K., & Minkoff, H. (1996). Health related quality of life of HIV infected women: Evidence for the reliability, validity and responsiveness of the medical outcomes study short form 20. Quality of Life Research, 5, 47–55.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stasinopoulou, P.G., Tzavara, C., Dimitrakaki, C. et al. Reliability and validity of the Greek translation of the MOS-HIV health survey in HIV-infected individuals. Qual Life Res 19, 199–205 (2010). https://doi.org/10.1007/s11136-009-9573-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-009-9573-0