Abstract
Background
The Cluster Headache Impact Questionnaire (CHIQ) is a specific and easy-to-use questionnaire to assess the current impact of cluster headache (CH). The aim of this study was to validate the Italian version of the CHIQ.
Methods
We included patients diagnosed with episodic CH (eCH) or chronic CH (cCH) according to the ICHD-3 criteria and included in the “Italian Headache Registry” (RICe). The questionnaire was administered to patients through an electronic form in two sessions: at first visit for validation, and after 7 days for test-retest reliability. For internal consistency, Cronbach’s alpha was calculated. Convergent validity of the CHIQ with CH features and the results of questionnaires assessing anxiety, depression, stress, and quality of life was evaluated using Spearman’s correlation coefficient.
Results
We included 181 patients subdivided in 96 patients with active eCH, 14 with cCH, and 71 with eCH in remission. The 110 patients with either active eCH or cCH were included in the validation cohort; only 24 patients with CH were characterized by a stable attack frequency after 7 days, and were included in the test-retest cohort. Internal consistency of the CHIQ was good with a Cronbach alpha value of 0.891. The CHIQ score showed a significant positive correlation with anxiety, depression, and stress scores, while showing a significant negative correlation with quality-of-life scale scores.
Conclusion
Our data show the validity of the Italian version of the CHIQ, which represents a suitable tool for evaluating the social and psychological impact of CH in clinical practice and research.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Background
Cluster headache (CH) is a primary headache disorder that affects approximately 0.1% of the population [1]. Approximately 85% of individuals afflicted by CH have episodic CH (eCH), defined by the occurrence of remissions lasting at least 3 months between active bouts, while 15% of patients have chronic CH (cCH), characterized by the lack of remissions lasting more than 3 months [2].
Although less frequent than other headache disorders, CH might be associated with a substantial degree of disability due to the recurrent attacks of excruciating pain. The impact of CH on patients’ life can be severe; it is estimated that almost 20% of patients with CH have lost a job due to their headache, while another 8% are out of work or on disability [3]. CH is also frequently associated with comorbidities, mostly psychiatric, such as depression, anxiety, and aggressive behavior [4, 5].
Patient-reported outcomes (PROs) are important tools to assess the impact of headache disorders on the affected individuals. Contrariwise to migraine, in which the importance of PROs has been widely recognized [6], there is still little attention to the PROs for patients with CH. The available CH-specific questionnaires [7, 8] are rather time-consuming and poorly usable in the everyday clinical practice. More in detail, the Cluster Headache Quality of Life Scale is a 28-item scale focusing on quality of life [7], while the Cluster Headache Scales are a 36-item tool assessing psychosocial factors [8]; notably, those scales do not focus on the disability related to headache itself. The Cluster Headache Impact Questionnaire (CHIQ) is a short questionnaire recently developed in the German language and published along with an English translation [9]. The CHIQ consists of eight items rated on a 6-point Likert scale. Each question receives a score from 0 (“Never”) to 5 (“Always”); the total score is calculated by summing up the scores of each question, for a total range from 0 to 40. Questions refer to the last week and assess limitations in physical and mental daily activities, self-injurious behavior, and the impression of being a burden to the patient’s social environment; additional questions assess attack frequency and acute medication intake during the last week [9]. The original version of CHIQ showed good internal consistency and test-retest reliability, and positive correlations with attack frequency and acute medication intake; positive correlations were also found between the CHIQ score and depression, anxiety, and stress scores, while a negative correlation was found with a measure of quality of life [9], demonstrating the ability of CHIQ to perform a thorough clinical assessment of patients with CH.
The aim of this study was to validate the Italian version of the CHIQ to provide a reliable and easy-to-use PRO for patients with CH in clinical practice and research.
Methods
Questionnaire translation
We followed international recommendations for the translation protocol [10] (Fig. 1). The English version of the CHIQ questionnaire was first translated from English to Italian by two independent researchers (AO and RO) and then back translated by a native English speaker (MM) to resolve potential discrepancies between the Italian and English version. Conflicts were resolved by discussion and agreement among all the involved researchers. The final questionnaire is provided as supplementary material.
Study design and selection of the validation cohort
To test the applicability of the questionnaire, patients ≥ 18 years old who met ICHD-3 criteria for eCH or cCH [2] and included in the “Italian Headache Registry” (RICe) [11] were recruited between April and December 2022. RICe was approved by the Ethics Committee of the University of Florence (code 14591_oss) and mutually recognized by the other local Institutional Review Boards. The study was conducted according to the guidelines of the Declaration of Helsinki and all patients signed an informed consent before participating in the study.
We included patients seeking care at the 14 headache centers for the first time (1st visit) or for follow-up visit. After obtaining informed consent, patients were asked to complete an online survey conducted using the Research Electronic Data Capture (REDCap) [12] platform combined within the RICe electronic data capture platform. Participants were assigned a personal code in order to match a first and a follow-up survey. The first survey comprised the CHIQ, and the questionnaires to assess psychological dimensions (Depression Anxiety Stress Scale Short Version, DASS-21) [13] and quality of life (Short Form Health Survey, SF-36) [14]. Seven days after the first survey, patients were asked to complete the follow-up survey which included the same questionnaires. Patients with missing data in the CHIQ, DASS-21, or SF-36 questionnaires were excluded.
The validation cohort included patients with active eCH or cCH, while patients with eCH in remission were excluded. Nevertheless, all patients completed the baseline questionnaire; the CHIQ scores of patients with active eCH, cCH, and CH in remission were compared to assess whether the score was able to identify differences across the three groups. Only patients with a stable attack frequency during the week before the baseline and the follow-up assessments (± 2 attacks) were included in the test-retest cohort, similarly to the original CHIQ validation [9].
Statistical analysis
Demographics and CH characteristics are presented as descriptive statistics (mean ± SD, median [interquartile range, IQR] or numbers, and percentages of patients) if not otherwise specified. Between-group comparisons were performed by non-parametric tests (Wilcoxon or Kruskal-Wallis test, as appropriate) given the assumption of non-normal distribution of variables. For internal consistency, Cronbach’s alpha was calculated. A Cronbach alpha > 0.80 was accepted as good [15]. Test-retest reliability was assessed using intraclass correlation coefficients (ICC). Statistical analysis was performed using R, version 4.2.2 (The R Project for Statistical Computing, Vienna, Austria). Significance was accepted at p < 0.05.
Results
During the study period, we evaluated 181 patients with CH of whom 96 (53.0%) had active eCH, 14 (7.7%) cCH, and 71 (39.3%) eCH in remission. The 110 patients with either active eCH or cCH were included in the validation cohort. After 7 days from the baseline questionnaire, 24 (21.8%) of those 110 patients had an attack frequency similar to baseline and were therefore included in the test-retest cohort (Fig. 2).
The characteristics of patients with active eCH, cCH, and eCH in remission are reported in Table 1. The 110 patients of the validation cohort had a median number of 8 headache attacks (IQR 3–15) and used a median of 7 analgesics (IQR 2–12) during the week preceding questionnaire assessments.
In the validation cohort (n = 110), the mean (±SD) global CHIQ score was 24.8 ± 8.3 (range 1–39, possible range 0–40). Visual inspection of the CHIQ score histogram revealed a slight positive skewness (Fig. 3). The Shapiro-Wilk test revealed a slight deviation from normality (W = 0.976; p = 0.044). Internal consistency of the CHIQ was good with Cronbach’s alpha value of 0.891. Cronbach’s alpha did not change after deletion of any of the items (Table 2).
CHIQ score showed a significant positive correlation with anxiety, depression, and stress scores of the DASS-21 scale, while showing a significant negative correlation with quality-of-life domains assessed by the SF36 scale (Table 3). CHIQ score showed a marginally significant correlation with the number of CH attacks during the previous week, but no significant correlation with the frequency of intake of acute medications (Table 3).
Median CHIQ score was 25 (IQR 19–31) in patients with active eCH, 26 (IQR 19–35) in those with cCH, and 21 (IQR 10–27) in those with eCH in remission. The difference across groups was significant (p < 0.001, Kruskal-Wallis test). When comparing groups in couples, the score was similar when comparing patients with active eCH and cCH (p = 0.777; Fig. 4), while it was significantly lower in eCH in remission when compared to either active eCH or cCH.
In the test-retest cohort, median weekly headache attacks remained unchanged from 5 (IQR 4–13) to 5 (IQR 2–9) (p = 0.284) as were the median CHIQ scores: 25 at baseline (IQR 22–33), 23 at the retest session (IQR 11–30) (p = 0.095). The intraclass correlation coefficients were overall poor and ranged from 0.326 and 0.690 (Table 4). Not all coefficients were significant, but the overall score showed a statistically significant test-retest correlation (Table 4).
Discussion
We validated the Italian version of the CHIQ in a nationwide collaboration among 14 headache centers. Our results show good internal consistency, comparable to the original version. Therefore, this version of the questionnaire could be used in clinical and in research settings to evaluate the impact of CH on patients. The availability of a specific PRO for CH will provide clinicians and researchers with an easy-to-use tool that assesses the impact of CH by including additional components beyond the simple quantification of attack frequency and medication use.
Some differences between our validation cohort and the original German cohort are worth mentioning. The first main difference is that we validated our questionnaire in a cohort of patients with CH assessed in headache centers only, while the original CHIQ score was validated in a cohort comprising patients’ associations. Therefore, our cohort might have a higher diagnostic accuracy, as all patients received a diagnosis validated by headache specialists. On the other hand, we reached a lower patient number—mostly referring to patients with cCH—and our results might be less generalizable to the global population of patients with CH. In our cohort, the median number of weekly CH attacks was slightly lower than that of the original validation: 8 headache attacks (IQR 3–15) in our cohort vs 15.2 ± 13.8 attacks in the German cohort. The consumption of analgesics was also lower in our cohort (n. 7, IQR 2–12) vs 13.5 ± 14.2 in the German cohort.
The internal consistency of the questionnaire in our cohort was excellent, which makes it suitable for a wider application in Italy. On the contrary, in the test-retest validation, the overall rate of agreement was poor and not significant for some items (Table 3). In our opinion, this result might be due to the low number of patients who still reported headache at the 7-day follow-up. We asked patients to repeat the questionnaire after a shorter time compared with the original validation (7 instead of 14 days). This short timeframe was chosen as we expected that patients referring to headache centers would receive treatments that would quickly change their headache frequency and associated disability. We cannot exclude that effective treatments might have changed headache-related disability even during this short timeframe, thus affecting the reliability of test-retest. This interpretation is supported by the fact that most patients did not report headache at the moment of the follow-up survey.
An additional difference between our cohort and the original CHIQ validation cohort was that we found no difference in median CHIQ scores between patients with active eCH and those with cCH (Fig. 3). This finding is likely influenced by the low number of patients with cCH. The validity of the Italian version of CHIQ as a tool fit for detecting the impact of CH is however strengthened by the significant difference observed between eCH in remission and both groups of active eCH and cCH.
Similar to the original validation, we found a high correlation between CHIQ scores and measures of depression, anxiety, stress, and quality of life. Rather surprisingly, we found only a marginal correlation between the CHIQ scores and CH frequency and no correlation between the scores and acute medication use. This finding might have important implications for the management of patients with CH as it signals that the information coming from the CHIQ questionnaire could provide more complete information compared with those of simple questions about CH frequency or acute medication use.
We performed a validation study on a nationwide cohort of patients referring to headache centers where headache diagnoses are established by trained professionals, therefore increasing the reliability of data. Patient compliance was complete as all patients who were offered the questionnaire on their clinical visit agreed to participate in the study and completed the questionnaire. On the other hand, our study suffers from some potential limitations. We cannot exclude that patients accessing headache centers were more motivated than those attending other care settings. Therefore, a wider application of the CHIQ questionnaire could be associated with some compliance issues compared with the present cohort. Selection bias cannot be excluded as patients were coming from specialized centers. Additionally, the number of patients with cCH and the size of the test-retest cohort were small. The 7-day timeframe for test-retest was also short, which could expose to a risk of recall bias. The validation cohort included 110 patients with a ratio between patients and questionnaire items of 14:1, which is higher than a widely recommended ratio of 10:1 [16], but lower than the optimal 20:1 ratio [17]. For this reason, the reliability of subgroup analyses for eCH and cCH cannot be granted.
Conclusions
We showed the applicability of the Italian version of the CHIQ in patients with chronic and episodic CH. The questionnaire represents a useful and easy-to-use tool to explore several aspects of disability and quality of life of patients with CH within a limited amount of time. Further large-scale studies are needed to detect relevant cutoffs of the scale associated with clinically relevant differences, to distinguish the disability of patients with eCH and cCH, and to assess the effect of CH treatments on the CHIQ scores as well as on CH frequency and acute medication use.
Data availability
The raw data collected and analyzed for the current study are available from the corresponding author on reasonable request.
Abbreviations
- CH:
-
Cluster headache
- cCH:
-
Chronic cluster headache
- eCH:
-
Episodic cluster headache
- PRO(s):
-
Patient-reported outcome(s)
- CHIQ:
-
Cluster Headache Impact Questionnaire
- ICHD-3:
-
International Classification of Headache Disorders, 3rd Edition
- RICe:
-
Italian Headache Registry (Registro Italiano delle Cefalee)
- REDCap:
-
Research Electronic Data Capture
- DASS-21:
-
Depression, Anxiety, and Stress Scale Short Version
- SF-36:
-
Short Form Health Survey
- IQR:
-
Interquartile range
- ICC:
-
Intraclass correlation coefficients
References
Fischera M, Marziniak M, Gralow I, Evers S (2008) The incidence and prevalence of cluster headache: a meta-analysis of population-based studies. Cephalalgia 28:614–618. https://doi.org/10.1111/j.1468-2982.2008.01592.x
Olesen J, Bendtsen L and Goadsby P(2018) Headache Classification Committee of the International Headache Society (IHS) The International Classification of Headache Disorders, 3rd edition. Cephalalgia 38:1–211. https://doi.org/10.1177/0333102417738202
Rozen TD, Fishman RS (2012) Cluster headache in the United States of America: demographics, clinical characteristics, triggers, suicidality, and personal burden. Headache: J Head and Face Pain 52:99–113. https://doi.org/10.1111/j.1526-4610.2011.02028.x
Robbins MS (2013) The psychiatric comorbidities of cluster headache. Curr Pain Headache Rep 17:313. https://doi.org/10.1007/s11916-012-0313-8
Hoffmann J, May A (2018) Diagnosis, pathophysiology, and management of cluster headache. Lancet Neurol 17:75–83. https://doi.org/10.1016/S1474-4422(17)30405-2
Rothermich EA, Brod MI, Schonfeld WH et al (2002) Prospective study designs in outcomes research. Pharmacoeconomics 20:715–725. https://doi.org/10.2165/00019053-200220110-00001
Abu Bakar N, Torkamani M, Tanprawate S et al (2016) The development and validation of the Cluster Headache Quality of life scale (CHQ). J Headache Pain 17:79. https://doi.org/10.1186/s10194-016-0674-1
Klan T, Bräscher A-K, Vales A et al (2020) Determination of psychosocial factors in cluster headache – construction and psychometric properties of the Cluster Headache Scales (CHS). Cephalalgia 40:1240–1249. https://doi.org/10.1177/0333102420928076
Kamm K, Straube A, Ruscheweyh R (2022) Cluster Headache Impact Questionnaire (CHIQ) – a short measure of cluster headache related disability. J Headache Pain 23:37. https://doi.org/10.1186/s10194-022-01406-y
Peters M, Bertelote J, Houchin C et al (2007) Translation protocols. J Headache Pain 8:S40–S47
Delussi M, Gentile E, Coppola G et al (2020) Investigating the effects of COVID-19 quarantine in migraine: an observational cross-sectional study from the Italian National Headache Registry (RICe). Front Neurol 11. https://doi.org/10.3389/fneur.2020.597881
Harris PA, Taylor R, Thielke R et al (2009) Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 42:377–381. https://doi.org/10.1016/j.jbi.2008.08.010
Lovibond PF, Lovibond SH (1995) The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy 33:335–343. https://doi.org/10.1016/0005-7967(94)00075-U
Brazier JE, Harper R, Jones NM et al (1992) Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ 305:160–164. https://doi.org/10.1136/bmj.305.6846.160
Lance CE, Butts MM, Michels LC (2006) The sources of four commonly reported cutoff criteria. Organ Res Methods 9:202–220. https://doi.org/10.1177/1094428105284919
Nunnally JC (1978) Psychometric theory, 2nd edn. McGraw-Hill, New York
Costello AB, Osborne J (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation 10, Article 7. https://doi.org/10.7275/jyj1-4868
Acknowledgements
The “Società Italiana per lo Studio delle Cefalee” (SISC) is acknowledged for the “Registro Italiano delle Cefalee (RICe).”
Funding
Open access funding provided by Università degli Studi dell’Aquila within the CRUI-CARE Agreement.
Author information
Authors and Affiliations
Consortia
Contributions
RO conceived the study, translated the questionnaire, performed the statistical analyses, and revised the paper for intellectual content; AO translated the questionnaire, coordinated data collection, and wrote the first draft of the manuscript; LFI coordinated data collection and wrote the first draft of the manuscript; MM performed the back translation of the questionnaire; all authors participated in data collection, revised the first draft, and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Ethical approval and consent to participate
The Local Ethics Committee of Florence University—Comitato Etico Regionale della Regione Toscana—approved the study as a promoter center with code 14591_oss. The study was conducted according to the guidelines of the Declaration of Helsinki. Informed consent was obtained from all subjects involved in the study.
Consent for publication
Not applicable.
Conflict of interest
SS reports consultant, advisory board, or speaker fees from Abbott, Allergan, AstraZeneca, Bayer, Bristol Myers Squibb, Daiichi Sankyo, Eli Lilly, Medscape, Medtronic, Novartis, StarMed, Teva, and Uriach. RO reports speaker fees from Eli Lilly, Novartis, and Teva, support for attending meetings or travel from Novartis and Teva, advisory board fees from Eli Lilly, and nonfinancial support from Allergan and Novartis. PG received personal fees from Allergan, Eli Lilly, Novartis, Amgen, and TEVA; and grants from Amgen, TEVA, Eli Lilly, Allergan, and Chiesi; and is Scientific Advisory Board, Endosome Therapeutics; and founding scientist of FloNext srl, Spinoff of the University of Florence. FDC received personal fees from TEVA, Eli Lilly, and Novartis. LFI received speaker/advisory board fees from Eli Lilly and meeting/travel support by Lundbeck. GS reports advisory board, or speaker fees from Eli Lilly, Lundbeck, Novartis, and Teva and meeting/travel support by TEVA. RDI received speaker fees from Eli Lilly and TEVA. CT reports consultant, advisory board, or speaker fees from Allergan/AbbVie, Dompé, Eli Lilly, Pfizer, Medscape, Lundbeck, and Teva. CV reports speaker fees and support for attending meetings or travel from Eli Lilly. SG received honoraria and fees from Allergan/AbbVie, Eli Lilly, Teva, Novartis, and Lundbeck. CB received honoraria and fees from Allergan/AbbVie, Eli Lilly, Teva, Novartis, and Lundbeck.
MPP received consultant, advisory board, or speaker fees from Allergan/AbbVie, Almirall, Bruno Farmaceutici, Eli Lilly, Fidia, Lundbeck, Novartis, Teva, and Valeas, and support for attending meetings from Allergan/AbbVie, Almirall, Bruno Farmaceutici, Eli Lilly, Idorsia, Lundbeck, Novartis, and Teva. AF received speaker fee from Eli Lilly and support for attending meetings from Lilly and Teva. IR reports speaker fees and support for attending meetings or travel from Eli Lilly, Teva, and Novartis. The other authors report that they have no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Agnese Onofri and Luigi Francesco Iannone share first authorship.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Onofri, A., Iannone, L.F., Granato, A. et al. Validation of the Italian version of the Cluster Headache Impact Questionnaire (CHIQ). Neurol Sci 44, 2845–2851 (2023). https://doi.org/10.1007/s10072-023-06758-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10072-023-06758-0