Skip to main content
Download PDF

Psychometric evaluation of Azeri version of the head and neck cancer specific quality of life questionnaire (EORTC QLQ-H&N43)

Health and Quality of Life Outcomes volume 18, Article number: 248 (2020) Cite this article

Abstract

Background

Oral cancer surgery can have a deep effect on the quality of life in the patient both in terms of functional and psychological aspects. This study aimed to translate and validate the European Organization for Research and Treatment of Cancer head and neck cancer specific quality of life questionnaire (EORTC QLQ-H&N43) in Azerbaijan.

Methods

Forward-backward translation was applied in order to translate the EORTC QLQ-H&N43 from English into Azeri. Then, a sample of patients with oral cancer attending a teaching hospital affiliated to Azerbaijan Medical University completed the EORTC QLQ-C30 (the core cancer specific questionnaire), and the EORTC QLQ-H&N43. To evaluate psychometric properties of the QLQ-H&N43, known groups validity, convergent and divergent validity was performed. Internal consistency reliability was examined by estimating the Crornbach’s alpha coefficient.

Results

Ninety-six patients with confirmed diagnosis of oral cancer were entered into the study. The mean age of patients was 59.6 (SD = 10.7) years and 36 patients (37.5%) diagnosed as having stage IV and 10 patients (10.5%) were metastatic. The results obtained from comparing quality of life scores among these patients showed that the questionnaire was able to differentiate among patients who differed in stage and metastasis lending support to its validity. In addition convergent and divergent validity showed satisfactory results. The internal consistency of the multi-item scales as assessed by the Cronbach’s alpha coefficient showed acceptable results (alpha ranging from 0.66 to 0.78).

Conclusion

The findings suggest that in general the Azeri version of EORTC QLQ-H&N43 has satisfactory internal consistency reliability and validity, but additional psychometric evaluation is needed to draw firm conclusions.

Background

Oral cancer and its treatment have substantial effect on patients’ quality of life [1]. More importantly there are several factors that deepen this effect. For instance patients with oral cancer who receive surgery finds problems with appearance, speech, ability to breathe, eat and swallow [2]. All these could have both short- and long-term effect on patients’ physical, mental and social well-being [3]. Thus in clinical settings it is important to assess health-related quality of life in this population in order to evaluate treatment outcomes. As such questionnaires that have been developed by the European Organization for Research and Treatment of Cancer (EORTC) are very well known and are frequently used in outcome studies in oncology. For instance the EORTC QLQ-C30 was developed for measuring quality of life in all cancer patients (core cancer questionnaire) [4] and consequently for many anatomical sites specific instruments proposed to be used in conjunction with core questionnaire and currently they are in use worldwide. One of these instruments is the specific questionnaire that was developed for measuring quality of life in patients with head and neck cancer. The questionnaire first introduced with 35 items in 1999 and was named the EORTC QLQ-H&N35 [5, 6]. Since then the QLQ-H&N35 was translated and validated in different countries and a number of various languages including US English [7], Italian [8] Taiwan Chinese [9], Japanese [10], German [11], Cantonese (Hong Kong) [12], Greek [13], Chinese [14], Mexican Spanish [15], and Arabic [16].

However later on after comprehensive review by the EORTC Quality of Life Group and the EORTC Head and Neck Cancer Group it was updated and it was tested in Danish, Dutch, French, German, Greek, Hebrew, Italian, Japanese, Mandarin, Norwegian, Polish, Portuguese, Spanish, and Swedish following forward-backward translation of original English version of the questionnaire. This update version of the questionnaire contains 43 items and examines several important symptoms in head and neck cancer patients [17].

Since the Azeri version of the questionnaire was not available we aimed to translate and validate the QLQ-H&N43 questionnaire in Azerbaijan.

Methods

QLQ-H&N43

The EORTC QLQ-H&N43 is a supplementary module for the EORTC QLQ-C30 that measures quality of life in patients with had and neck cancers. It contains 43 items tapping into 6 multi-item and 13 single-item symptom subscales namely pain, swallowing, senses problems, speech problems, trouble with social eating, less sexuality, teeth, dry mouth/sticky saliva, body image, shoulder pain, skin problems, anxiety, trouble with social contact, opening mouth, coughing, lymphedema, problems wound healing, weight loss, neurological problems [17]. Each item is rated on a 4-point Likert scale and scores for each subscale ranges from 0 to 100 where higher scores indicate greater symptoms.

Translation

After asking permission from the EORTC Quality of Life Study Group, forward-backward procedure was applied to translate the questionnaires from English into Azeri. Two independent translators translated the original questionnaire into Azeri. Although there were some differences between two translations, the research team dealt with these differences and provided a single forward version of the questionnaire. For instance there were differences in translating skin ‘rash’ or ‘skin changed color’. Consequently two other bilingual translators back translated the questionnaires from Azeri into English. Accordingly a single back translated version of the questionnaire made available and it was checked with the original questionnaire for any errors or deviations. To check cultural relevance of the translation, and ease of comprehension five patients (not included in the current study) the instrument was pre-tested. However, since it was verified, the provisional version of the Azeri questionnaire was subjected to psychometric properties.

Psychometric evaluation

A cross sectional study was conducted on a sample of patients with confirmed oral cancer attending a teaching hospital affiliated to Medical University of Azerbaijan in Baku from year 2011 to 2017. They all completed the study questionnaires including the Azeri version of the EORTC QLQ-C30 and the EORTC QLQ-H&N43.

Statistical analysis

Validity was examined using known groups comparison. We hypothesized that the questionnaire should be able to differentiate between patients who are differing in stage and metastasis. In fact we hypothesized that patients with lower stage and no metastasis should score better than patients with higher stage and having metastasis. For comparison the Mann-Whitney and Krurskal-Wallis tests were used. In addition convergent and divergent validity (discriminant validity) was examined by estimating correlation coefficient between the EORTC QLQ-C30 and the EORTC QLQ-H&N43 scores. Due to skewed distribution of the data we used the Spearman’s rho coefficient. Correlation coefficients ranging 0.1–0.3 were considered low, 0.31–0.5 as moderate, and those exceeding 0.5 as high. Internal consistency reliability for multi-items subscales (having at least 3 items) was assessed using the Cronbach’s alpha coefficient. Alpha coefficient equal or greater than 0.7 was thought satisfactory.

Results

A total of 96 patients (67 men and 29 women) who underwent flap reconstruction for oral cancer in Azerbaijan were studied. The mean age of patients was 59.6 (SD = 10.7) years ranging from 30 to 82. In 47 cases, age was lower than 60 years. The characteristics of patients are given in Table 1. In addition the descriptive quality of life scores for all patients including the floor and ceiling effects are presented in Table 2.

Table 1 Demographic and clinical characteristics of the study sample (n = 96)
Full size table
Table 2 The EORTC QLQ-C30 and the QOL-H&N43 scores for the patients (n = 96)
Full size table

Validity of the QOL-H&N43

Known groups validity

As shown in Tables 3 and 4 although not significant, the QLQ-H&N43 differentiated patients who differed in stage and metastasis. As expected patients with the advanced disease scored higher almost on all symptoms and thus lending support to the validity of the questionnaire.

Table 3 The QLQ-H&N43 scores in patients with and without metastasis*
Full size table
Table 4 The QLQ-H&N43 scores by stage of the disease*
Full size table

Convergent and divergent validity (discriminant validity)

The correlation between the EORTC QLQ-C30 and the EORTC QLQ-H&N43 scores was examined. As expected almost in all instances relevant subscales showed acceptable correlations and those not related exhibited low correlations. The detailed results are shown in Table 5.

Table 5 Correlation between the EORTC QLQ-C30 functioning and global quality of life and the EORTC QLQ-H&N43 scores*
Full size table

Internal consistency reliability

The Cronbach’s alpha coefficient for the multi-item scales of the QLQ-H&N43 ranged from 0.66 to 0.78 indicating that the internal consistency of the Azeri version of the questionnaire was acceptable. The results are shown in Table 6.

Table 6 Cronbach’s α for the EORTC QLQ-H&N43 multi-item subscales
Full size table

Discussion

The findings from this study indicated that the Azeri version of the EORTC QLQ-H&N43 is a valid instrument for measuring quality of life in head and neck cancer patients. The internal consistency in five out of seven multi-item subscales was good and only the Cronbach’s alpha for social eating (0.66) and body image (0.69) were slightly lower than acceptable threshold (0.7). Perhaps these could be due to cultural differences that exist among different nations. For instance, social eating is less common in Azerbaijan.

The authors of the original study that introduced the EORTC QLQ-H&N43 indicated that they analyzed the data in accordance with the EORTC Quality of Life Group QLG Module Development Guidelines. Thus, to retain an item in the module, they used 8 predefined criteria such as relevance, floor and ceiling effects, item difficulty, and compliance. They also used additional measures including the Cronbach’s alpha coefficient to assess internal consistency for multi-item subscales. The Cronbach’s alpha for hypothesized subscales they included in the module ranged from 0.77 to 0.87 that were well above acceptable values [17].

To the best of our knowledge contrary to expectation other than the original study, the current study is the second independent one that reports on psychometric properties of the QLQ-H&N43. The Serbian version of the QLQ-H&N43 was the first study that reported on psychometric evaluation of the questionnaire. The study included 170 patients and found good internal consistency for 5 out of 7 multi-item subscales. The study also showed that the questionnaire had acceptable validly (known groups validity) where patients who differed in type of laryngectomy, adjuvant therapy or 5-year survival scored differently in the expected directions [18].

We used known groups comparison for the validity purpose. As expected the Azeri version of the questionnaire well differentiated among patients who differed in stage and metastasis, although in most instances the differences among patients were not significant. For instance as reported in Table 5, only 8 out of 19 subscale showed statistically significant difference between the two groups, and in Table 6, only 2 out of 19 subscale showed statistically significant difference. One explanation for such observation might be related to the small sample size in each group. In addition since we analyzed the data for all types of oral cancers, therefore one might argue that if there was an opportunity to analyze the data for each sub-types of oral cancer, then it was possible to obtain significant results for all measures assessed. Finally as pointed out by Polit and Yang when performing known groups validity the direction of differences for scores among sub-groups (as hypothesized) are more important than statistical significant level values [19].

Interestingly the authors of the QLQ-H&N43 stated that the QLQ-H&N35 could still be used in ongoing or future studies if the investigators prefer to use this head and neck module version. However, they believe in studies investigating multimodal treatment or targeted therapies, the QLQ-H&N43 might be more suitable to detect differences between patient groups [17].

This study has some limitations. The sample size was relatively small. Secondly we did not perform test-retest analysis to investigate the stability. It seems that for using the Azeri version of the QLQ-H&N43 in future outcome studies we still need to perform further psychometric evaluations. However, one should note that the QLQ-H&N43 should be used with conjunction of the EORTC QLQ-C30 core cancer questionnaire, which is now available in Azeri version, too [20].

Conclusion

The findings of this study suggest that in general the Azeri version of EORTC QLQ-H&N43 has satisfactory internal consistency reliability and validity, but additional psychometric evaluation is needed to draw firm conclusions.

Availability of data and materials

All data presented in this paper are available from the corresponding authors on a reasonable request.

Abbreviations

EORTC QLQ-C30:

The European Organization for Research and Treatment of Cancer core quality of life questionnaire

EORTC QLQ-H&N35:

The European Organization for Research and Treatment of Cancer head and neck cancer specific quality of life questionnaire- 35 items

EORTC QLQ-H&N43:

The European Organization for Research and Treatment of Cancer head and neck cancer specific quality of life questionnaire-43 items

References

  1. Parkar SM, Shah MN. A relationship between quality-of-life and head and neck cancer: a systemic review. South Asian J Cancer. 2015;4(4):179–82.

    Article  Google Scholar 

  2. Høxbroe Michaelsen S, Grønhøj C, Høxbroe Michaelsen J, Friborg J, von Buchwald C. Quality of life in survivors of oropharyngeal cancer: a systematic review and meta-analysis of 1366 patients. Eur J Cancer. 2017;78:91–102.

    Article  Google Scholar 

  3. Clasen D, Keszte J, Dietz A, Oeken J, Meister EF, Guntinas-Lichius O, Pabst F, Büntzel J, Jenzewski EM, Singer S, Meyer A. Quality of life during the first year after partial laryngectomy: longitudinal study. Head Neck. 2018;40(6):1185–95.

    Article  Google Scholar 

  4. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC, Kaasa S, Klee M, Osoba D, Razavi D, Rofe P, Schraub S, Sneeuw K, Sullivan M, Takeda F. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.

    Article  CAS  Google Scholar 

  5. Bjordal K, Ahlner–Elmqvist M, Tollesson E, Jensen AB, Razavi D, Maher EJ, Kaasa S. Development of a European Organization for Research and Treatment of Cancer (EORTC) questionnaire module to be used in quality of life assessments in head and neck cancer patients. EORTC quality of life study group. Acta Oncol. 1994;33:879–85.

    Article  CAS  Google Scholar 

  6. Bjordal K, Hammerlid E, Ahlner-Elmqvist M, de Graeff A, Boysen M, Evensen JF, Biörklund A, de Leeuw JR, Fayers PM, Jannert M, Westin T, Kaasa S. Quality of life in head and neck cancer patients: validation of the European Organization for Research and Treatment of Cancer quality of life questionnaire-H&N35. J Clin Oncol. 1999;17(3):1008–19.

    Article  CAS  Google Scholar 

  7. Sherman AC, Simonton S, Adams DC, Vural E, Owens B, Hanna E. Assessing quality of life in patients with head and neck cancer: cross-validation of the European Organization for Research and Treatment of Cancer (EORTC) quality of life head and neck module (QLQ-H&N35). Arch Otolaryngol Head Neck Surg. 2000;126(4):459–67.

    Article  CAS  Google Scholar 

  8. Zotti P, Lugli D, Vaccher E, Vidotto G, Franchin G, Barzan L. The EORTC quality of life questionnaire-head and neck 35 in Italian laryngectomized patients. Qual Life Res. 2000;9(10):1147–53.

    Article  CAS  Google Scholar 

  9. Chie WC, Hong RL, Lai CC, Ting LL, Hsu MM. Quality of life in patients of nasopharyngeal carcinoma: validation of the Taiwan Chinese version of the EORTC QLQ-C30 and the EORTC QLQ-H&N35. Qual Life Res. 2003;12(1):93–8.

    Article  CAS  Google Scholar 

  10. Toth G, Sakaguchi T, Mikami Y, Hirose H, Tsukuda M. A pilot study of the translation, cultural adaptation and validation of the EORTC head and neck cancer quality of life questionnaire module (QLQ-H&N35) for use in Japan. Auris Nasus Larynx. 2005;32(2):175–83.

    Article  Google Scholar 

  11. Singer S, Wollbrück D, Wulke C, Dietz A, Klemm E, Oeken J, Meister EF, Gudziol H, Bindewald J, Schwarz R. Validation of the EORTC QLQ-C30 and EORTC QLQ-H&N35 in patients with laryngeal cancer after surgery. Head Neck. 2009;31(1):64–76.

    Article  Google Scholar 

  12. Bower WF, Vlantis AC, Chung TM, Cheung SK, Bjordal K, van Hasselt CA. Quality of life in head and neck cancer patients after surgical resection: translation into Cantonese and validation of the EORTC QLQ-H&N35. Acta Otolaryngol. 2009;129(7):779–85.

    Article  CAS  Google Scholar 

  13. Nalbadian M, Nikolaidis V, Nikolaou A, Themelis C, Kouloulas A, Vital V. Psychometric properties of the EORTC head and neck-specific quality of life questionnaire in disease-free Greek patients with cancer of pharynx and larynx. Qual Life Res. 2010;19(5):761–8.

    Article  Google Scholar 

  14. Yang Z, Meng Q, Luo J, Lu Q, Li X, Li G, Wan C. Development and validation of the simplified Chinese version of EORTC QLQ-H&N35 for patients with head and neck cancer. Support Care Cancer. 2012;20(7):1555–64.

    Article  Google Scholar 

  15. Carrillo JF, Ortiz-Toledo MA, Salido-Noriega Z, Romero-Ventura NB, Ochoa-Carrillo FJ, Oñate-Ocaña LF. Validation of the Mexican Spanish version of the EORTC QLQ-H&N35 instrument to measure health-related quality of life in patients with head and neck cancers. Ann Surg Oncol. 2013;20(5):1417–26.

    Article  Google Scholar 

  16. Ouattassi N, Benmansour N, ElFakir S, Nejjari C, Alami MN. Translation and validation of EORTC QLQ-H&N 35 into Moroccan Arabic for ENT head and neck cancer patients in Morocco. Eur Arch Otorhinolaryngol. 2016;273(9):2727–34.

    Article  CAS  Google Scholar 

  17. Singer S, Araújo C, Arraras JI, Baumann I, Boehm A, Brokstad Herlofson B, Castro Silva J, Chie WC, Fisher S, Guntinas-Lichius O, Hammerlid E, Irarrázaval ME, Jensen Hjermstad M, Jensen K, Kiyota N, Licitra L, Nicolatou-Galitis O, Pinto M, Santos M, Schmalz C, Sherman AC, Tomaszewska IM, Verdonck de Leeuw I, Yarom N, Zotti P, Hofmeister D, EORTC Quality of Life and the EORTC Head and Neck Cancer Groups. Measuring quality of life in patients with head and neck cancer: Update of the EORTC QLQ-H&N Module, Phase III. Head Neck. 2015;37(9):1358–67.

    Article  Google Scholar 

  18. Trivic SK, Trivic A, Singer S, Milovanovic J, Stankovic P, Mikic A, Vukasinovic M, Djordjevic V, Jotic A, Folic M, Stevanovic D. European Organization for Research and Treatment of Cancer quality of life questionnaire-head and neck module, updated version: preliminary psychometric data from Serbian laryngectomized patients. Head Neck. 2016;38(Suppl 1):E916–24.

    Article  Google Scholar 

  19. Polit DF, Yang FM. Measurement and the measurement of change: a primer for the health professions. Philadelphia: Lippincott Williams & Wilkins; 2015.

    Google Scholar 

  20. Davudov MM, Harirchi I, Amiraliyev N, Mehtiyeva E, Mirzajani Z, Amiraliyev K, Rustamli N, Zebardast J, Montazeri A. The Azeri version of European Organization for Research and Treatment of Cancer Core quality of life questionnaire (EORTC QLQ-C30): translation and validation. Asian Pac J Cancer Prev. 2020;21:267–71.

    Article  Google Scholar 

Download references

Acknowledgments

We are grateful to all patients who participated in the study. We are also grateful to all academic staff in oral and maxillofacial surgery department and oncology department of Azerbaijan Medical University for help and support.

Disclosure of results before publication

The results have not been presented or published before.

Funding

Azerbaijan Medical University and Cancer Institute of Tehran University of Medical Sciences supported the study.

Author information

Authors and Affiliations

  1. Cancer Institute, Tehran University of Medical Sciences, Tehran, Iran

    Mahammad M. Davudov, Iraj Harirchi, Zoheir Mirzajani & Jayran Zebardast

  2. Department of Oral and Maxillofacial Surgery, Azerbaijan Medical University, Baku, Azerbaijan

    Mahammad M. Davudov, Chingiz Rahimov, Zoheir Mirzajani, Kanan Amiraliyev & Narmin Rustamova

  3. Department of Oncology, Azerbaijan Medical University, Baku, Azerbaijan

    Namig Amiraliyev

  4. Population Health Research Group, Health Metrics Research Center, Iranian Institute for Health Sciences Research, ACECR, Tehran, Iran

    Ali Montazeri

  5. Faculty of Humanity Sciences, University of Science and Culture, ACECR, Tehran, Iran

    Ali Montazeri

Authors
  1. Mahammad M. Davudov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chingiz Rahimov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Iraj Harirchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zoheir Mirzajani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Namig Amiraliyev
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kanan Amiraliyev
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Narmin Rustamova
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jayran Zebardast
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ali Montazeri
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MMD and ZM were the main investigators. KA and NR collected the data and wrote the first draft. IH and CR supervised the study. NA operated patients and contributed to study design. JZ contributed to data entry and data analysis. AM supervised the study and contributed to analysis and provided the final draft. All authors read and approved the manuscript.

Corresponding author

Correspondence to Ali Montazeri.

Ethics declarations

Ethics approval and consent to participate

The ethics committee of Tehran University of Medical Sciences approved the study. All patients complete written informed consent before the study commence.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Davudov, M.M., Rahimov, C., Harirchi, I. et al. Psychometric evaluation of Azeri version of the head and neck cancer specific quality of life questionnaire (EORTC QLQ-H&N43). Health Qual Life Outcomes 18, 248 (2020). https://doi.org/10.1186/s12955-020-01500-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-020-01500-2

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us