Translation and validation of the EORTC brain cancer module (EORTC QLQ-BN20) for use in Iran
Health and Quality of Life Outcomes volume 10, Article number: 54 (2012)
The aim of this study was to translate the EORTC quality of life questionnaire for brain cancer, the QLQ-BN20, into Persian, and to evaluate its psychometric properties when used among brain cancer patients in Iran.
A standard backward and forward translation procedure was used to generate the Persian language version of the QLQ-BN20. The QLQ-BN20 was administered together with the QLQ-C30 to 194 patients diagnosed with primary brain cancer. Multitrait scaling and confirmatory factor analysis (CFA) were used to evaluate the hypothesized scale structure of the questionnaire. Internal consistency reliability was estimated with Cronbach’s alpha. The ability of the QLQ-BN20 to distinguish between patient subgroups formed on the basis of performance status and cognitive status was evaluated, as was the responsiveness of the questionnaire to changes in performance status over time.
Multitrait scaling and CFA results confirmed the hypothesized scale structure. The measurement model was consistent across men and women. Internal consistency reliability of the multi-item scales ranged from 0.74 to 0.89. The QLQ-BN20 distinguished clearly between patients with relatively good versus poor performance and cognitive status, and changes in scores over time reflected changes observed in performance status ratings.
These results support the validity and reliability of the QLQ-BN20 for use among Iranian patients diagnosed with primary brain cancer. Future studies should examine the psychometrics of the questionnaire when used in patients with brain metastasis.
It is estimated that 22,020 patients are diagnosed annually with brain cancer in the United States . In Iran, brain cancer is the 11th most common cancer, with an annual incidence rate of approximately 550 cases for males and 800 for females . Although brain cancer is relatively rare, it is a disease with serious symptoms and a poor prognosis. [1, 3]. The 5-year relative survival rate is 36% .
There is no definite cure for patients with brain cancer. Therefore, the primary aim of treatment is to prolong the patient's life and to palliate symptoms . The treatment for the most common brain tumors, gliomas, includes neurosurgery, followed by adjuvant radiotherapy, chemotherapy or combined chemoradiotherapy. All of these treatments may cause significant complications or have toxic side-effects [5, 6]. Therefore, in order to select the best treatment for a specific patient it is necessary to take into consideration the stage of the disease, any risk associated with the given treatment and the patient's general health. An assessment of patient-reported outcomes, and more specifically health-related quality of life (HRQOL), is very important in this respect.
Two well-known, generic questionnaires for assessing the HRQOL of patients with cancer include The European Organization for Research and Treatment of Cancer Core Questionnaire (the EORTC QLQ-C30) and the Functional Assessment of Cancer Therapy-General (FACT-G) [7, 8]. These generic questionnaires are applicable to all types of patients with cancer. Both the EORTC and the FACT measurement systems supplement their core questionnaire with condition-specific questionnaires designed to capture functional limitations and symptoms experienced by specific populations of patients. Both the EORTC and the FACT systems have developed questionnaires specific to brain cancer. The EORTC brain cancer-specific questionnaire, the QLQ-BN20, has been validated and has been translated into a number of primarily European languages [9, 10]. The aim of the present study was to translate the QLQ-BN20 into the dominant language in Iran, Persian (spoken by approximately two-thirds of the population), and to generate psychometric data regarding the questionnaires reliability and validity when used among Iranian brain cancer patients.
Translation of the QLQ-BN20
The QLQ-BN20 questionnaire contains 20 items organized into four scales; future uncertainty (3 items), visual disorder (3 items); motor dysfunction (3 items); and communication deficit (3 items), and seven single items (headaches, seizures, drowsiness, hair loss, itchy skin, weakness of legs, and bladder control) [9, 10]. All items are rated on a four-point Likert-type scale (‘not at all’, ‘a little’, ‘quite a bit’ and ‘very much’), and are linearly transformed to a 0-100 scale, with higher scores indicating more severe symptoms .
We obtained permission from the EORTC Quality of Life Department to generate the Iranian version of the QLQ-BN20. The aim of the translation procedure was to provide an Iranian version of the questionnaire that was conceptually equivalent to the original English language version.
We used the standard EORTC translation procedures . Briefly, two trained bilingual Iranians independently translated the QLQ-BN20 into Persian. A specialized translator (project manager; AHP) compared these two versions, evaluated the level of difficulty in terms of translation as well as the equivalence of each item and response scale. The translators compared their translations, reconciled their discrepancies and arrived at a unified Persian version of the questionnaire. Subsequently, the provisional Persian version was independently translated back into U.S. English by two additional translators who were native English speakers. The Project Manager compared the English translations with the original questionnaire, and any discrepancies between the back-translations were resolved with the translators. This process went through two iterations, and the documentation was reviewed by the EORTC Quality of Life Group. The resulting Persian version of the QLQ-BN20 was administered to 10 brain tumor patients (6 women and 4 men; age range = 28–69 years). All patients were able to complete the questionnaire without assistance, and reported that the questions were clear and easy to complete.
Validation of the Persian version of the QLQ-BN20
Study participants were patients with primary brain cancer who had been referred to Shariati Hospital and the Cancer Institute of Iran in Tehran. These centers are national referral centers for cancer treatment in Iran. Inclusion criteria were; a histologically verified diagnosis of brain cancer, older than 18 years, fluency in Persian, and a life expectancy of at least 4 weeks. All patients provided written informed consent. Patients with a previous cancer diagnosis, those who were too frail and those who were unable to understand the questionnaire or unwilling to provide written informed consent, were excluded. The study protocol was approved by the Ethical Committee of Tehran University of Medical Sciences. All participants gave their written informed consent.
Patients were recruited into the study after surgery and before chemotherapy (CT), radiotherapy (RT) or chemoradiotherapy (CRT). Patients completed the validated Persian version of the QLQ-C30  and the Persian version of the QLQ-BN20 before the start of the CT, RT or CRT, and again approximately four weeks later. We obtained sociodemographic and clinical information via questionnaire and medical record review. This included age, sex, education, tumor type, and surgery. Additionally, the Mini-Mental State Examination (MMSE) and The Karnofsky Performance Status Scale (KPS) were administered to all patients.
The questionnaire was completed by interview if the patients were illiterate. The interviewer read the questions to the patients without embellishment or explanation, and presented the possible responses and elicited patients’ choices without coaching.
Ceiling and floor effects were calculated for all QLQ- BN20 scales. A ceiling or floor effect lower than 15% indicates acceptable measurement standards .
We evaluated the scale structure of the QLQ-BN20 in several ways. First, we used multitrait scaling to assess item convergent and discriminant validity. We calculated Spearman correlation coefficients between each item and its own scale, corrected for overlap. Item-scale correlations of 0.40 or greater were taken as evidence of item convergent validity . We also calculated the correlations between each item and the other scales. We expected that items would correlate more highly (two times the standard error, 1/√N) with their own scale than with other scales.
Second, we used confirmatory factor analysis (CFA) to test the hypothesized model fit. We employed three categories of indices: absolute fit indices, incremental fit indices and parsimony fit indices. An absolute fit index assesses how well an a priori model reproduces the sample data. We used chi-square, root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) as absolute fit indices [16, 17]. Chi-square assesses the magnitude of discrepancy between the sample and fitted covariance matrices . However, the chi-square statistic is sensitive to sample size and therefore with large samples, is not a practical test of model fit. RMSEA incorporates a penalty function for poor model parsimony . RMSEA, values in the range of 0.05–0.08 were taken to indicate acceptable fit, values in the range of 0.08–0.10 to indicate marginal fit, and values larger than 0.10 to indicate poor fit . SRMR is the square root of the difference between the residuals of the sample covariance matrix and the hypothesized covariance model. Values of the SRMR less than 0.10 are generally considered favorable.
We used the non-normed fit index (NNFI, also known as the Tucker-Lewis index) and the comparative fit index (CFI) to estimate incremental fit. The suggested cut off for NNFI and CFI is 0.90 or greater.
We computed the parsimonious normed fit index (PNFI) to assess the parsimony the model [17, 19]. For PNFI we did not employ any absolute standard of model fit, but rather simply noted that higher PNFI values reflect more parsimonious fit . We used weighted least squares (WLS) as the method of estimation.
In addition, we examined the model invariance across gender. To compare the factor loadings across gender, we applied multi-group measurement invariance analysis. There are different terminologies in the literature for tests of invariance. We used two terms of factorial invariance (i.e., configural invariance and metric invariance). In configural invariance, the pattern of fixed- and free-factor loadings is constant across groups, while the magnitudes of these loadings are not constrained to be equal. For metric invariance, the magnitudes of factor loadings for particular items are invariant across groups . As suggested by Cheung, differences in practical fit indices such as CFI and NNFI not larger than 0.01 between NNFI or CFI values were considered as evidence of model invariance . We hypothesized that the Persian version of QLQ-BN20 would perform similarly across gender.
We estimated internal consistency reliability of the QLQ-BN20 scales with Cronbach's coefficient alpha. An alpha coefficient of 0.70 or higher was considered acceptable for purposes of group comparisons .
“Known groups” or clinical validity was evaluated by comparing the QLQ-BN20 scores between patients grouped according to KPS and MMSE scores. We hypothesized that patients with higher KPS (>80) would score better on the QLQ-BN20 than those with lower KSP (≤80) [9, 10]. We also anticipated that patients with higher MMSE (≥27) would score better on the QLQ-BN20 than those with lower MMSE (<27) . Analysis of covariance (ANCOVA) was used to test for group differences. To control for probability of type I errors due to multiple comparisons, we used an adjustment procedure developed by Benjamini and Hochberg. This procedure controls the false discovery rate. The false discovery rate level was set at 5% [22, 23]. Effect sizes (Cohen’s d statistic) were calculated to estimate the magnitude of observed, statistically significant group differences .
Finally, to evaluate the responsiveness of the QLQ-BN20 to change in health status over time, we classified patients as having worse, stable or improved KPS scores from baseline to follow-up. We evaluated changes in QLQ-BN20 scores as a function of change in KPS with analysis of covariance (ANCOVA), adjusting for baseline values.
We used SPSS 16.0 for Windows and LISREL 8.8 for data analyses. A p value <0.05 was considered as statistically significant.
In total, 194 patients were recruited into the study. The patients' baseline characteristics are provided in Table 1. The mean age of the patients was 42 ± 5 years, with a range between 18 and 80 years. Forty-seven percent of the patients was female. The majority of patients (66%) was married, and 46% had completed secondary school or college.
Astrocytomas (37.1%) constituted the most frequent tumor type. Slightly more than one-third of patients were receiving CT, one-third RT, and slightly less than one-third CT + RT. Only seven patients (3.65%) were lost to follow-up assessment due to death.
As shown in Table 2, all subscales of the QLQ-BN20 were found to be normally distributed (Kolmogorov-Smirnov, p >0.05). There was no ceiling effect for any of the BN20 subscales. However, some floor effects were observed for seizures, headaches, itchy skin and bladder control.
Results of the multitrait scaling analysis are presented in Table 3. All items correlated 0.60 or higher with their own scale, corrected for overlap. There were no scaling errors, with all items correlating two standard errors or higher with their own scales than with other scales.
Results of the CFA analysis indicated that all of the goodness of fit indices supported the four-factor model for the QLQ-BN20: χ 2 = 92.51, degree of freedom = 59, p <0.001, CFI = 1.0, RMSEA = 0.068, SRMR = 0.066, NNFI = 1.0, and PNFI = 0.73. Moreover, all factor loadings were significant, ranging from 0.24 to 0.89 (Figure 1). Additional analyses were based on a four-factor model that constrained the factor loadings to be equal across gender groups. The measurement model revealed an acceptable model fit for the QLQ-BN20: χ 2 = 190.5, degree of freedom = 133, p <0.001, CFI = 0.923, SRMR = 0.089, NNFI = 0.911, PNFI = 0.704, RMSEA = 0.080. Moreover, metric invariance showed good fit indices: χ 2 = 205.15, degree of freedom = 133, p <0.001, CFI = 0.927, SRMR = 0.091, NNFI = 0.915, PNFI = 0.753, RMSEA = 0.079. These results support the stability of the hypothesized factor structure across sexes.
The internal consistency reliability of all scales of the QLQ-BN20 was acceptable for group comparisons (Table 2). Cronbach's alpha coefficient for all scales was above the 0.70 threshold. Communication deficit had the highest internal consistency (0.89 at both baseline and follow-up) while the lowest was for future uncertainty (0.80, 0.74).
Results from the known group comparisons between subgroups of patients formed on the basis of performance status and MMSE are summarized in Table 4. As hypothesized, patients with better KPS and MMSE scores had significantly better scores on all of the QLQ-BN20 multi-item scales than patients with lower KPS and MMSE scores. Effect sizes (Cohen’s d statistic) ranged from 0.18 to 1.56 for the KPS, and from 0.20 to 0.65 for the MMSE.
Finally, changes in QLQ-BN20 scores over time as a function of changes in KPS scores (worse, stable or improved performance status) are reported in Table 5. The results supported the ability of all of the QLQ-BN20 scales to detect such shifts in KPS, with the exception of seizures, drowsiness, visual disorder and hair loss which did not vary as a function of change in KPS.
In this paper we have reported on the results of the translation and validation of the Persian version of the QLQ-BN20 for use with primary brain cancer patients in Iran. This included examination of the hypothesized scale structure of the questionnaire, internal consistency reliability estimation, known groups validity testing, and evaluation of the responsiveness of the QLQ-BN20 to changes over time in health status.
Overall, the results lend strong support to the psychometric robustness of the questionnaire. The large majority of patients completed all items and there were very minor missing items. Ceiling effects were absent while some floor effects were observed for items assessing seizures, hair loss, itchy skin and bladder control. A possible reason for this latter finding could be that most of the patients were newly-diagnosed and had only recently initiated adjuvant treatment. With longer follow-up, more variance in scores for these symptoms could be expected. Our results are in accordance with previous studies [9, 10].
The results of both the mulitrait scaling and CFA provided strong support for the hypothesized scale structure of the QLQ-BN20. To our knowledge, ours is the first study to employ CFA in the evaluation of the QLQ-BN20 measurement model. Some studies have reported that females with brain tumors tend to report worse QOL than their male counterparts [25–27]. It is important to determine if these gender differences also affect the scale structure of the questionnaire. . Toward this end, we assessed the factorial invariance of the QLQ-BN20. The results of the CFA demonstrated that the hypothesized four-factor model fit the data of both the male and female samples well, supporting invariance. To our knowledge, ours is the first study to assess factor structure of the QLQ-BN20 for patients with primary brain tumours using confirmatory factor analysis We would recommend that this be undertaken in other cultural and language settings as well.
The internal consistency reliability of the QLQ-BN20 scales exceeded the recommended 0.70 level, with most coefficients in the 0.80 to 0.90 range. These reliability estimates are even higher than those reported in previous studies with English-speaking and multi-national samples [9, 10].
The QLQ-BN20 was able to distinguish clearly between subgroups of patients formed on the basis of their performance status and cognitive status, and was responsive to change over time in performance status. Again, these results are in line with those of previous studies [9, 10].
Our study had several limitations that should be noted. First, we recruited a convenience sample of patients. Nevertheless, we believe that the sample sufficiently represents the population of interest. Second, although the overall sample size was sufficient for the analyses that we conducted, there were insufficient numbers available to carry out subgroup analyses of more homogenous groups of brain cancer patients. This is something that could be done in future studies. Finally, the study was of relatively short duration, and thus we had a relatively short period evaluate the responsiveness of the QLQ-BN20 over time. Use of the questionnaire in large, prospective studies should provide the opportunity to examine the responsiveness of the questionnaire over long periods of time.
In conclusion, the results of our study support the feasibility, measurement model, reliability and validity the QLQ-BN20 in assessing the HRQOL of Iranian patients with primary brain cancer. The availability of this questionnaire in Persian will facilitate the assessment of the health-related quality of life of brain cancer patients in Iran, particularly in the context of clinical research, but also potentially in clinical practice setting. Future studies are needed to examine the psychometric properties of the Iranian version of the QLQ-BN20 among patients with brain metastases.
Jemal A, Siegel R, Xu J, Ward E: Cancer statistics, 2010. CA: a cancer j clinicians 2010, 60(5):277–300. 10.3322/caac.20073
Iran center for disease control and prevention, cancer office: Iranian annual of national cancer registration report 2006–2007. Ministry of health, Tehran; 2008.
US News & World Report: Brain Tumor Channel: Cleveland Clinic [cited 2012 May]. Available from: URL: http://health.usnews.com/health-conditions/cancer/brain-tumor
Kirkbride P, Tannock IF: Trials in palliative treatment – have the goal posts been moved? Lancet Oncology 2008, 9: 186–187. 10.1016/S1470-2045(08)70041-X
Stupp R, Mason WP, van den Bent MJ, et al.: Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N Engl J Med 2005, 352: 987–996. 10.1056/NEJMoa043330
Brandsma D, van den Bent MJ: Molecular targeted therapies and chemotherapy in malignant gliomas. Curr Opin Oncol 2007, 19(6):598–605. 10.1097/CCO.0b013e3282f0313b
Aaronson NK, Ahmedzai S, Bergman B, et al.: The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Nat Cancer Institute 1993, 85(5):365–376. 10.1093/jnci/85.5.365
Cella DF, Tulsky DS, Gray G, et al.: The Functional Assessment of Cancer Therapy Scale: development and validation of the general measure. J oncology: official j Am Soc Clin Oncology 1993, 11(3):570–579.
Osoba D, Aaronson NK, Muller M, et al.: The development and psychometric validation of a brain cancer quality-of-life questionnaire for use in combination with general cancer specific questionnaires. Quality of Life Res 1996, 5(1):139–150. 10.1007/BF00435979
Taphoorn MJ, Claassens L, Aaronson NK, Coens C, Mauer M, Osoba D, Stupp R, Mirimanoff RO, van den Bent MJ, Bottomley A: EORTC Quality of Life Group, and Brain Cancer, NCIC and Radiotherapy Groups. An international validation study of the EORTC brain cancer module (EORTC QLQ-BN20) for assessing health-related quality of life and symptoms in brain cancer patients. Eur J Cancer 2010, 46(6):1033–1040. 10.1016/j.ejca.2010.01.012
Fayers PM, Aaronson NK, Bjordal K, Groenvold M, Curran D, Bottomley A: on behalf of the EORTC Quality of Life Group. 3rd edition. EORTC, Brussels; 2001.
Cull A, Sprangers MAG, Aaronson NK: On behalf of the EORTC Quality of Life Study Group. European Organization for Research and Treatment of Cancer quality of life study group translation procedure, Internal report of the EORTC Study Group on Quality of Life; 1994.
Montazeri A, Harirchi I, Vahdani M, Khaleghi F, Jarvandi S, Ebrahimi M, Haji-Mahmoodi M: The European Organization for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-C30): translation and validation study of the Iranian version. Supportive Care in Cancer 1999, 7(6):400–406. 10.1007/s005200050300
Terwee CB, Bot SD, de Boer MR, et al.: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007, 60: 34–42. 10.1016/j.jclinepi.2006.03.012
Fayers PM, Machin D: Quality of Life: Assessment, Analysis and Interpretation. John Wiley & Sons, Chichester; 2000.
Browne MW, Cudeck R: Alternative ways of assessing model fit. Sociological Methods & Res 1992, 21: 230–258. 10.1177/0049124192021002005
Sivo SA, Fan X, Witta EL, Willse JT: The search for optimal cutoff properties: Fit index criteria in structural equation modeling. J Exp Educ 2006, 74: 267–288. 10.3200/JEXE.74.3.267-288
Hu L, Bentler PM: Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model 1999, 6: 1–55. 10.1080/10705519909540118
Enders CK, Bandalos DL: The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Struct Equ Model 2001, 8: 430–457. 10.1207/S15328007SEM0803_5
Cheung GW, Rensvold RB: Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model 2002, 9: 233–255. 10.1207/S15328007SEM0902_5
Nunnally JC, Bernstein IR: Psychometric Theory. 3rd edition. McGraw-Hill, New York; 1994.
Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Statistical Society: Series B 1995, 57: 289–300. Retrieved http://www.jstor.org
Benjamini Y, Krieger AM, Yekutieli D: Adaptive linear step-up procedures that control the false discovery rate. Biometrika 2006, 93: 491–507. 10.1093/biomet/93.3.491
Cohen J: A Power Primer. Psychol Bull 1992, 112(1):155–159.
Janda M, Steginga S, Langbecker D, Dunn J, Walker D, Eakin E: Quality of life among patients with a brain tumor and their carers. J Psychosom Res 2007, 63(6):617–623. 10.1016/j.jpsychores.2007.06.018
Mainio A, Hakko H, Niemelä A, Koivukangas J, Räsänen P: Gender difference in relation to depression and quality of life among patients with a primary brain tumor. Eur Psychiatry 2006, 21(3):194–199. 10.1016/j.eurpsy.2005.05.008
Niemelä A, Koivukangas J, Herva R, Hakko H, Räsänen P: Gender Difference in Quality of Life among Brain Tumor Survivors. J Neurol Neurophysiol 2011, 2: 118.
Fischer R, Ferreira MC, Assmar E, Redford P, Harb C, Glazer S, Cheng BS, Jiang DY, Wong C, Kumar N, Kärtner J, Hofer J, Achoui M: Individualism-collectivism as descriptive norms: Development of a subjective norm approach to culture measurement. Journal of Cross-Cultural Psychology 2009, 40: 187–213. 10.1177/0022022109332738
The authors declare that they have no competing interests.
AKh and AHP were responsible for designing the study, analyzing and interpreting the data, and drafting the manuscript. ShKA and AM were responsible for data collection. NKA interpreted the data, and revised the manuscript. The analyses were performed by MY. All authors have read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Khoshnevisan, A., Yekaninejad, M.S., Ardakani, S.K. et al. Translation and validation of the EORTC brain cancer module (EORTC QLQ-BN20) for use in Iran. Health Qual Life Outcomes 10, 54 (2012). https://doi.org/10.1186/1477-7525-10-54