- Open Access
Validity and reliability of EQ-5D-3L for breast cancer patients in Korea
Health and Quality of Life Outcomesvolume 13, Article number: 203 (2015)
Recently, breast cancer incidence and prevalence has been increasing. Patients' health related quality of life is important considerations in the treatment of breast cancer. The EQ-5D-3L is one of most popular instruments to measure health related quality of life. This study was aimed to evaluate the validity and reliability of EQ-5D-3L in post-operative breast cancer patients from Korea.
A total of 827 patients visiting the ambulatory cancer center of 1 tertiary hospital after breast cancer surgery self-administered the EQ-5D-3L and Functional Assessment of Cancer Therapy-Breast Cancer (FACT-B). We evaluated known-group validity using differences in the EQ-5D-3L index and EQ-VAS score according to demographic and clinical data. The discriminatory ability of the EQ-5D-3L was determined by comparing the mean FACT-B subscale scores between subjects with no problems and subjects with moderate or severe problems in each EQ-5D-3L dimension. Construct validity was evaluated by Pearson correlation coefficients among the EQ-5D-3L index and FACT-B subscales, respectively. Reliability was assessed in terms of test-retest reliability using Cohen’s kappa value and intra-class correlation coefficient (ICC).
The EQ-5D-3L index and EQ-VAS score were higher in the educated, current radiotherapy and unmarried groups. The correlation of EQ-5D-3L index and subscales for the FACT-B was highest in physical well-being (r = 0.553) and lowest in social well-being (r = 0.199). For reliability, the Kappa values’ range was from 0.32 to 0.70, and ICCs of the EQ-5D-3L index and EQ-VAS scores were 0.70 and 0.48, respectively.
This study indicated that the EQ-5D-3L could be a valid health related quality of life instrument for postoperative breast cancer patients.
Breast cancer is the most frequently diagnosed cancer in females and the leading cause of cancer-related deaths in both economically developed and developing countries . In Korea, the crude breast cancer incidence rate was 63.7 per 100,000 persons in 2011 and has been increasing since 1999 . The 5-year survival rate for breast cancer patients has improved, with 91.3 % reported between 2007 and 2011 in Korea . Recent years have led to a range of treatments for breast cancer, and development of additional therapeutics is continually in progress.
Health-related quality of life (HRQoL) and traditional clinical outcomes (i.e., survival rate or tumor responses) are considered as significant outcomes of cancer care . Tools to assess HRQoL are classified into disease-specific instruments and generic instruments. Preference-based instruments (the Health Utility Index [4, 5], the EuroQol 5D (EQ-5D-3L) , or the Short Form 6D ) are generic instrument generating utilities that yield a measure that combines both the length and quality of life . Disease-specific instruments can be more sensitive for detecting clinically important differences or changes in specific disease groups in general, although general instrument is occasionally not inferior to disease-specific instrument . However, they do not compare HRQoL of patients with other diseases . Resource allocation for health care has been a critical issue, not only for its effectiveness, but also for efficiency of care; hence, it is important for guiding healthcare policy.
The EQ-5D-3L, a generic preference-based instrument that is widely used to measure HRQoL, can be used to assign preference values to various health states . Additionally, EQ-5D-3L is a unique instrument with quality weight tariffs for use in Korean populations . The psychometric properties of the Korean EQ-5D-3L have been studied for rheumatic disease  and colon cancer  patients. However, studies on validity and reliability of the EQ-5D-3L in breast cancer patients in Korea are scarce . Hence, we evaluated the validity and reliability of the EQ-5D-3L to measure the HRQoL in post-operative breast cancer patients from Korea.
Subjects and settings
A consecutive series of breast cancer patients who had surgery as a primary treatment at the ambulatory cancer center of 1 tertiary hospital in Seoul, Korea from February 2012 to May 2012, participated in this study. All participants provided informed written consent prior to taking our survey and a total of 1,002 subjects were consecutively recruited. The initial 150 recruited subjects were requested to complete an EQ-5D-3L questionnaire 1 week later via mail to assess the test-retest reliability of each patient. The survey was self-administered in the waiting room at the center with or without research nurse assistance. The Institutional Review Board of Asan Medical Center approved the study (IRB approval number: 2012–0010).
Our questionnaire included requests for demographic information (age, sex, level of education, marital status, and occupation) and 2 HRQOL instruments (EQ-5D-3L and Functional Assessment of Cancer Therapy-Breast Cancer [FACT-B] version 4). Clinical information (the type of surgery, American Joint Committee on Cancer [AJCC] 7th stage at diagnosis, duration of disease since diagnosis, and current treatment for breast cancer), was obtained from the cancer registry database of the center.
The EQ-5D-3L is an instrument widely used to measure and evaluate the general health status of a patient in 5 dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) with 3 levels as follows: 1, no problems; 2, some or moderate problems; and 3, extreme problems. The EQ-5D-3L provides a simple descriptive profile and a single index of health status . The EQ-VAS records the respondent’s self-rated health on a vertical, visual analogue scale where the endpoints are classified as follows: ‘best imaginable health state’ =100 and ‘worst imaginable health state’ =0 .
The FACT-B is a validated multi-dimensional self-reported questionnaire with a 36-item questionnaire that measures both the 27-item general QoL associated with cancer (Functional Assessment of Cancer Therapy - General [FACT-G]) and an additional 9-item breast cancer-related QOL. The FACT-B includes the following subscales that measure physical well-being (PWB), functional well-being (FWB), emotional well-being (EWB), social/family well-being (SWB), and the breast cancer subscale (BCS). FACT-B total scores were calculated as the sum of the 5 subscales. FACT-G scores were calculated as the sum of the PWB, FWB, EWB, and SWB scores and FACT-B Trial Outcome Index (TOI) was calculated as the addition of the PWB, FWB and BCS scores [15, 16]. This study used the Korean FACT-B version 4 that is validated  and a higher score indicated a better state.
The proportion of patients reporting any problems in each EQ-5D-3L dimension and EQ-5D-3L index were presented. The EQ-5D-3L index was calculated using a Korean valuation set . The EQ-5D-3L index ranged from −0.171 to 1, and higher values indicated better health status. The FACT-B subscale scores were calculated in accordance with a scoring guideline provided by the Functional Assessment of Chronic Illness Therapy (FACIT) measurement system (www.facit.org/FACITOrg).
Differences in the EQ-5D-3L index and EQ-VAS score according to demographic and clinical data were compared using the Student’s t-test or analysis of variance (ANOVA). In aspects of known group validity, we expected that the EQ-5D-3L index and EQ VAS would be lower for the following conditions: worse stage at diagnosis , current treatment group [18–20], shorter duration of disease since diagnosis [19, 21–24], older age group [16, 22], and lower education group [16, 18, 22].
The discriminatory ability of the EQ-5D-3L was determined by comparing the mean FACT-B subscale scores between subjects with no problems and subjects with moderate or severe problems in each EQ-5D-3L dimension. It was expected that the FACT-B subscale scores of subjects with no problem would be higher than those of subjects with any problem. The mean differences in the FACT-B subscale were compared using the Student’s t-test. Discriminatory ability of the EQ-5D-5 L was considered acceptable when all hypothesized differences were significant.
Construct validity was evaluated by Pearson correlation coefficients among the EQ-5D-3L index, EQ-VAS, and FACT-B subscales. EQ-5D-3L index and FACT-G total scores were expected to be moderately or strongly correlated, because both instruments measured HRQoL. It was expected that the correlations between the EQ-5D-3L index and SWB subscale would be weaker than those of the other FACT-B subscales, because the EQ-5D-3L does not contain a social dimension. Construct validity was considered as acceptable when the hypotheses were satisfied.
Cohen’s kappa statistic was used to assess the test-retest reliability of each dimension for the EQ-5D-3L instrument. The kappa statistic calculates the degree of agreement in classification over that which would be expected by chance. There is no universally agreed-upon criteria of significant kappa value. We considered test-retest reliability of EQ-5D-5 L as acceptable if kappa value was higher than 0.4 in each dimension . The intraclass correlation coefficient (ICC)  was used to assess the reliability of the EQ-5D-3L index and EQ-VAS score. We considered that > 0.5 ICC was acceptable.
Among 1,002 recruited patients with breast cancer, 175 patients were excluded from this analysis: 13 duplicated, 2 with missing EQ-5D-3L data, and 160 patients who did not merge into the cancer registry data. Thus, a total of 827 patients were included in the study cohort. Among 150 participants who completed a second survey 1 week later, 67 participants replied and 54 subjects were used for test-retest reliability after excluding 13 participants for whom clinical information was not available. Demographic characteristics of the survey participants were shown in Table 1. All study participants were female with a mean age of 52.1 years. Most patients were married. The number of participants who had undergone breast-conserving surgery was 524 (63.4 %).
The proportion of patients reporting any problems of the EQ-5D-3L and the FACT-B subscale score distribution in the study participants was shown in Table 2. The proportion of patients reporting any problems was relatively higher in the pain/discomfort and anxiety/depression dimensions at 43.5 % and 41.5 %, respectively. The mean FACT-G score was 78.7 (SD 15.8) and mean TOI was 66.7 (12.3). The EQ-5D-3L index and VAS score according to demographic and clinical features were shown in Table 3. In the highly educated and unmarried group, and not in current radiotherapy group, the EQ-5D-3L index scores were higher than corresponding scores of the other groups. A worse stage at the time of diagnosis was associated with lower HRQoL scores; however, this trend did not reach the threshold for statistical significance. By post-hoc analysis, individuals with < 1 year since the time of diagnosis had a significantly lower EQ-5D-3L index as compared with those who had > 4 years since their diagnosis. The EQ-VAS score were not significantly different according to demographic and clinical characteristics.
FACT-B subscale scores and summary measurements by dimension and level of the EQ-5D-3L were shown in Table 4. All FACT-B subscale scores and combined index of subjects with no problem were significantly higher than those of subjects with any problem in all EQ-5D-3L dimensions. Difference in PWB scores was larger than other FACT-B subscales in mobility dimension, whereas difference in PWB scores was larger in self-care and usual activities dimensions. Difference in EWB scores was the largest in the anxiety/depression dimension. Table 5 showed correlation coefficients among the EQ-5D-3L index, EQ-VAS score, and FACT-B scores. TOI scores showed the highest correlation with both the EQ-5D-3L index and EQ-VAS scores at 0.557 and 0.456, respectively, and the SWB scores showed the lowest correlation with the EQ-5D-3L index. Rates of agreements in the EQ-5D-3L dimensions ranged from 85.2 to 96.3 % across dimensions. Kappa statistics ranged from 0.32 in mobility to 0.70 in pain/discomfort and anxiety/depression dimensions. ICCs of the EQ-5D-3L index and EQ-VAS scores were 0.70 and 0.48, respectively (Table 6).
In this study, we aimed to assess the validity and reliability of EQ-5D-3L for measuring HRQoL in post-operative breast cancer patients. Our findings supported the validity of the EQ-5D-3L index. Values for this index were lower in the current radiation therapy, shorter duration of disease since diagnosis, and low education groups. Most of known-group validity features fulfilled our hypothesis. EQ-5D-3L indexes were lower for progressive stages at diagnosis and in the current chemotherapy group, although the differences in the EQ-5D-3L index between groups were not statistically significant. Our results corroborated the findings of Chae and Seo that patients who are younger, more highly educated, and with a longer time since diagnosis have a higher HRQoL . HRQoL score differences by age group were not consistent with previous reports of HRQoL measurements in breast cancer patients [16, 22, 23]. Age has different impacts on HRQoL domains. Ahn et al’s study on breast cancer survivors showed better social and emotional function but poorer physical function with increasing age .
The FACT-B subscale scores for problem reporting in each EQ-5D-3L dimension were significantly different in the current analysis. The EQ-5D-3L index was moderately correlated with FACT-B subscale scores, ranging from 0.377 at FWB to 0.553 at PWB subscales, except for SWB. This finding was similar to those of Lee et al. who studied patients with breast cancer in Singapore . In that study, a correlation between the EQ-5D-3L index and FACT-B subscales was the lowest at 0.11 on the SWB subscales and the highest at 0.66 on the PWB subscales .
Reliability of EQ-5D-3L in this study was inconclusive. Kappa values for EQ-5D-3L dimensions varied depending on domain and confidence intervals of kappa values were wide in mobility, self-care and usual activities. The ICCs of the EQ-5D-3L index was reasonable but EQ-VAS were somewhat low. Kappa values on mobility dimensions were the lowest at 0.32, but showed some agreement with the Landis and Koch criteria  at an agreement rate of 94.4 %. Low reliability statistics could be due to small sample size, change of health states between 2 time periods, and high proportion of no problem in mobility, self-care and usual activities dimensions. In the previous Singapore study, ICCs for the EQ-5D-3L index were reported to as 0.81 in the English version and 0.69 in the Chinese version . Similarly, another Korean study of colorectal cancer patients reported kappa values for the EQ-5D-3L dimensions ranging from 0.32 to 0.56 and the ICC of the EQ-5D-3L index of 0.55 . Compared to our present study, an earlier Taiwan study on cervical cancer patients reported somewhat higher kappa values for the EQ-5D-3L dimensions and the ICC of the EQ-5D-3L index .
The findings of the present study cannot be generalized since only postoperative breast cancer patients at 1 tertiary hospital were enrolled. Another limitation was that we did not investigate patient recurrence status, time since treatment completion, performance status at the visit day, or comorbidity. Because these parameters could affect the HRQoL, more comprehensive data are needed in the future to assess the psychometric properties of the HRQoL instruments. In addition, we did not assess the responsiveness of the EQ-5D-3L in breast cancer interventions; hence, further studies are warranted. Lastly, we did not reassess physical status at retest period, thus evidence on test-retest reliability was inconclusive.
In conclusion, we showed that the EQ-5D-3L could be a valid instrument for measuring the HRQoL of post-operative breast cancer patients in South Korea. However, reliability of the EQ-5D-3L is not conclusive and needs further research.
analysis of variance
breast CANCER subscale
Functional Assessment of Cancer Therapy-Breast Cancer
Functional Assessment of Cancer Therapy - General
health-related quality of life
intra-class correlation coefficient
Jemal A, Bray F, Center MM, Ferlay J, Ward E, Forman D. Global cancer statistics. CA Cancer J Clin. 2011;61:69–90.
The Korea Central Cancer Registry, National Cancer Center, Ministry of Health and Welfare. Annual report of cancer statistics in Korea in 2011. Seoul: Ministry of Health and Welfare; 2013.
Nayfield SG, Ganz PA, Moinpour CM, Cella DF, Hailey BJ. Report from a National Cancer Institute (USA) workshop on quality of life assessment in cancer clinical trials. Qual Life Res. 1992;1:203–10.
Torrance GW, Feeny DH, Furlong WJ, Barr RD, Zhang Y, Wang Q. Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. Med Care. 1996;34:702–22.
Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, et al. Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care. 2002;40:113–28.
Brooks R. EuroQol: the current state of play. Health Policy. 1996;37:53–72.
Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–92.
Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL. Methods for the Economic Evaluation of Health Care Programme. New York: Oxford University Press; 2005.
Lee CF, Luo N, Ng R, Wong NS, Yap YS, Lo SK, et al. Comparison of the measurement properties between a short and generic instrument, the 5-level EuroQoL Group's 5-dimension (EQ-5D-5 L) questionnaire, and a longer and disease-specific instrument, the Functional Assessment of Cancer Therapy-Breast (FACT-B), in Asian breast cancer patients. Qual Life Res. 2013;22:1745–51.
Brooks R, Rabin R, de Charro F. The Measurement and Valuation of Health Status Using Eq-5D: A European Perspective: Evidence from the Euroqol Biomed Research Programme. Dordrecht, The Netherlands. London: Kluwer Academic Publishers; 2003.
Lee YK, Nam HS, Chuang LH, Kim KY, Yang HK, Kwon IS, et al. South Korean time trade-off values for EQ-5D health states: modeling with observed values for 101 health states. Value Health. 2009;12:1187–93.
Kim MH, Cho YS, Uhm WS, Kim S, Bae SC. Cross-cultural adaptation and validation of the Korean version of the EQ-5D in patients with rheumatic diseases. Qual Life Res. 2005;14:1401–6.
Kim SH, Hwang JS, Kim TW, Hong YS, Jo MW. Validity and reliability of the EQ-5D for cancer patients in Korea. Support Care Cancer. 2012;20:3155–60.
Kim SH, Kim HJ, Lee SI, Jo MW. Comparing the psychometric properties of the EQ-5D-3L and EQ-5D-5 L in cancer patients in Korea. Qual Life Res. 2012;21:1065–73.
Brady MJ, Cella DF, Mo F, Bonomi AE, Tulsky DS, Lloyd SR, et al. Reliability and validity of the Functional Assessment of Cancer Therapy-Breast quality-of-life instrument. J Clin Oncol. 1997;15:974–86.
Park BW, Lee S, Lee AR, Lee KH, Hwang SY. Quality of Life Differences between Younger and Older Breast Cancer Patients. J Breast Cancer. 2011;14:112–8.
Yoo HJ, Ahn SH, Eremenco S, Kim H, Kim WK, Kim SB, et al. Korean translation and validation of the functional assessment of cancer therapy-breast (FACT-B) scale version 4. Qual Life Res. 2005;14:1627–32.
Lu W, Cui Y, Zheng Y, Gu K, Cai H, Li Q, et al. Impact of newly diagnosed breast cancer on quality of life among Chinese women. Breast Cancer Res Treat. 2007;102:201–10.
Lu W, Cui Y, Chen X, Zheng Y, Gu K, Cai H, et al. Changes in quality of life among breast cancer patients three years post-diagnosis. Breast Cancer Res Treat. 2009;114:357–69.
Janz NK, Mujahid M, Chung LK, Lantz PM, Hawley ST, Morrow M, et al. Symptom experience and quality of life of women following breast cancer treatment. J Womens Health (Larchmt). 2007;16(9):1348–61.
Nissen MJ, Swenson KK, Ritz LJ, Farrell JB, Sladek ML, Lally RM. Quality of life after breast carcinoma surgery: a comparison of three surgical procedures. Cancer. 2001;1(91):1238–46.
Chae YR, Seo K. Health-related quality of life in women with breast cancer in Korea: do sociodemographic characteristics and time since diagnosis make a difference? Oncol Nurs Forum. 2010;37:E295–303.
Park JH, Jun EY, Kang MY, Joung YS, Kim GS. Symptom experience and quality of life in breast cancer survivors. J Korean Acad Nurs. 2009;39:613–21.
Ahn SH, Park BW, Noh DY, Nam SJ, Lee ES, Lee MK, et al. Health-related quality of life in disease-free survivors of breast cancer with the general population. Ann Oncol. 2007;18:173–82.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40.
Lee CF, Ng R, Luo N, Wong NS, Yap YS, Lo SK, et al. The English and Chinese versions of the five-level EuroQoL Group's five-dimension questionnaire (EQ-5D) were valid and reliable and provided comparable scores in Asian breast cancer patients. Support Care Cancer. 2013;21:201–9.
Lang HC, Chuang L, Shun SC, Hsieh CL, Lan CF. Validation of EQ-5D in patients with cervical cancer in Taiwan. Support Care Cancer. 2010;18:1279–86.
This study supported by Bayer Korea.
The authors declare that they have no competing interests.
All authors contributed to the conception and design of the study and the interpretation of the results. MWJ was responsible for data acquisition. SHK analyzed the data and was involved in drafting the manuscript. MWJ, JWL and JKK were involved in revising the manuscript to ensure its critically important content. All authors have read and approved the final manuscript.