- Open Access
Adaptation and assessments of the Chinese version of the ICECAP-A measurement
Health and Quality of Life Outcomesvolume 16, Article number: 45 (2018)
This study adapts the ICECAP measure for Adults (ICECAP-A) to assess its capacity to measure the quality of life in China for economic evaluation.
Qualitative and quantitative methods were used to translate the ICECAP-A measure for wellbeing, established by the University of Birmingham, UK, to the Chinese cultural context. A focus group discussion solved the appropriateness and wording of the ICECAP attributes in Chinese; and a randomly selected sample of 1000 adults aged over 18 years were online surveyed. We conducted psychometric tests and compared the factors influencing the ICECAP-A measure with those influencing EQ-5D-3 L.
Members of the focus group discussion agreed that the five attributes of the ICECAP-A measure are sufficient to evaluate wellbeing in China. However, the terms “being settled” and “friendship” were changed to “stability” and “kindness” for the Chinese cultural context. Our results show that the Chinese version of ICECAP-A has good internal consistency with an overall Cronbach’s Alpha coefficient of 0.7999. The concurrent validity indicates that ICECAP-A is moderately correlated with EQ-5D-3 L (r ≤ 0.52).
The ICECAP-A measure can be adapted to evaluate wellbeing in China, but cultural changes to the wording are necessary. It is a valid measurement of wellbeing and can complement the EQ-5D already used in China. However, further work is still needed to evaluate the sensitivity of the ICECAP-A measure in relation to public health and social care.
Economic evaluations for health technology or healthcare services have been employed by decision-makers to overcome the challenges of rising health care expenditure in the context of rapidly developing medical innovations [1,2,3]. Beyond all costs measurement, outcome measures that can capture the broader impacts and multiple dimensions of these healthcare interventions are critical for economic evaluation. Moreover, economic evaluations are going beyond clinical medical services, to include public health, social care interventions, and even more general public policies and regulations [4, 5]. Therefore, it is becoming more important and challenging to seek for an approach capturing individuals’ benefits as well as their well-beings in a more general conceptual framework.
Currently, the quality adjusted life year (QALY) is a widely accepted instrument of measurement in health economic evaluation . However, the traditional framework of measuring quality of life (QoL) for QALYs focuses only on health-related QoL and may not be able to capture multi-dimensional outcomes which are important to quality of life in general [7, 8]. Alternative measures based on Amartya Sen’s capability approach are starting to become available [9,10,11]. The capability approach is primarily developed to assess an individual’s advantage based on a person’s ability to achieve ‘functionings’ in life that are valuable to them. Yet, health service researchers and bioethicists have considered Sen’s capability approach as a way to provide a more comprehensive well-being picture of individuals than preference-based HRQoL measures, such as QALYs.
One option for measuring capability wellbeing is the suite of ICECAP measures [12,13,14]; these have been developed in recent years to measure more general wellbeing than the traditional framework of health-related quality of life (HRQoL) permits. The ICECAP-A is a measure specially designed for adults. It was generated based on interviews with adults in the general population and consists of five attributes: Stability, Attachment, Autonomy, Achievement and Enjoyment . Studies suggest that these attributes capture individuals’ freedoms to function, as well as potentially key outcomes of public health policies and interventions [12, 14].
So far, most evidence on the use of this measure relates to its original UK version. This version includes studies of the measure’s content validity and acceptability [15, 16], its construct validity in both general population and patient groups [17,18,19], its reliability  and its sensitivity to change [18, 21]. The relationship of the ICECAP-A to the EQ-5D measure of HRQoL has also been explored [22, 23]. As of January 2017, the ICECAP questionnaire has been translated into seven other languages (Chinese, Dutch, French, German, Spanish, Turkish and Welsh) and validated in Dutch . However, a psychometrical analysis of a version translated for a substantially different culture has not been undertaken.
In this study, we used both qualitative and quantitative methods to develop a Chinese translation of the ICECAP-A instrument and validate it. We compared the Chinese version of ICECAP-A with the Chinese EQ-5D to identify similarities and differences between health-related and general quality of life measures. This study is the first to explore the use of a capability approach in the health field in China and the first to use any of the ICECAP measures in this context. This paper aims to introduce this new instrument for measuring capability for well-being to health economists and decision-makers in China.
A series of qualitative and quantitative analysis were conducted in 2016 to develop a translation of the ICECAP-A into Chinese and to validate this translated ICECAP-A version. Ethics approval for the work was obtained from the Ethics Review Committee at the Affiliated Zhongshan Hospital of Xiamen University.
ICECAP-A translation and cross-cultural adaptation
The research team translated the ICECAP-A into Chinese with permission from the ICECAP team at the Institute of Applied Health Research at the University of Birmingham. Initially, two team members translated the original version of the ICECAP-A questionnaire into Chinese. A focus group of four experts and eight team members then evaluated the appropriateness of the five translated attributes of ICECAP-A for a Chinese context during a half-day meeting. The experts were researchers with backgrounds in the social sciences, and the team members were postgraduate students in the health services and policy fields. A moderator was responsible for hosting and tape-recording the discussion. The main issues discussed were the factors that they considered important for their own wellbeing and the translational appropriateness of the five attributes based on the Chinese ICECAP-A questionnaire.
After the panel discussion, the revised questionnaire was pilot-tested with a convenient sample of 25 undergraduate students. They were asked to fill in both ICECAP-A and EQ-5D questionnaires and provide feedback and comments on the wording of the questions concurrently. Five community healthcare providers were asked to undertake the same process and provide feedback by phone or email.
We also selected two persons for back translation: one English native speaker who can speak and write Chinese very well, and one Chinese native speaker who is a senior English instructor. They were not aware of the concepts being explored before the translation. Both versions of the back translation were later merged, based on the original format of ICECAP questionnaire produced by University of Birmingham. Another two Chinese-speaking students were also asked for a back translation. Both of them can read English fluently and were involved in the earlier focus group discussion, they were also aware of the Chinese version of the questionnaire. Their back translation was used to double-check the cultural differences in the language translation.
An online survey
An online survey was administered to Chinese adults over 18 years of age. The survey was conducted through SoJump, which is the largest Internet market research firm in China. A sample of 1127 respondents was randomly selected from its 2.6 million registered subjects (http://ctang1.sojump.com/jq/8427388.aspx). Upon completion of the survey, respondents received points that can later be exchanged for cash. This is not a representative sample of the general Chinese population, but can be a representative sample of adult netizens. Detailed information about the panel can be found at the website at http://www.sojump.com/. Other recent studies in China have used the same online approach [25, 26]. In addition to asking participants to complete ICECAP-A, they were also asked to complete the EQ-5D-3 L and to provide socioeconomic information including: information about education, marital status, employment, health insurance, income, and housing. After deleting the results of those who finished the questionnaire in less than 2 min and those with missing or multiple responses, the final sample contained 975 valid responses. Table 1 shows the definition of the key variables.
Data from the focus group discussion, pilot-testing and the online survey were used to assess acceptability. Specifically, we used information about the time taken to answer the ICECAP-A questionnaire and those with missing or multiple responses to analyse the acceptability of the responses.
The reliability for the questionnaire as a system can be tested to check the reliability of the ICECAP-A where Cronbach’s alpha, with a value of > 0.70 is considered acceptable.
Exploratory factor analysis (EFA) was conducted for both the EQ-5D and ICECAP-A. We also conducted Polychoric correlation analysis between the scores for the ICECAP-A, EQ-5D-3 L, and EQ-VAS. We employed Polychoric correlation analysis instead of Pearson correlation, because the former is employed when the measurement of variables is based on an ordinal scale. Data from the online survey was also used to analyse the relationships between ICECAP-A scores and other socio-economic statuses determined by descriptive statistics and multivariable linear regression models. The different factors that influence the ICECAP-A and EQ-5D-3 L were identified.
In the study, the overall ICECAP score was calculated using the UK value set . We used the EQ-5D-3 L utility values set that were developed recently, based on the Chinese population . Individual attributes for the ICECAP-A questionnaire ranged from the highest capability level (4) to the lowest (1), whereas each dimension of the EQ-5D questionnaire ranges from the highest level (1) to the lowest (3). Therefore, the highest capability score is (4,4,4,4,4) whilst the highest EQ-5D-3 L score is (1,1,1,1,1).
Table 2 shows the descriptive statistics for the sample and Table 3 shows that the modal response to ICECAP-A for all attributes was at the second best level ranging from 51% for autonomy (independence) to 63% for attachment (love, kindness and support). The modal response for EQ-5D-3 L was at the top level for all dimensions ranging from 69% for anxiety/depression to 94% for self-care.
In general, the translated Chinese version of ICECAP-A can be understood and self-completed by members of the general adult population in around 5 min. Participants in the discussion group, field tests, and health providers agree that the five attributes contained in the translated ICECAP-A are sufficient to evaluate well-being in China. Three slight modifications were deemed useful to adapt the ICECAP-A to a Chinese cultural context. First, respondents felt uncomfortable when talking about “love/friendship” because it is not a word commonly used in their daily life. Consequently, we chose the closest Chinese word, “kindness”. Second, “feel settled” has the same meaning as “stability” when translated, but it is longer and was considered less acceptable. So “stability” was used instead of “feel settled”. Finally, we added an introduction to the questionnaire to guide participants. It stated:
“The following are questions related to your quality of life in general. Please take your own capabilities and external environment into consideration while answering each question. For example, a question like “sense of stability and security” is related to your health condition, working condition, family economic condition and social relationships. It may also require your judgment regarding whether or not it is in a harmonious and stable state”.
Both the revised Chinese version of ICECAP-A and the back-translated version were approved by the ICECAP team in the University of Birmingham.
As shown in Tables 4 and 5, each item of the ICECAP-A and EQ-5D-3 L in Chinese is independent as the correlation factor ranges from 0.2 to 0.6. Moreover, both the Cronbach’s Alpha coefficient are more than 0.7, which suggests an appropriate level of reliability.
Table 6 shows KMO (Kaiser-Meyer-Olkin) values for ICECAP, EQ-5D-3 L, the variables of which appear to warrant an exploratory factor analysis. In general, the items are meritorious in the ICECAP-A (0.85–0.91) and middling in the EQ-5D-3 L (0.78–0.86), indicating that performing an exploratory factor analysis is worthwhile. In Fig. 1 a scree plot presents a graph of eigen values, through the number of eigen values greater than one, a two factor solution was found to be optimal.
Table 7 presents the principal results of the exploratory factor analysis: the majority of ICECAP-A items loaded onto Factor 1, and the majority of EQ-5D-3 L items (Mobility, Self-care, Usual Activities and Pain/ discomfort) loaded strongly onto Factor 2, while the item of Anxiety/ depression loaded strongly onto Factor 1. The factor correlation is 0.4, meaning the promax rotation was an appropriate choice for the analysis. The results indicated that there is a different construct between the ICECAP-A and EQ-5D-3 L, providing different information. They also show certain similarity to results presented by Davis et al.  using the ICECAP-O and Keeley et al.  to analyse patients with knee pain [22, 30].
Table 8 shows the correlation coefficients of each item and total scores of ICECAP-A, EQ-5D-3 L, and EQ-VAS. In general, the item correlation between the two instruments is weak (Polychoric’s r 0.24–0.52). Stability, attachment, achievement, enjoyment in ICECAP-A have a higher correlation with anxiety/depression than other items in EQ-5D-3 L (Polychoric’s r 0.36–0.51), but the autonomy in ICECAP-A has a higher correlation with mobility and, self-care in EQ-5D-3 L (Polychoric’s r 0.52). However, each item in the ICECAP-A has a weak correlation with the EQ-5D-3 L and EQ-VAS scores (Polyserial’s r 0.27–0.39), and each item in the EQ-5D-3 L has a moderate correlation with the ICECAP-A score (Polyserial’s r 0.36–0.48). Specifically, the Polychoric’s r of the ICECAP-A score with EQ-5D-3 L score and EQ-VAS is 0.45 and 0.42 respectively, which indicates moderate correlation between them .
Table 9 shows sociodemographic characteristics that correlated with the ICECAP-A and EQ-5D-3 L scores as well as each item of the ICECAP-A. The total average score for the ICECAP-A for females is statistically significant and lower than for males. Specifically, females seem to feel less stable, autonomous, fulfilled than males, but there appears to be no difference in gender in the other attributes, nor is there any for EQ-5D-3 L scores. Marital status correlates with ICECAP-A significantly. Compared to those who are single, married persons tend to have higher ICECAP-A scores, as a result of higher levels of all attributes. Being divorced or widowed is negatively correlated with ICECAP-A, especially on the attributes of stability, attachment and enjoyment. Respondents with Urban Workers’ Basic Medical Insurance have higher ICECAP-A scores for stability, autonomy and achievement compared to those with no health insurance, but not in regard to other items. Age, education, job characteristics, and income have no correlation with ICECAP-A and EQ-5D-3 L scores.
Discussion and Conclusion
The ICECAP-A is a newly developed general QoL measurement instrument in the UK. No published study is available for its use in non-English speaking countries yet. Although there are cultural differences between English and non-English speaking countries, our study suggests that a version of ICECAP-A that slightly adapts the terminology for the two attributes is able to measure general QoL in China.
Our results show that the adapted version of ICECAP-A has good acceptability and internal reliability. As for validity, Davis et al.  and Keeley et al.  both have previously suggested two factors about “physical functioning/health” and “(psychosocial) wellbeing” [22, 32]. The principal results presented in this paper suggest that “physical health state” and “psychosocial health state” may accurately reflect the constructs termed in health economic evaluation. Therefore, our study suggests an appropriate internal validity of the ICECAP-A previous study has shown that the total score of the ICECAP-A questionnaire is significantly correlated with the total score, as well as anxiety and depression in the EQ-5D-3 L questionnaire (> 0.5). Yet, the results of our study show these two indexes have a relatively low correlation (0.45, 0.48 respectively) .
Keeley’s study also finds that the total score of ICECAP-A is moderately associated with that derived from EQ-5D-3 L, however their correlation index 0.49 is higher than our study 0.45. This may be attributed to our study being generalizable to general population, whereas Goranitis’ and Keeley’s focused on patients in their studies . Moreover, among the 36 correlation indexes between ICECAP-A and EQ-5D-3 L, Keeley’s study shows 22 (61.11%) indexes are larger than 0.3, while our study has only 9 (25%) indexes. Although the two studies demonstrate minor differences in the results of their correlation index, they particularly show a consistency in which indexes for the dimension of anxiety/depression are generally greater than other dimensions.
Our results confirmed previous literature that demonstrated that ICECAP complements EQ-5D measures [22, 32]. Specifically, each dimension in the ICECAP is moderately associated with the items of pain/discomfort and anxiety/depressed. In contrast, the items of daily activities that may primarily represent physical healthy are relatively weakly correlated with the ICECAP score. The results in this study show that ICECAP-A was more refined for assessing well-being and the distribution of each item in ICECAP-A may suggest that the “floor effect” of EQ-5D-3 L can be avoided.
Our results indicate that ICECAP-A may be able to capture broader dimensions of QoL compared with EQ-5D. First, compared to male, females have lower ICECAP-A scores, while there is no gender difference for EQ-5D-3 L scores. As indicated by Sen, compared to males, females in many developing countries may have less capabilities in terms of their resource availability such as education and political freedom to carry out functions [33, 34].Second, compared to those with Urban Resident Basic Medical Insurance, respondents with Urban Workers’ Basic Medical Insurance have higher ICECAP-A scores. This confirmed the assumption that availability of health insurance is an important resource for capability .Consistent with previous literature, our results show no significant correlation between ICECAP-A and other socio-demographic variables, such as age and education [17, 19, 29]. However, unlike results from previous UK studies, our results found no significant positive relationship between income and ICECAP-A [17, 36, 37].
In China, the capability approach has been introduced recently and several measures have been developed to assess capability in inequality studies [35, 38, 39]. However, no capability approach study is available in the health economics discipline. Due to the escalating health care expenditures and overtreatment problems in China, economic evaluation has received increasing attention from policy makers, including designing drug formularies of national essential health insurance policies and medical pricing . However, most of the health economic evaluations are narrowly focused on pharmaceutical products. In addition to clinical outcomes, EQ-5D is the commonly used instrument for outcome measurement . Currently, the Chinese government and policy makers are putting more efforts into improving public health . Due to the complexity of new public health interventions, an appropriate approach is needed to conduct the economic evaluation of these health maintaining and improving strategies [41, 42].
Our study has a few limitations. First, the online sample for the survey is composed of younger and better educated individuals than is expected in the general population. The sample size is also relatively small. Thus, we need to be cautious when generalizing these results to the general population. Further studies with large national representative sample is needed to add evidence to the international literature on the validity and use of the ICECAP-A. Second, we don’t have respondents’ objective health status in order to directly measure the correlation of EQ-5D and ICECAP with health. In the future, we will not only collect data from a larger sample with clinical health status measurement, but also apply it to patients and the elderly population to test the sensitivity of the ICECAP-A with social and healthcare interventions. Third, the ICECAP score was calculated based on the UK setting which may not reflect the value of Chinese population appropriately. It is necessary to develop a set of Chinese ICECAP values to conduct economic evaluation.
In summary, although the current study has some limitations, it represents an important first step to adapt ICECAP-A for capability well-being measurement in China. It suggests that ICECAP-A is valid and can complement the EQ-5D to measure well-being and general QoL, which can be helpful for health and social care decision-making.
- EQ-5D or EQ-5D-3L:
a standardized instrument for use as a measure of health outcome
Health-related quality of life
Investigating choice experiments capability measure for Adults
Quality adjusted life year
Quality of life
Garber AM, Phelps CE. Economic foundations of cost-effectiveness analysis. J Health Econ. 1997;16:1–31.
Cutler DM, McClellan M. Is technological change in medicine worth it? Health Affair. 2001;20:11–29.
Drummond MF, Sculpher MJ, Claxton K, et al. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015.
Bulamu NB, Kaambwa B, Ratcliffe J. A systematic review of instruments for measuring outcomes in economic evaluation within aged care. Health Qual Life Outcomes. 2015;13(1):179.
Chalkidou K, Culyer A, Naidoo B, et al. Cost-effective public health guidance: asking questions from the decision-maker's viewpoint. Health Econ. 2008;17:441–8.
Drummond M, Brixner D, Gold M, et al. Toward a consensus on the QALY. Value Health. 2009;12:S31–5.
Lorgelly PK, Lawson KD, Fenwick EA, et al. Outcome measurement in economic evaluations of public health interventions: a role for the capability approach? Int J Environ Res Public Health. 2010;7:2274–89.
Coast J, Flynn T, Sutton E, et al. Investigating choice experiments for preferences of older people (ICEPOP): evaluative spaces in health economics. J Health Serv Res Policy. 2008;13:31–7.
Anand P. Capabilities and health. J Med Ethics. 2005;31:299–303.
Coast J, Smith R, Lorgelly P. Should the capability approach be applied in health economics? Health Econ. 2008;17:667–70.
Lorgelly PK. Choice of outcome measure in an economic evaluation: a potential role for the capability approach. PharmacoEconomics. 2015;33:849–55.
Al-Janabi H, Flynn TN, Coast J. Development of a self-report measure of capability wellbeing for adults: the ICECAP-A. Qual Life Res. 2012;21:167–76.
Sutton EJ, Coast J. Development of a supportive care measure for economic evaluation of end-of-life care using qualitative methods. Palliat Med. 2013;
Coast J, Flynn TN, Natarajan L, et al. Valuing the ICECAP capability index for older people. Soc Sci Med. 2008;67:874–82.
Al-Janabi H, Keeley T, Mitchell P, et al. Can capabilities be self-reported? A think aloud study. Soc Sci Med. 2013;87:116–22.
Keeley T, Al-Janabi H, Lorgelly P, et al. A qualitative assessment of the content validity of the ICECAP-A and EQ-5D-5L and their appropriateness for use in health research. PLoS One. 2013;8:e85287.
Al-Janabi H, Peters TJ, Brazier J, et al. An investigation of the construct validity of the ICECAP-A capability measure. Qual Life Res. 2012;22:1831–40.
Goranitis I, Coast J, Al-Janabi H, et al. The validity and responsiveness of the ICECAP-A capability-well-being measure in women with irritative lower urinary tract symptoms. Qual Life Res. 2016:1–13.
Goranitis I, Coast J, Day E, et al. Measuring health and broader well-being benefits in the context of opiate dependence: the psychometric performance of the ICECAP-A and the EQ-5D-5L. Value Health. 2016;(6):19, 820–828.
Al Janabi H, Flynn TN, Peters TJ, et al. Test–retest reliability of capability measurement in the UK general population. Health Econ. 2015;24:625–30.
Keeley T, Al-Janabi H, Nicholls E, et al. A longitudinal assessment of the responsiveness of the ICECAP-A in a randomised controlled trial of a knee pain intervention. Qual Life Res. 2015;24:2319–31.
Keeley T, Coast J, Nicholls E, et al. An analysis of the complementarity of ICECAP-A and EQ-5D-3 L in an adult population of patients with knee pain. Health Qual Life Outcomes. 2016;14(1):36.
Mitchell PM, Al-Janabi H, Richardson J, et al. The relative impacts of disease on health status and capability wellbeing: a multi-country study. PLoS One. 2015;10:e143590.
Makai P, Koopmanschap MA, Brouwer WB, et al. A validation of the ICECAP-O in a population of post-hospitalized older people in the Netherlands. Health Qual Life Outcomes. 2013;11:57.
Huang H. International knowledge and domestic evaluations in a changing society: the case of China. Am Polit Sci Rev. 2015;109:613–34.
Tang C, Zhang Y. Using discrete choice experiments to value preferences for air quality improvement: the case of curbing haze in urban China. J Environ Plan Manag. 2015;59:1473–94.
Flynn, T. N. and E. Huynh, et al. Scoring the Icecap-a Capability Instrument. Estimation of a UK General Population Tariff. Health Economics. 2015;24;3: 258–269.
Liu, G. G. and H. Wu, et al. Chinese time trade-off values for EQ-5D health states. Value in Health. 2014;17;5: 597–604.
Davis JC, Liu-Ambrose T, Richardson CG, et al. A comparison of the ICECAP-O with EQ-5D in a falls prevention clinical setting: are they complements or substitutes? Qual Life Res. 2012;22:969–77.
Cohen J. Set correlation and contingency tables. Appl Psychol Meas. 1988;12:425–34.
Sen AK. Gender and Cooperative Conflicts., “in Persistent inequalities: women and world development”. New York: Oxford University Press; 1990.
Sen A. Capability and well-being. Qual Life. 1993;30
Yuan F, Shi Q. Reinvestigating inequality: Capability, income inequality and welfare of rural-urban migrants. Manag World (in Chinese). 2013;10:7.
Coast J, Peters TJ, Natarajan L, et al. An assessment of the construct validity of the descriptive system for the ICECAP capability measure for older people. Qual Life Res. 2008;17:967–76.
Flynn TN, Chan P, Coast J, et al. Assessing quality of life among British older people using the ICEPOP CAPability (ICECAP-O) measure. Appl Health Econ Health Policy. 2012;9:317–29.
Sen A. Development as freedom: Oxford Paperbacks; 2001.
Zhong X, Zhao X. A review of empirical studies on welfare measurements: Based on capability theory. Journal of Hubei University of Economics (in Chinese). 2014;12:75–8.
Xiao Y, Zhao K, Bishai DM, et al. Essential drugs policy in three rural counties in China: what does a complexity lens add? Soc Sci Med. 2013;93:220–8.
Wu H, Tian C. A review and development of China's pharmaceconomic evaluation: Based on bibliometric analysis. China Pharmacy (in Chinese). 2015;26:2305–7.
National Health and Family Planning Commission. Health China 2030. http://www.nhfpc.gov.cn/zhuzhan/zcjd/201610/732d915f89a4443dad8364a49a08a60d.shtml (Accessed 27 Sept 2016; in Chinese). 2016.
Wanless D. Securing good health for the whole population. London: HM Treasury 2004;4: 2003–04.
McDaid D, Needle J. What use has been made of economic evaluation in public health? A systematic review of the literature. Berlin: Springer; 2009.
We are grateful to all participants in the survey. We especially thank Professor Joanna Coast in the University of Birmingham for her kindly suggestions on the manuscript.
This work was supported by the National Natural Science Foundation of China (Grant Number 71473202), the National Natural Science Foundation of China (Grant Number: 71463007) and the National Social Science Foundation of China (Grant Number: 16BGL097).
Availability of data and materials
The dataset of this article is available upon request from the correspondence author.
Ethics approval and consent to participate
Ethics approval was obtained from the Ethics Review Committee at the Affiliated Zhongshan Hospital of Xiamen University. We used implied consent and attached information statement before starting the survey.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.