Assessing the construct validity of the Italian version of the EQ-5D: preliminary results from a cross-sectional study in North Italy
© Savoia et al; licensee BioMed Central Ltd. 2006
Received: 13 March 2006
Accepted: 10 August 2006
Published: 10 August 2006
Information on health related quality of life (HR-QOL) can be integrated with other classical health status indicators and be used to assist policy makers in resource allocation decisions. For this reason instruments such as the SF-12 and EQ-5D have been widely proposed as assessment tools to monitor changes in HR-QOL in general populations and very recently in general practice settings as well
The primary goal of our study was to assess the construct validity of the Italian version of the EQ-5D in a general population of North Italy using socio-demographic factors and diagnostic sub-groups. Our secondary goal was to assess the concurrent validity of the EQ-5D and SF-12.
The SF-12, the EQ-5D plus an additional questionnaire on socio-demographic characteristics, clinical conditions and symptoms were completed by 1,622 adults, randomly selected from the Registry of the Health Authorities of the city of Bologna, Italy. The primary care physician of each subject was contacted to report on the subject's health status.
Our findings indicate that the Italian version of the EQ-5D is well accepted by the general population (91% response rate), has good reliability (Cronbach's alpha 0.73), and shows evidence of construct validity.
Our data provide a basis for further research to be conducted to assess the validity of the EQ-5D in Italy. In particular future studies should focus on assessing its ability to detect a clinically important change in health related quality of life over time (responsiveness).
Improving the health of local populations requires specific knowledge of the current levels of health status, which can be compared over time. However commissioning health care services carries with it the need to prioritize resources. For this reason policy makers have always expressed the necessity to identify variations within the communities they are serving, compare local data with normative population levels and eventually monitor changes in health status by diagnostic and socio-demographic sub-groups. Information on health related quality of life (HR-QOL) can be integrated with other classical health status indicators and be used to assist policy makers in resource allocation decisions [1–3]. For this reason instruments such as the SF-12 and the EQ-5D have been widely proposed as assessment tools to assess HR-QOL in general populations and very recently in general practice settings as well [4–9].
The SF-12 is a generic short form health survey, originally developed in the USA to provide a short alternative to the SF-36 . It produces two summary measures evaluating physical and mental aspects of health derived from 12 questions. SF-12 has been successfully tested in several European countries, including Italy, on large samples of the general population, where it has proved its comprehensiveness, reliability, validity and cross-cultural applicability. 
The EQ-5D is an internationally developed health related quality of life measure that has been used throughout the world.  The main difference with the SF-12 is that the EQ-5D was developed as a preference-based measure, suitable for cost-effectiveness analysis. The most interesting characteristic of this instrument is the availability of a "utility index score" which for the decision makers following the principles of utilitarism makes the tool useful to set priorities in clinical settings and policy determinations. The utility view of quality of life refers to a subject's preference for a state of health. This view describes quality of life in a manner similar to the description of the benefits of a life insurance policy, where different monetary benefits are placed on the loss of various limbs. Although the EQ-5D has been extensively utilized in non-Italian settings, it lacks of empirical evaluations in Italy. The lack of information on the construct validity and reliability of the instrument as well as the absence of utilities estimated in the Italian population preclude its applicability.
The primary goal of our study was to assess the applicability, internal consistency, and construct validity of the Italian version of the EQ-5D in a random sample of the citizens of Bologna (North Italy). Our secondary goal was to test its concurrent validity with the SF-12.
Study population and data collection
A sample of 1,622 adults, aged 18–93, was randomly selected (simple random sample) from the Registry of the North and South Health Authorities of the city of Bologna, Italy. The adopted exclusion criteria were: people aged < 18 years, non residents of the two Health Authorities geographical areas, institutionalized subjects, and people not able to reason or understand and make decisions on their own. The study was performed in 2002 and the sample was expected to be representative of the residents of the geographical area covered by the two Health Authorities. A package with the SF-12 and the EQ-5D questionnaires plus an additional questionnaire on socio-demographic characteristics, clinical conditions and symptoms was sent home to the 1,622 subjects. The primary care physician of each subject was contacted by mail to report on the enrolled subject's health status by filling out a questionnaire to be returned to the Health Authority. In order to maximize the response rate each subject was contacted by telephone three times after the 7th, 14th and the 21st day from the inception of the survey. Delinquency after the third phone call resulted in dropping out the subject from the study and replacing her with a subject (same age and gender) randomly selected from the original sample. No reimbursement was offered to the study participants.
Health status measurement
Two instruments were used to measure health related quality of life: the SF-12 v.1 and the EQ-5D. The SF-12 is a generic instrument that contains 12 items from the SF-36 Health Survey. The SF-12 estimates scale scores for four of the SF-36 eight health concepts (physical functioning, role-physical, role-emotional and mental health) using two items each; the remaining four health concepts (bodily pain, vitality, social functioning and general health) are each represented by a single item. We calculated the summary scores PCS-12 and MCS-12 using the scoring program described by Apolone .
The EQ-5D is a generic instrument, consisting of five three-level items, representing various aspects of health: mobility, self-care, usual activities, pain/discomfort and anxiety/depression (mood). Respondents can value their health in each domain by reporting whether they are experiencing none (score 1), some (score 2) or extreme (score 3) problems. These scores result in a health profile, e.g. a patient with profile 12113 has no problem with mobility, usual activities and pain/discomfort, some problems with self-care and extreme problems with anxiety/depression. Data of a visual analogue scale are also included in the EQ-5D and used by subjects to rate their health status between worst imaginable health state (score 0) to best imaginable health state (score 100). A utility index score was calculated for each subject's EQ-5D health status by applying the time trade-off-based valuations from a general UK population sample to the observed EQ-5D profile, as data from an Italian norm are not available at the present time. Using the data at hand self-rated index were also calculated using the EQ-VAS score method.
Self-reported clinical conditions and socio-demographic data
In the package shipped to the subjects we also included an additional questionnaire to gather data on socio-demographic characteristics (gender, age, height, weight, level of education, occupation and marital status) and to investigate clinical conditions and/or symptoms that based on a literature search we hypothesized could affect everyday life (i.e. headache) and do not necessary require a medical consult or that are known to be reliable when self reported (i.e. diabetes, in treatment for dialysis). [17–21]
The self-reported questionnaire focused on the following symptoms or clinical conditions: visual impairment, hearing impairment, anxiety/depression, headache, diabetes, and dialysis. In addition a final open question was created asking the subject to report on other clinical conditions affecting her health status.
We used the level of education as proxy indicator of socio-economic status because information on income was not available. The level of education was described according to the Italian school system into 5 categories: less than elementary school degree, elementary school degree, middle school degree, high school degree, and college degree equivalent to less than 5 years of school, between 5 and 8, between 8 and 13 and more than 13 respectively.
We grouped the variable occupation into 7 categories: 1) managers, professionals, directors, businessmen, 2) public or private companies' employees, 3) labors, 4) house-keeping, 5) retirees, 6) students and 7) unemployed.
Primary care physicians' assessments
The primary care physician of each subject was invited to give a clinical assessment on the enrolled subject. In order to gather such information in a structured and reliable way we designed a questionnaire including the definition of each investigated condition based on a review of the most recent clinical guidelines. References to the adopted guidelines were included and the questionnaire piloted tested before implementation. The clinical conditions included in the questionnaire were: hypertension, heart failure, angina, COPD, asthma, back-pain, cancer (diagnosed in the past 5 years), stroke, cirrhosis, arthritis (proved by X-ray documentation), myocardial infarction (occurred in the past 5 years), and stomach ulcer (proved by endoscopy).
Construct and concurrent validity assessment
Construct validity refers to the evaluation of hypotheses about the expected performance of an instrument. A construct can be thought as a mini-theory to explain the relationships among attitudes, behaviors, and perceptions as well. Construct validation is an ongoing process of learning more about the construct, making new predictions and then testing them. It is a process where the theory and the measure are assessed at the same time 
Our approach in evaluating the EQ-5D construct validity was based on comparisons of mean value scores (for the EQ-5D index, EQ-self rated index and VAS) and ORs (for the EQ-5D items) across categories such as diagnostic or socio-demographic groups known or hypothesized to score differently "known group validity". For example we hypothesized that subjects of older age, with a lower educational attainment, female and unemployed scored lower compared to younger, more educated, male and employed subjects.
We also hypothesized that for the 14 identified diagnostic sub-groups scores would have been lower compared to healthy subjects.
The SF-12 was used to compare whether conceptually similar domains had higher correlations than conceptually unrelated domains.
Internal consistency of the multi-item EQ-5D scale was calculated by means of Cronbach's α . Average scores for the EQ-5D index (based on the UK population), EQ-self rated index, EQ-VAS, PCS-12 and MCS-12 scales were computed, as well as the proportions of respondents reporting impairment in the 5 EQ domains. The magnitude and significance of the ORs for the EQ-5D domains, as well as the sign and significance of the regression coefficients for the EQ-5D Index, EQ-self rated index, EQ-VAS, PCS-12 and MCS-12 scores were used as discriminative measurement tools in testing "known group validity". The level of significance was set at 0.05. When the assumption of linearity was satisfied we adjusted the sub-groups mean scores for age and/or gender using linear regression. We used logistic regression to adjust when dealing with categorical variables. Adjustment was performed because age and gender are known to be associated with both scores of health status and particular socio-demographic and clinical variables. Therefore, considered as potential confounders. The effect of self-reported health problems and of the physicians' reported diagnosis on the EQ-5D dimensions was estimated using logistic regression while the effect of the same variables on the EQ-5D index, EQ-self rated index, EQ-VAS, PCS-12 and MCS-12 was estimated using multivariate linear regression.
The concurrent validity of the EQ-5D and SF-12 in this respondent sample was tested examining the relationship between the self-reported EQ-5D and the SF-12 component scores. The relationships between comparable dimensions and component scores, such as anxiety/depression with the MCS-12 and mobility, self-care, usual activities and pain/discomfort with the PCS-12 were hypothesized to be stronger than between less comparable dimensions and component scores, for example mobility and the MCS-12. In contrast the EQ-VAS score was expected to correlate reasonably well with both the MCS-12 and PCS-12. The correlation between the EQ-index (calculated on the UK population time trade off criteria) and the EQ-self rated index was also computed. The strength of the correlation was determined by Cohen's (1992) criteria where large correlations are described as being >0.50, medium correlations range between 0.30–0.49 and small correlations range between 0.10–0.29.
The compare the "discriminant" validity of the two questionnaires we used the magnitude of ratio of the F-test from multivariable analyses of variance. We hypothesized the ratio to be greater for comparable dimensions such as PCS-12 and the 4 EQ-functional dimensions compared to non-comparable dimensions such as PCS-12 and the anxiety dimension.
Data were analyzed using Statistical Package for the Social Sciences (SPSS) version 11.5.
Completed questionnaires were collected from 1,555 subjects, 96% response rate. Of the 1,555 subjects 1,421 (91%) completed the EQ-5D, 1,326 (85%) the EQ-VAS, and 1,364 (88%) the SF-12.
Considering the original sample 16.4% of non-respondents were replaced. Thirty-six percent (524) of respondents that completed all items of the EQ-5D reported no problems (i.e. 11111) on all five dimensions. Of the 243 possible health states described by the EQ-5D, respondents reported 47 different health states. Therefore the ceiling effect of the EQ-5D was modest compared to other studies .
Demographics of participants
< 5 years
> 13 years
EQ-5D reliability and construct validity
Cronbach's coefficient α was 0.73 showing good reliability of the instrument.
Responses to the EQ-5D and SF-12 by socio-demographic characteristics.
% Reporting a problem (moderate or severe) for categorical variables or mean value for numeric variables.
>Educational level γ
< 5 years
> 13 years
Responses to the EQ-5D and SF-12 by clinical condition.
Clinical Condition (n)
OR of reporting an impairment
Usual activities α
EQ-5D index α-UK
EQ-5D vas α
Visual impairment (159)
Hearing impairment (204)
Head ache at least once a week (351)
Heart failure (35)
Back pain (327)
Stomach ulcer (35)
Obesity (BMI >30) (163)
Subjects reporting to be affected by anxiety and to be in treatment for the condition were 17.1 times more likely to report impairment in the anxiety and depression domain compared to subjects not affected by the condition (OR = 17.1, 95% C.I. 10.9–26.9)
Diabetes was associated to all 5 dimensions with ORs ranging from 4.8 (95% C.I. 2.7–8.7) in the mobility domain to 1.7 (95% C.I. 1.0–3.0) in the anxiety and depression domain.
With respect to the clinical conditions referred by the subject's primary care physician all were significantly associated with increased odds of reporting impairment in all 5 EQ dimensions. Table 3. Most of them were strongly associated to increased odds of reporting impairment in the mobility domain. In particular heart failure is the one showing the greatest odds (OR = 22.0, 95% C.I. 8.6–56.0). But also arthritis, back pain, COPD, and obesity (BMI>30) were strongly associated to mobility impairment. Angina, asthma and COPD mainly affected the usual activities domain. Angina was associated with the anxiety and depression domain with 210% increased odds of reporting impairment (OR = 3.1, 95% C.I. 1.1–8.3) compared to subjects not affected by the clinical condition. Stomach ulcer was mainly associated with the pain and discomfort domain with 260% increased odds of reporting impairment (OR = 3.6, 95% C.I. 1.5–8.6) compared to subjects not affected by this condition.
All clinical conditions showed a negative impact on HR-QOL when the EQ-5D index, EQ-self rated index and the EQ-VAS scores were taken into considerations. Applying a linear regression model, adjusting for age and gender, regression coefficients ranged from – 0.08 (p < 0.005) for obesity and stomach ulcer impacting the EQ-5D index and EQ-5D VAS score respectively and -0.35 (p < 0.001) for arthritis impacting the EQ-VAS score, results are shown on Table 3.
EQ-5D and SF12 concurrent validity
As expected the relationships were stronger between the EQ-5D functional dimensions and the PCS-12, and between the MCS-12 and the anxiety/depression dimension. As a matter of fact the correlation coefficients between PCS-12 and the functional dimensions ranged from 0.65 for the usual activities domain to 0.43 for the self-care domain. As expected the MCS-12 score well correlated with the anxiety and depression domain r = 0.59. The relationships between the less comparable dimensions and the component scores were not as strong. In fact the correlation coefficients between the MCS-12 and the physical items ranged from 0.34 for the usual activities domain to 0.25 for the self-care and mobility domains. While the PCS-12 score correlated with the anxiety and depression domain with a coefficient as low as of 0.29. The EQ-VAS scores were positively correlated with both component scores; r = 0.46 for MCS-12 and r = 0.66 for PCS-12. All correlations were significant with p-value < 0.001.
In addition corresponding dimensions and summary scores were more strongly related (eg, mobility and PCS-12; F ratio = 401.45, p-value < 0.001, or anxiety and MCS; F ratio = 356.8, p-value < 0.001) than dissimilar dimensions (eg, mobility and MCS-12; F ratio = 46.8 or anxiety and PCS-12 F ratio = 63.6, p-value < 0.001).
In this study we investigated the construct validity of the Italian version of the EQ-5D administering the instrument to a sample of citizens living in Bologna (North Italy). We provided evidence supporting the construct validity and reliability of the instrument supported by data on socio-demographic characteristics and diagnostic sub-groups of the participants. Strength of our study was the achieved high response rate and the primary care physicians' support in assessing each subject's health status.
The instrument resulted to be consistent with the hypothesized construct and showed good reliability. The convergent and discriminant validity of the EQ-5D were also supported by the relationship with the SF-12 component scores observed in the data, with stronger relationships observed between the PCS-12 scores and the functional dimensions than with the anxiety/depression dimension. Likewise the MCS-12 scores differentiated the level of anxiety/depression dimension more strongly than for the levels of the functional dimensions of mobility, self-care, usual activities and pain/discomfort.
We consider our results as a preliminary step towards the empirical validation process of the EQ-5D in Italy. However some limits of our research should be taken into consideration.
Our sample was representative of two health district areas of the city of Bologna, the Italian territory is extremely heterogeneous in terms of population characteristics such as age, socio-economic status, health status and life-style. In particular differences are present in most health indicators between the North and South of the country. Therefore any inference on the Italian population should be cautious. The utility value calculated for the EQ-5D was based on the U.K. population norm data, debate on the cross adaptability of such scores has not been solved yet. The absence of values based on the Italian population affects the most important characteristic of the instrument, which is its use in cost-effectiveness analysis. However EQ-self rated index scores were derived and showed a high correlation with the UK EQ-index scores.
A known limit of the EQ-5D is to have a 3 responses format, as a consequence subject to a considerable ceiling effect. However in our sample it appeared that the dimensions were discriminative enough to distinguish between respondents with and without specific clinical conditions.
An other limit of our study was not being able to assess the instrument's responsiveness, which is extremely important for its use in monitoring a population's health status.
Our data provide evidence on the construct validity of the Italian version of the EQ-5D in a general population of a large city in North Italy. The measurements of the EQ-5D behaved in patterns that were consistent with recognized socio-demographic differences in health status.
Future studies should focus on assessing the instrument's ability to detect a clinically important change in health related quality of life over time (responsiveness) in order to be able to adopt the tool to monitor a population's health status. However in addition to a psychometric approach measurement/metric equivalence of the Italian version of the EQ-5D should also be investigated. In particular the clinically minimal important difference (MCID), which is defined as the smallest difference between the scores in a questionnaire that the patient perceives to be beneficial should be assessed in an Italian sample should be assessed. A national effort in designing a study with a representative sample of the Italian population will be a necessary step to increase evidence on the EQ-5D applicability in Italy.
- Institute of Medicine: Summarizing Population Health: Directions for the Development and Application of Population Metrics. Edited by: Field MJ, Gold MR. Washington, D.C.:National Academy Press; 1998.Google Scholar
- Murray CJL, Lopez AD, Mathers CD, Stein C: The Global Burden of Disease 2000 project: Aims, methods, and data sources. In Global Programme on Evidence for Health Policy Discussion Paper No. 36. World Health Organization; 2001.Google Scholar
- Gold MR, Muennig P: Measure-dependent variation in burden of diseases estimates: Implication for policy. Med Care 2002, 40: 260–266. 10.1097/00005650-200203000-00009PubMedView ArticleGoogle Scholar
- Ware JE, Kosinski M, Keller SD: A 12-item Short Form Health Survey: construction of scales and preliminary test of reliability and validity. Med Care 1996, 34: 220–226. 10.1097/00005650-199603000-00003PubMedView ArticleGoogle Scholar
- Lam CL, Fong DY, Lauder IJ, Lam TP: The effect of health-related quality of life (HRQOL) on health service utilisation of a Chinese population. Soc Sci Med 2002, 55: 1635–1646. 10.1016/S0277-9536(01)00296-9PubMedView ArticleGoogle Scholar
- Johnson JA, Coons SJ: Comparison of the EQ-5D and SF-12 in an adult US sample. Qual Life Res 1998, 7: 155–166. 10.1023/A:1008809610703PubMedView ArticleGoogle Scholar
- Rabin R, de Charro F: EQ-5D: A measure of health status from the EuroQol Group. Ann Med 2001, 33: 337–343.PubMedView ArticleGoogle Scholar
- Brazier J, Jones N, Kind P: Testing the validity of the Euroqol and comparing it with the SF- 36 health survey questionnaire. Qual Life Res 1993, 2: 169–180. 10.1007/BF00435221PubMedView ArticleGoogle Scholar
- Johnson JA, Pickard AS: Comparison of the EQ-5D and SF-12 health surveys in a general population survey in Alberta, Canada. Med Care 2000, 38: 115–121. 10.1097/00005650-200001000-00013PubMedView ArticleGoogle Scholar
- Zahran HS, Kobau R, Moriarty DG, Zack MM, Holt J, Donehoo R: Centers for Disease Control and Prevention (CDC). Health-related quality of life surveillance – United States, 1993–2002. MMWR Surveill Summ 2005, 54: 1–35.PubMedGoogle Scholar
- Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, Brazier JE, et al.: Cross-validation of items selection and scoring for the SF-12 Health Survey in 9 countries: results from the IQOLA project. J Clin Epidemiol 1998, 51: 1171–1178. 10.1016/S0895-4356(98)00109-7PubMedView ArticleGoogle Scholar
- Kodraliu G, Mosconi P, Groth N, Carmosino G, Perilli A, Gianicolo EA, et al.: Subjective health status assessment: evaluation of the Italian version of the SF-12 Health Survey. Results from the MiOS project. J Epidemiol Biostat 2001, 6: 305–316. 10.1080/135952201317080715PubMedView ArticleGoogle Scholar
- Rabin R, de Charro F: EQ-5D: A measure of health status from the EuroQol Group. Ann Med 2001, 33: 337–343.PubMedView ArticleGoogle Scholar
- Apolone G, Mosconi P, Quattrociocchi L, Gianicolo E, Groth N, Ware J: Questionario sullo stato di salute SF-12. Guerini e Associati 2001.Google Scholar
- Tobiasz-Adamczyk B, Brzyski P: Factors determining changes in self-rated health in the Polish community-dwelling elderly. Cent Eur J Public Health 2005, 13: 117–124.PubMedGoogle Scholar
- Alonso J, Ferrer M, Gandek B, Ware JE Jr, Aaronson NK, Mosconi P, Rasmussen NK, Bullinger M, Fukuhara S, Kaasa S, Leplege A, IQOLA Project Group: Health-related quality of life associated with chronic conditions in eight countries: results from the International Quality of Life Assessment (IQOLA) Project. Qual Life Res 2004, 13: 283–298. 10.1023/B:QURE.0000018472.46236.05PubMedView ArticleGoogle Scholar
- Jiang Y, Hesser JE: Associations between health-related quality of life and demographics and health risks. Results from Rhode Island's 2002 Behavioral Risk Factor Survey. Health Qual Life Outcomes 2006, 4: 14. 10.1186/1477-7525-4-14PubMed CentralPubMedView ArticleGoogle Scholar
- Lubetkin E, Jia H, Franks P, Gold MR: Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: Examining the EQ-5D in the U.S. general population. Qual Life Res 2005, 14: 2187–2196. 10.1007/s11136-005-8028-5PubMedView ArticleGoogle Scholar
- Jelsma J, Ferguson G: The determinants of self-reported health-related quality of life in a culturally and socially diverse South African community. Bull World Health Organ 2004, 82: 206–212.PubMed CentralPubMedGoogle Scholar
- Lacey EA, Walters SJ: Continuing inequality: Gender and social class influences on self perceived health after a heart attack. J Epidemiol Commun Health 2003, 57: 622–627. 10.1136/jech.57.8.622View ArticleGoogle Scholar
- Franks P, Gold MR, Fiscella K: Sociodemographics, self rated health, and mortality in the US. Soc Sci Med 2003, 56: 2505–2514. 10.1016/S0277-9536(02)00281-2PubMedView ArticleGoogle Scholar
- Streiner DL, Norman GR New York, NY: Oxford University Press, Health measurement scales; 1992.
- Lubetkin EI, Jia H, Gold MR: Construct validity of the EQ-5D in low income Chinese American primary care patients. Qual Life Res 2004, 13: 1459–1468. 10.1023/B:QURE.0000040793.40831.72PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.