Comparison of health-related quality of life measures in chronic obstructive pulmonary disease
© Pickard et al; licensee BioMed Central Ltd. 2011
Received: 14 February 2011
Accepted: 18 April 2011
Published: 18 April 2011
The aims of this study were: (1) to compare the discriminative ability of a disease-specific instrument, the St. George's Respiratory Questionnaire (SGRQ) to generic instruments (i.e., EQ-5D and SF-36); and (2), to evaluate the strength of associations among clinical and health-related quality of life (HRQL) measures in chronic obstructive pulmonary disease (COPD).
We analyzed data collected from 120 COPD patients in a Veterans Affairs hospital. Patients self-completed two generic HRQL measures (EQ-5D and SF-36) and the disease-specific SGRQ. The ability of the summary scores of these HRQL measures to discriminate COPD disease severity based on Global Obstructive Lung Disease (GOLD) stage was assessed using relative efficiency ratios (REs). Strength of correlation was used to further evaluate associations between clinical and HRQL measures.
Mean total scores for PCS-36, EQ-VAS and SGRQ were significantly lower for the more severe stages of COPD (p < 0.05). Using SGRQ total score as reference, the summary scores of the generic measures (PCS-36, MCS-36, EQ index, and EQ-VAS) all had REs of <1. SGRQ exhibited a stronger correlation with clinical measures than the generic summary scores. For instance, SGRQ was moderately correlated with FEV1 (r = 0.43), while generic summary scores had trivial levels of correlation with FEV1 (r < 0.2).
The SGRQ demonstrated greater ability to discriminate among different levels of severity stages of COPD than generic measures of health, suggestive that SGRQ may provide COPD studies with greater statistical power than EQ-5D and SF-36 summary scores to capture meaningful differences in clinical severity.
Chronic obstructive pulmonary disease
Global burden of obstructive lung disease
Health-related quality of life
- FEV1 :
Forced expiratory volume in 1 second
Forced expiratory vital capacity
Kruskal Wallis test
St. George's respiratory questionnaire
Short-form 36 item questionnaire
Visual analog scale
six minute walk test.
Chronic obstructive pulmonary disease (COPD) is a leading cause of death worldwide and is associated with a high burden of illness , particularly in terms of health-related quality of life (HRQL). COPD is characterized by airflow obstruction that is not fully reversible and symptoms such as dyspnea, sputum production, and chronic cough . Airflow limitation is usually progressive; thus daily activities can become very difficult as the condition gradually worsens. Consequently, the burden of COPD on HRQL disease tends to increase with COPD severity [3–6].
HRQL is inherently subjective, involving patient self-assessment of multiple dimensions of health that often are not strongly correlated with clinical indicators of COPD [7, 8]. Measures of self-reported HRQL and pulmonary function assess different aspects of the disease and therefore provide complementary information [9, 10]. Both generic and disease-specific HRQL instruments are used in COPD. St. George's Respiratory Questionnaire (SGRQ) is a disease-specific measure used in both COPD and asthma research . EQ-5D  and the SF-36  are generic measures of health often used in studies of COPD [3, 5, 10, 14, 15].
The severity of disease in a study population may affect the choice of instruments to measure health status. For instance, EQ-5D demonstrated fewer floor effects among patients with more severe asthma while SF-6D, a utility-based measure derived from items on the SF-36, demonstrated fewer ceiling effects and thus would be a more preferable measure to assess HRQL in patients with mild asthma who have good disease control . A meta-analysis that examined EQ-5D index-based scores by COPD severity found that while mean scores decreased with the severity of GOLD stages, there was little discrimination of scores for moderate to severe stages of disease . Such studies suggest that the performance of a HRQL measure may depend on the severity of COPD in a patient population. We were interested in further investigating the strengths and limitations of disease-specific and generic HRQL measures, particularly EQ-5D, SF-36 and SGRD, to better inform the selection of PRO measures in clinically heterogeneous COPD patient populations. Thus, aims of this study were: (1) to compare the discriminative ability of a disease-specific HRQL instrument (i.e., SGRQ) versus a generic instrument (i.e., EQ-5D); and (2), to evaluate the strength of associations among various clinical and HRQL measurements in COPD.
We conducted a secondary data analysis of de-identified patient data from a study conducted in a Veterans Administration (VA) hospital. A previous publication described how the original data was obtained . First, investigators identified patients with any inpatient or outpatient diagnosis of COPD in the previous 12 months and received VA care for at least 12 months prior to the study. Next, eligible patients were contacted by mail and received a follow-up phone call inviting them to participate in the study. If they consented, participants came to a pulmonary function laboratory where they completed pulmonary function testing, a 6-minute walk test (6MWT), and several self-reported measures, including the Borg dyspnea scale, SGRQ, SF-36, and EQ-5D. Respondents also completed a brief demographic questionnaire that asked about smoking history, including number of years that they smoked and average number of packs smoked per day. Number of pack-years was calculated based on number of years smoked (smoke-year) multiplied by average number of packs of cigarettes smoked per day (packs/day). As the present study was conducted using only de-identified data, it was granted exempt status by the UIC Office for the Protection of Research Subjects.
We used forced expiratory volume in 1 second (FEV1) and forced expiratory vital capacity (FVC) to assess lung function. According to The Global Initiative for chronic Lung Disease (GOLD) guidelines , once airway obstruction is established based on a FEV1/FVC ratio of <0.70, COPD are categorized into 4 stages of disease: mild (FEV1 ≧ 80%), moderate (FEV1 ≧ 50-79%), severe (FEV1 ≧ 30-49%), and very severe (FEV1 < 30%) .
FEV1 was expressed as a percentage of predicted normal values based on age, gender and height . 6MWT is a widely used assessment of functional status in patients with COPD. It measures the distance (in meters) that a patient can walk on their own pace in six minutes. Dyspnea was measured on the Borg dyspnea scale . Borg scores range from 0 (no breathlessness) to 10 (maximum breathlessness).
SGRQ is self-administered and includes 50 items in three components: symptoms, activity, and impact on daily life . The SGRQ scores range from 0 to 100, with 0 indicating no impairment in the quality of life. Higher scores on the SGRQ represent worse HRQL. MID of four points was proposed for the SGRQ total score.
The veterans SF-36 is a slightly modified version of the SF-36 [13, 22] that consists of 8 domains: general health, physical functioning, role function, role emotional, bodily pain, vitality, social functioning, and mental health. In addition, two summary scores, a physical component summary (PCS) and mental component summary (MCS) score can be calculated. The main modification made to the veterans SF-36 was to expand the number of response options from 2 to 5 for the role functioning scales due to physical health problems or emotional problems, which improved the properties of scales and the summary scores .
EQ-5D is a generic, preference-based utility instrument that includes a descriptor health classifier and a visual analog scale (VAS) . The self-classifier has five dimensions including mobility, self-care, usual activities, pain/discomfort and anxiety/depression. An index-based utility score was calculated using algorithms for societal preference weights from the United Kingdom  and from the United States . The VAS score is a rating of health today by the respondent where 0 represents worst imaginable health state and 100 represents best imaginable health.
Chi-square tests were used to test whether there were differences in patient characteristics for nominal variables across stages of COPD. Differences in means for continuous variables were examined using analysis of variance (ANOVA) and the non-parametric equivalent (Kruskal-Wallis) tests across the four stages of severity. Relative efficiency (RE) ratios were calculated by taking the ratio of the ANOVA-based test statistics, e.g. F-statistics, associated with the reference and comparator measure . The SGRQ total summary score served as the reference measure in the calculation of RE ratios. Correlation between measures was calculated using Pearson's correlation coefficients (r). Strength of correlation was categorized as follows: absent (<0.20), poor (0.20-0.34), moderate (0.35-0.50) and strong (>0.50) . A p-value < 0.05 was interpreted as statistically significant.
We hypothesized that the correlations between SGRQ and clinical measures, i.e. Borg dyspnea scale and 6MWT, would be stronger than between the summary scores of generic measures and the clinical measures, as SGRQ includes items specifically related to breathing problems. We also hypothesized moderate to strong correlations between the summary scores of the SGRQ, SF-36, and EQ-5D.
(n = 120)
(n = 23)
(n = 53)
(n = 27)
(n = 17)
Male, n (%)
Race, n (%)
Smoking status, n (%)
Smoke-years (n = 109)
Packs/day (n = 105)
Pack-years (n = 109)
Patient Clinical and Quality-of-Life Measurements (Total N = 120)
(n = 120)
(n = 23)
(n = 53)
(n = 27)
(n = 17)
EQ-5D US Index
EQ-5D UK Index
Using the SGRQ total score as the reference, relative efficiency ratios indicated that summary scores for SF-36 and EQ-5D were less efficient at discriminating between COPD stages (RE < 1) (Table 2). For the purpose of discriminating among COPD patients according to stage of disease, results indicated that only the SGRQ activity component score was more efficient than the SGRQ total score, i.e. RE > 1 (Table 2).
Correlations between Clinical and HRQL Measures
EQ-5D index (UK)
EQ-5D index (US)
EQ-5D Index (US)
The results of this study supported the hypothesis that the disease-specific SGRQ had greater ability to discriminate among levels of COPD severity than generic measures of HRQL, i.e. SF-36 and EQ-5D. This finding is consistent with the other results that indicate the SGRQ is more strongly correlated with clinical measures than the summary scores of the generic measures. The correlation between generic HRQL summary scores - SF-36 and EQ-5D - and FEV1 was trivial, similar to a previous study . GOLD stage is predicated upon breathing function, and the generic measures do not directly include items on breathing-related symptoms, while SGRQ does include such items. The RE ratios favoured the SGRQ total and activity scores, which suggests that those scales may provide greater statistical power to detect significant differences/changes in HRQL in COPD patients than the other measures, particularly if the study is intended to capture changes related to clinical severity.
Greater discriminative ability of disease-specific measures compared to generic HRQL measures has been reported in studies of other conditions [28–30]. In peripheral arterial disease, the disease-specific Vascular Quality of Life (VascuQol) measure was more discriminative than the EQ-5D and SF-36 . In rheumatoid arthritis, Marra et al. found that the Rheumatoid Arthritis Quality of Life Questionnaire had greater ability to discriminate among the levels of severity of patients than the EQ-5D and SF-6D .
The EQ-5D VAS was better able to discriminate levels of HRQL according severity of disease than the EQ-5D index score in COPD patients. Unlike EQ-5D index-based scores, mean EQ-5D VAS scores decreased monotonically with stage of COPD, and the difference in VAS mean scores by severity represented what could be considered an important difference in VAS scores between stage 1, 2 and 3 . It is important to note that COPD is often accompanied by other co-morbid conditions which were not captured in our data and may differentially affect the ability of HRQL measures to capture burden of illness.
Our study contributes to the literature on HRQL measurement in COPD in several ways. We present further evidence to support the validity of disease-specific and generic measures consistent with a previous study , but in a cohort of older and more severe COPD patients. Similar to Stahl and colleagues, we found that SGRQ total, PCS, and EQ-5D index and VAS scores got worse with severity based on GOLD stage . Particular to this study, we showed that SGRQ scores were associated with greater statistical power to discriminate among levels of COPD severity using REs. We also found that the strengths of correlation between measures and EQ-5D index-based scores were nearly identical regardless of whether the UK or US value set was employed, because the correlation was nearly perfect (r = 0.993) between the EQ-5D index-based scores generated by each value set. For users of these measures, this study shows that the SGRQ has the advantage over generic measures in that it may be more likely to obtain a statistically significant result on a HRQL score if there are clinically meaningful differences/changes among patients. In addition, the EQ-5D index-based scores did not differentiate between the more severe stages of COPD. However, it is unclear if unobserved factors like comorbid conditions that might have been captured by the generic measure had a role in this finding.
This study had some limitations. The sample size used in our analyses may have yielded insufficient power to detect important differences across the severity stages. However, it was sufficiently powered to detect significant differences in EQ-5D scores . Our data was cross-sectional; therefore, we could not compare the responsiveness of the measures over time. Use of a clinically-based measure of severity (GOLD stage) as the basis for comparing HRQL instruments may be suboptimal, but there is no clear gold standard for anchoring known-group comparisons of HRQL measures. Since the data used in our study were collected, modified versions of the SGRQ and EQ-5D have been introduced. These are all considerations for future studies comparing the psychometric performance of HRQL measures in studies of COPD patients.
The SGRQ demonstrated greater ability to discriminate among different levels of severity stages of COPD and is more strongly correlated with clinical measures of COPD than generic measures of health. However, generic measures are intended to capture more broad aspects of health, and thus scores may potentially be less strongly correlated with clinical measures because they are capturing additional information on HRQL that is non-COPD related. For these reasons, generic and disease-specific measures may capture complementary information and it may be desirable to incorporate both types of measures in a study, depending on the goal of the study. As new versions of these widely used HRQL measures become available, such as a 5-level version of the EQ-5D, further comparisons - particularly using longitudinal data - will be useful in understanding the psychometric strengths and weaknesses of generic and disease-specific HRQL measures for the assessment and monitoring of COPD patient outcomes.
Yoojung Yang was supported by a Takeda/UIC fellowship in Health Economics and Outcomes Research. Simon Pickard was supported by an inter-personnel agreement with Edward Hines Jr. VA Hospital. We are grateful to Fang-Ju Lin, doctoral student in Pharmacy Administration, University of Illinois at Chicago, for her assistance with this manuscript.
- World Health Organization: Chronic obstructive pulmonary disease. [http://www.who.int/mediacentre/factsheets/fs315/en/index.html]
- Global Initiative for Chronic Obstructive Lung Disease: Global strategy for diagnosis, management, and prevention of COPD (updated 2010). [http://www.goldcopd.com/Guidelineitem.asp?l1=2&l2=1&intId=1116]
- Hajiro T, Nishimura K, Tsukino M, Ikeda A, Oga T, Izumi T: A comparison of the level of dyspnea vs disease severity in indicating the health-related quality of life of patients with COPD. Chest 1999,116(6):1632–1637.PubMedView Article
- Menn P, Weber N, Holle R: Health-related quality of life in patients with severe COPD hospitalized for exacerbations - comparing EQ-5D, SF-12 and SGRQ. Health and quality of life outcomes 8:39.
- Stahl E, Lindberg A, Jansson SA, Ronmark E, Svensson K, Andersson F, Lofdahl CG, Lundback B: Health-related quality of life is related to COPD disease severity. Health and quality of life outcomes 2005, 3:56.PubMedView ArticlePubMed Central
- Stavem K: Reliability, validity and responsiveness of two multiattribute utility measures in patients with chronic obstructive pulmonary disease. Qual Life Res 1999,8(1–2):45–54.PubMedView Article
- Alonso J, Prieto L, Ferrer M, Vilagut G, Broquetas J, Roca J, Batlle J, Antó J: Testing the measurement properties of the Spanish version of the SF-36 Health Survey among male patients with chronic obstructive pulmonary disease. Quality of Life in COPD Study Group. J Clin Epidemiol 1998, 51:1087–1094.PubMedView Article
- Tsukino M, Nishimura K, Ikeda A, Koyama H, Mishima M, Izumi T: Physiologic factors that determine the health-related quality of life in patients with COPD. Chest 1996, 110:896–903.PubMedView Article
- Hesselink A, van der Windt D, Penninx B, Wijnhoven H, Twisk J, Bouter L, van Eijk J: What predicts change in pulmonary function and quality of life in asthma or COPD? J Asthma 2006, 43:513–519.PubMedView Article
- Wijnhoven HAH, Kriegsman DMW, Hesselink AE, Penninx BWJH, de Haan M: Determinants of different dimensions of disease severity in asthma and COPD. Chest 2001,119(4):1034–1042.PubMedView Article
- Jones PW, Quirk FH, Baveystock CM: The St George's Respiratory Questionnaire. Respir Med 1991,85(Suppl B):25–31. discussion 23–27PubMedView Article
- Brooks R, Rabin R, Charro F, (eds): The measurement and valuation of health status using EQ-5D: a European perspective. Dordrecht: Kluwer Academic Publishers; 2003.
- Ware JE Jr, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): I. conceptual framework and item selection. Medical care 1992,30(6):473–483.PubMedView Article
- Katsura H, Yamada K, Kida K: Usefulness of a linear analog scale questionnaire to measure health-related quality of life in elderly patients with chronic obstructive pulmonary disease. Journal of the American Geriatrics Society 2003,51(8):1131–1135.PubMedView Article
- Pickard AS, Wilke C, Jung E, Patel S, Stavem K, Lee TA: Use of a preference-based measure of health (EQ-5D) in COPD and asthma. Respiratory Medicine 2008,102(4):519–536.PubMedView Article
- Szende A, Svensson K, Stahl E, Meszaros A, Berta G: Psychometric and utility-based measures of health status of asthmatic patients with different disease control level. PharmacoEconomics 2004,22(8):537–547.PubMedView Article
- Joo MJ, Lee TA, Bartle B, van de Graaff WB, Weiss KB: Patterns of healthcare utilization by COPD severity: a pilot study. Lung 2008,186(5):307–312.PubMedView Article
- Celli B, MacNee W: Standards for the diagnosis and treatment of patients with COPD: a summary of the ATS/ERS position paper. Eur Respir J 2004, 23:932–46.PubMedView Article
- Lung function testing: selection of reference values and interpretative strategiesAm Rev Respir Dis 1991, 144:1202–1218.
- Borg GA: Psychophysical bases of perceived exertion. Medicine and science in sports and exercise 1982,14(5):377–381.PubMedView Article
- Jones PW, Quirk FH, Baveystock CM, Littlejohns P: A self-complete measure of health status for chronic airflow limitation. The St. George's Respiratory Questionnaire. Am Rev Respir Dis 1992, 145:1321–1327.PubMedView Article
- Kazis LE, Ren XS, Lee A, Skinner K, Rogers W, Clark J, Miller DR: Health status in VA patients: results from the Veterans Health Study. American Journal of Medical Quality 1999,14(1):28–38.PubMedView Article
- Kazis LE, Miller DR, Clark JA, Skinner KM, Lee A, Ren XS, Spiro A, Rogers WH, Ware JE Jr: Improving the response choices on the veterans SF-36 health survey role functioning scales: results from the Veterans Health Study. The Journal of ambulatory care management 2004,27(3):263–280.PubMedView Article
- Dolan P: Modeling valuations for EuroQol health states. Medical care 1997,35(11):1095–1108.PubMedView Article
- Shaw JW, Johnson JA, Coons SJ: US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Medical care 2005,43(3):203–220.PubMedView Article
- Hays R, Anderson R, Revicki D: Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993, 2:441–449.PubMedView Article
- Juniper E, Guyatt G, Jaeschke R: Chapter 6: How to develop and validate a new health-related quality of life instrument. In Quality of Life and Pharmacoeconomics in Clinical Trials. 2nd edition. Edited by: Spilker B. Philadelphia: Lippincott-Raven Publishers; 1996:49–56.
- de Vries M, Ouwendijk R, Kessels AG, de Haan MW, Flobbe K, Hunink MGM, van Engelshoven JMA, Nelemans PJ: Comparison of generic and disease-specific questionnaires for the assessment of quality of life in patients with peripheral arterial disease. Journal of Vascular Surgery 2005,41(2):261–268.PubMedView Article
- Krahn M, Bremner K, Tomlinson G, Ritvo P, Irvine J, Naglie G: Responsiveness of disease-specific and generic utility instruments in prostate cancer patients. Quality of Life Research 2007,16(3):509–522.PubMedView Article
- Marra CA, Woolcott JC, Kopec JA, Shojania K, Offer R, Brazier JE, Esdaile JM, Anis AH: A comparison of generic, indirect utility measures (the HUI2, HUI3, SF-6D, and the EQ-5D) and disease-specific instruments (the RAQoL and the HAQ) in rheumatoid arthritis. Social Science & Medicine 2005,60(7):1571–1582.View Article
- Pickard AS, Neary MP, Cella D: Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health and quality of life outcomes 2007, 5:70.PubMedView ArticlePubMed Central
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.