Comparison of health-related quality of life measures in chronic obstructive pulmonary disease
Health and Quality of Life Outcomes volume 9, Article number: 26 (2011)
The aims of this study were: (1) to compare the discriminative ability of a disease-specific instrument, the St. George's Respiratory Questionnaire (SGRQ) to generic instruments (i.e., EQ-5D and SF-36); and (2), to evaluate the strength of associations among clinical and health-related quality of life (HRQL) measures in chronic obstructive pulmonary disease (COPD).
We analyzed data collected from 120 COPD patients in a Veterans Affairs hospital. Patients self-completed two generic HRQL measures (EQ-5D and SF-36) and the disease-specific SGRQ. The ability of the summary scores of these HRQL measures to discriminate COPD disease severity based on Global Obstructive Lung Disease (GOLD) stage was assessed using relative efficiency ratios (REs). Strength of correlation was used to further evaluate associations between clinical and HRQL measures.
Mean total scores for PCS-36, EQ-VAS and SGRQ were significantly lower for the more severe stages of COPD (p < 0.05). Using SGRQ total score as reference, the summary scores of the generic measures (PCS-36, MCS-36, EQ index, and EQ-VAS) all had REs of <1. SGRQ exhibited a stronger correlation with clinical measures than the generic summary scores. For instance, SGRQ was moderately correlated with FEV1 (r = 0.43), while generic summary scores had trivial levels of correlation with FEV1 (r < 0.2).
The SGRQ demonstrated greater ability to discriminate among different levels of severity stages of COPD than generic measures of health, suggestive that SGRQ may provide COPD studies with greater statistical power than EQ-5D and SF-36 summary scores to capture meaningful differences in clinical severity.
Chronic obstructive pulmonary disease (COPD) is a leading cause of death worldwide and is associated with a high burden of illness , particularly in terms of health-related quality of life (HRQL). COPD is characterized by airflow obstruction that is not fully reversible and symptoms such as dyspnea, sputum production, and chronic cough . Airflow limitation is usually progressive; thus daily activities can become very difficult as the condition gradually worsens. Consequently, the burden of COPD on HRQL disease tends to increase with COPD severity [3–6].
HRQL is inherently subjective, involving patient self-assessment of multiple dimensions of health that often are not strongly correlated with clinical indicators of COPD [7, 8]. Measures of self-reported HRQL and pulmonary function assess different aspects of the disease and therefore provide complementary information [9, 10]. Both generic and disease-specific HRQL instruments are used in COPD. St. George's Respiratory Questionnaire (SGRQ) is a disease-specific measure used in both COPD and asthma research . EQ-5D  and the SF-36  are generic measures of health often used in studies of COPD [3, 5, 10, 14, 15].
The severity of disease in a study population may affect the choice of instruments to measure health status. For instance, EQ-5D demonstrated fewer floor effects among patients with more severe asthma while SF-6D, a utility-based measure derived from items on the SF-36, demonstrated fewer ceiling effects and thus would be a more preferable measure to assess HRQL in patients with mild asthma who have good disease control . A meta-analysis that examined EQ-5D index-based scores by COPD severity found that while mean scores decreased with the severity of GOLD stages, there was little discrimination of scores for moderate to severe stages of disease . Such studies suggest that the performance of a HRQL measure may depend on the severity of COPD in a patient population. We were interested in further investigating the strengths and limitations of disease-specific and generic HRQL measures, particularly EQ-5D, SF-36 and SGRD, to better inform the selection of PRO measures in clinically heterogeneous COPD patient populations. Thus, aims of this study were: (1) to compare the discriminative ability of a disease-specific HRQL instrument (i.e., SGRQ) versus a generic instrument (i.e., EQ-5D); and (2), to evaluate the strength of associations among various clinical and HRQL measurements in COPD.
We conducted a secondary data analysis of de-identified patient data from a study conducted in a Veterans Administration (VA) hospital. A previous publication described how the original data was obtained . First, investigators identified patients with any inpatient or outpatient diagnosis of COPD in the previous 12 months and received VA care for at least 12 months prior to the study. Next, eligible patients were contacted by mail and received a follow-up phone call inviting them to participate in the study. If they consented, participants came to a pulmonary function laboratory where they completed pulmonary function testing, a 6-minute walk test (6MWT), and several self-reported measures, including the Borg dyspnea scale, SGRQ, SF-36, and EQ-5D. Respondents also completed a brief demographic questionnaire that asked about smoking history, including number of years that they smoked and average number of packs smoked per day. Number of pack-years was calculated based on number of years smoked (smoke-year) multiplied by average number of packs of cigarettes smoked per day (packs/day). As the present study was conducted using only de-identified data, it was granted exempt status by the UIC Office for the Protection of Research Subjects.
We used forced expiratory volume in 1 second (FEV1) and forced expiratory vital capacity (FVC) to assess lung function. According to The Global Initiative for chronic Lung Disease (GOLD) guidelines , once airway obstruction is established based on a FEV1/FVC ratio of <0.70, COPD are categorized into 4 stages of disease: mild (FEV1 ≧ 80%), moderate (FEV1 ≧ 50-79%), severe (FEV1 ≧ 30-49%), and very severe (FEV1 < 30%) .
FEV1 was expressed as a percentage of predicted normal values based on age, gender and height . 6MWT is a widely used assessment of functional status in patients with COPD. It measures the distance (in meters) that a patient can walk on their own pace in six minutes. Dyspnea was measured on the Borg dyspnea scale . Borg scores range from 0 (no breathlessness) to 10 (maximum breathlessness).
SGRQ is self-administered and includes 50 items in three components: symptoms, activity, and impact on daily life . The SGRQ scores range from 0 to 100, with 0 indicating no impairment in the quality of life. Higher scores on the SGRQ represent worse HRQL. MID of four points was proposed for the SGRQ total score.
The veterans SF-36 is a slightly modified version of the SF-36 [13, 22] that consists of 8 domains: general health, physical functioning, role function, role emotional, bodily pain, vitality, social functioning, and mental health. In addition, two summary scores, a physical component summary (PCS) and mental component summary (MCS) score can be calculated. The main modification made to the veterans SF-36 was to expand the number of response options from 2 to 5 for the role functioning scales due to physical health problems or emotional problems, which improved the properties of scales and the summary scores .
EQ-5D is a generic, preference-based utility instrument that includes a descriptor health classifier and a visual analog scale (VAS) . The self-classifier has five dimensions including mobility, self-care, usual activities, pain/discomfort and anxiety/depression. An index-based utility score was calculated using algorithms for societal preference weights from the United Kingdom  and from the United States . The VAS score is a rating of health today by the respondent where 0 represents worst imaginable health state and 100 represents best imaginable health.
Chi-square tests were used to test whether there were differences in patient characteristics for nominal variables across stages of COPD. Differences in means for continuous variables were examined using analysis of variance (ANOVA) and the non-parametric equivalent (Kruskal-Wallis) tests across the four stages of severity. Relative efficiency (RE) ratios were calculated by taking the ratio of the ANOVA-based test statistics, e.g. F-statistics, associated with the reference and comparator measure . The SGRQ total summary score served as the reference measure in the calculation of RE ratios. Correlation between measures was calculated using Pearson's correlation coefficients (r). Strength of correlation was categorized as follows: absent (<0.20), poor (0.20-0.34), moderate (0.35-0.50) and strong (>0.50) . A p-value < 0.05 was interpreted as statistically significant.
We hypothesized that the correlations between SGRQ and clinical measures, i.e. Borg dyspnea scale and 6MWT, would be stronger than between the summary scores of generic measures and the clinical measures, as SGRQ includes items specifically related to breathing problems. We also hypothesized moderate to strong correlations between the summary scores of the SGRQ, SF-36, and EQ-5D.
The mean (SD) age of the cohort was 71.3 (±10.3), and greater than 90% were white males. Patient characteristics did not differ across stages of COPD severity (Table 1). The exception was number of years smoked, which was significantly lower among patients with mildest stage of COPD (p = 0.02).
Mean FEV1, 6MWT, and Borg dyspnea scores were significantly different across GOLD stage (ANOVA/KWT, p-values < 0.001), with poorer functioning observed for patients with more severe COPD (Table 2). Mean symptom, activity, and impact and total SGRQ scores were significantly different across stages of disease, (ANOVA/KWT, all p-values < 0.001 except a p-value of 0.03 for symptom score), with activity and total scores getting worse with stage of disease. Mean SGRQ symptom and impact scores declined across stages 1 to 3, but stage 4 scores were slightly less severe than stage 3. Mean PCS and MCS scores both demonstrated a trend towards decline in health status with COPD severity, but only PCS mean scores were statistically different across COPD stage (p = 0.02). The mean EQ-5D index score (both UK and US) did not differ across the stages (p = 0.25). Mean EQ-5D VAS scores were different across stage of disease, with lower mean scores for more severe stage of disease (p = 0.02).
Using the SGRQ total score as the reference, relative efficiency ratios indicated that summary scores for SF-36 and EQ-5D were less efficient at discriminating between COPD stages (RE < 1) (Table 2). For the purpose of discriminating among COPD patients according to stage of disease, results indicated that only the SGRQ activity component score was more efficient than the SGRQ total score, i.e. RE > 1 (Table 2).
SGRQ activity and total scores demonstrated stronger correlations with the clinical measures than the other HRQL scores, although all HRQL measures had moderate to strong correlations with the dyspnea scale (Table 3). The summary scores of the generic measures - SF-36 PCS and MCS and EQ-5D index and VAS - were poorly correlated with FEV1 (r < 0.2), and poor-to-moderately correlated with 6MWT (r = 0.16 to 0.40). SGRQ total and impact scores were strongly correlated with both SF-36 and EQ-5D scores (r ≥ 0.5). The SGRQ symptom score exhibited moderate correlation with SF-36 and EQ-5D summary scores (0.35 ≤ r < 0.5). The correlation between the activity score and the generic instruments ranged from poor-to-moderate (0.2 ≤ r < 0.5).
The results of this study supported the hypothesis that the disease-specific SGRQ had greater ability to discriminate among levels of COPD severity than generic measures of HRQL, i.e. SF-36 and EQ-5D. This finding is consistent with the other results that indicate the SGRQ is more strongly correlated with clinical measures than the summary scores of the generic measures. The correlation between generic HRQL summary scores - SF-36 and EQ-5D - and FEV1 was trivial, similar to a previous study . GOLD stage is predicated upon breathing function, and the generic measures do not directly include items on breathing-related symptoms, while SGRQ does include such items. The RE ratios favoured the SGRQ total and activity scores, which suggests that those scales may provide greater statistical power to detect significant differences/changes in HRQL in COPD patients than the other measures, particularly if the study is intended to capture changes related to clinical severity.
Greater discriminative ability of disease-specific measures compared to generic HRQL measures has been reported in studies of other conditions [28–30]. In peripheral arterial disease, the disease-specific Vascular Quality of Life (VascuQol) measure was more discriminative than the EQ-5D and SF-36 . In rheumatoid arthritis, Marra et al. found that the Rheumatoid Arthritis Quality of Life Questionnaire had greater ability to discriminate among the levels of severity of patients than the EQ-5D and SF-6D .
The EQ-5D VAS was better able to discriminate levels of HRQL according severity of disease than the EQ-5D index score in COPD patients. Unlike EQ-5D index-based scores, mean EQ-5D VAS scores decreased monotonically with stage of COPD, and the difference in VAS mean scores by severity represented what could be considered an important difference in VAS scores between stage 1, 2 and 3 . It is important to note that COPD is often accompanied by other co-morbid conditions which were not captured in our data and may differentially affect the ability of HRQL measures to capture burden of illness.
Our study contributes to the literature on HRQL measurement in COPD in several ways. We present further evidence to support the validity of disease-specific and generic measures consistent with a previous study , but in a cohort of older and more severe COPD patients. Similar to Stahl and colleagues, we found that SGRQ total, PCS, and EQ-5D index and VAS scores got worse with severity based on GOLD stage . Particular to this study, we showed that SGRQ scores were associated with greater statistical power to discriminate among levels of COPD severity using REs. We also found that the strengths of correlation between measures and EQ-5D index-based scores were nearly identical regardless of whether the UK or US value set was employed, because the correlation was nearly perfect (r = 0.993) between the EQ-5D index-based scores generated by each value set. For users of these measures, this study shows that the SGRQ has the advantage over generic measures in that it may be more likely to obtain a statistically significant result on a HRQL score if there are clinically meaningful differences/changes among patients. In addition, the EQ-5D index-based scores did not differentiate between the more severe stages of COPD. However, it is unclear if unobserved factors like comorbid conditions that might have been captured by the generic measure had a role in this finding.
This study had some limitations. The sample size used in our analyses may have yielded insufficient power to detect important differences across the severity stages. However, it was sufficiently powered to detect significant differences in EQ-5D scores . Our data was cross-sectional; therefore, we could not compare the responsiveness of the measures over time. Use of a clinically-based measure of severity (GOLD stage) as the basis for comparing HRQL instruments may be suboptimal, but there is no clear gold standard for anchoring known-group comparisons of HRQL measures. Since the data used in our study were collected, modified versions of the SGRQ and EQ-5D have been introduced. These are all considerations for future studies comparing the psychometric performance of HRQL measures in studies of COPD patients.
The SGRQ demonstrated greater ability to discriminate among different levels of severity stages of COPD and is more strongly correlated with clinical measures of COPD than generic measures of health. However, generic measures are intended to capture more broad aspects of health, and thus scores may potentially be less strongly correlated with clinical measures because they are capturing additional information on HRQL that is non-COPD related. For these reasons, generic and disease-specific measures may capture complementary information and it may be desirable to incorporate both types of measures in a study, depending on the goal of the study. As new versions of these widely used HRQL measures become available, such as a 5-level version of the EQ-5D, further comparisons - particularly using longitudinal data - will be useful in understanding the psychometric strengths and weaknesses of generic and disease-specific HRQL measures for the assessment and monitoring of COPD patient outcomes.
Chronic obstructive pulmonary disease
Global burden of obstructive lung disease
Health-related quality of life
- FEV1 :
Forced expiratory volume in 1 second
Forced expiratory vital capacity
Kruskal Wallis test
St. George's respiratory questionnaire
Short-form 36 item questionnaire
Visual analog scale
six minute walk test.
World Health Organization: Chronic obstructive pulmonary disease. [http://www.who.int/mediacentre/factsheets/fs315/en/index.html]
Global Initiative for Chronic Obstructive Lung Disease: Global strategy for diagnosis, management, and prevention of COPD (updated 2010). [http://www.goldcopd.com/Guidelineitem.asp?l1=2&l2=1&intId=1116]
Hajiro T, Nishimura K, Tsukino M, Ikeda A, Oga T, Izumi T: A comparison of the level of dyspnea vs disease severity in indicating the health-related quality of life of patients with COPD. Chest 1999,116(6):1632–1637. 10.1378/chest.116.6.1632
Menn P, Weber N, Holle R: Health-related quality of life in patients with severe COPD hospitalized for exacerbations - comparing EQ-5D, SF-12 and SGRQ. Health and quality of life outcomes 8: 39.
Stahl E, Lindberg A, Jansson SA, Ronmark E, Svensson K, Andersson F, Lofdahl CG, Lundback B: Health-related quality of life is related to COPD disease severity. Health and quality of life outcomes 2005, 3: 56. 10.1186/1477-7525-3-56
Stavem K: Reliability, validity and responsiveness of two multiattribute utility measures in patients with chronic obstructive pulmonary disease. Qual Life Res 1999,8(1–2):45–54.
Alonso J, Prieto L, Ferrer M, Vilagut G, Broquetas J, Roca J, Batlle J, Antó J: Testing the measurement properties of the Spanish version of the SF-36 Health Survey among male patients with chronic obstructive pulmonary disease. Quality of Life in COPD Study Group. J Clin Epidemiol 1998, 51: 1087–1094. 10.1016/S0895-4356(98)00100-0
Tsukino M, Nishimura K, Ikeda A, Koyama H, Mishima M, Izumi T: Physiologic factors that determine the health-related quality of life in patients with COPD. Chest 1996, 110: 896–903. 10.1378/chest.110.4.896
Hesselink A, van der Windt D, Penninx B, Wijnhoven H, Twisk J, Bouter L, van Eijk J: What predicts change in pulmonary function and quality of life in asthma or COPD? J Asthma 2006, 43: 513–519. 10.1080/02770900600856954
Wijnhoven HAH, Kriegsman DMW, Hesselink AE, Penninx BWJH, de Haan M: Determinants of different dimensions of disease severity in asthma and COPD. Chest 2001,119(4):1034–1042. 10.1378/chest.119.4.1034
Jones PW, Quirk FH, Baveystock CM: The St George's Respiratory Questionnaire. Respir Med 1991,85(Suppl B):25–31. discussion 23–27
Brooks R, Rabin R, Charro F, (eds): The measurement and valuation of health status using EQ-5D: a European perspective. Dordrecht: Kluwer Academic Publishers; 2003.
Ware JE Jr, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): I. conceptual framework and item selection. Medical care 1992,30(6):473–483. 10.1097/00005650-199206000-00002
Katsura H, Yamada K, Kida K: Usefulness of a linear analog scale questionnaire to measure health-related quality of life in elderly patients with chronic obstructive pulmonary disease. Journal of the American Geriatrics Society 2003,51(8):1131–1135. 10.1046/j.1532-5415.2003.51363.x
Pickard AS, Wilke C, Jung E, Patel S, Stavem K, Lee TA: Use of a preference-based measure of health (EQ-5D) in COPD and asthma. Respiratory Medicine 2008,102(4):519–536. 10.1016/j.rmed.2007.11.016
Szende A, Svensson K, Stahl E, Meszaros A, Berta G: Psychometric and utility-based measures of health status of asthmatic patients with different disease control level. PharmacoEconomics 2004,22(8):537–547. 10.2165/00019053-200422080-00005
Joo MJ, Lee TA, Bartle B, van de Graaff WB, Weiss KB: Patterns of healthcare utilization by COPD severity: a pilot study. Lung 2008,186(5):307–312. 10.1007/s00408-008-9095-5
Celli B, MacNee W: Standards for the diagnosis and treatment of patients with COPD: a summary of the ATS/ERS position paper. Eur Respir J 2004, 23: 932–46. 10.1183/09031936.04.00014304
Lung function testing: selection of reference values and interpretative strategies Am Rev Respir Dis 1991, 144: 1202–1218.
Borg GA: Psychophysical bases of perceived exertion. Medicine and science in sports and exercise 1982,14(5):377–381.
Jones PW, Quirk FH, Baveystock CM, Littlejohns P: A self-complete measure of health status for chronic airflow limitation. The St. George's Respiratory Questionnaire. Am Rev Respir Dis 1992, 145: 1321–1327.
Kazis LE, Ren XS, Lee A, Skinner K, Rogers W, Clark J, Miller DR: Health status in VA patients: results from the Veterans Health Study. American Journal of Medical Quality 1999,14(1):28–38. 10.1177/106286069901400105
Kazis LE, Miller DR, Clark JA, Skinner KM, Lee A, Ren XS, Spiro A, Rogers WH, Ware JE Jr: Improving the response choices on the veterans SF-36 health survey role functioning scales: results from the Veterans Health Study. The Journal of ambulatory care management 2004,27(3):263–280.
Dolan P: Modeling valuations for EuroQol health states. Medical care 1997,35(11):1095–1108. 10.1097/00005650-199711000-00002
Shaw JW, Johnson JA, Coons SJ: US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Medical care 2005,43(3):203–220. 10.1097/00005650-200503000-00003
Hays R, Anderson R, Revicki D: Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993, 2: 441–449. 10.1007/BF00422218
Juniper E, Guyatt G, Jaeschke R: Chapter 6: How to develop and validate a new health-related quality of life instrument. In Quality of Life and Pharmacoeconomics in Clinical Trials. 2nd edition. Edited by: Spilker B. Philadelphia: Lippincott-Raven Publishers; 1996:49–56.
de Vries M, Ouwendijk R, Kessels AG, de Haan MW, Flobbe K, Hunink MGM, van Engelshoven JMA, Nelemans PJ: Comparison of generic and disease-specific questionnaires for the assessment of quality of life in patients with peripheral arterial disease. Journal of Vascular Surgery 2005,41(2):261–268. 10.1016/j.jvs.2004.11.022
Krahn M, Bremner K, Tomlinson G, Ritvo P, Irvine J, Naglie G: Responsiveness of disease-specific and generic utility instruments in prostate cancer patients. Quality of Life Research 2007,16(3):509–522. 10.1007/s11136-006-9132-x
Marra CA, Woolcott JC, Kopec JA, Shojania K, Offer R, Brazier JE, Esdaile JM, Anis AH: A comparison of generic, indirect utility measures (the HUI2, HUI3, SF-6D, and the EQ-5D) and disease-specific instruments (the RAQoL and the HAQ) in rheumatoid arthritis. Social Science & Medicine 2005,60(7):1571–1582. 10.1016/j.socscimed.2004.08.034
Pickard AS, Neary MP, Cella D: Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health and quality of life outcomes 2007, 5: 70. 10.1186/1477-7525-5-70
Yoojung Yang was supported by a Takeda/UIC fellowship in Health Economics and Outcomes Research. Simon Pickard was supported by an inter-personnel agreement with Edward Hines Jr. VA Hospital. We are grateful to Fang-Ju Lin, doctoral student in Pharmacy Administration, University of Illinois at Chicago, for her assistance with this manuscript.
Simon Pickard is a member of the EuroQol group, a not for profit foundation that distributes the EQ-5D.
ASP and TAL conceptualized the study, TAL obtained the data, ASP and YY analysed the data and drafted the manuscript. All authors provided input on the interpretation and they read and approved of the final draft of the manuscript.
About this article
Cite this article
Pickard, A.S., Yang, Y. & Lee, T.A. Comparison of health-related quality of life measures in chronic obstructive pulmonary disease. Health Qual Life Outcomes 9, 26 (2011). https://doi.org/10.1186/1477-7525-9-26
- respiratory disease
- quality of life
- health status