Skip to main content

Content validity of preference-based measures for economic evaluation in chronic obstructive pulmonary disease

Abstract

Background

Generic preference-based measures (GPBMs) are health-related quality of life (HRQoL) measures commonly used to evaluate the cost-utility of interventions in healthcare. However, the degree to which the content of GPBMs reflect the HRQoL of individuals with chronic obstructive pulmonary disease (COPD) has not yet been assessed. The purpose of this study was to examine the content and convergent validity of GPBMs in people with COPD.

Methods

COPD patients were recruited from healthcare centers in Ontario, Canada. The Patient-Generated Index (PGI) (an individualized HRQoL measure) and the RAND-36 (to obtain SF-6D scores; a GPBM) were administered. Life areas nominated with the PGI were coded using the International Classification of Functioning Disability and Health and mapped onto GPBMs.

Results

We included 60 participants with a mean age of 70 and FEV1% predicted of 43. The mean PGI score was 34.55/100 and the top three overarching areas that emerged were: ‘mobility’ (25.93%), ‘recreation and leisure’ (25.19%) and ‘domestic life’ (19.26%). Mapping of the nominated areas revealed that the Quality of Well-Being scale covered the highest number of areas (84.62%), Health Utilities Indices covered the least (15.38% and 30.77%) and other GPBMs covered between 46 and 62%. A correlation of 0.32 was calculated between the SF-6D and the PGI.

Conclusions

The majority of GPBMs covered approximately half of the areas reported as being important to individuals with COPD. When areas relevant to COPD are not captured, HRQoL scores generated by these measures may inaccurately reflect patients’ values and affect cost-effectiveness decisions.

Background

Health-related quality of life (HRQoL) is “an individual’s perception of how an illness and its treatment affect the physical, mental and social aspects of his or her life” [1]. Different methods of measuring HRQoL have been developed and can be used in research to assign a value to one’s overall HRQoL. Among these methods are generic preference-based measures (GPBMs), which are patient-reported outcome measures of HRQoL that can be used for cost-utility analyses of different interventions [2]. Some well-known GPBMs are the EuroQol 5-Dimensions (EQ-5D), the Six-Dimensional Short Form Survey (SF-6D) and the Health Utilities Index Mark 3 (HUI3) [3]. They are typically anchored from 0.0 (death) to 1.0 (perfect-health), and this value of HRQoL can be used to calculate quality-adjusted life years (QALYs) for an intervention by multiplying it by the number of years the intervention is predicted to extend life. QALYs can be used by healthcare professionals and policymakers to make decisions about resource allocation and implementation of interventions.

Individuals with chronic obstructive pulmonary disease (COPD) experience respiratory symptoms, such as cough, difficulty breathing and fatigue, which have been found to affect HRQoL [4, 5]. Luckily, many treatments have shown to increase health status in people with COPD [6]. The use of GPBMs in COPD can help determine which treatments are more effective in terms of both quality and quantity of life. However, before a measure is used to make cost-effectiveness decisions for a specific population, its psychometric properties should be tested to ensure its reliability and validity [7]. Content validity of GPBMs in people with COPD has not yet been evaluated [8] and is a fundamental step in establishing a measure’s validity as it assesses whether the measure reflects the construct under study [9]. Therefore, the primary objective of this study is to assess the content validity of GPBMs by estimating the extent to which GPBMs capture domains of quality of life that are important to individuals with COPD, as measured by the Patient-Generated Index (PGI).

The SF-36 is a widely used health profile in research studies and clinical trials [10,11,12,13]. It is easy to use (can be self-administered and completed within 5 min) and has been translated and adapted in several countries, making it widely available [10, 14]. Preference-based scores can easily be obtained from the SF-36 data [15] and be used to make cost-effectiveness comparisons for different disease groups and populations [16]. Preference-based scores obtained from the SF-36 are known as SF-6D scores [15]. A recent systematic review demonstrated the need for further research on the performance of the SF-6D in COPD [8]. Therefore, the secondary objective of this study is to examine the convergent validity of a well-known GPBM; the SF-6D [3], against the PGI.

Methods

Participants

Participants were recruited from outpatient clinics and pulmonary rehabilitation programs at two academic centers in Ontario. Eligibility criteria for the study included: 1) over the age of 18, 2) a clinical physician-diagnosis of COPD, and 3) smoking history of at least 10 pack-years. Individuals who were not able to speak/understand English and those with a severe disability (caused by a musculoskeletal or neurological condition unrelated to their COPD) were excluded.

Outcome measures

Sociodemographic and clinical characteristics

Sociodemographic information, such as sex, age, number of pack years, oxygen use and mobility aid use, and clinical information, such as comorbidities and spirometry results (i.e., forced expiratory volume in one second (FEV1), forced vital capacity (FVC)), were obtained.

The Patient-Generated Index (PGI)

The PGI has been utilized in previous content validity studies to identify areas of quality of life important to individuals with chronic conditions [17,18,19]. This individualized measure of HRQoL was administered in three stages. First, participants were asked to list up to five most important areas of their life affected by their COPD, with the last/sixth item being: ‘all other areas of life that are not mentioned above’. Second, participants were asked to rate each area on a scale from 0 (the worst you could imagine) to 10 (exactly as you would like it to be), relative to the past month. Third, participants were given 12 imaginary points and asked to distribute these points among the areas which they would like to have improved; more points being allocated to areas with more hopes of improvement. The rating of each area and the proportion of complementary points allocated were multiplied and summed to produce a total score of HRQoL on a scale from 0 to 10; with higher scores indicating better HRQoL [20]. This score is typically reported as a percentage [21].

The Six-Dimensional Short Form Survey (SF-6D)

The SF-6D is a commonly used GPBM, developed by Brazier et al. [15, 22], from the SF-36 (generic health profile). The SF-6D defines 18,000 health states and items cover 6 dimensions: physical functioning, role limitation, social functioning, pain, mental health and vitality [23, 24]. The RAND-36, a distributable version of the SF-36, was used to obtain SF-6D scores as recommended by the developers [25]. The RAND-36 is a 36-item questionnaire that covers various domains of HRQoL, across 8 scales, varying from physical functioning to mental health and social functioning, summed into 2 subscales (Physical and Mental Health) [26]. Scores obtained from the RAND-36 were transformed to SF-6D scores using an algorithm developed by Kharroubi et al. [27], using non-parametric Bayesian preference weights. The SF-6D produces a HRQoL score from 0.2 (worst possible health state) to 1.0 (perfect health state) [27]. Permission to use the SF-6D algorithm was obtained from the developers.

Procedure

Eligible participants who provided informed consent completed the PGI and the RAND-36 in person or over the phone. The areas reported from the PGI were coded independently by two reviewers (AM and SO) using the World Health Organization’s International Classification of Functioning, Disability and Health (ICF) [28]. A third reviewer (AK) was consulted if agreement between the reviewers was not reached. The most specific code was selected for each reported area, and if the reported area covered more than one code, then all codes were stated. Similar codes were then pooled together (e.g., ‘recreation and leisure, unspecified’ and ‘recreation and leisure, other specified’).

Overarching domains were identified from the codes and mapped onto GPBMs: the EQ-5D, the SF-6D, the Health Utilities Index Mark 2 (HUI2), the Health Utilities Index Mark 3 (HUI3), the Assessment of Quality of Life 8-Dimensions (AQoL-8D), the 15-Dimensional (15D) and the Quality of Well-Being Self-Administered (QWB-SA) scale [3]. Mapping was also performed independently by two reviewers (AM and SO) with a third reviewer (AK) for consultation, if needed. This methodology followed previous studies examining content validity of GPBMs using the PGI [17, 18]. A flow diagram of the study’s procedure is outlined in Fig. 1.

Fig. 1
figure 1

Flow diagram outlining the study’s procedure

Statistical analysis

All statistical analyses were performed using Stata, version 15.1 (StataCorp, College Station, TX, USA). Descriptive statistics (mean and standard deviation, or frequency and percentage) were calculated to analyze participants’ sociodemographic/clinical information, ICF codes/domains identified and domains covered by GPBMs. A Pearson’s correlation coefficient was calculated to assess the correlation between the SF-6D and PGI scores. A positive correlation coefficient of at least 0.5 was hypothesized between the PGI and the SF-6D, as both measures are evaluating the construct of HRQoL [29].

Sample size

There are no specific sample size estimates for content validation; therefore, our sample size was based on the number needed to achieve saturation. Common saturation guidelines agree that saturation for qualitative analysis is achieved at small sample sizes (e.g., around 20–30) and usually do not need to be greater than 60 [30].

Results

Sample characteristics

Table 1 outlines the clinical and sociodemographic characteristics for the study sample. For our 60 participants, the mean age of the sample was 70 years and approximately 57% were males. On average, participants had a smoking history of 44 pack-years; 45% used supplemental oxygen and 50% used a mobility aid (e.g., walker, cane, wheelchair). The mean FEV1% predicted of the sample was approximately 43, with the majority having severe to very severe airflow obstruction (GOLD stage 3–4) [6]. The most common comorbidities were cardiac and/or respiratory (e.g., asthma). The mean PGI score was approximately 35 out of 100, with 100 being the highest self-reported HRQoL. The mean SF-6D score was 0.57 out of 1, with 1 representing best HRQoL.

Table 1 Clinical and sociodemographic characteristics of sample (N = 60)

Life areas important to COPD

Nineteen overarching domains were identified and thirteen appeared more than once. Table 2 presents the thirteen domains. The top three overarching domains were ‘mobility’ (25.93%), ‘recreation and leisure’ (25.19%) and ‘domestic life’ (19.26%). Specifically, ‘mobility’ included walking and using transportation, ‘recreation and leisure’ included socializing, hobbies and sports, and ‘domestic life’ included housework, preparing meals and shopping.

Table 2 Overarching domains identified more than once from the Patient-Generated Index (total n = 270)

Figure 2 outlines the mean severity rating (from 0 to 10, where 0 is the worst and 10 is the best one could imagine that area to be) of each overarching domain. Although, ‘work and employment’ was reported only 8 times, it was found to be the area most severely impacted by COPD with a mean score close to 2 out of 10 (very poor). ‘Mobility’, ‘recreation and leisure’, ‘domestic life’ and ‘interpersonal relationships’ were also severely affected with mean scores ranging from 3 (poor) to 4 (between poor and fair).

Fig. 2
figure 2

Mean severity rating given to each overarching domain appearing more than once, scaled from 0 (the worst one could imagine) to 10 (exactly as one would like it to be) n = number of appearances

Figure 3 outlines the mean number of points (out of 12) that participants allocated to the overarching domains, indicating their desire for improvement in that area. With a frequency of 3, ‘respiratory system functions’ (e.g., breathing) was the area most desired for improvement (mean 6 points; 50% of their points), followed by ‘environmental factors’ (e.g., weather conditions) (mean 4.4 points; 37% of their points) and ‘mobility’ (mean 4 points; 33% of their points). Participants’ spent on average 2.5 points (21% of their points) on ‘recreation and leisure’, ‘domestic life’, ‘interpersonal relationships’ and ‘mental functions’ each.

Fig. 3
figure 3

Mean number of points (out of 12) for improvement desires allocated to each overarching domain appearing more than once n = number of appearances

Content validity

Table 3 presents the mapping of the overarching domains against items on the GPBMs. The QWB-SA covered the highest number of domains important to individuals with COPD (84.62%) and the HUIs covered the least (15.38% and 30.77%). The rest of the GPBMs covered between 46 and 62%. ‘Mobility’ and ‘mental functions’ domains were covered by all the measures, and ‘environmental factors’ and ‘looking after one’s health’ were not covered by any of the measures. ‘Recreation and leisure’ and ‘domestic life’, areas commonly reported by participants, were covered by the EQ-5D, SF-6D, AQoL-8D, 15D and QWB-SA, but not by HUI2 and HUI3. ‘Interpersonal relationships’ was covered by the AQoL-8D, 15D and QWB-SA, but not by EQ-5D, SF-6D, HUI2 and HUI3.

Table 3 Mapping of overarching domains, identified by COPD patients, onto GPBMs

Convergent validity

A Pearson’s correlation coefficient of 0.32 was calculated between the PGI and the SF-6D. Figure 4 presents a scatter plot of SF-6D scores against PGI scores. Correlation values between the two measures did not fall around the line of best fit and were scattered, but did follow an upward trend, indicating a weak positive correlation between the measures [31].

Fig. 4
figure 4

Scatter plot of SF-6D scores against Patient-Generated Index scores with a line of best fit

Discussion

This was the first study to evaluate the content validity of GPBMs in individuals with COPD [8]. Areas of life most affected by COPD were identified by people with COPD, coded using the ICF and mapped onto GPBMs. A major finding of this study was that the majority of GPBMs covered only half of the areas reported as being important to individuals with COPD. In particular, several domains, such as respiratory problems, interpersonal relationships and work and employment, were missing from one or more of the GPBMs. We also found the SF-6D, a well-known GPBM, to be weakly associated with the PGI, an individualized measure of HRQoL capturing issues COPD patients consider important. Taken together, these findings suggest that GPBMs may not necessarily be suitable for assessing the HRQoL of COPD patients for cost-effectiveness analyses.

Many of the domains reported by patients with COPD were both severely affected and had a large proportion of points allocated to them, indicating their importance to participants. Mobility, for example, was not only an area that was severely impacted, but also an area that participants desired to improve notably. Without mobility, other aspects of life may become impaired. Being able to leave one’s house can help expand one’s social circle and allow for engagement in meaningful activities [32]. Similarly, physical movement is needed to engage in sports or perform chores around the house. This was evident in our findings as individuals with COPD highly reported social and participation restrictions in addition to mobility. Respiratory function was the second most impacted area by COPD and was given the highest amount of points in terms of desire for improvement. Even though this area was not highly reported, this finding suggests that among those listing it as important, they found it to be severely impacted by COPD and valued it highly by allocating, on average, half of their points to this area.

One of the biggest advantages of GPBMs is that they can be used for economic evaluation purposes to determine the cost-utility of alternative treatments and programs. They allow the different dimensions of health to be combined into a single index with anchors from 0 (death) to 1 (perfect health). GPBMs attach explicit weights to the various dimensions of health, allowing trade-offs to be made between them [24]. However, in the context of COPD, the majority of GPBMs, including the most widely used GPBM for cost-effectiveness analysis; the EQ-5D [3], only covered approximately half of the areas reported as being important to patients. Interpersonal relationships, a frequently reported affected area, along with carrying/lifting objects, changing/maintaining body positions and respiratory problems were not covered by the majority of these measures. If such aspects are not captured by preference-based measures, then the overall HRQoL score may be inaccurate in terms of its reflection of patients’ values, and thus, the cost-effectiveness of healthcare interventions and decisions made based on these results may also be inaccurate.

The HUIs covered less than one third of the areas nominated by COPD patients. The HUI3 evolved from the HUI1 and HUI2 [33], which were originally developed for infants and children [34, 35]. Although the HUI2 has been applied in older populations (i.e., Alzheimer’s disease) [36], its validity was not tested and some domains, such as ‘fertility’, remain relevant to younger populations. HUI2 and HUI3 focus on sensory difficulties, which is not necessarily relevant to a respiratory disease population. The HUIs were developed using the “within the skin” definition of health status, which focuses on impairments and excludes social interactions [33, 37]. Therefore, frequently reported areas, such as recreation and leisure, domestic life and interpersonal relationships, that encompass social aspects of HRQoL were not covered by these measures.

The QWB-SA is a comprehensive measure of HRQoL encompassing 58 symptoms (mental, acute physical and chronic) [38]. Even though the QWB-SA covered many of the life areas reported by participants, it is not as widely used as other preference-based measures like the EQ-5D [3]. This may be because it consists of 71 items and has a 14-min completion time in older adults [39], compared to the EQ-5D which consists of 5 items and only takes a few minutes to complete [40]. Furthermore, the QWB-SA is heavily focused on symptoms, which can be burdensome for respondents if they do not possess the listed symptoms. In our study, when asked about the important areas of life affected by COPD, none of the chronic symptoms and only 2 of the acute symptoms on the QWB-SA were mentioned by participants (i.e., shortness of breath and difficulty walking/standing). Having HRQoL measures with short administration times that target important areas affected by COPD may be valuable, providing accurate and easy to implement tools for cost-effectiveness analyses in clinical trials focused on patients with COPD.

A limitation of this study is that the sample comprised a low percentage of individuals with mild airflow limitations (5.17%). A recent study using data from the Canadian Cohort Obstructive Lung Disease (CanCOLD) study found two-thirds of the cohort to be undiagnosed for COPD [41]. These individuals were not given a clinical diagnosis but had airflow obstruction according to spirometry tests [41]. Even though individuals with mild airflow limitations present fewer symptoms [42], they compose a large portion of the population and their perspectives may have not been completely captured in our study. However, the disease severity of our sample was comparable to other COPD samples in the measurement literature [43,44,45,46,47]. A second limitation of this study is the comparability of findings to other healthcare settings. Since recruitment was performed at tertiary care settings, findings may not be transferable to other settings (e.g., primary care settings). Last, for the PGI, participants were asked to list the most important areas of their life affected by their COPD. The phrasing of this question elicits reference to life activities and may result in less identification of the symptoms relevant to the disease. For example, respiratory system functions such as difficulty breathing, well-known to impact the COPD population [6], were not highly endorsed by this sample.

Conclusions

GPBMs form the basis for cost-effectiveness analysis and resource allocation decisions within the healthcare system, however, our findings showed that not a single measure covered all life areas important to those living with COPD and that their association with an individualized measure of HRQoL is weak. The content of preference-based measures should be reflective of the population’s health concerns for accurate economic evaluation of treatments [48]. When GPBMs are used to evaluate the cost-utility of interventions in COPD, they may not always be sensitive to the concerns and values of individuals with COPD, which may result in inaccurate recommendations. Findings from this study suggest that a COPD-specific preference-based measure could be developed in order to more accurately reflect the health concerns of individuals living with COPD. Until such a measure is developed, researchers and policymakers can use these findings to make informed decisions when selecting a GPBM for cost-effectiveness analyses of interventions in the COPD population.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due to privacy and confidentiality reasons but are available from the corresponding author on reasonable request.

Abbreviations

15D:

15-Dimensional

AQoL-8D:

Assessment of Quality of Life 8-Dimensions

COPD:

Chronic Obstructive Pulmonary Disease

EQ-5D:

EuroQol 5-Dimensions

FEV1:

Forced Expiratory Volume in 1 s

FVC:

Forced Vital Capacity

GPBM:

Generic Preference-Based Measure

HRQoL:

Health-Related Quality of Life

HUI 2:

Health Utilities Index Mark 2

HUI 3:

Health Utilities Index Mark 3

ICF:

International Classification of Functioning, Disability and Health

PGI:

Patient-Generated Index

QALYs:

Quality-Adjusted Life Years

QWB-SA:

Quality of Well-Being Self-Administered

SF-6D:

Six-Dimensional Short Form Survey

References

  1. Mayo NE. ISOQOL dictionary of quality of life and health outcomes measurement. ISOQOL; 2015.

  2. Neumann PJ, Goldie SJ, Weinstein MC. Preference-based measures in economic evaluation in health care. Annu Rev Public Health. 2000;21:587–611.

    Article  CAS  Google Scholar 

  3. Brazier J, Ara R, Rowen D, et al. A review of generic preference-based measures for use in cost-effectiveness models. Pharmacoeconomics. 2017;35:21–31.

    Article  Google Scholar 

  4. Breslin E, Van Der Schans C, Breukink S, et al. Perception of fatigue and quality of life in patients with COPD. Chest. 1998;114(4):958–64.

    Article  CAS  Google Scholar 

  5. Miravitlles M, Ribera A. Understanding the impact of symptoms on the burden of COPD. Respir Res. 2017;18:67.

    Article  Google Scholar 

  6. Global Initiative for Chronic Obstructive Lung Disease. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease (2020 report). Glob Initiat Chronic Obstr Lung Dis. 2020.

  7. Cláudia de Souza A, Maria Costa Alexandre N, de Brito Guirardello E. Psychometric properties in instruments evaluation of reliability and validity. Appl Epidemiol Epidemiol Serv Saude Brasília. 2017;26(3):649–59.

    Article  Google Scholar 

  8. Mehdipour A, Beauchamp MK, Wald J, Peters N, Kuspinar A. Measurement properties of preference-based measures for economic evaluation in COPD: a systematic review. Qual Life Res. 2020;29(11):2875–85.

    Article  Google Scholar 

  9. De Vet HCW, Terwee CB, Mokkink LB, et al. Measurement in medicine: a practical guide. Meas Med Pract Guide. 2011.

  10. Ware JE Jr. SF-36 health survey update. Spine. 2000;25(24):3130–9.

    Article  Google Scholar 

  11. Benzo R, Flume PA, Turner D, Tempest M. Effect of pulmonary rehabilitation on quality of life in patients with COPD: the use of SF-36 summary scores as outcomes measures. J Cardiopulm Rehabil Prev. 2000;20(4):231–4.

    Article  CAS  Google Scholar 

  12. Prieto L, Alonso J, Ferrer M, Antó JM. Are results of the SF-36 health survey and the Nottingham health profile similar? A comparison in COPD patients. J Clin Epidemiol. 1997;50(4):463–73.

    Article  CAS  Google Scholar 

  13. Ståhl E, Lindberg A, Jansson S-A, Rönmark E, Svensson K, Andersson F, et al. Health-related quality of life is related to COPD disease severity. Health Qual Life Outcomes. 2005;3(1):56. https://doi.org/10.1186/1477-7525-3-56.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Curtis JR, Patrick DL. The assessment of health status among patients with COPD. Eur Respir J. 2003;21(41 suppl):36s–45s.

    Article  Google Scholar 

  15. Brazier J, Usherwood T, Harper R, et al. Deriving a preference-based single index from the UK SF-36 Health Survey. J Clin Epidemiol. 1998;51(11):1115–28.

    Article  CAS  Google Scholar 

  16. McHorney CA, Ware JE Jr, Lu JFR, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994;32:40–66.

    Article  CAS  Google Scholar 

  17. Kuspinar A, Mayo NE. Do generic utility measures capture what is important to the quality of life of people with multiple sclerosis? Health Qual Life Outcomes. 2013;11:71.

    Article  Google Scholar 

  18. Kuspinar A, Mate K, Lafontaine AL, et al. Evaluating the content validity of generic preference-based measures for use in Parkinson’s disease. Parkinsonism Relat Disord. 2019;62:112–6.

    Article  Google Scholar 

  19. Mayo NE, Aburub A, Brouillette MJ, et al. In support of an individualized approach to assessing quality of life: comparison between Patient Generated Index and standardized measures across four health conditions. Qual Life Res. 2017;26(3):601–9.

    Article  Google Scholar 

  20. Patel KK, Veenstra DL, Patrick DL. A review of selected patient-generated outcome measures and their application in clinical trials. Value Health. 2003;6(5):595–603.

    Article  Google Scholar 

  21. Martin F, Camfield L, Rodham K, et al. Twelve years’ experience with the Patient Generated Index (PGI) of quality of life: a graded structured review. Qual Life Res. 2007;16(4):705–15.

    Article  Google Scholar 

  22. Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.

    Article  Google Scholar 

  23. Walters SJ, Brazier JE. Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res. 2005;14(6):1523–32.

    Article  Google Scholar 

  24. Brazier J, Ratcliffe J, Saloman J, et al. Measuring and valuing health benefits for economic evaluation. Oxford: Oxford University Press; 2017.

    Google Scholar 

  25. The University of Sheffield. https://www.sheffield.ac.uk/scharr/sections/heds/mvh/sf-6d/faqs (2020). Accessed 25 August 2020.

  26. Hays RD, Sherbourne CD, Mazel RM. The rand 36-item health survey 1.0. Health Econ. 1993;2(3):217–27.

    Article  CAS  Google Scholar 

  27. Kharroubi SA, Brazier JE, Roberts J, et al. Modelling SF-6D health state preference data using a nonparametric Bayesian method. J Health Econ. 2007;26(3):597–612.

    Article  Google Scholar 

  28. World Health Organization. World Health Organisation. International classification of functioning, disability and health (ICF). Geneva: World Health Organisation; 2001.

    Google Scholar 

  29. Mokkink LB, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, De Vet HCW, et al. COSMIN methodology for systematic reviews of patient—reported outcome measures (PROMs). User Manual. 2018;1–78.

  30. Mason M. Sample size and saturation in PhD studies using qualitative interviews. Forum Qual Soc Res. 2010;11(3):8.

    Google Scholar 

  31. Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69–71.

    CAS  PubMed  PubMed Central  Google Scholar 

  32. Rosso AL, Taylor JA, Tabb LP, et al. Mobility, disability, and social engagement in older adults. J Aging Health. 2013;25(4):617–37.

    Article  Google Scholar 

  33. Horsman J, Furlong W, Feeny D, et al. The Health Utilities Index (HUI): concepts, measurement properties and applications. Health Qual Life Outcomes. 2003;1:54.

    Article  Google Scholar 

  34. Torrance GW, Boyle MH, Horwood SP. Application of multi-attribute theory to measure social preferences for health states. Oper Res. 1982;30(6):1043–69.

    Article  CAS  Google Scholar 

  35. Boyle MH, Torrance GW, Sinclair JC, et al. Economic evaluation of neonatal intensive care of very-low-birth-weight infants. N Engl J Med. 1983;308(22):1330–7.

    Article  CAS  Google Scholar 

  36. Neumann PJ, Kuntz KM, Leon J, et al. Health utilities in Alzheimer’s disease: a cross-sectional study of patients and caregivers. Med Care. 1999;37(1):27–32.

    Article  CAS  Google Scholar 

  37. Ware JE, Brook RH, Davies AR, et al. Choosing measures of health status for individuals in general populations. Am J Public Health. 1981;71(6):620–5.

    Article  Google Scholar 

  38. Seiber WJ, Groessl EJ, David KM, et al. Quality of well being self-administered (QWB-SA) scale. San Diego Health Serv Res Cent Univ Calif. 2008.

  39. Andresen EM, Rothenberg BM, Kaplan RM. Performance of a self-administered mailed version of the quality of well-being (QWB-SA) questionnaire among older adults. Med Care. 1998;36(9):1349–60.

    Article  CAS  Google Scholar 

  40. EQ-5D-5L User Guide. EuroQol Res. Found. 2015. https://euroqol.org/publications/user-guides. Accessed 25 August 2020.

  41. Labonté LE, Tan WC, Li PZ, et al. Undiagnosed chronic obstructive pulmonary disease contributes to the burden of health care use. Data from the CanCOLD study. Am J Respir Crit Care Med. 2016;194(3):285–98.

    Article  Google Scholar 

  42. Martinez CH, Mannino DM, Jaimes FA, et al. Undiagnosed obstructive lung disease in the United States. Associated factors and long-term mortality. Ann Am Thorac Soc. 2015;12(12):1788–95.

    Article  Google Scholar 

  43. Polley L, Yaman N, Heaney L, et al. Impact of cough across different chronic respiratory diseases: comparison of two cough-specific health-related quality of life questionnaires. Chest. 2008;134(2):295–302.

    Article  Google Scholar 

  44. Rutten-Van Mölken MPMH, Oostenbrink JB, Tashkin DP, et al. Does quality of life of COPD patients as measured by the generic EuroQol five-dimension questionnaire differentiate between COPD severity stages? Chest. 2006;130(4):1117–28.

    Article  Google Scholar 

  45. Stavem K. Reliability, validity and responsiveness of two multiattribute utility measures in patients with chronic obstructive pulmonary disease. Qual Life Res. 1999;8(1–2):45–54.

    Article  CAS  Google Scholar 

  46. Harper R, Brazier JE, Waterhouse JC, et al. Comparison of outcome measures for patients with chronic obstructive pulmonary disease (COPD) in an outpatient setting. Thorax. 1997;52(10):879–87.

    Article  CAS  Google Scholar 

  47. Puhan MA, Guyatt GH, Goldstein R, et al. Relative responsiveness of the Chronic Respiratory Questionnaire, St. Georges Respiratory Questionnaire and four other health-related quality of life instruments for patients with chronic lung disease. Respir Med. 2007;101(2):308–16.

    Article  Google Scholar 

  48. Brazier J, Deverill M, Green C. A review of the use of health status measures in economic evaluation. J Health Serv Res Policy. 1999;4(3):174–84.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

All authors (AM, SO, MKB, JW, AK) contributed to the study’s conception and/or design. Data collection and analysis was performed by AM and SO under the supervision of AK. AM, MKB, JW and AK contributed to the study’s interpretations. First draft of the manuscript was written by AM. Preliminary edits were made by AK and all authors commented on previous versions of the manuscript, and AK is the guarantor of the paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ayse Kuspinar.

Ethics declarations

Ethics approval and consent to participate

Ethics approval was obtained from both recruitment sites, from respective research ethics boards (Joint West Park Healthcare Centre-The Salvation Army Toronto Grace Health Centre Research Ethics Board #17-013WP; Hamilton Integrated Research Ethics Board #7661). Individuals who provided informed written consent were included in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mehdipour, A., O’Hoski, S., Beauchamp, M.K. et al. Content validity of preference-based measures for economic evaluation in chronic obstructive pulmonary disease. Health Qual Life Outcomes 19, 101 (2021). https://doi.org/10.1186/s12955-021-01744-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-021-01744-6

Keywords