- Open Access
Estimating a minimal clinically important difference for the EuroQol 5-dimension health status index in persons with multiple sclerosis
Health and Quality of Life Outcomes volume 12, Article number: 66 (2014)
Limited data define what constitutes a minimal clinically important difference (MCID) on the EuroQol 5-Dimension (EQ-5D) health status index in persons with multiple sclerosis (PwMS). We sought to estimate the MCID for the EQ-5D health index in North American PwMS.
PwMS completing the Patient Determined Disease Steps (PDDS) scale, 12-Item Multiple Sclerosis Walking Scale (MSWS-12) and EQ-5D as part of the North American Research Committee on Multiple Sclerosis (NARCOMS) registry’s spring 2011 update and supplemental survey were included in this retrospective, cross-sectional study. Distribution-based (standard error of measurement [SEM], 0.50 standard deviation [SD] and 0.33 SD unit) approaches were used to estimate a range of MCIDs for the EQ-5D based upon disease severity groups determined by the PDDS and MSWS-12 tertiles.
A total of 3,044 participants were included. Moderately strong correlations between the EQ-5D and the PDDS and MSWS-12 were observed (Spearman’s r = -0.56 and -0.59, respectively, p < 0.0001 for both). MCID estimates based on PDDS score categories ranged from 0.065-0.158 (SEMs), 0.059-0.142 (0.50 SDs) and 0.039-0.095 (0.33 SDs). MCID estimates as measured by MSWS-12 tertile categories ranged from 0.068-0.098 (SEMs), 0.061-0.088 (0.50 SDs), and 0.041-0.059 (0.33 SDs). Across both the PDDS and tertiles of MSWS-12, MCID estimates tended to be larger as disease severity worsened. Mean weighted MCID estimates ranged from 0.05-0.084 for both the PDDS and MSWS-12 tertiles.
MCID estimates for the EQ-5D in PwMS were within the range of estimates seen for other disease states and appeared to be larger in those reporting more severe disease.
Multiple sclerosis (MS) has long been known to negatively impact health-related quality of life (HRQoL) [1–3]. For this reason, clinical studies have increasingly utilized validated HRQoL measures to evaluate the effect of treatment or the impact of disease progression on HRQoL in persons with MS (PwMS) [4–6]. The Euro-Qol 5-Dimension (EQ-5D), a generic health status index score [7, 8], is one such measure; however, interpretation of the EQ-5D in PwMS is hampered by a paucity of information regarding what constitutes a minimally important clinical improvement in score in this population. The purpose of this study was to estimate the minimal clinically important difference (MCID), or smallest difference in score PwMS from North America perceive as being both beneficial and nontrivial .
We used data from the North American Research Committee on Multiple Sclerosis (NARCOMS) registry to conduct this retrospective, cross-sectional analysis . NARCOMS gathers self-reported patient data through an extensive, semi-annual health survey of registrants. In 2010, NARCOMS, in conjunction with Acorda Therapeutics, Inc., sent a supplemental questionnaire to a sample of 4,389 NARCOMS registrants reporting a Patient-Determined Disease Step (PDDS) score ≤7 to collect additional data on patient perceptions of HRQoL using the EQ-5D, 3-level (3 L) descriptive system and walking using the 12-item Multiple Sclerosis Walking Scale (MSWS-12). The supplemental survey was sent about one month after the close of the update survey.
The collection and research use of NARCOMS data is approved by the Institutional Review Board (IRB) at the University of Alabama at Birmingham. Approval was obtained from the same IRB for the acquisition of the additional data via the supplemental questionnaire. The secondary analyses reported here were reviewed and approved by the IRB at Hartford Hospital and conducted with de-identified datasets.
PwMS who completed the EQ-5D, PDDS and MSWS-12 as part of the NARCOMS update and supplemental surveys during spring 2010 were included in this study. The EQ-5D-3 L consists of five descriptive questions concerning five domains of HRQoL (mobility, self-care, usual activities, pain/discomfort, anxiety/depression) each with 3-levels of response (no, some/moderate or unable/extreme) with participants’ pattern of responses used to derive health status index scores. US-specific health status index scores between 1.0 and -0.11 (on a scale where 1.0 = perfect health and 0.0 = death, negative values suggest health states worse than death) were derived using the scoring algorithm developed in a study of a general US population .
Disease severity in PwMS was evaluated using the PDDS, as the Kurtzke Expanded Disability Status Scale (EDSS) and other clinician-based tools (signs, symptoms and medical examination results) are not available in the NARCOMS registry. The PDDS is a patient-reported measure that is scored ordinally from 0 (no disability) to 8 (bedbound) . It has been shown to correlate well with the neurologist scored EDSS (r = 0.78; p = 0.0001) ; and both measures have been used by clinicians and researchers to assess MS-related disease severity and progression.
PwMS also completed the MSWS-12, a validated, patient-reported outcome measure of walking impairment that consists of 12 questions with five possible responses ranging from 1 (not at all) to 5 (extremely) . Each question represents a different aspect of walking function and quality, including walking speed, ability to run, ability to climb and descend stairs, ability to stand, balance, endurance, smoothness of gait, need for support (indoors and outdoors), and concentration required. The possible scores for this measure range from 12–60, and were converted to scores ranging to 0–100 for easier interpretation, with higher scores representing greater walking disability . The MSWS-12 is the only measure of walking ability reported in the NARCOMS registry and is strongly correlated with both the PDDS (r = 0.80; p < 0.01) and EDSS (r = 0.73; p < 0.01) (since both the PDDS and EDSS focus on mobility in the middle of their scales) .
Since no suitable anchor was available in our NARCOMS dataset, multiple distribution-based approaches were used to estimate MCIDs for the EQ-5D in this NARCOMS cohort. Consistent with prior studies, we used the following distribution-based approaches: (1) the standard error of measurement (SEM), (2) 0.5 * standard deviation (SD) and (3) 0.33 * SD [9, 14–19]. The SEM describes the variability between an individual’s observed score and the true score and is calculated as the SD of the measure multiplied by the square root of 1 minus its reliability coefficient [9, 14]. For this analysis, we used Cronbach’s alpha as the measure of reliability of the EQ-5D when calculating the SEM. Our estimate of Cronbach’s alpha in this NARCOMS population was 0.69, which is consistent with estimates reported in prior studies .
Correlations between the PDDS, MSWS-12 and the EQ-5D were assessed using Spearman’s rho (r), with a coefficient ≥0.40 suggesting an adequate correlation. We used the PDDS to define disease severity in PwMS (using the ordinal values from 0–8) and the MSWS-12 tertiles (with scores of 0 – 33 representing mild walking impairment; 34 – 67 as moderate walking impairment; and 68 – 100 representing severe walking impairment) to grouppatients into walking impairment categories. Subsequently, we applied the above-mentioned distribution-based approaches to each category. Resulting MCID estimates were summarized as ranges, and a mean MCID across categories, weighted by sample size, was calculated for each questionnaire.
Descriptive statistics including percentages for categorical data; and medians/ranges and means/SDs for ordinal/continuous data are reported. All data analyses for this study were conducted with SPSS version 20.0 (SPSS Inc., Chicago, IL).
In 2010, 3,609 subjects completed the spring NARCOMS update and supplemental surveys. Of those, 3,307 subjects also completed the PDDS, 3,338 completed MSWS-12 and 3,557 completed the EQ-5D. Therefore, of the 4,389 originally sent both surveys, a total of 3,044 NARCOMS registrants (69.4%) had complete data sets and were included in this analysis. Characteristics of these PwMS are depicted in Table 1. Most PwMS were women, Caucasian, and on average, in their fifth decade of life. Mean duration in time from initial MS diagnosis was nearly 18 years, and 61.4% had received a disease-modifying drug within the prior 6 months. Approximately 63% were not working or attending school. The mean transformed MSWS-12 score for the entire population was 50.2 ± 33.7 (median and range = 52, 0–100), with PwMS relatively evenly distributed among the three walking impairment tertiles. The median PDDS of the population was 3, with at least three-quarters having a score of 5 or below. EQ-5D index scores ranged from a minimum of -0.04 to a maximum of 1.0 (0% and 13.3% at the floor and ceiling, respectively) with a mean score of 0.74 ± 0.18 and a median score (range) of 0.78 (-0.04-1.0). Moderately-strong correlations between the EQ-5D and the PDDS and MSWS-12 were observed (Spearman’s r = -0.56 and -0.59, respectively, p < 0.0001 for both).
MCID estimates for EQ-5D index score within PDDS score categories ranged from 0.065-0.158 (SEMs), 0.059-0.142 (0.50 SDs) and 0.039-0.095 (0.33 SDs) (Table 2). MCID estimates within MSWS-12 tertile categories ranged from 0.068-0.098 (SEMs), 0.061-0.088 (0.50 SDs), and 0.041-0.059 (0.33 SDs) (Table 3). Across both the PDDS and tertiles of MSWS-12, MCID estimates tended to get larger as disease severity worsened. Mean weighted MCID estimates ranged from 0.050-0.084 for both the PDDS and MSWS-12 tertiles.
HRQoL assessments can be used by researchers in clinical trials and clinicians and patients in real-world practice settings to measure response to treatment and quantify the impact of changes in disease severity; however, understanding what constitutes a minimally important change on a HRQoL measure is critical for doing so. This is the first study to calculate MCID estimates for the US-scored EQ-5D health status index in PwMS. Our analysis suggests the MCID for a population with MS likely falls between the values of 0.050-0.084. However, our analysis also suggests that the MCID varies by disease severity; with higher estimates in those reporting greater disability due to MS.
Prior studies have estimated MCID values for the US-algorithm scored EQ-5D index in a variety of disease states other than MS [17–20]. Luo and colleagues estimated EQ-5D index scores in patients suffering leg ulcers, early rheumatoid arthritis, back pain, and systemic sclerosis, among others, using distribution-based approaches . They estimated mean MCID estimates that were on the lower end of our calculated ranges (0.040 for US-based EQ-5D). In a study of intervertebral disk herniation, anchor-based MCID estimates for the US-scored EQ-5D ranged from 0.08-0.17 depending on the anchor used . Le and colleagues found MCID estimates ranging between 0.05 and 0.08 when using anchor-based approaches and 0.04-0.10 using distribution-based approaches in a cohort of patients suffering from post-traumatic stress disorder . Yet, another study conducted by Pickard and colleagues using a similar methodology to our own suggested MCID estimates for US-based EQ-5D scores ranged from 0.07-0.09 in patients with cancer, and between 0.04 and 0.07 across various types of cancer . While our range of MCID estimates for the EQ-5D, 0.050-0.084, fall within these previously reported ranges; these prior studies suggest that a single MCID estimate for the EQ-5D does not fit all.
A number of additional points should be considered when interpreting our findings. First, given the cross-sectional nature of the study and the exclusive use of distribution-based methods, our MCID estimates are essentially “between-patient” differences, rather than “within-patient” changes over time. Therefore, our estimated MCIDs are best suited for discriminating between patient groups, as compared to defining responders to treatment. Second, the population in the NARCOMS registry used for this study may not be representative of all MS patients, particularly those living outside of North America and those with PDDS scores of 8. Moreover, NARCOMS data comes from semi-annual surveys, and therefore, responses may be subject to reporting or recall bias. However, despite these limitations stemming from the registry’s design, it provides a unique ability to look at a large (n > 3,000) population of PwMS with varying degrees of disease severity (PDDS range: 0–8; EQ-5D range: -0.04-1.0). This is important because MCID estimates for the EQ-5D index score may vary to an important degree between persons in the same target cohort [18, 19]. In our analysis, the MCID was found to be largest in PwMS having the most severe disease or walking impairment, suggesting that patients perceive HRQoL differently based the severity of their current health state. We recommend using the MCID estimate that best matches the population being studied/evaluated (i.e., a MCID of 0.08-0.09 may be more appropriate for patients with greater mobility impairment; while a estimate of ~0.06 may be more suitable for those less impaired). Third, in order to provide a range of plausible EQ-5D MCIDs for PwMS based on disease severity, we used the PDDS and MSWS-12 to define disease severity categories. While we used the native ordinal scale to categorize PwMS using the PDDS, it should be noted we arbitrarily divided the MSWS-12 into equal tertiles based upon score (with scores of 0 – 33 representing mild walking impairment; 34 – 67 as moderate walking impairment; and 68 – 100 representing severe walking impairment). Next, our analysis did not utilize an anchor-based approach, which is often considered more desirable than the distribution-based approaches we used for MCID estimation [9, 14]. Unfortunately, the lack of a true anchoring question (one that allows for categorization of patients who perceived only minimal improvement) in the NARCOMS registry precluded the use of an anchor-based approach . A common concern of distribution-based approaches is that they assume data is normally distributed, and estimates can be skewed when large floor or ceiling effects are present [9, 14]. However, this was less of a concern in our analysis, since no PwMS were at the floor (lowest possible) EQ-5D value (0% at -0.11) and only a small number were at the ceiling (highest possible) EQ-5D score (13.3% at 1.00). A final consideration for our analysis relates to its external validity. Our use of a North American population and the US population-based EQ-5D scoring algorithm likely means our results are not highly externally valid to PwMS outside the US. In fact, studies suggest EQ-5D index values and MCID estimates using the US scoring algorithm vary significantly from non-US population values because of differences in the scaling properties of the EQ-5D from country to country, as well as potential variation in population characteristics [7, 8, 21]. For example, Johnson and colleagues  compared valuations of the same 42 EQ-5D health states for US and UK populations, and found US mean scores to be numerically higher than the UK for 39 of the health states, with an average increase in score of 0.10 (p < 0.001) for US-based estimates compared to UK estimates after adjusting for known predictors.
In conclusion, the MCID estimate calculated in this study can aid researchers and clinicians when discriminating between patient groups for EQ-5D index scores of PwMS. Our MCID range of 0.050-0.084 for EQ-5D was within the range of MCID estimates of other disease states. In general, patients who have severe disability had higher MCIDs than patients who had mild-moderate disability. Additional analysis to verify these EQ-5D health status index MCID estimates in an independent data set should be performed.
Expanded Disability Status Scale
12-Item Multiple Sclerosis Walking Scale
North American Research Committee on Multiple Sclerosis
Patient Determined Disease Steps
Persons with multiple sclerosis
Standard error of measurement
Fisk JD, Brown MG, Sketris IS, Metz LM, Murray TJ, Stadnyk KJ: A comparison of health utility measures for the evaluation of multiple sclerosis treatments. J Neurol Neurosurg Psychiatry 2005, 76: 58–63. 10.1136/jnnp.2003.017897
Kobelt G, Berg J, Atherly D, Hadjimichael O: Costs and quality of life in multiple sclerosis: a cross-sectional study in the United States. Neurology 2006, 66: 1696–1702. 10.1212/01.wnl.0000218309.01322.5c
Pfaffenberger N, Pfeiffer KP, Deibl M, Höfer S, Günther V, Ulmer H: Association of factors influencing health-related quality of life in MS. Acta Neurol Scand 2006, 114: 102–108.
Rudick RA, Miller D, Hass S, Hutchinson M, Calabresi PA, Confavreux C, Galetta SL, Giovannoni G, Havrdova E, Kappos L, Lublin FD, Miller DH, O'Connor PW, Phillips JT, Polman CH, Radue EW, Stuart WH, Wajgt A, Weinstock-Guttman B, Wynn DR, Lynn F, Panzara MA, AFFIRM and SENTINEL Investigators: Health-related quality of life in multiple sclerosis: effects of natalizumab. Ann Neurol 2007, 62: 335–346. 10.1002/ana.21163
Montalban X, Comi G, O'Connor P, Gold S, de Vera A, Eckert B, Kappos L: Oral fingolimod (FTY720) in relapsing multiple sclerosis: impact on health-related quality of life in a phase II study. Mult Scler 2011, 17: 1341–1350. 10.1177/1352458511411061
Lovera JF, Frohman E, Brown TR, Bandari D, Nguyen L, Yadav V, Stuve O, Karman J, Bogardus K, Heimburger G, Cua L, Remingon G, Fowler J, Monahan T, Kilcup S, Courtney Y, McAleenan J, Butler K, Wild K, Whitham R, Bourdette D: Memantine for cognitive impairment in multiple sclerosis: A randomized placebo-controlled trial. Mult Scler 2010, 16: 715–723. 10.1177/1352458510367662
Shaw JW, Johnson JA, Coons SJ: US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care 2005, 43: 203–220. 10.1097/00005650-200503000-00003
The EuroQol Group: EuroQol–a new facility for the measurement of health-related quality of life. Health Policy 1990, 16: 199–208.
Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR: Methods to explain the clinical significance of health status measures. Mayo Clin Proc 2002, 77: 371–383. 10.4065/77.4.371
NARCOMS: Multiple Sclerosis patient registry. Available at: . Accessed April 18, 2013 http://www.narcoms.org
Marrie RA, Goldman M: Validity of performance scales for disability assessment in multiple sclerosis. Mult Scler 2007, 13: 1176–1182. 10.1177/1352458507078388
Learmonth YC, Motl RW, Sandroff BM, Pula JH, Cadavid D: Validation of patient determined disease steps (PDDS) scale scores in persons with multiple sclerosis. BMC Neurol 2013, 13: 37. 10.1186/1471-2377-13-37
Hobart JC, Riazi A, Lamping DL, Fitzpatrick R, Thompson AJ: Measuring the impact of MS on walking ability: the 12-Item MS Walking Scale (MSWS-12). Neurology 2003, 60: 31–36. 10.1212/WNL.60.1.31
Revicki D, Hays RD, Cella D, Sloan J: Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol 2008, 61: 102–109. 10.1016/j.jclinepi.2007.03.012
Gilbert C, Brown MC, Cappelleri JC, Carlsson M, McKenna SP: Estimating a minimally important difference in pulmonary arterial hypertension following treatment with sildenafil. Chest 2009, 135: 137–142. 10.1378/chest.07-0275
Shikiar R, Harding G, Leahy M, Lennox RD: Minimal important difference (MID) of the Dermatology Life Quality Index (DLQI): results from patients with chronic idiopathic urticaria. Health Qual Life Outcomes 2005, 3: 36. 10.1186/1477-7525-3-36
Na L, Je J, St C: Using Instrument-Defined Health State Transitions to Estimate Minimally Important Differences for Four Preference-Based Health-Related Quality of Life Instrument. Med Care 2010, 48: 365–371. 10.1097/MLR.0b013e3181c162a2
Le QA, Doctor JN, Zoellner LA, Feeny NC: Minimal clinically important differences for the EQ-5D and QWB-SA in Post-traumatic Stress Disorder (PTSD): results from a Doubly Randomized Preference Trial (DRPT). Health Qual Life Outcomes 2013, 11: 59. 10.1186/1477-7525-11-59
Pickard AS, Neary MP, Cella D: Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health Qual Life Outcomes 2007, 5: 70. 10.1186/1477-7525-5-70
McDonough CM, Tosteson TD, Tosteson AN, Jette AM, Grove MR, Weinstein JN: A longitudinal Comparison of 5 Preference-Weighted Health State Classification System in Persons with Intervertebral Disk Herniation. Med Decis Making 2011, 31: 270–280. 10.1177/0272989X10380924
Johnson JA, Luo N, Shaw JW, Kind P, Coons SJ: Valuations of EQ-5 D health states: are the United States and United Kingdom different? Med Care 2005, 43: 221–228. 10.1097/00005650-200503000-00004
This research was funded by Acorda Therapeutics, Inc., Ardsely, NY. The NARCOMS registry is supported in part by the Consortium of Multiple Sclerosis Centers and its Foundation. The publication of these study results was not contingent on the sponsor’s approval or censorship of the manuscript. Mr. Sidovar is a paid employee and stockholder of Acorda Therapeutics, Inc., Ardsley, NY; Dr. Coleman has received research funding from Acorda Therapeutics, Inc., Ardsley, NY; Drs. Kohn, Kaur, Zhu have no conflicts of interest to report.
Drs CGK and CIC had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: CGK, MFS, CIC. Acquisition of data: CGK, MFS, KK, YZ, CIC. Analysis and interpretation of data: CGK, MFS, KK, YZ, CIC. Drafting of the manuscript: CGK, MFS, KK, YZ, CIC. Critical revision of the manuscript for important intellectual content: CGK, MFS, CIC. Administrative, technical, or material support: CGK and CIC. Study supervision: CIC. All authors read and approved the final manuscript.
About this article
Cite this article
Kohn, C.G., Sidovar, M.F., Kaur, K. et al. Estimating a minimal clinically important difference for the EuroQol 5-dimension health status index in persons with multiple sclerosis. Health Qual Life Outcomes 12, 66 (2014). https://doi.org/10.1186/1477-7525-12-66
- Multiple sclerosis
- Quality of life
- Health status
- EuroQol 5-Dimension
- Minimal clinically important difference