What is the relationship between the minimally important difference and health state utility values? The case of the SF6D
DOI: 10.1186/1477752514
© Walters and Brazier 2003
Received: 7 February 2003
Accepted: 11 April 2003
Published: 11 April 2003
Abstract
Background
The SF6D is a new single summary preferencebased measure of health derived from the SF36. Empirical work is required to determine what is the smallest change in SF6D scores that can be regarded as important and meaningful for health professionals, patients and other stakeholders.
Objectives
To use anchorbased methods to determine the minimally important difference (MID) for the SF6D for various datasets.
Methods
All responders to the original SF36 questionnaire can be assigned an SF6D score provided the 11 items used in the SF6D have been completed. The SF6D can be regarded as a continuous outcome scored on a 0.29 to 1.00 scale, with 1.00 indicating "full health".
Anchorbased methods examine the relationship between an healthrelated quality of life (HRQoL) measure and an independent measure (or anchor) to elucidate the meaning of a particular degree of change. One anchorbased approach uses an estimate of the MID, the difference in the QoL scale corresponding to a selfreported small but important change on a global scale. Patients were followed for a period of time, then asked, using question 2 of the SF36 as our global rating scale, (which is not part of the SF6D), if there general health is much better (5), somewhat better (4), stayed the same (3), somewhat worse (2) or much worse (1) compared to the last time they were assessed. We considered patients whose global rating score was 4 or 2 as having experienced some change equivalent to the MID. In patients who reported a worsening of health (global change of 1 or 2) the sign of the change in the SF6D score was reversed (i.e. multiplied by minus one). The MID was then taken as the mean change on the SF6D scale of the patients who scored (2 or 4).
Results
This paper describes the MID for the SF6D from seven longitudinal studies that had previously used the SF36.
Conclusions
From the seven reviewed studies (with nine patient groups) the MID for the SF6D ranged from 0.010 to 0.048, with a weighted mean estimate of 0.033 (95% CI: 0.029 to 0.037). The corresponding Standardised Response Means (SRMs) ranged from 0.11 to 0.48, with a mean of 0.30 and were mainly in the "small to moderate" range using Cohen's criteria, supporting the MID results. Using the halfstandard deviation (of change) approach the mean effect size was 0.051 (range 0.033 to 0.066). Further empirical work is required to see whether or not this holds true for other patient groups and populations.
Introduction
Health Related Quality of Life (HRQoL) outcome measures are being increasingly used in research trials, but less so in routine clinical practice. The interpretation of HRQoL scores raises many issues. [1–7] The scales and instruments used may be unfamiliar to many clinicians and patients, who may be uncertain of the meaning of the scale values and summary scores. [8]
Repeated experience and familiarity with a wide variety of physiological measures such as blood pressure or forced expiratory volume, has allowed clinicians to make meaningful interpretation of the results. [9, 10] In contrast, the meaning of a change in score of x points on a HRQoL instrument is less intuitively apparent, not only because the scale has unfamiliar units, but also because health professionals seldom use HRQoL measures in routine clinical practice.
In clinical trials, where HRQoL instruments are being increasingly used as primary outcome measures, it is simple to determine the statistical significance of a change in HRQoL, but placing the magnitude of these changes in a context that is meaningful for health professionals, patients and other stakeholders (Pharmaceutical and Medical Device Developers, Insurance Payers, Regulators, Governments) has not been so easy. Ascertaining the magnitude of change that corresponds to a minimal important difference would help address this problem. [11] So when determining an important change standard the perspective can influence the assessment approach and the way in which an important difference is determined. [5] The minimal important difference (MID), from the patient perspective, can be defined as "the smallest difference in score in the domain of interest which patients perceive as beneficial and which would mandate, in the absence of troublesome side effects and excessive cost, a change in the patient's management". [9]
Thus, individual change standards are needed to provide meaningful interpretation of HRQoL intervention and treatment effects and to classify patients based on this standard as improved, stable or declined. To date two broad strategies have been used to interpret differences or changes in HRQoL following treatment: [12] distribution based approaches  the effect size (ES); and anchorbased measures  the minimum clinically important difference (MCID).
Distribution based approaches rely on relating the difference between treatment and control groups to some measure of variability. The most popular approach uses Cohen's [13] standardised effect size, the mean change divided by the standard deviation to serve as an "effect size index", that is suitable for sample size estimation. Cohen suggested that standardised effect sizes of 0.2 to 0.5 should be regarded as "small", 0.5 to 0.8 as "moderate" and those above 0.8 as "large". Cohen's effect size may be influenced by the degree of homogeneity or heterogeneity in the sample. Distributionbased methods rely on expressing an effect in terms of the underlying distribution of the results. Investigators may express effects in terms of betweenperson standard deviation units, withinperson standard deviation units, and the standard error of measurement. [2]

Paired tstatistics = D/SE

Effect size (ES) statistic = D/SD

Standardised response mean (SRM) = D/SD*

Responsiveness statistic = D/SD#
The paired tstatistic is best suited to prepost assessments of interventions of known efficacy. The effect size statistic relates change over time to the standard deviation of baseline scores. The standardised response mean compares change to the standard deviation of change. The responsiveness statistic looks at HRQoL change relative to variability for clinically stable respondents. The effect size statistic ignores variation in change entirely, the tstatistic ignores information about variation in scores for clinically stable respondents, and the responsiveness statistic ignores information about variation in scores for clinically unstable responders.
Anchorbased methods examine the relationship between an HRQoL measure and an independent measure (or anchor) to elucidate the meaning of a particular degree of change. Thus anchorbased approaches require an independent standard or anchor that is itself interpretable and at least moderately correlated with the instrument being explored. [2] One anchorbased approach uses an estimate of the MID, the difference on the HRQoL scale corresponding to selfreported small but important change on a global scale.[9]
Norman et al mention several problems with the global assessment of change including, that the reliability and validity of the global scale has not been established and that the judgement of change is psychologically difficult. [19] Another limitation of the global rating is that is does not represent a criterion or gold standard for assessment of change and yet we use the global rating as an anchor to define small, medium and large changes. [9, 11]
No single approach to interpretability is perfect. As Guyatt et al suggest the use of multiple strategies is likely to enhance the interpretability of any particular instrument. [2] Therefore we used both distribution and anchorbased approaches to try and establish the interpretability of the SF6D, a new single summary preferencebased measure of health derived from the SF36.
The SF36 is one of the most widely used HRQoL outcome measures in the world today. It contains 36 questions measuring health across eight dimensions  physical functioning, role limitation because of physical health, social functioning, vitality, bodily pain, mental health, role limitation because of emotional problems and general health. Responses to each question within a dimension are combined to generate a score from 0 to 100, where 100 indicates "good health". [20] Thus, the SF36 generates a profile of HRQoL outcomes (on up to eight dimensions), which makes statistical analysis and interpretation difficult. [8]
The developers of the SF36 have suggested that using the general health dimension a fivepoint difference (on the 0–100 scale) is the smallest score change achievable by an individual and considered as 'clinically and socially relevant'. [21] Angst et al found the MCID ranged from 3.3 to 5.3 points on the physical function dimension and 7.2 to 7.8 points on the bodily pain dimension in patients with osteoarthritis of the hip or knee. [22] Hays and Morales also provide information on what a clinically important difference is for the SF36 scales. They conclude that the MCID for the SF36 is "typically in the range of 3–5 points", although they also recommend caution in interpreting 3–5 points on the SF36 dimensions as the MCID. [23]
The method of scoring the SF36 is not based on preferences. The simple scoring algorithm for the eight dimensions assumes equal intervals between the response choices, and that all items are of equal importance, which may not be appropriate. The SF6D is a new single summary preference based or utility measure of health derived from the SF36. [24, 25] Empirical work is required to determine what is the smallest change in SF6D scores that can be regarded as important. We used anchorbased methods to determine the MID for the SF6D for various datasets.
Methods
The Questionnaire: SF6D Health State Classification
The SF36 was revised into a sixdimensional health state classification called the SF6D. The six dimensions are physical functioning, role limitations, social functioning, pain, mental health and vitality. These six dimensions each have between two and six levels. An SF6D "health state" is defined by selecting one level from each dimension. A total of 18,000 health states are thus defined. All responders to the original SF36 questionnaire can be assigned SF6D score provided the 11 items used in the six dimensions of the SF6D have been completed. The SF6D preferencebased measure can be regarded as a continuous outcome scored on a 0.29 to 1.00 scale, with 1.00 indicating "full health". [24, 25]
The studies
The data used in this paper comes from seven longitudinal studies and (nine patient groups), which used the SF36 including randomised controlled trials, [26] and observational studies. [27–30]
Global Rating of change (GRoC)
Patients were followed for a period of time, then asked, using question 2 of the SF36 as our global rating of change scale, (which is not part of the SF6D), if:
2. Compared to one year ago, how would you rate your health in general now?
(5) Much better now than one year ago
(4) Somewhat better now than one year ago.
(3) About the same
(2) Somewhat worse now than one year ago.
(1) Much worse now than one year ago
The original question 2 of the SF36 compares health now with one year ago. Depending on the followup time we used a slightly modified version: e.g. health now compared to three (or six) months ago.
Statistical Analysis
We examined the relationship between the global ratings of change question and changes in SF6D score, by calculating the change in SF6D score from 1^{st} to 2^{nd} assessment for each patient. We considered patients whose GRoC score was 4 or 2 as having experienced some change equivalent to the MID. In patients who reported a worsening of health (GRoC of 1 or 2) the sign of the change in the SF6D score was reversed (i.e. multiplied by minus one). The MID was then taken as the mean change on the SF6D scale of the patients who scored (2 or 4).
Since the SF6D is a continuous measure of effect we used metaanalytic methods to estimate the weighted grand mean of the MID and to test the hypothesis of homogeneity of MID across the nine studies. If there was no statistical evidence of lack of homogeneity, a 95% confidence interval for the summary estimate of the MID was then calculated. [31, 32]
We also used a distributionbased approach and calculated a standardised response mean (SRM). Since the standard error of the SRM is not defined we used bootstrap methods to estimate 95% confidence intervals for the SRM. [33]
Global measures of change are typically highly correlated with the present state and uncorrelated with the initial state. Any measure of change that reflects the unbiased difference between the final and initial state, should show a positive correlation with the final state and an equal negative correlation with the initial state. [19] We therefore also calculated Pearson's product moment correlations between the GRoC question and the baseline and followup SF6D scores.
Results
The nine longitudinal studies
Study/patient group  Total study size  Number who reported some change  Period of time 

Older adults (aged >65 years): 1st followup  4945  1362  Baseline to year 1 
Older adults (aged >65 years): 2nd followup  3127  948  Year 1 to year 2 
Irritable bowel syndrome (IBS) patients  137  56  Baseline to 3 months 
Irritable bowel syndrome (IBS) control patients  177  27  Baseline to 3 months 
Leg ulcer patients  194  45  Baseline to 3 months 
Knee Osteoarthritis (OA) patients  157  59  Baseline to 6 months 
Limb reconstruction patients  60  29  Baseline to year 1 
Early Rheumatoid Arthritis (RA) patients  246  99  Baseline to year 1 
Patients with Chronic Obstructive Pulmonary Disease (COPD)  60  29  Baseline to year 1 
Minimum Important Difference (MID's) and Effect Sizes (SRM's)
Study/patient group  N  MID  Mean change in SF6D (95% CI)*  Standard Deviation  Effect Size (SRM) (95% CI)*  0.5 of a Standard Deviation 

Older adults 1st followup  1362  0.039 (0.034 to 0.044)  0.099  0.39 (0.35 to 0.45)  0.050 
Older adults 2nd followup  948  0.026 (0.021 to 0.033)  0.096  0.27 (0.22 to 0.34)  0.048 
IBS patients  56  0.023 (0.001 to 0.050)  0.096  0.24 (0.03 to 0.52)  0.048 
IBS control patients  27  0.025 (0.013 to 0.071)  0.113  0.22 (0.15 to 0.62)  0.057 
Leg ulcer patients  45  0.032 (0.001 to 0.071)  0.131  0.24 (0.06 to 0.53)  0.066 
OA Knee patients  59  0.032 (0.015 to 0.049)  0.066  0.49 (0.22 to 0.73)  0.033 
Limb reconstruction patients  29  0.048 (0.007 to 0.091)  0.120  0.40 (0.02 to 0.79)  0.060 
Early (RA) patients  99  0.039 (0.017 to 0.061)  0.112  0.33 (0.14 to 0.58)  0.056 
COPD Patients  29  0.010 (0.019 to 0.043)  0.087  0.11 (0.28 to 0.47)  0.044 
There was no reliable statistical evidence of lack of homogeneity in the MID estimates across the nine studies (χ^{2} = 13.41 on 8 df, p = 0.098). Therefore it seemed reasonable to combine the MID estimates from the nine studies to produce an overall weighted grand mean MID estimate of 0.033 (95% CI: 0.029 to 0.037). Figure 3 shows a forest plot of the MID estimates and associated confidence limits for the nine studies and the estimated combined overall weighted grand mean MID.
Magnitude of the MID by worse/better
Global rating of health change  

Somewhat worse  Somewhat better  
Study/patient group  N  Mean change (SD)  N  Mean change (SD)  Mean Difference (95% CI)  Pvalue 
Older adults 1st followup  1087  0.039 (0.099)  275  0.042 (0.098)  0.004 (0.017 to 0.009)  0.58 
Older adults 2nd followup  783  0.028 (0.095)  165  0.019 (0.102)  0.009 (0.008 to 0.026)  0.32 
IBS patients  36  0.022 (0.096)  20  0.026 (0.097)  0.040 (0.059 to 0.051)  0.87 
IBS control patients  15  0.017 (0.130)  12  0.035 (0.094)  0.018 (0.107 to 0.071)  0.69 
Leg ulcer patients  14  0.082 (0.109)  31  0.009 (0.105)  0.073 (0.03 to 0.176)  0.08 
OA Knee patients  30  0.003 (0.073)  29  0.036 (0.059)  0.007 (0.041 to 0.028)  0.70 
Limb reconstruction patients  10  0.044 (0.14)  19  0.051 (0.112)  0.007 (0.117 to 0.102)  0.88 
Early (RA) patients  17  0.007 (0.117)  82  0.046 (0.109)  0.053 (0.117 to 0.011)  0.08 
COPD Patients  19  0.012 (0.095)  10  0.006 (0.074)  0.006 (0.061 to 0.072)  0.87 
Correlations between global health change scale and baseline and followup SF6D scores.
Baseline  Followup  

Study/patient group  N  r  pvalue  r  pvalue 
Older adults (aged >65 years): 1st followup  4945  0.324  0.001  0.390  0.001 
Older adults (aged >65 years): 2nd followup  3127  0.395  0.001  0.514  0.001 
Irritable bowel syndrome (IBS) patients  137  0.311  0.001  0.441  0.001 
Irritable bowel syndrome (IBS) control patients  177  0.094  0.215  0.202  0.007 
Leg ulcer patients  194  0.041  0.572  0.309  0.001 
Knee Osteoarthritis (OA) patients  157  0.300  0.001  0.559  0.001 
Limb reconstruction patients  60  0.007  0.959  0.458  0.001 
Early Rheumatoid Arthritis (RA) patients  246  0.147  0.021  0.524  0.001 
Patients with Chronic Obstructive Pulmonary Disease (COPD)  60  0.391  0.002  0.547  0.001 
Discussion
We used a fivepoint GRoC scale; others have used seven or 14 points, which may be more sensitive. [9, 11] Although the designation of what GRoC suggests patients as fundamentally unchanged and what GRoC suggests patients have experienced a small but important change is inevitably subjective.
The reliability and validity of a single GRoC question has not been established. Multiitem scales may have better reliability. Indeed if the single GRoC could be shown to have superior measurement properties, then there is no reason not to simply use this a measure of HRQoL. Although Wyrwich found moderatetosubstantial agreement between the responses to question 2 of the SF36 (weighted Kappa 0.64  0.73) at test and retest (1–4 days later) in a group of 241 patients with asthma, coronary artery disease, congestive heart failure and COPD. This result provides some evidence of the usefulness of retrospective GRoC as patientperceived anchors for ascertaining important HRQoL changes. [34]
The judgement of change is psychologically difficult. Patients must be able to quantify both their present state and their initial state and then perform a mental subtraction. Patients may be unable to recall their initial state, and the judgement is based on their present state and working backwards. Any measure of change that reflects the unbiased difference between the final and initial state, should show a positive correlation with the final state and an equal negative correlation with the initial state. [19] Our results found larger correlations between the global measures of change with the present state (HRQoL) and far lower correlations with the initial state, supporting this hypothesis.
The length of time between 1^{st} and 2^{nd} assessments was up to a year, which is far larger than the timeframes used in other studies (e.g. 2 weeks for Jaeschke et al [9] and 4 weeks for Juniper et al [11]). This may be a limitation of this study in the evaluation of clinical change, as patients may have some difficulty recalling their previous state of health. However, we found no reliable evidence of an association between the MID and the time between assessments in our nine studies. Although preliminary results with two older adults cohorts suggest some form of 'Response shift' and that the MID may not be constant over time.
We combined the worse and better groups into one and assumed that the magnitude of the MID for these two cohorts were identical except for the sign. We found no reliable statistical evidence that the magnitude of the MID for those who improved and deteriorated was different. This may be explained by the small sample sizes for some of the studies and the low power to detect anything other than large differences in the mean changes. Thus the small sample sizes can explain the lack of statistical significance of the difference in MID between the worse and better groups, but not the overall size of the observed mean difference, which for some studies was more than twice as great in one group compared to the other.
We used a single anchor; our results require validation with alternative anchors or multiple anchor methods. Other approaches to interpretating changes in HRQOL are available including two similar distribution approaches, e.g. Jacobson's Reliable Change Index [35, 36] and Wyrwich's Standard Error of Measurement. [37, 38]
The SF6D is an example of a utility or preferencebased measure of HRQoL. The primary use of such measures is to adjust life years saved by quality for use in economic evaluations and decision models. Preferencebased health state scores or utilities do not have natural units. Since health is a function of both length of life and quality of life, the QALY (Qualityadjusted life year) has been developed in an attempt to combine the value of these attributes into a single index number. If utilities are multiplied by the amount of time spent in that particular health state then they become QALYs (and are measured in units of time). QALYs allow for varying times spent in different states by calculating an overall score for each patient. For the studies where the followup is one year (e.g. the two older adults cohorts) the mean change in utility scores over the one year can be directly interpreted as the MID for a QALY.
QALYs may have the potential to influence public policy and resource allocation decisions. Results from other preference based measures, such as the 15D and Health Utilities Index suggests a difference of 0.03 is considered the minimum clinically important difference for sample size calculations. Finally, as Drummond suggests, in the case of preferencebased measures, if the ultimate objective is to influence resource allocation decisions, then it is the difference in costeffectiveness (e.g. incremental cost per QALY) that is important, not the change in quality of life. Therefore changes in the measure alone may not be of interest without also considering the cost of bringing about such changes. [39]
Our findings are also limited in that a change in SF6D score of 0.033 is important when the instrument is used for examining withinpatient changes, but this does not necessarily mean that a difference of 0.033 will signify the MID when the instrument is used to discriminate between patients.
Despite the absence of a gold standard (criterion) measure, establishing the mean of any changes in a new measure like the SF6D requires some sort of independent standard. The GRoC represents one credible alternative. Whilst we have not established with certainty a single best estimate of the MID for the SF6D, our data suggest a plausible range within which the MID probably falls. This information will be useful in the interpreting SF6D scores, both in individuals and in groups of patients participating in trials. It will also be useful in the planning of new trials, as sample size depends on the magnitude of the difference investigators consider important and are not willing to risk failing to detect. [40]
Summary and Conclusions
From the nine reviewed studies the MID for the SF6D ranged from 0.010 to 0.048, weighted mean 0.033 (95% CI: 0.029 to 0.037). The corresponding SRMs ranged from 0.11 to 0.48, mean 0.30 and were mainly in the "small to moderate" range using Cohen's criteria, supporting the MID results. Using a halfstandard deviation of change approach the mean effect size was 0.051 and ranged from 0.033 to 0.066. This suggests that the results obtained through the MID method are reasonable and generally of similar size to the effect size (SRM) estimates. It demonstrates that regardless of the method used, the actual cutoff point for a clinically important difference is going to be in the same neighbourhood, thereby making the particular method of approach less important. However, further empirical work is required to see whether or not these results hold true for other patient groups and populations.
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.