Does the correspondence between EQ-5D health state description and VAS score vary by medical condition?

Background

The EQ-5D health-related quality of life instrument comprises a health state classification (health problems by severity in five domains), followed by an evaluation using a visual analogue scale (VAS). Despite the EQ-5D’s use in health technology assessment and as a patient-reported outcome measure (PROM), the correspondence between the two parts of the instrument remains ill-understood. In this paper, we consider whether the association between health state classification and VAS score might vary by medical condition.

Methods

EQ-5D data collected for studies of patients in four different clinical conditions or circumstances (stroke, low back pain, colposcopic investigation or cytological surveillance) were pooled to generate a sample of 3,851 patient records. VAS scores were regressed on reported problem severities, with the inclusion of intercept and slope dummy variables specific to condition.

Results

The regression model achieved a goodness-of-fit of 0.54. Given its structure and the significance of the coefficients, the proportion of VAS scores which differed by condition for the same health state varied between 33.3 and 88.5 per cent of possible states.

Conclusions

Many of the patients with different medical conditions or in receipt of different interventions recorded different VAS valuations, in spite of ostensibly being in the same EQ-5D-defined health states. By implication, it is probable that the same state-to-state change would by valued differently by patients experiencing different conditions.

The EQ-5D is a well-established and widely-used generic instrument for assessing health-related quality of life (HRQL). It is a two-part questionnaire, designed for self-completion. In the first part, the respondent describes his or her prevailing state of health in terms of perceived problem severities for five domains. These domains are limitations on mobility, capacity for self-care, ability to conduct usual activities, pain & discomfort and anxiety & depression, in that order. Three severity descriptions are available within each domain in the traditional version of the instrument (EQ-5D-3L), namely, none, moderate and severe/extreme (coded 1 through 3, respectively). This descriptive system accommodates 243 possible health states, each defined as a different vector or profile, ranging from 11111 (no problems in any domain) to 33333 (severe problems in all domains). In the second part of the instrument, the respondent evaluates his or her prevailing state of health by indicating a position on a visual analogue scale (VAS). This is a vertical, calibrated, line, anchored at 0, the “worst health state imaginable ”, and at 100, the “best health state imaginable ” [1].

The principal use of the EQ-5D instrument to date has been in health technology assessment (HTA); indeed, the UK’s influential National Institute for Health and Clinical Excellence has declared the EQ-5D to be “the preferred measure of HRQL in adults” [2] p. 38. For the purposes of cost utility HTA, the first (descriptive) part of the questionnaire is of far greater significance than the second (evaluative) part. This is because HTA conventions in most countries [3] dictate that, whilst the health effects of interventions during clinical trials should be assessed using the health state descriptions made by the participating individuals, the values of those states should derive from public or social, rather than individual, judgements [4]. These social health state utilities are obtained from independent studies which aggregate the opinions of members of general populations into state-specific “index scores”, anchored at 1 (EQ-5D state 11111) and 0 (dead).

As EQ-5D VAS results have had little relevance in HTA, the relationship between individuals’ descriptive profiles and their corresponding VAS scores has not been extensively researched. Only a few regression studies have been undertaken, predicting VAS scores from reported problem severities by domain, coded as binary dummy variables. These studies confirm the intuition that subjects who report more health problems at greater severities tend to indicate poorer HRQL in the form of lower VAS scores. For example, a UK analysis of a large sample of pooled records for surgical procedures reported that “the binary variable coefficients are all in the expected direction and are highly statistically significant. Moreover, they are consistent in each dimension, so that the coefficients on level 3 are all higher than the coefficients of level 2. The differences between the level 2 and level 3 scores are all significant” [5] p. 16-17. Such analyses also suggest that problem severity variations in the five domains are, of themselves, insufficient to explain VAS scores fully [6–8].

A new role for the EQ-5D raises further concern over the absence of investigations of the association between profiles and VAS scores. Since 2009, the National Health Service (NHS) in England has been collating and publishing data from a suite of “before and after” patient-reported outcome measures (PROMs) [9]. PROMs are intended to facilitate comparisons of provider performance and of patient benefit from services. Although the PROMs include both components of the EQ-5D, the performance of the VAS was excluded from appraisal of the pre-implementation pilot study [10]. Presently limited to four types of elective surgery (hip, knee, hernia repair and varicose veins), there exists an explicit intention to “extend PROMs across the NHS wherever practicable” [11] p. 14. Assuming that such an extension were to occur, published VAS and index scores would become available and might be used for comparison across different conditions, despite the validity of any such comparison remaining un-established. The potential problem is not confined to England, as other countries, including Sweden [12] and Canada [13], have indicated an interest in publishing EQ-5D results as part of their own PROMs packages.

The EQ-5D aims to be a “non-disease-specific instrument for describing and valuing health-related quality of life” [14] p. 337, and it was the promise of generality which made the instrument attractive as a PROM [15]. For this aspiration to be realised, however, it is necessary to suppose that the association between EQ-5D profile and VAS score does not vary systematically by medical condition or circumstances. Were the converse to be the case, it would follow that VAS results are not necessarily comparable across conditions or interventions, even when subjects are ostensibly in the same health states. In this paper, we consider the supposition as a hypothesis and investigate the association between VAS scores and health states amongst subjects experiencing different interventions.

The data for the investigation constituted a convenience sample, constructed by pooling EQ-5D records for participants in several controlled clinical trials of different conditions. The data comprised four sub-samples, as follows:

1. i)

   Men and women with a mean (SD) age of 56.5 (9.8) years, undergoing epidural steroid treatment for chronic low back pain, recorded regularly over a period of six months [16, 17].

ii) Men and women with a mean (SD) age of 69.9 (11.4) years, in recovery following a stroke and recorded at approximately three months post-event [18].

iii) Women of mean (SD) age 35.2 (10.7) years, being followed up after a colposcopic examination following abnormal cervical cytology. These women would have experienced excision or ablation of abnormalities as necessary, and were recorded at approximately nine months post-event [19, 20].

iv) Women of mean (SD) age 35.1 (10.7) years, with no specific medical conditions and receiving no active treatment. These women were under routine cytological surveillance following abnormal cytology, which had occurred up to one year prior to HRQL measurement [19, 20].

All subjects had completed the EQ-5D-3L version of the questionnaire. Details of patients characteristics and methods of data collection appear in the sources cited. Some of the patients in the original stroke study had been recruited outside the UK but their records were omitted from this analysis, as there are grounds for believing that EQ-5D responses vary geographically [21]. The other studies had been conducted with UK subjects only.

All statistical analyses employed SPSS version 20. One-way analysis of variance was conducted to establish whether mean VAS and index scores differed between the four sub-samples. The principal hypothesis was tested using Potthoff regression analysis [22], which establishes whether a relationship between a criterion variable and predictor variables differs across values of a categorical variable. The model to be estimated is

where Y is the VAS score. X is a vector of ten predictor variables coded as 0/1 binary dummy variables. These are the presence of level 2 and of level 3 health problems for each of the five EQ-5D domains, with problems at level 1 being the reference categories. D is a vector comprising binary dummy variables to connote three of the four different sub-samples. The surveillance group was chosen as the reference category, on the grounds that patients in this group had been in receipt of the least amount of formal treatment. Finally, D*X is a vector of thirty interactions between each of the domain/severity variables and each of the conditions/interventions. Significant b₂ or b₃ coefficients in the regression model would contradict the primary hypothesis; specifically, one or more significant b₂ coefficients would support the existence of different intercepts in the VAS-determining equation for those conditions, whereas significant b₃ coefficients would support the existence of differential slopes. The regression model was fitted using stepwise regression.

A total of 3,851 records were analysed. Table 1 displays the characteristics of the four component data sets, arranged by increasing mean VAS score for each set. Analysis of variance indicated that all four mean VAS scores were significantly different from one another (F(3,3848) = 594.8, p < 0.01). The index scores of the four sets differed significantly also, with the exception of those for colposcopy and surveillance (F(3,3848) = 893.1, p < 0.01). Of the four sets, those for surveillance and colposcopy displayed the greatest similarity in terms of EQ-5D profile, with the surveillance group recording slightly fewer problems at level 1 in each domain. Compared with these two data sets, those for stroke and for back pain included substantially more problems beyond level 1 in all domains. Subjects in these two sub-samples were considerably older than those in the colposcopy and surveillance sub-samples, with the stroke patients being older on average than the back pain patients. Problems with mobility and pain & discomfort were less frequently reported in the stroke sample than in the back pain sample. In the full sample 113 different health states were represented.

Table 2 presents the regression model (adjusted R² = 0.54) which possessed a number of characteristics of interest. First, neither of the coefficients for the level 2 and the level 3 variable in the “capacity for self care” domain achieved statistical significance. Second, and irrespective of intervention, the relative magnitudes of the estimated coefficients of levels 2 and 3 for the remaining domains were consistent with intuition, in that greater problem severity was associated with lower VAS score. Third, none of the coefficients on the intercept dummies (b₂) achieved statistical significance at 5 per cent. Fourth, as regards the slope dummies (b₃), moderate limitations on usual activities for women following colposcopy exerted a greater negative effect on VAS score, compared with the reference group (surveillance). For those with low back pain compared with the surveillance group, pain & discomfort at levels 2 and 3 produced significantly lower VAS scores, whereas anxiety & depression at these levels were associated with higher VAS scores. For stroke patients in comparison with the reference group, both severe pain & discomfort and severe anxiety & depression were associated with smaller negative effects on VAS scores.

Insignificant coefficients for the intercept dummies (b₂) imply that the predicted mean VAS score at health state 11111 is the same for all four conditions, namely, the constant term. However, significant coefficients on at least some of the slope dummies mean that, for many other health states as described by the EQ-5D, the predicted VAS score must vary by condition. Evaluating the estimated regression equation for vector 22222 produces mean VAS scores of 50.8 for low back pain, 55.2 for surveillance and for stroke, and 60.7 for colposcopy. The predicted scores for vector 33333 are 10.5 for surveillance and colposcopy, 21.3 for back pain, and 33.7 for stroke.

Of the 243 EQ-5D states which any respondent could possibly occupy, 81 (33.3 per cent) would have a severity level of 2 for “usual activities”. Given the model’s structure, therefore, the VAS scores for the colposcopy group would differ from those of the reference group for these 81 states. By the same token, the scores for the stroke and low back pain groups would differ for 135 and 215 states (55.6 and 88.5 per cent, respectively), compared against the reference. The scores for the stroke and back pain groups would, between themselves, also differ for 215 (88.5 per cent) of states.

The estimated regression model indicates that the marginal impact of a change in health state on VAS score would, for many such changes, differ by condition. By way of example, and based on the calculation above, a change from health state vector 33333 to vector 22222 would improve VAS scores by 21.5, 29.5, 44.7 and 50.2 for stroke, back pain, surveillance and colposcopy patients, respectively. At the domain level, and according to the coefficients presented in Table 2, a decrease in severity from level 2 to level 1 in the pain & discomfort domain would entail an increase of 3.9 in VAS score for the surveillance group. For the low back pain group, however, the improvement would register an additional increase of 11.7, or 15.6 in total. Similarly, a pain & discomfort severity reduction from level 3 to level 2 would result in the mean VAS score being 14.6 higher amongst the colposcopy group but only 5.5 higher for the stroke group. If anxiety & depression fell from severity level 3 to level 2, the mean VAS score would rise by 19.0 according to the colposcopy patients but by 4.9 according to the stroke patients. An improvement from level 2 to level 1 would imply an increase of 4.5 in VAS score for the low back pain group but of 11.8 for the surveillance group.

A literature on the association between EQ-5D VAS scores and health state descriptions does exist, although in a context quite different from that of the present investigation. In the past, the VAS has been employed to establish index scores, rather than to self-evaluate HRQL per se. Respondents from general populations have been asked to consider hypothetical health states and to associate a VAS score with each [23]. The average valuations of hypothetical states made by large numbers of individuals currently in no particular actual state have become, in effect, social health state utilities. It was observed at an early stage of the EQ-5D’s development that when respondents actually existed in the health state which they had been asked to value, their valuations differed significantly from those for whom the state was hypothetical [24, 25]. The observed discrepancies between patient and public values stimulated debate over both whose opinions were the most appropriate for HTA purposes [26] and the validity of using the VAS to elicit social preferences [27].

In spite of the difference in context, two of the social valuation studies provide some support for our findings. First, the magnitude of the divergence between patient VAS valuations of real states and population VAS values for those states considered hypothetically, has been shown to vary by medical condition [28]. This particular result also contradicts the hypothesis under investigation, namely, that patient VAS scores for any particular EQ-5D health profile are not condition-specific. Second, a study investigating the marginal impact of problem severity by domain concluded that, compared to respondents who were valuing hypothetical states, those valuing the states which they were actually experiencing attributed a far lower significance to the capacity for self-care [29]. Our subjects who were valuing real states also found the capacity for self-care domain insignificant (Table 2).

The principal limitation of this study lies in its data. These were derived from trial-based economic evaluations in which the author participated and which were readily available. Convenience rather than premeditated design influenced the selection of records and, scientifically, the data are less-than-perfect as a basis for testing the hypothesis. For example, records of a proportion of the stroke patients were completed by proxies, and the back pain sub-sample comprised repeated measures whilst the remainder did not. Sequential evaluation of health states is prone to individual subject bias although none was identified in the original studies, and VAS and index scores were correlated over time [17]. That having been said, inconsistencies in repeated VAS measures have been identified; for example, a foot surgery study reported a significant improvement of 0.2 in EQ-5D index scores at six months whilst detecting no change in VAS scores [30].

Women were more heavily represented in the sample than men, with two sets including data for women only. We cannot exclude the possibility, therefore, that the observed effect should be ascribed to sex rather than to the medical conditions themselves. Opposing this possibility, (i) none of the previous studies relating VAS response to health profile reported a sex effect, (ii) regression models using both the low back pain data and the stroke data separately failed to produce significant coefficients for the sex of respondent. In similar vein, the considerable age differences between sub-samples raises the possibility that differential response in VAS scoring might be age- rather than condition-related. Distinguishing the effect would prove difficult in this sample, in view of the strong association between sub-sample age and condition.

In view of the new importance attached to VAS scores, further research would seem imperative. Ideally, the hypothesis would be investigated using purposefully-collected data including more variables. Two classes of candidate for inclusion would be, first, health domains which are absent from the EQ-5D but present in other HRQL instruments, domains such as sleep, memory and energy & fatigue [8] and, second, measures of psychological disposition which have been shown to influence self-perceived health independently of actual health [31, 32]. Even so, and in spite of the idiosyncrasies of the data, the coefficient of determination for the Table 2 model was considerably beyond the 0.24-0.32 range obtained in previous regression models [5–7] where different medical conditions had not been distinguished.

The results call into question the proposition that patients in the same EQ-5D-defined health state but with different medical conditions (or in receipt of different interventions) necessarily evaluate the state similarly. The regression model supports the possibility that a given change between two EQ-5D-defined health states could produce different changes in VAS scores for different medical conditions and interventions. It follows that EQ-5D VAS scores published as PROMS may not be consistent across different conditions or interventions.

HRQL:

Health-related quality of life

HTA:

Health technology assessment

NHS:

National health service

PROM:

Patient-reported outcome measure

VAS:

Visual analogue scale.

Affiliations

1. School of Economics, University of Nottingham, Nottingham, NG7 2RD, UK
   • David K Whynes

Corresponding author

Correspondence to David K Whynes.

Competing interests

The author declares that he has no competing interests.

Reprints and Permissions