Skip to main content
Download PDF
Download ePub

Assessing the psychometric performance of EQ-5D-5L in dementia: a systematic review

Health and Quality of Life Outcomes volume 20, Article number: 139 (2022) Cite this article

Abstract

Background

EQ-5D is widely used for valuing changes in quality of life for economic evaluation of interventions for people with dementia. There are concerns about EQ-5D-3L in terms of content validity, poor inter-rater agreement and reliability in the presence of cognitive impairment, but there is also evidence to support its use with this population. An evidence gap remains regarding the psychometric properties of EQ-5D-5L.

Objectives

To report psychometric evidence around EQ-5D-5L in people with dementia.

Methods

A systematic review identified primary studies reporting psychometric properties of EQ-5D-5L in people with dementia. Searches were completed up to November 2020. Study selection, data extraction and quality assessment were undertaken independently by at least 2 researchers.

Results

Evidence was extracted from 20 articles from 14 unique studies covering a range of dementia severity. Evidence of known group validity from 5 of 7 studies indicated that EQ-5D-5L distinguishes severity of disease measured by cognitive impairment, depression, level of dependence and pain. Convergent validity (9 studies) showed statistically significant correlations of weak and moderate strengths, between EQ-5D-5L scores and scores on other key measures. Statistically significant change was observed in only one of 6 papers that allowed this property to be examined. All seven studies showed a lack of inter-rater reliability between self and proxy reports with the former reporting higher EQ-5D-5L scores than those provided by proxies. Five of ten studies found EQ-5D-5L to be acceptable, assessed by whether the measure could be completed by the PwD and/or by the amount of missing data. As dementia severity increased, the feasibility of self-completing EQ-5D-5L decreased. Three papers reported on ceiling effects, two found some evidence in support of ceiling effects, and one did not.

Conclusions

EQ-5D-5L seems to capture the health of people with dementia on the basis of known-group validity and convergent validity, but evidence is inconclusive regarding the responsiveness of EQ-5D-5L. As disease progresses, the ability to self-complete EQ-5D-5L is diminished.

Background

With an increasing incidence of people living with dementia (PwD), the number of studies investigating novel interventions and strategies for the management and care of dementia is on the rise [1], which in turn, may lead to increased pressure on the limited resources of the NHS. Having the right outcome measures to adequately capture the benefits of treatments for this population is essential to ensure the efficient allocation of resources. Concerns around the challenges posed by issues of cognition, time perception, memory and judgement have questioned the suitability of existing preference-based measures (PBMs) to compute quality adjusted life years (QALYs) in PwD [2].

In the UK, the EQ-5D is the preferred measure of health-related quality of life (HRQoL) by the National Institute of Health and Care excellence (NICE) to generate QALYs for use in economic evaluation [3]. The descriptive system comprises five dimensions reflecting generic HRQoL: mobility, self-care, usual activities, pain and discomfort and anxiety and depression [4]. In addition to the descriptive system, EQ-5D has preference weights from several countries allowing health state utility values to be estimated that reflect the societal preferences of the given country, which can be integrated into country-specific economic evaluations. There are two versions of the EQ-5D, the EQ-5D-3L [4] and the EQ-5D-5L [5]. The 3L version has three response levels of severity for each of the five dimensions and the 5L version was later introduced to improve the instrument’s sensitivity and reduce ceiling effects by increasing the number of severity levels [5]. It has the same five dimensions, with two additional levels of severity. The EQ-5D can be self-completed or administered by interviewer, and in particular cases can be completed via a proxy assessor—which describes when a person is asked to report on behalf of someone else in relation to their health status. The proxy should be someone that knows the patient well for example, a family member or friend, caregiver or healthcare professional [6].

A recent systematic review of utility measures for PwD, based on 64 published studies, found that EQ-5D-3L was the most widely used measure in cost-effectiveness analyses (34 studies) [7]. The other measures used were: Dementia Quality of Life (DEMQOL)-U (utility score) [8] (n = 2), Health-Utility Index (HUI) [9] (n = 17), Quality of Wellbeing (QWB) [10] (n = 4), Assessment of Quality of Life (AQoL-8D) [11] (n = 2) and 15-D (n = 3). EQ-5D-3L was considered the most feasible and acceptable in terms of completion time, response rate and the number of missing items. In terms of precision, ceiling effects have been observed for EQ-5D-3L and other measures. The majority of evidence pertained to the three-level version of EQ-5D and there is a lack of evidence on the more recent five-level version, EQ-5D-5L.

Concerns have been raised around the content validity of PBMs to reflect the themes that are important for PwD. QWB was found to have the highest number of relevant items [7]. A more recent study assessing the face and content validity of six preference-based measures suggested that participants did not express a clear preference for one over the other [12]. When responsiveness was assessed, only EQ-5D-3L was found to have an effect size greater than 0.5, underscoring the need for more evidence on this property. In summary, EQ-5D-3L remained the most widely used PBM mainly by virtue of its brevity. The majority of the evidence on EQ-5D in this population uses the 3L version. While in theory, the EQ-5D-5L may be more sensitive and less subject to ceiling effects, the five responses may pose extra challenges for PwD. A recent systematic review of the psychometric performance across conditions found that the EQ-5D-5L exhibited excellent psychometric performance, but this did not fully assess the evidence on EQ-5D-5L usage in dementia [13].

The purpose of this paper was to assess the psychometric performance of EQ-5D-5L in a population of PwD with a view to help inform the suitability of the measure for generating utilities and QALYs to inform economic evaluation. The objectives were to identify published literature on the psychometric properties of EQ-5D-5L in PwD and conduct a systematic review of the published literature.

Methods

EQ-5D-5L has five dimensions: mobility, self-care, usual care, pain/discomfort, anxiety/depression. Each dimension has five levels: no problems, slight problems, moderate problems, severe problems and extreme problems.

Literature searches

A systematic search was conducted in Medline (Ovid), the Web of Science Core Collection Science Citation Index Expanded (Clarivate Analytics) and PsycINFO from 2009 (date when EQ-5D-5L became available) to Nov 2020 to identify studies reporting the psychometric performance of EQ-5D-5L in PwD. Search terms for the measures and the population are shown in Table 1. The search strategy was translated across each database and limits for human studies and English language were applied. No study type limit was applied. Supplementary grey literature searches included the conference abstract websites in the last three years from the International Society for Pharmacoeconomics and Outcomes Research and International Society for Quality of Life Research, Web of Science Cited Reference Search, keyword searching using Google Scholar search engine and examination of reference lists of included studies.

Table 1 Final MEDLINE strategy
Full size table

Study selection

Eligible papers (full-text articles and abstracts without available free full versions online) were selected by two reviewers (AK and HH). Eligibility criteria are summarised in Table 2. After excluding duplicates, titles and abstracts, all potentially relevant articles were obtained for detailed review. Disagreements were resolved by discussion with a third reviewer present (DR).

Table 2 Study eligibility criteria
Full size table

Data extraction

Three reviewers (HH, AK, DR) independently extracted psychometric evidence for the same three very different papers purposefully selected [14,15,16], compared their findings and resolved any disagreement to ensure a standard approach to data extraction for the remaining papers. Thereafter, each of the two reviewers (DR, HH) extracted half of the remaining papers and a final check was carried out by a third reviewer (AK).

Data extraction for this review was performed using similar methods to a previous review [17]. Data on the following were extracted: study aim; country; language of the EQ-5D-5L; mode of administration; preference weights to generate EQ-5D-5L scores if used; age range of participants; mean age; gender proportions; sample size; other measures; disease and severity reported; whether the measures have been self-reported or proxy-completed; whether the analysis uses scores, dimensions or both and the other measures reported. Data assessing the psychometric properties of known-group validity, convergent validity, responsiveness, reliability and acceptability described below were also extracted. Known-group validity measures whether the instrument is able to differentiate between different groups with different severity. To do so, a measure of severity is needed as well as hypotheses to be tested, for example, people with more severe impairment are likely to have lower quality of life, and we have used the a priori hypotheses identified by the authors (either explicitly or implicitly) of each study. Known-group validity is indicated if a statistically significance difference at the 5% level across known groups is observed, along with whether the direction of the difference is in accordance with clinical expectation. Known-group difference can be measured by standardised effect sizes (ES) often dividing the mean by the standard deviation of the milder group where ES of 0.2 is normally considered small, 0.5 moderate, and 0.8 large [18]. Convergent validity measures the degree of association between the measure of interest (EQ-5D-5L) and other health-related quality of life measures, and this can be at item/dimension level or using sum scores of scores where appropriate. Convergent validity is more often assessed using correlation coefficients but can also be assessed using statistical significance from regression analyses. In this review, a correlation coefficient of ≥ 0·70 is taken as strong evidence of construct validity with the additional categories: ≤ 0.40—weak correlation and moderate correlation lies between 0.41 and 0.70 [19]. Evidence of convergent validity focuses upon expected correlations motivated in theory. Test–retest reliability assesses the ability of the measure to produce consistent values in cases where no changes in health-related quality of life is expected. Inter-rater reliability refers to the ability of different raters completing the measures to produce consistent values. Intra-class coefficients are often used to measure test–retest reliability. Responsiveness is the ability to reflect change over time in cases where change is expected, for example following treatments. Evidence of responsiveness is present if a statistically significance change at the 5% level over time is observed. The direction of the change is also considered to determine whether it is in accordance with clinical expectation e.g. higher HRQoL post-treatment compared to baseline. Acceptability and feasibility refer to the practicality of administering a measure and the ease with which it is completed by the patients. They cover aspects such as time taken to complete the measure, whether assistance is needed and missing data, the latter being an indication of the ease with which the measures can be completed. A lack of evidence for acceptability and feasibility is concluded where the study reports, for example, high levels of missing data or low levels of understanding. We have reported ceiling effects separately as it is an important consideration given the context of EQ-5D-5L. Ceiling effects are said to be present when there are significant number of respondents score the highest possible value. Amongst the different cut-offs in the literature, in this review we have taken the cut-off to be 15% [20] as this is also stated by one of the papers [21].

Quality assessment

This review allowed for the inclusion of all study types (clinical studies, cost-effectiveness analyses, observational studies etc.). Therefore, rather than using pre-existing quality appraisal tools (which tend to be targeted to a specific study-type), the standardised GRADE assessment tool was adapted and used to perform a less formal quality appraisal of the papers [22]. The assessment criteria comprised 11 questions around the population, study sample size and outcome administration methods used within the study, whether details of analysis were provided, quality of data and whether selection bias was discussed. Each question was scored and the total score was used to categorise papers are high, medium and low (details in Additional file1).

Results

Of the 511 records retrieved from the three databases searches, 225 duplicates were removed, and 20 studies were found to be eligible for inclusion in the review. Forty-four studies were excluded because they did not include EQ-5D-5L, were from the wrong population or no meaningful psychometric data could be extracted (Fig. 1).

Fig. 1
figure 1

PRISMA diagram outlying flow of study selection

Full size image

Summary of included studies

The 20 papers in this review related to 14 unique studies: with four papers from the Access to Timely Formal Care Cohort (Actifcare) study [23,24,25,26], and three from the Enhancing person Centred Care in Care Homes (EPIC) trial [27,28,29], and two from the INSPIRED study [14, 16] (Table 3). The studies were carried out in a number of countries with the highest number of papers from the UK (n = 7) from 5 different studies and Australia (n = 5) from four different studies, four countries with one paper each (Denmark, Italy, Japan and Singapore) and four papers from one multinational study (Germany, Ireland, Italy, the Netherlands, Norway, Portugal, Sweden and United Kingdom).

Table 3 Characteristics of included studies (20 studies)
Full size table

There were several languages for EQ-5D-5L used in the papers: English (n = 13), Japanese (n = 1), Italian (n = 1), Danish (n = 1) and local languages for the multinational studies (n = 4). In the case of four papers, the language was not stated and had been assumed to be English [21] and Japanese [30].

The papers recruited participants in different settings: residential care homes (n = 8), community dwellings (n = 6), nursing homes (n = 4) and memory clinics (n = 2). While all the studies assessed patients with dementia, there was a wide range of severity where specified: mild dementia (n = 3), mild to moderate (n = 4), moderate to severe (n = 2), advanced (n = 1) and mild Alzheimer disease (n = 1). One study among nursing home residents did not specify the percentage of participants with dementia but it was selected for inclusion because the authors stated that participants were selected through stratified sampling according to the resident’s dementia status and functional diagnosis [21].

Sample size varied considerably across studies ranging from 26 (qualitative study) [12] or 29 [31] to 1004 [28]. Three papers had sample sizes less than 50, one between 51 and 100, four between 101 and 200, seven between 201 and 500, four between 501 and 750 and one greater than 750.

Ten studies assessed the EQ-5D-5L index score only, one study only assessed the dimensions, eight included both dimensions and index score and one qualitative study did not explicitly consider either. Twelve of the 20 studies reported using UK specific preference weights with four using the cross-walk from EQ-5D-5L to EQ-5D-3L [32]; eight used values from the value set for England produced by Devlin et al. [33]; one used both sets mentioned; the value sets used by three papers was unclear though there is some reference to UK values. One paper used the Australian weights, one used a crosswalk from Singaporean 3L value set, one used the Spanish preference values and, the preference weights used was unclear in a further four papers. Sopina et al. clearly stated using EQ-5D-5L but the preference weights used of those elicited for EQ-5D-3L and it was not possible to infer exactly how the weights for EQ-5D-5L were generated [34, 35]. One paper analysed dimensions only and one qualitative paper did not consider any value sets.

Known-group validity

We were able to assess known-group validity from information provided in seven papers. Five papers significantly captured known-group differences for PwD with different degrees of unmet needs, with different levels of physical function and communication ability, people with or without sarcopenia (condition with loss of muscle mass and function) and for people with and without dementia (Table 4). Known-group differences were not observed in one study assessing a ‘facilitated family case conferencing’ intervention (similar to care planning with a multidisciplinary team) [34]. Although one study found mixed evidence for self-report and proxy completed scores at two different time points, the overall direction pointed to the fact that EQ-5D-5L scores were able to distinguish between different severity levels as measured by cognitive impairment, depression, level of dependence (self-care) and pain level [36]. The majority of results found that the differences were in the direction expected. Easton et al. [14] investigated both dimensions and the index and while the results were in the direction expected when assessed by different levels of cognition and functional impairment, they found that those with a diagnosis of dementia had higher EQ-5D-5L scores that those without. Another paper found no difference between those with and without dementia [37].

Table 4 Known-group validity (7 studies)
Full size table

Convergent validity

As shown in Table 5, nine studies assessed convergent validity, with all of them finding statistically significant correlations with the other measures included in the studies, which are measures commonly used in dementia. However, the strength of these associations was varied. While one study did not report the exact correlation coefficient [28], of the remaining eight studies, half reported weak associations [14, 27, 34] (r < 0.4) and the other half found moderate associations [21, 24,25,26] (r = 0.41–0.7), with none of the studies reporting strong evidence of convergent validity between the measures. All of the studies with weak (but significant) associations were analysing the relationship between EQ-5D-5L and dementia-specific QoL measures i.e., DEMQoL-U, DEMQoL-U-proxy, QoL-AD, Quality of Life in Alzheimer’s disease scale—Nursing Homes version (QOL-AD-NH) and Quality of life in late-stage dementia (QULAID) [38]. Two studies explored relationships with ICEpop CAPability measure for Older people (ICECAP-O) [39], and reported moderate (significant) associations with both self [24] and proxy reported [25] EQ-5D-5L.

Table 5 Convergent validity (9 studies)
Full size table

The lowest correlations were found between EQ-5D-5L completed by the PwD and other dementia measures (e.g. QUALID) completed by staff proxies.

Reliability

Seven studies assessed the inter-rater reliability of EQ-5D-5L comparing completion by PwD and other proxies: staff proxies only (n = 2); family members or friends or informal carers (n = 4); and one study included one of the proxies mentioned and one included all formal and informal proxies as well as staff (Table 6). There was clear evidence from all the studies of the lack of inter-rater reliability between self-report and other proxy raters. One study reported fair agreement between staff proxy and informal carer proxies [27] and stated that for EQ-5D-5L dimensions, residents rated themselves as having ‘no problems’ more frequently than either relative/ friend proxies or staff proxies. The difference was particularly large for self-care, where one study found that 76% of residents stated they had no problems whereas staff and relative/friend proxies rated a much lower percentage of people with no problems (14% and 10%, respectively) [27]. Usman et al. [40] reported fair agreement for the mobility dimension and lower agreement for the remaining EQ-5D-5L dimensions. Across the studies, the overall EQ-5D-5L scores reported by PwD were higher than the scores recorded by proxies. Martin et al. [28] stated that these differences were more pronounced at the low end of utilities, namely as severity increased.

Table 6 Reliability (7 studies)
Full size table

Responsiveness

The results from six studies assessing responsiveness are presented in Table 7. For five of the studies, responsiveness was assessed in the context of an intervention and in one study [28, 29, 34, 35, 41], change was assessed in the post-hospitalisation following a hip fracture [36]. All studies assessed the EQ-5D-5L index over time from baseline to one or up to three follow-up points. Five of the studies found changes in the direction expected, but of these two did not find that the change was statistically significant and one did not report on statistical significance. One study reported significant change for EQ-5D-5L proxy-completed by staff and relatives but not when self-completed by the PwD. One study which collected follow-up responses to assess the feasibility of doing so was not included in the table as the authors did not perform any analysis given the small sample size (n = 9) [31].

Table 7 Responsiveness (6 studies)
Full size table

Acceptability and feasibility

Ten studies assessed acceptability and feasibility of EQ-5D-5L as presented in Table 8. Six papers used missing data, one of which also analysed ceiling/floors effects, one study assessed the ability to complete, one qualitative study assessed people’s opinion from interviews, and one paper did not specify the analysis performed but reported a conclusion. Five studies found EQ-5D-5L to be acceptable to PwD assessed by whether the measure could be completed by the PwD and/or by the amount of missing data. The percentage of missing data for EQ-5D-5L for the PwD, when reported, ranged between 1 and 77%. Easton et al. [14] concluded that self-completion was feasible for only part of the population. Similar findings were observed by three other papers [28, 29, 42]. The studies found that as severity increased, the feasibility of collecting EQ-5D-5L data from PwD decreased, for example Griffiths et al. [27] found that PwD were too tired, and some had severe cognitive impairment hence were unable to complete the measure.

Table 8 Acceptability and feasibility (10 studies)
Full size table

Ceiling effects

Ceiling effects were assessed by three papers. As mentioned in Table 8, one paper did not find any ceiling effects associated with the use of EQ-5D-5L in PwD [21]. One paper found evidence of ceiling effects for both EQ-5D and DEMQOL-U [14] and a further paper stated that half of the respondents in their sample had full utility scores [30].

Quality assessment

Out of the 20 papers, four were of high quality, 12 were medium, two low and a score could not be determined for the qualitative paper included in the review [12] (see Additional file1 for the quality assessment).

Discussion

This review has assessed the psychometric evidence of EQ-5D-5L in PwD based on 20 papers from 14 unique studies. Participants were recruited from a number of settings (residential, community dwelling, nursing homes, memory clinics) at different stages of dementia (from mild to severe) and a wide range of sample sizes, all adding to the heterogeneity of the population and the studies. Only a small number of papers assessed the psychometric properties of interest: known-group difference (n = 7); convergent validity (n = 9); responsiveness (n = 6); reliability (n = 7); and acceptability and feasibility (n = 10). The findings indicated that EQ-5D-5L scores could distinguish between known-groups of different severities as measured by cognitive impairment, depression, level of dependence and pain. Evidence of weak to moderate convergent validity was found in all papers assessing it. The weakest associations were present between self-completed EQ-5D-5L and staff completed outcome measures, which may be expected due to the otherwise observed inter-rater relationships. Out of the six papers assessing responsiveness, four papers did not show any significant changes though all reported changes in the expected direction. There was clear evidence of the absence of inter-rater reliability between self and proxy reports. While there was some evidence to support acceptability and feasibility of self-report EQ-5D-5L across six papers out of ten examining this, concerns were raised about burden and severe cognitive impairment jeopardising the ability of PwD to self-complete the measure.

Nine of the papers presented results for the EQ-5D-5L index only and nine presented results for both EQ-5D-5L dimensions and the utility index. The value set used was extracted when it was reported. There are currently 29 published value sets available that were generated using the standardised valuation techniques and protocol recommended by the EuroQoL Group [43]. There is evidence in the literature that utilities and results of cost-utility analyses are dependent on value sets used [44, 45]. By extension, some psychometric properties can be influenced by the value set especially where the utility scores have been used to assess the property. In the UK, the valuation of the EQ-5D-5L using time trade-off is currently in progress. There is a previous England value set that used a hybrid time-trade-off (TTO) and discrete choice experiment approach [33]. Currently the National Institute for Health and Care Excellence (NICE) [3] recommends the published mapping function to obtain EQ-5D-5L utilities from the EQ-5D-3L value set [3, 46, 47]. Therefore, as new value sets become available and more papers published using them, the psychometric properties of the EQ-5D-5L may need to be reassessed.

The evidence assessed is limited due to several reasons. First, there is a limited number of studies (14 studies from 20 papers). From the initial search, we retrieved 64 full articles and excluded 44 because either they used EQ-5D-3L which was not evident from either the abstract or the title, or no psychometric properties could be extracted, or the study assesses another population. Second, the quality of reporting in several of the papers was not ideal for the assessment of psychometric properties. This was mainly because the aim of only seven papers in this review was to psychometrically assess the properties of measures, while the rest have broader aims, for example cost-effectiveness analyses or assessing pain in people with and without dementia. As a result, we did not use any guidelines often used to assess the methodological quality of the studies. Third, we found limited evidence on content validity and this is an important psychometric property.

In assessing the evidence, a lot of caution needs to be exercised. First, the known-groups that were used might not necessarily have been the most indicative for assessing the suitability of EQ-5D-5L for measuring the HRQoL of PwD. It is noted that the authors in the included papers assessed known-group validity based on statistical significance and not on whether the expected differences between groups were clinically relevant despite the latter being recommended by the COSMIN guidelines [48]. In assessing known-group differences between the intervention and treatment groups, non-significant differences could have been the result of an “ineffective” intervention or other factors rather than the psychometric properties of the instrument per se. In the two studies assessing known-group validity across those with and without dementia, one did not find a significant difference and the other found an outcome in the wrong direction, and this may be impacted by under-diagnosis or diagnosis at later disease stages. Similarly, failure of an instrument to detect responsiveness which is change over time may be due to the intervention (and the sample size) rather than the ability of the instrument to detect change; we could not disentangle these in the evidence provided. From the published sources, it was not always clear whether a change was expected with respect to a global rate of change or as assessed by clinicians. From the mixed evidence reported in this paper, there was reassurance that EQ-5D-5L was likely to capture known-group validity and had convergent validity with other measures commonly used in PwD. However, concerns were raised around responsiveness, inter-rater reliability and acceptability and feasibility. Whilst inter-rater reliability and acceptability and feasibility may be an issue only for self-report for PwD and may be equally applicable to other measures where self-reported by PwD, further evidence on this (and head-to-head comparisons of measures) would be beneficial. We recommend that additional analyses are required on secondary datasets to be able to answer some of these questions more accurately.

The review highlighted that as the severity of the condition increased, PwD were less likely to be able to self-complete EQ-5D-5L (or measures in general) because of fatigue, cognitive or functional impairment. It was not possible to determine from the review, the suitability of EQ-5D-5L across different severity levels and other co-morbidities despite this being of crucial importance. It is recommended that more detailed analyses required to make clear recommendations around the suitability of EQ-5D-5L across these variables. This warrants more detailed analyses on secondary datasets that allow for more head-to-head comparisons of different generic and condition-specific PBMs.

Self-completion is not always feasible for several populations including children, those at the end of life, those with several cognitive impairment and PwD at a later stage of disease. Given that a proportion of the population with dementia are unable to self-complete HRQoL, a viable option is for the measures to be completed by proxies. In this review, there was clear evidence of absence of inter-rater reliability of EQ-5D-5L. This finding in dementia is supported by a large literature on this issue [49,50,51,52,53,54]. In general, PwD themselves tend to provide more optimistic reports of their own HRQoL than their proxies, and there was some evidence that this difference became more pronounced at the more severe stages of disease [55]. The proxies should be a person who knows the PwD and is involved in their care, for example informal carers such as family members and friends [6]; however this closeness in relationship may be contributing to the disparity in reports via projection bias of proxy/caregiver burden. In addition, the wider literature shows that factors such as the relationship of the proxy, and specific characteristics of the proxy themselves can impact proxy assessments of HRQoL [50], as well as more pragmatic aspects such as the perspective the proxy is told to adopt when completing the measure [6, 52], and mode of administration (i.e., telephone, postal or interview) [56]. While the lack of inter-reliability is likely to be equally relevant for other measures, the issue of proxy reporting remains pertinent for EQ-5D-5L as it is the recommended measure for use in economic evaluation. Despite the known differences between self and proxy reports, there is no clear guidance on how to interpret these differences, and which HRQoL-reports to use to generate QALYs. A recent paper made an attempt to do this using psychometric techniques [57]. More research is warranted to contribute to the debate on how to interpret the differences between self-report and proxy-reports that can be more easily reflected in an economic evaluation and may provide a solution when self-report is only possible for a sub-group of the study population.

This review has not been able to throw any light on the comparison of EQ-5D-3L and EQ-5D-5L. One of the motivations for developing the latter measure was to overcome some issues related to EQ-5D-3L such as ceiling and floor effects due to the crude response levels. Li et al. [7] reported that in a trial comparing DEMQOL-U and EQ-5D-3L higher ceiling effects were observed for EQ-5D-3L [8]. Similar findings on high ceiling effects were observed in several studies [50, 52, 58]. We are unable to draw any conclusion on the presence of ceiling and floor effects in EQ-5D-5L in PwD as one paper explicitly reports that no ceiling or floor effects exists while two report evidence of ceiling effects. A more recent paper not included in the review comparing EQ-5D-3L and EQ-5D-5L in PwD suggests that the ceiling effects are 17% lower in the latter compared with the former [59].

Conclusions

This review based on 20 papers from 14 different studies has reported the following psychometric properties (overall assessment of psychometric property) of EQ-5D-5L with PwD: known-group difference (good), convergent validity (good), responsiveness (inconclusive), reliability (poor), and acceptability and feasibility (moderate). We were unable to assess floor and ceiling effects and there was very limited evidence on content validity. Concerns were raised around the absence of inter-rater reliability and the inability to self-report which have implications for use of utilities generated for economic evaluation. The evidence must be interpreted with caution as the number of studies is limited, and the nature of the studies can mean that evidence of a psychometric property may not be demonstrated due to the specific characteristics of the particular studies rather than a weakness of the EQ-5D-5L.

Availability of data and materials

The tables supporting the conclusions of this article are included within the article and its additional files.

Abbreviations

Actifcare:

Access to timely formal care cohort

AQOL:

Assessment of Quality of Life

CDR:

Clinical Dementia Rating

CSDD:

Cornell Scale for Depression in Dementia

DEMQOL:

Dementia Quality of Life

DEMQOL-U:

Dementia Quality of Life-Utility measure

EPIC trial:

Enhancing person centred care in care homes

EQ-5D:

EuroQoL-5 dimensions

EQ-5D-3L:

EuroQoL-5 dimensions 3-level

EQ-5D-5L:

EuroQoL-5 dimensions 5-level

EQ-VAS:

EuroQoL-visual analogue scale

EQ-VT:

EuroQoL-valuation techniques

FAST:

Functional Assessment Screening Tool

HRQoL:

Health-related quality of life

HUI:

Health Utility Index

ICECAP-O:

ICEpop CAPability measure for Older people

MBI:

Modified Barthel Index

MMSE:

Mini-mental state examination

NICE:

National Institute for Health and Care Excellence

PAS-Cog:

Cognitive Impairment Scale of the Psychogeriatric Assessment Scales

PBM:

Preference-based measure

PwD:

People with dementia

QALY:

Quality-adjusted life year

QWB:

Quality of well-being

QoL-AD:

Quality of Life-Alzheimer Disease

QoL-AD NH:

Quality of Life-Alzheimer Disease Nursing home version

QUALID:

Quality of Life in late-stage dementia

TTO:

Time-trade-off

VAS:

Visual analogue scale

DCM WIB:

Dementia care mapping well/illbeing (score)

References

  1. Sopina E, Sørensen J. Decision modelling of non-pharmacological interventions for individuals with dementia: a systematic review of methodologies. Heal Econ Rev. 2018;8:1–12.

    Google Scholar 

  2. O’Shea E, Hopper L, Marques M, Gonçalves-Pereira M, Woods B, Jelley H, Verhey F, Kerpershoek L, Wolfs C, de Vugt M. A comparison of self and proxy quality of life ratings for people with dementia and their carers: a European prospective cohort study. Aging Ment Health. 2020;24:162–70.

    Article  PubMed  Google Scholar 

  3. National Insititute for Health and Care Excellence: NICE technology evaluations: the manual vol. Process and methods [PMG36]: NICE; 2022.

  4. Brooks R, Group E. EuroQol: the current state of play. Health Policy. 1996;37:53–72.

    Article  CAS  PubMed  Google Scholar 

  5. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, Bonsel G, Badia X. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Pickard AS, Knight SJ. Proxy evaluation of health-related quality of life: a conceptual framework for understanding multiple proxy perspectives. Med Care. 2005;43:493.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Li L, Nguyen K-H, Comans T, Scuffham P. Utility-based instruments for people with dementia: a systematic review and meta-regression analysis. Value Health. 2018;21:471–81.

    Article  PubMed  Google Scholar 

  8. Mulhern B, Rowen D, Brazier J, Smith S, Romeo R, Tait R, Watchurst C, Chua K-C, Loftus V, Young T, Lamping D, Knapp M, Howard R, Banerjee S. Development of DEMQOL-U and DEMQOL-PROXY-U: generation of preference-based indices from DEMQOL and DEMQOL-PROXY for use in economic evaluation. Health Technol Assess. 2013;17(5):1–140. https://doi.org/10.3310/hta17050.

    Article  Google Scholar 

  9. Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, Denton M, Boyle M. Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care. 2002;40:113–28.

    Article  PubMed  Google Scholar 

  10. Kaplan RM, Anderson JP, Ganiats TG. The quality of well-being scale: rationale for a single quality of life index. In: Walker SR, Rosser RM, editors. Quality of life assessment: key issues in the 1990s. Dordrecht: Springer; 1993. p. 65–94.

    Chapter  Google Scholar 

  11. Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the assessment of quality of life (AQoL)-8D multi-attribute utility instrument. Patient-Patient-Centered Outcomes Res. 2014;7:85–96.

    Article  Google Scholar 

  12. Engel L, Bucholc J, Mihalopoulos C, Mulhern B, Ratcliffe J, Yates M, Hanna L. A qualitative exploration of the content and face validity of preference-based measures within the context of dementia. Health Qual Life Outcomes. 2020;18:178.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Feng Y-S, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30:647–73.

    Article  PubMed  Google Scholar 

  14. Easton T, Milte R, Crotty M, Ratcliffe J. An empirical comparison of the measurement properties of the EQ-5D-5L, DEMQOL-U and DEMQOL-Proxy-U for older people in residential care. Qual Life Res. 2018;27:1283–94.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Griffin XL, Costa ML, Phelps E, Parsons N, Dritsaki M, Png ME, Achten J, Tutton E, Lerner R, McGibbon A, Baird J. Retrograde intramedullary nail fixation compared with fixed-angle plate fixation for fracture of the distal femur: the TrAFFix feasibility RCT. Health Technol Assess. 2019;23:1–132.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Harrison SL, Kouladjian O’Donnell L, Bradley CE, Milte R, Dyer SM, Gnanamanickam ES, Liu E, Hilmer SN, Crotty M. Associations between the drug burden index, potentially inappropriate medications and quality of life in residential aged care. Drugs Aging. 2018;35:83–91.

    Article  PubMed  Google Scholar 

  17. Longworth L, Yang Y, Young T, Mulhern B, Alava MH, Mukuria C, Rowen D, Tosh J, Tsuchiya A, Evans P, Keetharuth AD, Brazier J. Use of generic and condition-specific measures of health-related quality of life in NICE decision-making: a systematic review, statistical modelling and survey. Health Technol Assess. 2014. https://doi.org/10.3310/hta18090.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cohen J. Statistical power analysis for the behavior science. Lawrance Eribaum Association 1988.

  19. Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Asses. 1998. https://doi.org/10.3310/hta2140.

    Article  Google Scholar 

  20. McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4:293–307.

    Article  CAS  PubMed  Google Scholar 

  21. Toh HJ, Yap P, Wee SL, Koh G, Luo N. Feasibility and validity of EQ-5D-5L proxy by nurses in measuring health-related quality of life of nursing home residents. Qual Life Res. 2020;16:16.

    Google Scholar 

  22. Meader N, King K, Llewellyn A, Norman G, Brown J, Rodgers M, Moe-Byrne T, Higgins J, Sowden A, Stewart G. A checklist designed to aid consistency and reproducibility of GRADE assessments: development and pilot validation. Syst Rev. 2014;3:1–9.

    Article  Google Scholar 

  23. Handels RLH, Skoldunger A, Bieber A, Edwards RT, Goncalves-Pereira M, Hopper L, Irving K, Jelley H, Kerpershoek L, Marques MJ, et al. Quality of life, care resource use, and costs of dementia in 8 European countries in a cross-sectional cohort of the actifcare study. J Alzheimers Dis. 2018;66:1027–40.

    Article  PubMed  Google Scholar 

  24. Janssen N, Handels RL, Skoldunger A, Woods B, Jelley H, Edwards RT, Orrell M, Selbaek G, Rosvik J, Goncalves-Pereira M, et al. Impact of untimely access to formal care on costs and quality of life in community dwelling people with dementia. J Alzheimers Dis. 2018;66:1165–74.

    Article  PubMed  Google Scholar 

  25. Perry-Duxbury M, van Exel J, Brouwer W, Skoldunger A, Goncalves-Pereira M, Irving K, Meyer G, Selbaek G, Woods B, Zanetti O, et al. A validation study of the ICECAP-O in informal carers of people with dementia from eight European Countries. Qual Life Res. 2020;29:237–51.

    Article  PubMed  Google Scholar 

  26. Rombach I, Iftikhar M, Jhuti GS, Gustavsson A, Lecomte P, Belger M, Handels R, Castro Sanchez AY, Kors J, Hopper L, et al. Obtaining EQ-5D-5L utilities from the disease specific quality of life Alzheimer’s disease scale: development and results from a mapping study. Qual Life Res. 2020;17:17.

    Google Scholar 

  27. Griffiths AW, Smith SJ, Martin A, Meads D, Kelley R, Surr CA. Exploring self-report and proxy-report quality-of-life measures for people living with dementia in care homes. Qual Life Res. 2020;29:463–72.

    Article  PubMed  Google Scholar 

  28. Martin A, Meads D, Griffiths AW, Surr CA. How should we capture health state utility in dementia? Comparisons of DEMQOL-proxy-U and of self- and proxy-completed EQ-5D-5L. Value Health. 2019;22:1417–26.

    Article  PubMed  Google Scholar 

  29. Meads DM, Martin A, Griffiths A, Kelley R, Creese B, Robinson L, McDermid J, Walwyn R, Ballard C, Surr CA. Cost-effectiveness of dementia care mapping in care-home settings: evaluation of a randomised controlled trial. Appl Health Econ Health Policy. 2020;18:237–47.

    Article  PubMed  Google Scholar 

  30. Umegaki H, Bonfiglio V, Komiya H, Watanabe K, Kuzuya M. Association between sarcopenia and quality of life in patients with early dementia and mild cognitive impairment. J Alzheimers Dis. 2020;76:435–42.

    Article  PubMed  Google Scholar 

  31. Maidment ID, Barton G, Campbell N, Shaw R, Seare N, Fox C, Iliffe S, Randle E, Hilton A, Brown G, et al. MEDREV (pharmacy-health psychology intervention in people living with dementia with behaviour that challenges): the feasibility of measuring clinical outcomes and costs of the intervention. BMC Health Serv Res. 2020;20:157.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Van Hout B, Janssen M, Feng Y-S, Kohlmann T, Busschbach J, Golicki D, Lloyd A, Scalone L, Kind P, Pickard AS. Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health. 2012;15:708–15.

    Article  PubMed  Google Scholar 

  33. Devlin NJ, Shah KK, Feng Y, Mulhern B, van Hout B. Valuing health-related quality of life: an EQ-5 D-5 L value set for England. Health Econ. 2018;27:7–22.

    Article  PubMed  Google Scholar 

  34. Sopina E, Chenoweth L, Luckett T, Agar M, Luscombe GM, Davidson PM, Pond CD, Phillips J, Goodall S. Health-related quality of life in people with advanced dementia: a comparison of EQ-5D-5L and QUALID instruments. Qual Life Res. 2019;28:121–9.

    Article  PubMed  Google Scholar 

  35. Sopina E, Sorensen J, Beyer N, Hasselbalch SG, Waldemar G. Cost-effectiveness of a randomised trial of physical activity in Alzheimer’s disease: a secondary analysis exploring patient and proxy-reported health-related quality of life measures in Denmark. BMJ Open. 2017;7:e015217.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Ratcliffe J, Flint T, Easton T, Killington M, Cameron I, Davies O, Whitehead C, Kurrle S, Miller M, Liu E, Crotty M. An empirical comparison of the EQ-5D-5L, DEMQOL-U and DEMQOL-Proxy-U in a post-hospitalisation population of frail older people living in residential aged care. Appl Health Econ Health Policy. 2017;15:399–412.

    Article  PubMed  Google Scholar 

  37. van de Rijt LJ, Feast AR, Vickerstaff V, Lobbezoo F, Sampson EL. Prevalence and associations of orofacial pain and oral health factors in nursing home residents with and without dementia. Age Ageing. 2020;49:418–24.

    Article  PubMed  Google Scholar 

  38. Weiner MF, Martin-Cook K, Svetlik DA, Saine K, Foster B, Fontaine C. The quality of life in late-stage dementia (QUALID) scale. J Am Med Dir Assoc. 2000;1:114–6.

    CAS  PubMed  Google Scholar 

  39. Flynn TN, Chan P, Coast J, Peters TJ. Assessing quality of life among British older people using the ICEPOP CAPability (ICECAP-O) measure. Appl Health Econ Health Policy. 2011;9:317–29.

    Article  PubMed  Google Scholar 

  40. Usman A, Lewis S, Hinsliff-Smith K, Long A, Housley G, Jordan J, Gage H, Dening T, Gladman JRF, Gordon AL. Measuring health-related quality of life of care home residents: comparison of self-report with staff proxy responses. Age Ageing. 2019;48:407–13.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Jurkeviciute M, van Velsen L, Trimarchi PD, Sarvari L, Giunco F. An Italian business case for an eHealth platform to provide remote monitoring and coaching services for elderly with mild cognitive impairment and mild Dementia. 2019.

  42. Hurley MV, Wood J, Smith R, Grant R, Jordan J, Gage H, Anderson LW, Kennedy B, Jones F. The feasibility of increasing physical activity in care home residents: active residents in care homes (ARCH) programme. Physiotherapy. 2020;107:50–7.

    Article  PubMed  Google Scholar 

  43. EuroQol Group: Status of EQ-5D-5L valuation using standardized valuation methodology 2021.

  44. Ben Â, Finch AP, van Dongen JM, Wit M, van Dijk SE, Adriaanse MC, Snoek FJ, van Tulder MW, Bosmans JE. PRM202-comparing the EQ-5D-5L crosswalks and value sets for England, the Netherlands and Spain: do conclusions change? Value Health. 2018;21:S391.

    Article  Google Scholar 

  45. van Dongen JM, Jornada Ben Â, Finch AP, Rossenaar MM, Biesheuvel-Leliefeld KE, Apeldoorn AT, Ostelo RW, van Tulder MW, van Marwijk HW, Bosmans JE. Assessing the impact of EQ-5D country-specific value sets on cost-utility outcomes. Med Care. 2021;59:82–90.

    Article  PubMed  Google Scholar 

  46. Hernández Alava M, Pudney, S. and Wailoo, A. Estimating the relationship between EQ-5D-5L and EQ-5D-3L: results from an English population study. Report 063: Policy Research Unit in Economic Evaluation of Health and Care Interventions. Universities of Sheffield and York. 2020.

  47. Hernández-Alava M, Pudney S. Econometric modelling of multiple self-reports of health states: the switch from EQ-5D-3L to EQ-5D-5L in evaluating drug therapies for rheumatoid arthritis. J Health Econ. 2017;55:139–52.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, De Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:1–8.

    Article  Google Scholar 

  49. Hesmann P, Seeberg G, Reese JP, Dams J, Baum E, Muller MJ, Dodel R, Balzer-Geldsetzer M. Health-related quality of life in patients with Alzheimer’s disease in different German health care settings. J Alzheimers Dis. 2016;51:545–61.

    Article  Google Scholar 

  50. Hounsome N, Orrell M, Edwards RT. EQ-5D as a quality of life measure in people with dementia and their carers: evidence and key issues. Value Health. 2011;14:390–9.

    Article  PubMed  Google Scholar 

  51. Kunz S. Psychometric properties of the EQ-5D in a study of people with mild to moderate dementia. Qual Life Res. 2010;19:425–34.

    Article  PubMed  Google Scholar 

  52. Orgeta V, Edwards RT, Hounsome B, Orrell M, Woods B. The use of the EQ-5D as a measure of health-related quality of life in people with dementia and their carers. Qual Life Res. 2015;24:315–24.

    Article  PubMed  Google Scholar 

  53. Shearer J, Green C, Ritchie CW, Zajicek JP. Health state values for use in the economic evaluation of treatments for Alzheimer’s disease. Drugs Aging. 2012;29:31–43.

    Article  PubMed  Google Scholar 

  54. Sheehan BD, Lall R, Stinton C, Mitchell K, Gage H, Holland C, Katz J. Patient and proxy measurement of quality of life among general hospital in-patients with dementia. Aging Ment Health. 2012;16:603–7.

    Article  PubMed  Google Scholar 

  55. Landeiro F, Mughal S, Walsh K, Nye E, Morton J, Williams H, Ghinai I, Castro Y, Leal J, Roberts N. Health-related quality of life in people with predementia Alzheimer’s disease, mild cognitive impairment or dementia measured with preference-based instruments: a systematic literature review. Alzheimer’s Res Therapy. 2020;12:1–14.

    Article  Google Scholar 

  56. Hanmer J, Hays RD, Fryback DG. Mode of administration is important in US national estimates of health-related quality of life. Med Care. 2007;45:1171–9.

    Article  PubMed  Google Scholar 

  57. Smith SC, Hendriks AJ, Regan J, Black N. A novel method of proxy reporting questionnaire based measures of health-related quality of life of people with dementia in residential care: a psychometric evaluation. Patient Relat Outcome Measures. 2018;9:221.

    Article  Google Scholar 

  58. Naglie G, Tomlinson G, Tansey C, Irvine J, Ritvo P, Black SE, Freedman M, Silberfeld M, Krahn M. Utility-based quality of life measures in Alzheimer’s disease. Qual Life Res. 2006;15:631–43.

    Article  PubMed  Google Scholar 

  59. Michalowsky B, Xie F, Kohlmann T, Gräske J, Wübbeler M, Thyrian JR, Hoffmann W. Acceptability and validity of the EQ-5D in patients living with dementia. Value Health. 2020;23:760–7.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Ruth Wong for the search strategy and for identifying the papers.

Disclaimer The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care or its arm's length bodies, or other UK government departments. Any errors are the responsibility of the authors.

Funding

This research is funded by the National Institute for Health Research (NIHR) Policy Research Programme, conducted through the Policy Research Unit in Economic Methods of Evaluation in Health and Social Care Interventions, PR-PRU-1217-20401.

Author information

Authors and Affiliations

  1. School of Health and Related Research, University of Sheffield, Sheffield, S14DA, UK

    Anju D. Keetharuth, Hannah Hussain, Donna Rowen & Allan Wailoo

Authors
  1. Anju D. Keetharuth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hannah Hussain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Donna Rowen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Allan Wailoo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ADK was responsible for the conception and design of the study, data collection, analysis and interpretation of findings, drafting, reviewing and revising the manuscript and also approved the final version. HH was responsible for the conception and design of the study, data collection, data extraction, analysis and interpretation of findings, drafting, reviewing and revising the manuscript. DR participated in the conception and design of the study, data extraction, analysis and interpretation of findings, drafting, reviewing and revising the manuscript. AW participated in the conception and design of the study, reviewing and revising the manuscript. All authors read and approved the final manuscript,

Corresponding author

Correspondence to Anju D. Keetharuth.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

This research is a systematic review based on published data. It does not contain information obtained directly from individual patients. Therefore, consent for publication is not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Table S1: Known-group validity (7 studies). Table S2: Convergent validity (9 studies). Table S3: Reliability (7 studies). Table S4 Quality assessment of included papers adapted from the GRADE assessment tool.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keetharuth, A.D., Hussain, H., Rowen, D. et al. Assessing the psychometric performance of EQ-5D-5L in dementia: a systematic review. Health Qual Life Outcomes 20, 139 (2022). https://doi.org/10.1186/s12955-022-02036-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-022-02036-3

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us