Skip to main content
Download PDF
Download ePub

Responsiveness to change in health status of the EQ-5D in patients treated for depression and anxiety

Health and Quality of Life Outcomes volume 21, Article number: 35 (2023) Cite this article

Abstract

Background

The EQ-5D is a commonly used generic measure of health but evidence on its responsiveness to change in mental health is limited. This study aimed to explore the responsiveness of the five-level version of the instrument, the EQ-5D-5 L, in patients receiving treatment for depression and anxiety.

Methods

Patient data (N = 416) were collected at baseline and at end of treatment in an observational study in a Norwegian outpatient clinic. Patients were adults of working age (18–69 years) and received protocol-based metacognitive or cognitive therapy for depression or anxiety according to diagnosis. Responsiveness in the EQ-5D was compared to change in the Beck Depression Inventory-II (BDI-II) and the Beck Anxiety Inventory (BAI). Effect sizes (Cohen’s d), Standardised response mean (SRM), and Pearson’s correlation were calculated. Patients were classified as “Recovered”, “Improved”, or “Unchanged” during treatment using the BDI-II and the BAI. ROC analyses determined whether the EQ-5D could correctly classify patient outcomes.

Results

Effect sizes were large for the BAI, the BDI-II, the EQ-5D value and the EQ VAS, ranging from d = 1.07 to d = 1.84. SRM were also large (0.93-1.67). Pearson’s correlation showed strong agreement between change scores of the EQ-5D value and the BDI-II (rs -0.54) and moderate between the EQ-5D value and the BAI (rs -0.43). The EQ-5D consistently identified “Recovered” patients versus “Improved” or “Unchanged” in the ROC analyses with AUROC ranging from 0.72 to 0.84.

Conclusion

The EQ-5D showed good agreement with self-reported symptom change in depression and anxiety, and correctly identified recovered patients. These findings indicate that the EQ-5D may be appropriately responsive to change in patients with depression and anxiety disorders, although replication in other clinical samples is needed.

Plain English Summary

The EQ-5D is a questionnaire that people fill in to report their subjective health. It is often used in clinics or hospitals to better understand how patients are affected by their illnesses, and if their health improves after treatment. For this information to be trustworthy, we need to verify how accurately the EQ-5D measures health for the particular patients we want to use it with. This is often done by comparing EQ-5D scores with scores from other questionnaires. For example, if we want to use the EQ-5D with a group of patients with depression, we compare the scores of the EQ-5D with scores from questionnaires that are commonly used to measure depression symptoms.

In this study, we compared the scores of the EQ-5D with scores from questionnaires measuring symptoms of depression and anxiety. Their performances were similar, and the EQ-5D scores could also correctly identify which patients had recovered during treatment. This implies that the EQ-5D can be a useful tool for understanding the impact of depression and anxiety and can help in decision-making regarding these patients.

Introduction

One out of every two people will experience a mental health problem during their lifetime and mental ill health is a leading cause of global disease burden [1]. Between 2010 and 2030, mental illness is projected to cost $ 16.1 trillion worldwide, putting it on par with cardiovascular disease [2]. Depression and anxiety disorders account for 40.5% and 14.6% of the disability-adjusted life-years that are due to mental illness, making them the most costly mental health problems [3]. This substantial burden may still be underestimated [4], in part because of the wide ranging effects these disorders have on health and functioning [5].

At the recommendation of decision-making bodies such as the National institute of Health and Care excellence (NICE), generic measures are increasingly used to capture health status [6]. Mental disorders like depression and anxiety have broad, negative impact on quality of life and wellbeing that may not be adequately reflected by condition-specific measures [5, 7]. Generic measures may thus be a valuable supplement to measures of primary symptoms as they capture a broader measure of health. These instruments can also be used to compare burden of disease and impact of interventions between different patient groups, such as in cost-benefit analyses, making them useful tools for decision-makers, researchers, and clinicians [8]. To adequately fill this role, it must be demonstrated that the generic measure in question can accurately capture health status in the relevant patient population.

One of the most commonly used generic measures of health-related quality of life is the EQ-5D [8]. The EQ-5D records health status across five dimensions: Mobility, Self-care, Usual activities, Pain / discomfort, and Anxiety / depression [9]. The previous version of the EQ-5D, the EQ-5D-3L, used three levels of severity and showed good psychometric properties in depression, but mixed results in anxiety disorders [10]. A recent review evaluated the properties of the newer five-level version of the EQ-5D, the EQ-5D-5L, across multiple patient groups [11]. These and other studies of patients with mental health problems have shown moderate to good correlation between condition-specific measures and the EQ-5D-5L in cross-sectional designs [11,12,13,14,15].

These studies did not include data on responsiveness [11]. Responsiveness is often defined as an instruments ability to detect clinically significant change over time [10, 16]. Two criteria have been suggested for defining what constitutes “clinically significant change”: That the magnitude of change be statistically reliable, and that patients end up in a clinical range that renders them indistinguishable from the normal population, i.e. they have recovered [17]. Responsiveness according to these criteria is not a fixed parameter, but will likely vary according to populations and context [18]. This makes it necessary to investigate responsiveness across multiple patient groups. One study did find reasonable validity and moderate responsiveness in anxiety on the EQ-5D-3L [19]. But only a few studies have examined this aspect of the five-level EQ-5D-5L in depression and anxiety [11].

One study found that using only the Anxiety/depression dimension of the EQ-5D-5L did not adequately capture responsiveness in anxiety and depression for patients treated in a general internal medicine ward [20]. Another study found that the EQ-5D-5L could adequately screen for depression and anxiety by distinguishing between severity levels in patients with type 2 diabetes. This was true of both the Anxiety / depression dimension and the EQ-5D value [21]. However, this was a cross-sectional design, and the ability of the EQ-5D-5 L to detect change in severity over time in patients with depression and anxiety is not established, and was specifically targeted by a review of the literature as a future research priority [11]. Investigating this aspect of the EQ-5D-5 L is imperative in establishing whether it is a valid tool for capturing the health status of these patients.

To our knowledge, ours is the first study to examine the responsiveness of the EQ-5D-5L in patients treated for depression and anxiety as their primary diagnoses. In line with recommendations and methodology used in previous studies, we explored responsiveness of the EQ-5D-5L by comparing change from start to end of intervention with change in condition-specific measures [17, 20, 21] The aim of the study was thus to test the following hypotheses: (1) that the EQ-5D-5L shows similar range in effect size and an at least moderate correlation with change scores in condition-specific measures, and (2) that the EQ-5D-5L can identify patients classified as “Recovered” by condition-specific measures at end of treatment.

Methods

Study context

Data were collected in a naturalistic observational study that ran from May 2017 – March 2020 at the Department of Mental Health and Substance Abuse, Diakonhjemmet Hospital in Oslo, Norway. The clinic is part of the national health service, and the study is part of the project “The Norwegian studies of psychological treatments and work (NOR-WORK)”. Patients are referred by their general practitioners for treatment of depression and anxiety. Patients at the clinic are generally of working age, and previous research has shown that on average, half the patients are on sick leave due to depression or anxiety at baseline [22]. They are then screened by a clinical psychologist using anamnestic information, the Beck Depression Inventory-II (BDI-II), the Beck Anxiety Inventory (BAI), and the MINI-International Neuropsychiatric Interview [23,24,25]. Patients are diagnosed during the screening in accordance with the International Classification of Diseases 10 (ICD-10) [26]. Inclusion criteria for the present study were that the patient was an adult of working age (18–70 years) with clinically significant levels of depression and anxiety operationalised as follows: Patients with a primary depression diagnosis had to have a minimum score of 14 on the BDI-II, and patients with a primary anxiety diagnosis had to have a minimum score of 16 on the Beck Anxiety Inventory BAI. In addition to primary depression or anxiety diagnoses, patients with adjustment disorder and mixed anxiety and depression were included in the study. Adjustment disorder is sometimes referred to as “situational depression”, underlining its close relationship with depressive disorders [26]. Similarly, patients with a mixed anxiety and depressive disorder were included as the diagnosis is comprised of symptoms of anxiety and depression.

Exclusion criteria were severe mental illness such as bipolar disorder, high risk of suicide, engaging in active substance abuse, or suffering from cluster A or B personality disorder. Patients scoring below clinical thresholds for depression and anxiety on the BDI and BAI at baseline were excluded from the study. All patients who signed a written consent form and completed treatment, including filling in questionnaires at baseline and at end of treatment, were included (N = 416). The current study thus focused on patients who completed treatment.

Patients received either Metacognitive therapy (MCT) or Cognitive behavioural therapy (CBT) according to diagnose-specific manuals [27, 28], and average duration of treatment was 10.11 sessions (SD 3.93). Previous research has shown that half the patients are on sick leave when referred, and treatment thus also includes interventions aimed at helping patients return to work [29].

Instruments

Clinical and sociodemographic data were collected at baseline and end of treatment from patient journals and from self-report questionnaires.

The EQ-5D-5L: The EQ-5D-5L questionnaire firstly asks respondents to rate their current health on five dimensions: Mobility, Self-Care, Usual activities, Pain / discomfort, and Anxiety / depression on a severity scale from 1 (“No problems”) to 5 (“Severe problems”). The combined severity ratings give an EQ-5D profile, e.g. “11111” in the case of “No problem” on all five dimensions. This health profile can be converted to the EQ-5D value using preference-based weights. A value of 0.00 indicates death and 1.00 indicates perfect health. The EQ-5D value can be used to calculate quality-adjusted life-years (QALYs), i.e. a score of 1.00 for one year equals one QALY. The preference-based weights used to convert responses to EQ-5D values are often referred to as “value sets”. A study is underway, but there is currently no Norwegian value set [30]. This study used the crosswalk system recommended by NICE for converting EQ-5D profiles to EQ-5D values [31, 32]. For the EQ-5D value, healthy people generally report scores close to 1.0. In a recent survey of the Norwegian general population, the mean EQ-5D value in a postal survey was 0.848 [33].

The second part of the EQ-5D-5L asks patients to rate their health on a 20 cm visual analogue scale (VAS) where the bottom (“0”) indicates worst imaginable health, and the top (“100”) indicates best imaginable health. Although it is related to the EQ-5D profile and the value scores, it does not measure the same construct. For instance, the EQ VAS score has been shown to decline with age even for people whose EQ-5D profile show no problems (“11111”) [8].

The Beck Depression Inventory-II (BDI-II) is a 21-item questionnaire measuring severity of symptoms over the last two weeks on a scale from 0 to 3, giving a total sum score of 0–63. Examples include feeling sad and change in appetite or sleep. Suggested scoring indicates that 0–13 reflects minimal symptoms, 14–19 mild, 20–28, moderate, and 29–63 severe symptoms [24]. The BDI-II has been found to be psychometrically sound in depression[31], Chronbach’s α in the current study was 0.86.

The Beck Anxiety Inventory (BAI) is a self-report measure of anxiety severity over the last week. As with the BDI-II, anxiety symptoms (e.g. “Heart pounding or racing” or feeling “nervous”) are scored on a severity range from 0 to 3, giving a total sum score of 0–63. Suggested scoring indicates that 0–15 reflects mild symptoms, 16–25 moderate, and 26–63 severe symptoms. The BAI has demonstrated good psychometric properties [34], Chronbach’s α in the current study was 0.90.

Statistical analyses

Descriptive statistics on age, gender, education level and diagnosis were compiled at baseline. Distribution of scores on the EQ-5D dimensions were calculated in percentages at baseline and at end of treatment and analysed using a non-parametric test of trends developed by Cuzick. The test is similar to the Wilcoxon rank-sum test [35]. Mean scores and standard deviations at baseline and end of treatment, including change (∆) during treatment, were calculated for the BAI, the BDI-II, the EQ-5D values, and the EQ VAS. Effect sizes (ES) were calculated from baseline to end of treatment using Cohen’s d. Values < 0.5 are considered small, ≥ 0.5 < 0.8 moderate, and ≥ 0.8 large [36]. We also calculated the standardised response mean (SRM), defined as the mean change in score from baseline to end of treatment divided by the standard deviation of change in scores [37]. For the SRM it is suggested that magnitude of change is dependent on correlation between scores at baseline and end of treatment. For example, SRM > 0.8 can be interpreted as large if this correlation < 0.5, moderate if correlation > 0.5 [38]. Agreement between the change scores on the four measures were also analysed with Pearson’s correlation. Pearson’s correlation < 0.40 are considered weak, 0.40–0.49 moderate, and > 0.50 are considered strong [39].

Using the BAI and the BDI-II, the patients were then classified according to treatment response. With a minimum score of 14 on the BDI-II for depression patients and 16 on the BAI for anxiety patients at baseline, based on scoring norms for the BDI-II and BAI, patients were classified thus: “Deteriorated” if their scores increased by 9 points or more from baseline to end of treatment, “Unchanged” if the change was less than 9 points in either direction, and “Improved” if the scores decreased by 9 points or more but score at the end of treatment was still above the clinical threshold, . Finally, patients were classified as “Recovered” if their score decreased by 9 points or more and their final score was below clinical threshold (i.e. 14 for the BDI-II and 16 for the BAI) [18, 40, 41].

We ran ROC curve analyses to determine how well the EQ-5D value scores could correctly classify patients according to the clinical criteria of the BDI-II and the BAI: Recovered versus Improved, Recovered versus Unchanged, and Improved versus Unchanged. Analyses of BDI were run to calculate the area under the curve (AUROC) using the entire sample for patients that had a BDI score of at least 14 at baseline, and for all patients who had a BAI score of at least 16, regardless of primary diagnoses. Then, using primary diagnosis as recorded from the medical journals, we then calculated the AUROC for BDI-II for only the patients with depression as primary diagnosis and BDI-II baseline scores of at least 14. Lastly, we calculated the AUROC for BAI for the patients with anxiety as their primary diagnosis and a BAI baseline score of at least 16. The EQ-5D value at end of treatment was used as classifier, when computing the AUROC. AUROC was interpreted as < 0.50 useless test, 0.51–0.69 poor test, 0.7–0.79 fair test, 0.8–0.89 good test, 0.9–0.99 excellent test, 1.0 perfect test [40]. We calculated the sample size needed for the groups included in the ROC analyses. We set the Alpha level to 0.05 and the Beta level to 0.20, area under curve was set to 0.7 and value of null hypothesis was set to 0.5. The ratio of positive to negative cases was set according to the characteristics of the sample. We also computed cut-off values for recovery using Youden’s index (J), which displays which values have the highest combined sensitivity and specificity [42].

Generally accepted methods for handling missing data are applicable to the EQ-5D-5L [8]. Missing data on individual items in the current study were replaced by weighted means, a method developed for treating missing data in depression cohorts [43]. All analyses were carried out using STATA 16 [44].

Ethical considerations

All patients included in the study gave written, informed consent to participate. The study is classified as health service research under Norwegian regulation. The Norwegian Data Protection Agency has in such cases designated that treatment providers (i.e. hospitals) are responsible for proper data management. Data collection and security in the present study was managed by Diakonhjemmet Hospital, and approval of data handling was granted by Oslo University Hospital, approval number 2015/15606. The study was carried out in accordance with the principles of the Helsinki declaration.

Results

Characteristics of included patients (N = 416) at baseline are shown in Table 1. Average age of patients was 37.7 years, the youngest was 18 and the oldest 65 years at start of treatment. Females made up 71.9% of the patient sample, which is in line with the gender disparity seen in prevalence studies of depression and anxiety [45]. More than 80% of the sample had some form of higher education. The study only recorded primary diagnosis from the patient’s medical journal, but comorbidity was not recorded. The majority of patients had either a primary depression or anxiety diagnosis, the remaining patients were diagnosed with either mixed anxiety / depression, or adjustment disorder. The most prevalent single diagnoses were F32 Major depressive disorder, single episode (n = 114, 26.8%), F 33 Major depressive disorder, recurrent (n = 97, 22.8%), and F 41.1 Generalised anxiety disorder (n = 86, 20.2%). Missing data in the study was typically low, > 5% on individual items for all measures.

Table 1 Demographic characteristics and diagnoses of patients at baseline (N = 416)
Full size table

Change in depression, anxiety and the EQ-5D-5 L during treatment

Of the 216 patients with depression diagnoses, 146 (67.59%) were “Recovered” at end of treatment, 31 (14.35%) were “Improved”, and 39 were (18.05%) were “Unchanged”. Of the 161 patients with anxiety disorder diagnoses, 109 (67.70%) were “Recovered” at end of treatment, 14 (8.69%) were “Improved”, and 38 were (23.60%) were “Unchanged”. Overall, two patients in the sample were “Deteriorated” on the BAI at end of treatment, both were diagnosed with adjustment disorder. Four patients were “Deteriorated” on the BDI-II, three of which were diagnosed with adjustment disorder, and one with anxiety disorder. No patients with anxiety diagnoses were “Deteriorated” on the BAI at end of treatment, and no patients with depression diagnoses were “Deteriorated” on the BDI-II at end of treatment.

Table 2 shows the distribution of scores on the EQ-5D dimensions at baseline, and after end of treatment. All dimensions had at least some patients reporting problems at baseline. Cuzick’s non-parametric test of trends showed that all dimensions saw significant improvement from baseline to end of treatment [33]. The symptom scores reported on the BDI-II and the BAI at baseline in Table 3 indicate moderate levels of depression and anxiety. Patients saw a marked improvement in symptoms over the observation period. Cohen’s d was > 0.8 on all measures from baseline to end of treatment. Similarly, all SRM showed values > 0.8 on all instruments. Correlation between baseline scores and scores at end of treatment were < 0.5 on the BDI-II (rs = 0.39), EQ-5D value (rs = 0.34), and the EQ-VAS (rs = 0.31), but > 0.5 on the BAI (rs = 0.51). This indicates that the SRM was large for the BDI-II, EQ-5D value, and the EQ VAS, whilst moderate for the BAI.

Table 2 Distribution of EQ-5D dimensions as reported by patients (N = 416)
Full size table
Table 3 Instrument scores at baseline and end of treatment with ES and SRM (N = 416)
Full size table

Correlation of change scores

Pearson’s rank order correlations are shown in Table 4. Note that the BAI and the BDI-II indicate worse health status with higher scores, whereas the reverse is true for the EQ-5D value and the EQ VAS. The EQ-5D value showed strong correlations with both the BDI-II, the EQ VAS, and moderate correlations with the BAI. The EQ VAS showed strong correlation with the BDI-II, but weak correlation with the BAI.

Table 4 Pearson’s correlation of change scores (N = 416)
Full size table

ROC curve analysis

For the total sample, the ROC curve analysis showed that the EQ-5D value consistently distinguished between “Recovered” and “Improved” or “Unchanged” patients according the BDI-II or BAI, AUROC ranging from 0.72 to 0.84 (Table 5). The AUC did not adequately distinguish between “Improved” and “Unchanged” on either measure, AUROC ranged from 0.49 to 0.61.

Table 5 Area under the receiver operating characteristic curve (AUROC) using non-parametric ROC analyses (N = 416)
Full size table

< Table 5 APPROXIMATELY HERE>

The same pattern repeated when patients scores were analysed according to diagnoses. For patients with depression, the AUC was excellent when distinguishing between “Recovered” and “Unchanged” (0.81) and acceptable distinguishing “Recovered” from “Improved” (0.78), but ineffective separating “Improved” and “Unchanged” (0.52). For patients with anxiety, the AUC showed excellent classification for “Recovered” versus “Unchanged” (0.83). Our analyses of “Recovered” versus “Improved” and “Improved” versus “Unchanged” did not have appropriate statistical power and can thus not be regarded as significant findings. Youden’s index indicated that an EQ-5D value of 0.768 had the highest combined sensitivity and specificity when identifying recovered patients in the total sample. The value was the same for both depression and anxiety (Table 6).

Table 6 The central range of operating characteristics of the EQ-5D value post-treatment for identifying recovered versus non-recovered patients (N = 416)
Full size table

Discussion

Our aim was to explore the responsiveness of the EQ-5D-5L in patients receiving treatment for depression and anxiety. This was done by comparing change in the EQ-5D-5L to change in the disorder-specific measures BDI-II and BAI. We hypothesised that the EQ-5D-5L should show magnitude of change as the BDI-II and BAI during treatment. The ES was large (d > 0.8) for all measures, ranging from Cohen’s d 1.07–1.84. For the SRM, which accounts for variability in treatment response by dividing change scores by the standard deviation of change scores, the BDI-II, the EQ-5D value and the EQ VAS all showed large magnitude of change. The BAI showed moderate magnitude of change on the SRM when accounting for its higher correlation between baseline and end of treatment scores. Furthermore, the EQ-5D-5L change scores showed strong correlation with the BDI-II, and moderate correlation with the BAI. The hypothesis that the EQ-5D-5 L should show similar magnitude of change as the condition-specific measures thus seems confirmed.

We then examined if the EQ-5D value could correctly classify patients deemed as “Recovered” according to the condition-specific measures. Results from the ROC analyses indicate that this was the case: AUROC were from fair to good when distinguishing “Recovered” patients from “Improved” or “Unchanged”. This was true for the total sample (AUROC 0.72–0.82), for patients with depression (AUROC 0.75 and 0.80), and for patients with anxiety when distinguishing “Recovered” patients from “Unchanged” patients (AUROC 0.83). In a similarly consistent pattern, the EQ-5D-5L showed poor ability to distinguish between “Improved” and “Unchanged” patients for the total sample, for depression, and for anxiety, (AUROC 0.52–0.64). The ability of the EQ-5D-5L to consistently identify recovered patients indicates that our second hypothesis was confirmed. We also calculated Youden’s index, as this may be informative for clinicians and serve as a reference for future research. For recovery from both depression and anxiety in the total sample, cut-off point as defined by highest combined sensitivity and specificity was an EQ-5D value ≥ 0.768 at end of treatment.

Data on the responsiveness of the five-level version of the EQ-5D-5L in mental health is limited, though cross-sectional measures have indicated moderate to good correlation with condition-specific measures [11]. Comparing to the three-level version, one study found moderate responsiveness to anxiety disorders. Similar to the present study, patients were classified as having either “more”, “constant”, or “less anxiety” according to the BAI. T-tests showed significant differences in change scores for the EQ-5D value and the EQ VAS. However, that study found that the SRM were moderate to small, and ES were large for the EQ-5D value only when patients were deteriorated [19].

Reviews of the literature on the three-level version have indicated reasonable responsiveness in depression and anxiety [10], suggesting that the five-level version may have similar properties. One recent study compared the responsiveness of the three-level and five-level versions of Anxiety / depression dimension for mental health patients. Although the five-level version was found to be more responsive, both showed limited ability to capture changes in mental health [20]. The Anxiety / depression dimension did show significant change from baseline to end of treatment in the present study. Future research may determine how useful it is as a measure on its own.

A previous cross-sectional study did find that the EQ-5D value could screen for depression and anxiety in patients with type 2 diabetes [21]. In the present study, the EQ-5D value showed similar performance in a longitudinal design in patients with depression and anxiety as primary diagnoses. That the EQ-5D value may perform better than the Anxiety / depression dimension alone is perhaps reasonable, as it may better capture the wide-ranging impact of depression and anxiety on health and quality of life [4, 5].

The EQ-5D-5L is increasingly used when evaluating health status in surveys and clinical trials [8], and decision-making bodies recommend its use in evaluating health technologies [6, 46]. Demonstrating its validity in diverse patient groups is therefore essential for sound decision-making when allocating healthcare resources. In this study, the EQ-5D-5L showed good responsiveness to change for patients with depression and anxiety. This suggests that the EQ-5D-5L can be a valid and useful tool for evaluating impact of disease and benefit of treatment for these patients, for instance through estimating QALYs. It also suggests that the EQ-5D-5L can useful when evaluating interventions for patients with depression and anxiety.

Strengths and limitations

The main strength of the study is adding to a limited evidence-base concerning the responsiveness of the five-level version of the EQ-5D in patients with depression and anxiety. The study included a fairly large clinical sample who were assessed and diagnosed by clinical psychologists before entering treatment. We can thus be reasonably certain of the clinical characteristics of the sample. The study took part in a national health service clinic, suggesting that these patients are somewhat representative of clinical populations with depression and anxiety in Norway. The patients saw substantial treatment gains as reflected by the large ES and SRM, which gave an opportunity for evaluating the ability of the EQ-5D-5L to identify recovered patients.

Several limitations to the study have to be considered. The study only included patients who completed treatment, and treatment gains were large. The study could therefore not evaluate the ability of the EQ-5D-5L to detect smaller changes, that still may be of importance to patients. A related limitation is that the large rate of recovered patients in the study meant that “Unchanged” patients formed a small subgroup. The findings concerning the unchanged patients should be treated with caution. We also lack adequate data to determine if the EQ-5D-5L would be equally responsive to deterioration as improvement during treatment. The study also lacked data on comorbidity.

The current study uses the UK value set for converting to EQ-5D value scores, as there is currently no Norwegian value set available. Choice of value sets has shown to influence the estimation of QALYs, which suggests that it would be useful to replicate the present findings when a Norwegian value set is available [14].

As new measures of health status become available, such as the Recovering Quality of Life (ReQoL), it will be important to compare and contrast these against the EQ-5D-5L to judge which instrument is best suited for patients with depression and anxiety [47]. There is evidence that a wide range of outcomes that are important to patients with mental health problems are not adequately captured by commonly used instruments [5, 7]. Further research is needed to assess whether the EQ-5D-5L could reflect key changes in a wider range of outcomes [5], or if other instruments or bolt-on dimensions may be better for capturing psycho-social factors of importance to patients [48].

Conclusion

The findings in this study suggest that the EQ-5D-5L may be responsive to change in health status for patients receiving treatment for depression and anxiety. The EQ-5D-5L showed similar magnitude of change as the condition-specific measures and was also able to consistently identify patients who had recovered from depression and anxiety. Responsiveness of the EQ-5D-5L is likely sensitive to context, and these findings should be replicated in other samples. Still, these findings suggest that the EQ-5D-5L may be a useful tool for evaluating outcomes of treatment for patients with depression and anxiety.

Data Availability

material.

The patient data used for this study is not readily available as the patients have not given consent for use or distribution beyond the research at Diakonhjemmet Hospital. Inquiries can be directed to kenneth.sandin@diakonsyk.no.

Code Availability

Any inquiry can be directed to kenneth.sandin@diakonsyk.no.

References

  1. OECD, Health at a OECD. ; 2019 [cited 2022 Mar 20]. Available from: https://www.oecd-ilibrary.org/social-issues-migration-health/health-at-a-glance-2019_4dd50c09-en

  2. Bloom DE, Cafiero E, Jané-Llopis E, Abrahams-Gessel S, Bloom LR, Fathima S et al. The Global Economic Burden of Noncommunicable Diseases [Internet]. Program on the Global Demography of Aging; 2012 [cited 2022 Mar 31]. Available from: https://ideas.repec.org/p/gdm/wpaper/8712.html

  3. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of Disease Study 2010. Lancet. 2013;382:1575–86.

    Article  PubMed  Google Scholar 

  4. Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. The Lancet Psychiatry. 2016;3:171–8.

    Article  PubMed  Google Scholar 

  5. Chevance A, Ravaud P, Tomlinson A, Berre CL, Teufer B, Touboul S, et al. Identifying outcomes for depression that matter to patients, informal caregivers, and health-care professionals: qualitative content analysis of a large international online survey. The Lancet Psychiatry. 2020;7:692–702.

    Article  PubMed  Google Scholar 

  6. NICE NI for H and CE. Technology appraisal processes | Technology appraisal guidance | NICE guidance | Our programmes | What we do | About [Internet]. NICE [cited 2022 Mar 31];Available from: https://www.nice.org.uk/about/what-we-do/our-programmes/nice-guidance/nice-technology-appraisal-guidance/process

  7. Cuijpers P. Targets and outcomes of psychotherapies for mental disorders: an overview. World Psychiatry. 2019;18:276–85.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Devlin N, Parkin D, Janssen B. Methods for Analysing and Reporting EQ-5D Data [Internet]. Cham: Springer International Publishing; 2020 [cited 2022 Mar 20]. Available from: http://link.springer.com/https://doi.org/10.1007/978-3-030-47622-9

  9. Herdman M, Gudex C, Lloyd A, Janssen Mf, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T et al. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess 2014;18:vii–viii, xiii–xxv, 1–188.

  11. Feng YS, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30:647–73.

    Article  PubMed  Google Scholar 

  12. Mihalopoulos C, Chen G, Iezzi A, Khan MA, Richardson J. Assessing outcomes for cost-utility analysis in depression: comparison of five multi-attribute utility instruments with two depression-specific outcome measures. Br J Psychiatry. 2014;205:390–7.

    Article  PubMed  Google Scholar 

  13. Engel L, Chen G, Richardson J, Mihalopoulos C. The impact of depression on health-related quality of life and wellbeing: identifying important dimensions and assessing their inclusion in multi-attribute utility instruments. Qual Life Res. 2018;27:2873–84.

    Article  PubMed  Google Scholar 

  14. Camacho EM, Shields G, Lovell K, Coventry PA, Morrison AP, Davies LM. A (five-)level playing field for mental health conditions?: exploratory analysis of EQ-5D-5L-derived utility values. Qual Life Res. 2018;27:717–24.

    Article  CAS  PubMed  Google Scholar 

  15. Sandin K, Shields GE, Gjengedal RGH, Osnes K, Bjørndal MT, Hjemdal O. Self-reported health in patients on or at risk of sick leave due to depression and anxiety: validity of the EQ-5D. Front. Psychol. 2021;12:655151.

    Google Scholar 

  16. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5th ed. Oxford University Press; 2014.

  17. Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61:102–9.

    Article  PubMed  Google Scholar 

  18. Jacobson NS, Roberts LJ, Berns SB, McGlinchey JB. Methods for defining and determining the clinical significance of treatment effects: description, application, and alternatives. J Consult Clin Psychol. 1999;67:300–7.

    Article  CAS  PubMed  Google Scholar 

  19. König HH, Born A, Günther O, Matschinger H, Heinrich S, Riedel-Heller SG, et al. Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes. 2010;8:47.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Crick K, Al Sayah F, Ohinmaa A, Johnson JA. Responsiveness of the anxiety/depression dimension of the 3- and 5-level versions of the EQ-5D in assessing mental health. Qual Life Res. 2018;27:1625–33.

    Article  PubMed  Google Scholar 

  21. Al Sayah F, Ohinmaa A, Johnson JA. Screening for anxiety and depressive symptoms in type 2 diabetes using patient-reported outcome measures: comparative performance of the EQ-5D-5L and SF-12v2. MDM Policy & Practice. 2018;3:2381468318799361.

    Article  Google Scholar 

  22. Sandin K, Anyan F, Osnes K, Gunnarsdatter Hole Gjengedal R, Risberg Leversen JS, Endresen Reme S, et al. Sick leave and return to work for patients with anxiety and depression: a longitudinal study of trajectories before, during and after work-focused treatment. BMJ Open. 2021;11:e046336.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22–33;quiz 34–57.

  24. Beck AT, Steer RA, Brown GK. Manual for the beck depression inventory-II. 1996

  25. Beck AT, Steer RA. Manual for the Beck anxiety inventory. San Antonio, TX: Psychological Corporation; 1990.

    Google Scholar 

  26. WHO. The International classification of Diseases-10 (ICD-10). Geneva: World Health Organisation; 1992.

    Google Scholar 

  27. Dobson KS, Dozois DJA. Handbook of Cognitive-Behavioral Therapies: Fourth Edition [Internet]. Guilford Press [cited 2023 Jan 11];Available from: https://www.guilford.com/books/Handbook-of-Cognitive-Behavioral-Therapies/Dobson-Dozois/9781462547722

  28. Wells A. Metacognitive Therapy for Anxiety and Depression. 1st edition. New York, NY: The Guilford Press; 2009.

  29. Gjengedal RGH, Reme SE, Osnes K, Lagerfeld SE, Blonk RWB, Sandin K, et al. Work-focused therapy for common mental disorders: a naturalistic study comparing an intervention group with a waitlist control group. WOR. 2020;66:657–67.

    Article  Google Scholar 

  30. Hansen TM, Helland Y, Augestad LA, Rand K, Stavem K, Garratt A. Elicitation of norwegian EQ-5D-5L values for hypothetical and experience-based health states based on the EuroQol Valuation Technology (EQ-VT) protocol. BMJ Open. 2020;10:e034683.

    Article  PubMed  PubMed Central  Google Scholar 

  31. van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value in Health. 2012;15:708–15.

    Article  PubMed  Google Scholar 

  32. NICE. Position statement on use of the EQ-5D. -5L value set for England (updated October 2019) | Technology appraisal guidance | NICE guidance | Our programmes | What we do | About [Internet]. NICE [cited 2023 Jan 11];Available from: https://www.nice.org.uk/about/what-we-do/our-programmes/nice-guidance/technology-appraisal-guidance/eq-5d-5l

  33. Stavem K, Augestad LA, Kristiansen IS, Rand K. General population norms for the EQ-5D-3L in Norway: comparison of postal and web surveys. Health Qual Life Outcomes. 2018;16:204.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Beck AT, Brown G, Epstein N, Steer RA. An Inventory for Measuring Clinical Anxiety: Psychometric Properties.:5.

  35. Cuzick J. A wilcoxon-type test for trend. Stat Med. 1985;4:543–7.

    Article  Google Scholar 

  36. Cohen J. Statistical Power Analysis for the Behavioral Sciences [Internet]. Routledge; 2013 [cited 2023 Jan 11]. Available from: https://www.taylorfrancis.com/books/mono/10.4324/9780203771587/statistical-power-analysis-behavioral-sciences-jacob-cohen

  37. Liang MH. Longitudinal construct validity: establishment of clinical meaning in patient Evaluative Instruments. Med Care. 2000;38:II–84.

    Article  Google Scholar 

  38. Middel B, Van Sonderen E. Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. Int J Integr Care [Internet] 2002 [cited 2022 Mar 20];2. Available from: http://www.ijic.org/article/https://doi.org/10.5334/ijic.65/

  39. Fleiss JL, Levin B, Paik MC. Statistical methods for Rates and Proportions. John Wiley & Sons; 2013.

  40. Seggar LB, Lambert MJ, Hansen NB. Assessing clinical significance: application to the beck depression inventory. Behav Ther. 2002;33:253–69.

    Article  Google Scholar 

  41. Gillis MM, Haaga DAF, Ford GT. Normative values for the Beck anxiety inventory, fear questionnaire, Penn state worry questionnaire, and social phobia and anxiety inventory. Psychol Assess. 1995;7:450–5.

    Article  Google Scholar 

  42. Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–5.

    Article  CAS  PubMed  Google Scholar 

  43. Gale T, Hawley C. A model for handling missing items on two depression rating scales. Int Clin Psychopharmacol. 2001;16:205–14.

    Article  CAS  PubMed  Google Scholar 

  44. StataCorp. Stata Statistical Software: Release 16. 2019

  45. Albert PR. Why is depression more prevalent in women? J Psychiatry Neurosci. 2015;40:219–21.

    Article  PubMed  PubMed Central  Google Scholar 

  46. National Institute of Public Health. Fremskaffing av EQ-5D vekter og normative data for helseøkonomiske evalueringer - prosjektbeskrivelse. (English: Acquisition of EQ-5D weights and normative data for health economic evaluations – project description) [Internet]. 2019;Available from: https://www.fhi.no/cristin-prosjekter/aktiv/fremskaffing-av-eq-5d-vekter-og-normative-data-for-helseokonomiske-evalueri/

  47. Keetharuth AD, Brazier J, Connell J, Bjorner JB, Carlton J, Taylor Buck E, et al. Recovering quality of life (ReQoL): a new generic self-reported outcome measure for use with people experiencing mental health difficulties. Br J Psychiatry. 2018;212:42–9.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Chen G, Olsen JA. Filling the psycho-social gap in the EQ-5D: the empirical support for four bolt-on dimensions. Qual Life Res. 2020;29:3119–29.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the patients, next of kin, and user representatives for their participation in the study, and for their valuable feedback. We would also like to thank the staff at the Division of Mental Health and Substance Abuse at Diakonhjemmet Hospital.

Funding

Open access funding provided by Norwegian University of Science and Technology

Author information

Authors and Affiliations

  1. Division of Mental Health and Substance Abuse, Diakonhjemmet Hospital, Postboks 23 Vinderen, Oslo, 0319, Norway

    Kenneth Sandin, Ragne G.H. Gjengedal, Kåre Osnes, Marianne T. Bjørndal, Silje E. Reme & Odin Hjemdal

  2. Department of Psychology, Norwegian University of Science and Technology, Trondheim, NO-7491, Norway

    Kenneth Sandin, Ragne G.H. Gjengedal, Marianne T. Bjørndal & Odin Hjemdal

  3. Manchester Centre for Health Economics, Division of Psychology and Mental Health, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, England

    Gemma Shields

  4. Department of Psychology, University of Oslo, Oslo, Norway

    Silje E. Reme

Authors
  1. Kenneth Sandin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gemma Shields
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ragne G.H. Gjengedal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kåre Osnes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marianne T. Bjørndal
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Silje E. Reme
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Odin Hjemdal
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the conceptualisation and design of the study. KS led the writing of the manuscript and is the principal author of the funding application. GS contributed to conceptualisation, analyses, and writing. RGHG, KO, MTB, and SER contributed to design of study and intervention, data management, and writing. OH is the project manager and contributed to design, analyses and writing. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kenneth Sandin.

Ethics declarations

Conflict of interest

None declared.

Ethics approval

This study was approved as a health service study by the Norwegian Data Protection Authority. The data used in the present study is part of ongoing routine data collection, and no further approval is needed beyond consent from the individual patient. Data collection and security in the present study was managed by Diakonhjemmet Hospital, and approval of data handling was granted by Oslo University Hospital, approval number 2015/15606.

Consent for publication

All participants gave written, informed consent for use of data for research and publication.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sandin, K., Shields, G., Gjengedal, R.G. et al. Responsiveness to change in health status of the EQ-5D in patients treated for depression and anxiety. Health Qual Life Outcomes 21, 35 (2023). https://doi.org/10.1186/s12955-023-02116-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-023-02116-y

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us