- Open Access
The responsiveness of the EQ-5D and time trade-off scores in schizophrenia, affective disorders, and alcohol addiction
Health and Quality of Life Outcomesvolume 13, Article number: 114 (2015)
To compare the responsiveness of the EQ-5D index (German and British tariff), the EQ-5D visual analogue scale (EQ VAS), and time trade-off (TTO) scores in schizophrenia, affective disorders, and alcohol addiction.
We used a sample of 502 patients and examined the measures at baseline and after 14 months. We used the generic “WHO Quality of Life BREF” (WHOQOL) and the disorder-specific “Global Severity Index” (GSI) as anchors for a relevant improvement in a patient’s health status. In a complete case analysis, we assessed the responsiveness, which is the ability to detect a change given a relevant change on the anchor. We computed the effect sizes (ESs) and standardised response means (SRMs).
In patients with schizophrenia, the ESs and SRMs were large (ES/SRM > 0.8) for the British EQ-5D index (ESGSI: 0.93; SRMGSI: 0.89; SRMWHOQOL: 0.82). In patients with affective disorders, we found large ESs and SRMs for the EQ VAS (ESGSI: 1.79; ESWHOQOL: 0.90; SRMGSI: 1.52; SRMWHOQOL: 0.93) and a large ES for the British EQ-5D index (ESGSI: 0.88). In patients with alcohol addiction, the ESs and SRMs were large for the EQ VAS (ESGSI: 1.40; ESWHOQOL: 0.94; SRMGSI: 1.04; SRMWHOQOL: 0.83). The ESs and SRMs of the German EQ-5D index were consistently lower than those of the British EQ-5D index. Regarding TTO score, ESs and SRMs were generally less than 0.5.
No preference-based instrument was consistently more responsive than others across all mental disorders. While the EQ VAS was the most responsive instrument in patients with affective disorders or alcohol addiction, the British EQ-5D index was reasonably responsive in patients with schizophrenia.
Various approaches and instruments can be used to assess patients’ health related quality of life (HRQOL). In the field of economic evaluation, preference-based instruments are often used to assess HRQOL. These instruments quantify a preference-based valuation of the patient’s current health state by so-called utility weights, which usually range from 0 (death) to 1 (full health) and should be comparable across diseases and disorders. Preference-based instruments can be categorised into direct and indirect instruments [1, 2]. In direct instruments, patients value their own experienced health state or described vignettes directly. Common direct instruments are the time trade-off (TTO) or standard gamble. In indirect instruments, there are two steps to assess utility weights: first, persons of a reference population value a set of predefined generic or condition-specific health states via direct instruments. Based on these valuations, an algorithm is generated to estimate utility weights for each possible health state of the indirect instrument. Second, patients describe their health state on the indirect instrument, and the corresponding utility weight is assigned to the reported health state. Common indirect instruments in patients with mental disorders are the EQ-5D and the SF-6D .
Before a preference-based instrument is used in economic evaluations, its psychometric properties should be tested. An important psychometric property is responsiveness, which refers to an instrument’s ability to detect changes in the underlying construct (e.g., health status) over time .
Although some studies have already compared the responsiveness of various preference-based instruments [5–10], only a few studies have compared the responsiveness of preference-based instruments in patients with mental disorders [11–14]. In patients with mental disorders, however, no study has compared the responsiveness of direct and indirect preference-based instruments. Thus, the purpose of this study was to compare the responsiveness of the EQ-5D index (British and German tariff), the EQ-5D visual analogue scale (EQ VAS), and the TTO score in patients with schizophrenia, affective disorders, or alcohol addiction.
Subjects and study design
The data of this study came from a study that analysed a new financing model for mental health care in two regions of Northern Germany . The study sample consisted of 170 patients with schizophrenic, schizotypal, or delusional disorders (ICD-10: F2) ; 171 patients with affective disorders (ICD-10: F3); and 161 patients with alcohol addiction (ICD-10: F10). The patients were recruited from September 2003 to March 2004 in inpatient, day clinic, or outpatient settings. Five hundred and two patients were assessed at baseline (t0) and after 14 months (t1).
The EQ-5D measures HRQOL by three concepts : (I) the patient-reported “EQ-5D descriptive system” has five dimensions (“mobility”, “self-care”, “usual activities”, “pain/discomfort”, and “anxiety/depression”) with three ordinal levels (“no problems”, “moderate problems”, and “severe problems”), resulting in 243 (35) possible health states.
(II) A utility weight (EQ-5D index) can be attached to the answers on the EQ-5D descriptive system according to a country-specific tariff. The utility weight is based on the valuation of health states by the general population, which represents the value of a patient’s health state from a general population’s perspective. The EQ-5D index score ranges from health states that are valued worse than death to death (0) to full health (1). The value of the worst possible health state is −0.59 on the British EQ-5D index (EQ-5D index-UK)  and −0.21 on the German EQ-5D index (EQ-5D index-G) . Despite the analysis being of a German patient sample, we used both EQ-5D indexes because the estimation of the EQ-5D index-G was based on a rather small sample (nGerman = 334 vs. nUK = 2997) and on the valuation of fewer health states (36 vs. 43). Because most of the valued health states had large standard deviations in relation to the mean in the German sample, a regression model without non-significant variables was computed. Based on the study’s results, the EQ-5D index-G score does not change if the patients have improved from level 2 (“moderate problems”) to level 1 (“no problems”) in the dimension “anxiety/depression”. Thus, the EQ-5D index-G scores must be considered as less precise.
(III) Respondents rate their current health state on the EQ VAS, which is a rating scale similar to a thermometer that ranges from 0 (worst imaginable health state) to 100 (best imaginable health state). The EQ VAS represents the value of HRQOL from the respondent’s perspective. Based on economic theory, the EQ VAS does not represent choice-based preferences and thus produces no utility weights [20–22]. However, the EQ VAS has been shown to explain a substantial proportion of the variance in standard gamble and TTO . Despite these theoretical limitations, we labelled the EQ VAS as a preference-based instrument. To better compare the preference-based instruments, we divided the EQ VAS score by 100.
The TTO assessment was based as closely as possible on the protocol of the Measurement and Valuation of Health (MVH) Group  (see TTO study protocol in the Additional file 1). Accordingly, patients had to choose between two hypothetical alternatives in personal interviews: in the first alternative, patients stayed in their current health state for 10 years followed by death; in the second alternative, patients stayed x years at full health followed by death (restricted to x ≤ 10 years). Time x was varied until the patient was indifferent between the two alternatives, leading to a utility weight of “x/10”. If the patient preferred zero years at full health (which equals immediate death) to 10 years in the current health state, the patient valued their current health state worse than death. In this case, utility weights can be negatively infinite for health states valued worse than death.
The WHOQOL-BREF is a self-administered generic HRQOL measure referring to the previous two weeks. It is a short version of the WHOQOL-100 measure and contains 26 items, each rated on a 5-point Likert scale. Two items assess the patients’ overall perception of quality of life and their health, respectively. The other 24 items can be summarised in a global score. The global score ranges from 0 (worst) to 100 (best). It has been shown that the WHOQOL-BREF is valid, reliable, and responsive in patients with schizophrenia, affective disorders, or alcohol addiction [25–27].
The SCL-90R is a self-administered questionnaire measuring the distress induced by mental symptoms in the previous 7 days . Each of the 90 items ranges from 0 (best) to 4 (worst). The items can be aggregated to the Global Severity Index (GSI), which represents the mean of all the item scores ranging from 0 (best) to 4 (worst).
We only analysed the responsiveness in patients with an improved health status because the number of patients with a deteriorated health status was very small. We conducted a complete case analysis regarding the preference-based instruments. We used both the GSI and WHOQOL-BREF global scores as anchors to identify patients with an improved health status. Because of the lack of available minimal important differences in the anchors, a relevant health status change on the anchor was defined as more than ±0.5 standard deviations (baseline) for each mental disorder [29, 30].
In regard to the TTO, 15 patients had utility weights less than −1.00 (lowest TTO score: −19) at baseline. Because outliers strongly influence the coefficients of the ES and SRM in small sample sizes, we censored the range of the TTO from −1.00 to 1.00.
We assessed the correlation between the preference-based instruments and each anchor to ensure that the constructs of both instruments were similar. We computed Spearman’s rank correlation coefficient because the preference-based instruments did not follow a normal distribution. According to Cohen, we defined a correlation coefficient as small if 0.1 ≤ |rs| < 0.3, moderate if 0.3 ≤ |rs| < 0.5, and large if |rs| ≥ 0.5 .
Responsiveness can be assessed in various ways [32–35]. In our analysis, we computed effect sizes (ESs, mean of change scores divided by the standard deviation at baseline) and standardised response means (SRMs, mean of change scores divided by the standard deviation of the change scores) of each preference-based instrument given a relevant improvement on the anchor. Both responsiveness scores provide information on the magnitude of change in relation to the level of variation at baseline (ES) or in relation to the level of variation in change scores (SRM). Thus, the interpretation of responsiveness differs between ES and SRM according to how the level of variation is defined. According to Cohen , we defined the scores of ES and SRM as trivial from ≥ |0.1| to < |0.2|, as small from ≥ |0.2| to < |0.5|, as medium from ≥ |0.5| to < |0.8|, and as large if ≥ |0.8|.
The statistical analyses were conducted using the Statistical Package for the Social Sciences (version 18, SPSS Inc., Chicago, IL, USA).
The patient characteristics at baseline are shown in Table 1. Most of the schizophrenic patients were male (57.6 %), unmarried (61.2 %), and lived alone (33.7 %). The patients with affective disorders were mostly female (69.0 %), married (37.4 %), and lived with their spouse/partner (48.8 %). Most of the patients with alcohol addiction were male (71.4 %), separated/divorced (36.6 %), and lived alone (50.9 %). Across all disorders, most patients had a lower secondary school degree.
Score distribution at baseline
Scores of instruments used as anchors
The patients with schizophrenia showed the highest mean WHOQOL-BREF score (57.4) and the lowest mean GSI score (0.62; Table 2). The patients with affective disorders reported the lowest mean WHOQOL-BREF score (44.8) and the highest mean GSI score (0.95). In the patients with alcohol addiction, the mean WHOQOL-BREF score was 49.4 (SD: 21.7) and the mean GSI score was 0.65 (SD: 0.60), indicating moderate psychopathological problems.
Scores of preference-based instruments
Across all disorders, the mean EQ-5D index-G score was the highest, followed by the TTO, EQ-5D index-UK, and EQ VAS scores, except in the patients with alcohol addiction for whom the mean EQ-5D index-UK score (0.710) was higher than the mean TTO score (0.650, Table 2). No preference-based instrument showed floor effects at baseline (results not shown). Both EQ-5D indexes and TTO showed ceiling effects in contrast to the EQ VAS (<5 %). In the patients with schizophrenia, 25 % (measured by the EQ-5D index-UK), 43 % (EQ-5D index-G), and 45 % (TTO) of all patients reported full health. In the patients with affective disorders, 15 % (EQ-5D index-UK) and 34 % (EQ-5D index-G/TTO) of all patients reported full health. In the patients with alcohol addiction, 10 % (EQ-5D index-UK), 31 % (EQ-5D index-G), and 26 % (TTO) of all patients reported full health.
Comparing the means of the patient population with those of the German population norms, the available means of the German population norms were consistently higher than the means of each patient group.
Correlation between scores of the preference-based instruments and scores of the anchors
Across all disorders, we mostly found moderate Spearman’s rank correlation coefficients between the EQ-5D index-G/TTO scores and the WHOQOL-BREF/GSI scores. The EQ-5D index-UK scores and the EQ VAS scores had both moderate and large correlations with the scores of both anchors (Table 3).
British EQ-5D index
In the patients with schizophrenia, there were large ESs and SRMs on the EQ-5D index-UK (ESGSI: 0.93; SRMGSI: 0.89; SRMWHOQOL-BREF: 0.82). In the patients with affective disorders, there was a large ES (ESGSI: 0.88) anchored by the GSI (Table 4). In the patients with alcohol addiction, the ESs and SRMs that were anchored by the WHOQOL-BREF were small, whereas those anchored by the GSI were medium (ESGSI: 0.64; SRMGSI: 0.56).
German EQ-5D index
In the patients with schizophrenia, the ESs and SRMs on the EQ-5D index-G were medium (ESWHOQOL-BREF: 0.54; ESGSI: 0.66; SRMWHOQOL-BREF: 0.63; SRMGSI: 0.63). In the patients with affective disorders or alcohol addiction, the ESs and SRMs were generally small.
In the patients with schizophrenia, we found medium ESs and SRMs (ESWHOQOL-BREF: 0.61; ESGSI: 0.58; SRMWHOQOL-BREF: 0.70; SRMGSI: 0.63) on the EQ VAS. In the patients with affective disorders, we found large ESs and SRMs (ESWHOQOL-BREF: 0.90; ESGSI: 1.79; SRMWHOQOL-BREF: 0.93; SRMGSI: 1.52). In the patients with alcohol addiction, the ESs and SRMs were large (ESWHOQOL-BREF: 0.94; ESGSI: 1.40; SRMWHOQOL-BREF: 0.83; SRMGSI: 1.04).
In the patients with schizophrenia, we found small and trivial ESs and SRMs on the TTO score. In the patients with affective disorders, we found a medium ES and SRM (ESGSI: 0.56; SRMGSI: 0.74) anchored by the GSI. In the patients with alcohol addiction, the ESs and SRMs were small or trivial.
In this study, we analysed the responsiveness of the EQ-5D index-UK, the EQ-5D index-G, the EQ VAS, and the TTO score in patients with schizophrenia, affective disorders, or alcohol addiction with an improved health status according to the WHOQOL-BREF or GSI, which were used as anchors. We computed the ES and SRM to assess and compare the responsiveness of the four preference-based instruments.
The correlation coefficients between the preference-based instruments and the anchors were mainly moderate and large, indicating that the preference-based instruments captured relevant aspects of HRQOL that were covered in the anchors. Thus, the constructs of the preference-based instruments were similar to the constructs of both anchors.
Using two anchors, in total, we computed 24 ESs/SRMs (4 preference-based instruments *2 anchors *3 mental disorders). Of the 24 computed ESs/SRMs, we found six large ESs and six large SRMs. With the large ESs, the corresponding SRM was large in five comparisons and medium in one comparison and vice versa. Thus, the level of responsiveness between ES and SRM was consistent in five of the six comparisons, indicating that both responsiveness statistics may lead to the same level of responsiveness. However, this evidence does not imply that only one of both responsiveness statistics is sufficient to assess the level of responsiveness. Various factors influence the level of responsiveness in each method. Whereas the distribution of the baseline scores influences the ES, the SRM is influenced by the distribution of change scores (particularly the change scores of outliers) [35, 36]. Depending on the particular study population, ES and SRM can differ according to their level of responsiveness.
In patients with affective disorders or alcohol addiction, the EQ VAS appeared to be the most responsive instrument. This may be because of the different characteristics of the EQ VAS and the EQ-5D index. Compared to the EQ-5D index, the EQ VAS covers all dimensions that the patients feel are subjectively important in their HRQOL. In contrast, the EQ-5D descriptive system predefines the HRQOL dimensions that are externally considered important for patients’ HRQOL. Additionally, the EQ-5D descriptive system only differentiates between three levels of severity. Patients may be reluctant to respond to an improvement in the corresponding EQ-5D dimensions because the improvements may be considered marginal from the patient perspective. In the EQ VAS, however, patients can respond to these marginally perceived improvements with small change scores. Therefore, the EQ VAS may encompass more subjectively important HRQOL dimensions than the EQ-5D index  and may even detect marginally perceived improvements in patients’ HRQOL.
In patients with schizophrenia, the EQ-5D index-UK appeared to be the most responsive instrument with large ESs and SRMs despite large ceiling effects at baseline. The EQ VAS had a lower level of responsiveness, which contrasts our previous argument that the EQ VAS encompasses more subjectively important HRQOL dimensions than the EQ-5D index. A reason may be that the descriptive system of the EQ-5D covers most of the relevant HRQOL dimensions in this patient group. The mean change score of the EQ-5D index-UK was higher than those of the other preference-based instruments. However, our results should be interpreted with caution because previous studies showed that the responsiveness of the (British and German) EQ-5D index was low in larger patient samples [13, 14, 38]. There may be two reasons for the differences in the level of responsiveness. The first reason may be our smaller sample size. The second reason may be that the assessment of responsiveness differed from our study. Whereas Mulhern et al.  assessed the responsiveness with SRM based on all patients and no anchor, McCrone et al.  used the SRM in relevantly improved patients based on a disorder-specific anchor. Konnopka et al.  assessed the responsiveness with the receiver operating characteristic curve using other anchors (EQ-5D transition question and a schizophrenia-specific measure). However, it is difficult to decide whether an anchor is required at all and if so, which anchor may be the most suitable (“gold standard”) for the assessment of responsiveness (transition question, disease-specific, or generic anchor). When using no anchor, the level of responsiveness is highly depended on the particular treatment effects and is based on “statistically significant” change, which may not necessarily constitute a meaningful change in a patient’s health status . However, the number of patients which can be used for the analysis is larger than that if using anchor-based methods. In using an anchor, the change in the preference-based instrument can be linked to a meaningful change in the anchor. When using transition questions, there is a definite indicator for a change. However, if the transition question has various levels (e.g., slightly, a little, a lot), it is unclear which level of the change is meaningful for patients. Although disease-specific anchors can detect marginal clinical changes in a patient’s health status, the question is whether each marginal clinical change leads to a change in the preference-based instrument. When using a generic anchor, it is debateable whether the generic anchor is sensitive enough to detect meaningful health status changes in the disease. Additionally, the assessment of an anchor’s minimal important difference (MID) is influenced by the choice of the sample and the MID method leading to different MIDs of the same anchor [39, 40].
Both EQ-5D indexes are based on the same descriptive system. In contrast to the EQ-5D index-UK, which had two large ESs and SRMs, the EQ-5D index-G had no large ESs or SRMs. The lower responsiveness of the EQ-5D index-G may be a result of the instrument’s insensitivity to a change from level 2 to level 1 in the EQ-5D dimension “anxiety/depression”. It is expected that patients with mental disorders report the most changes in this EQ-5D dimension.
To estimate the EQ-5D index scores, the TTO method was used to value predefined health states of the EQ-5D descriptive system. Thus, one may expect that the TTO score and the EQ-5D index have a similar level of responsiveness. In our study, we found two large and two medium ESs and two large and three medium SRMs in the EQ-5D index-UK. The TTO score, however, had only one medium ES and one medium SRM. This inconsistent level of responsiveness between the TTO score and the EQ-5D index-UK may be based on two major reasons. First, the TTO scores of our study referred to the valuation of the patients’ own experienced and unrelated health state, whereas the TTO scores used for the EQ-5D index referred to the valuation of predefined and hypothetical health states. Thus, the construct of the valued health state is different between the TTO of our study and the TTO used for the EQ-5D index. Second, the TTO task may be more challenging for patients than describing their current health state in the EQ-5D descriptive system.
Studies comparing the responsiveness of preference-based instruments in patients with mental disorders
We did not find any studies comparing the preference-based instruments used in this study. However, four studies compared the responsiveness of the EQ-5D index-UK and the SF-6D in patients with mental disorders. Gerhards and colleagues  compared the responsiveness of the SF-6D and the EQ-5D index-UK in patients with depression using the ES and SRM. The ESs and SRMs ranged from small to large and were anchored by a disease-specific instrument and a patient self-reported global rating of change. The SF-6D had slightly higher ESs and SRMs than the EQ-5D index-UK. The authors concluded that both instruments can be applied in assessing health effects in patients with depression.
Lamers and colleagues  assessed the responsiveness of the SF-6D and the EQ-5D index-UK in patients with mood and/or anxiety disorders using the SRM. Without using an anchor, the SRM of the SF-6D was consistently higher (SRM ≈ 0.83) than the SRM of the EQ-5D index-UK (SRM ≈ 0.46) in each severity subgroup.
McCrone and colleagues  compared the responsiveness of the EQ-5D index-UK with the SF-6D in patients with schizophrenia using the SRM. With an improvement of the patients’ health status anchored by a disease-specific instrument, the SRM of the EQ-5D index-UK and the SF-6D were identical but small (SRM = 0.39).
Mulhern and colleagues  assessed the responsiveness of the EQ-5D index-UK and the SF-6D in patients with schizophrenia using the SRM. They included all patients who had completed both instruments at both time points. Without referring to an anchor, the SRM of the EQ-5D index-UK and the SF-6D were identical but trivial (SRM = 0.12). In our study, however, we found that the EQ-5D index-UK was reasonably responsive, irrespective of the responsiveness statistic.
Strengths and limitations
This study was the first to compare the responsiveness of the EQ-5D index-UK, the EQ-5D index-G, the EQ VAS, and the TTO score in patients with schizophrenia, affective disorders, or alcohol addiction. Additionally, we used the ES and the SRM to provide more insight into a potential convergence or divergence in the level of responsiveness by applying these two different responsiveness statistics.
However, the number of patients with each mental disorder may have been too small to draw general conclusions about whether the preference-based instrument is responsive in each mental disorder. Nonetheless, we could identify some hints about which preference-based instrument was more responsive than the others in each mental disorder using the same patients. Another limitation was the use of 0.5 standard deviations as the definition of a relevant change in the anchor. However, we did not find a valid definition of a relevant change in both anchors. Finally, we used generic anchors instead of disease-specific measures to conduct the comparisons of responsiveness across the mental disorders. Therefore, additional comparisons of preference-based instruments against other external instruments may be required.
Implications for future research
Because many preference-based instruments are available in the literature, the assessment and comparison of the responsiveness of these instruments should be extended to other mental disorders and diseases. Particularly, researchers should compare the responsiveness between generic (such as the EQ-5D) and disorder-specific preference-based instruments (e.g., the DEMQOL-U for patients with dementia ). Disorder-specific preference-based instruments may encompass more specific dimensions that patients feel are relevant for the valuation of their health status. Moreover, researchers may focus on the assessment of responsiveness in patients with a deteriorated health state.
No preference-based instrument was consistently more responsive than the others across all mental disorders. In the patients with schizophrenia, the EQ-5D index-UK appeared to detect relevant changes in contrast to other studies. In the patients with affective disorders or alcohol addiction, the EQ VAS appeared to be the most responsive instrument. The responsiveness of the EQ-5D index-G and the TTO score was low in each mental disorder. More responsiveness studies comparing various preference-based instruments are required.
Global severity index
Health related quality of life
Standardised response mean
World Health Organisation quality of life
Visual analogue scale
Brazier J, Deverill M, Green C, Harper R, Booth A. A review of the use of health status measures in economic evaluation. Health Technol Assess. 1999;3:i–iv. 1–164.
Brazier J, Ratcliffe J, Salomon J, Tsuchiya A. Measuring and valuing health benefits for economic evaluation. Oxford: Oxford University Press; 2007.
Sonntag M, König HH, Konnopka A. The estimation of utility weights in cost-utility analysis for mental disorders: a systematic review. Pharmacoeconomics. 2013;31:1131–54.
Streiner DL, Norman GR. Health measurement scales : a practical guide to their development and use. 4th edn. Oxford. New York: Oxford University Press; 2008.
Krahn M, Bremner KE, Tomlinson G, Ritvo P, Irvine J, Naglie G. Responsiveness of disease-specific and generic utility instruments in prostate cancer patients. Qual Life Res. 2007;16:509–22.
Salaffi F, Stancati A, Carotti M. Responsiveness of health status measures and utility-based methods in patients with rheumatoid arthritis. Clin Rheumatol. 2002;21:478–87.
Kaplan RM, Tally S, Hays RD, Feeny D, Ganiats TG, Palta M, et al. Five preference-based indexes in cataract and heart failure patients were not equally responsive to change. J Clin Epidemiol. 2011;64:497–506.
Gregor JC, McDonald JW, Klar N, Wall R, Atkinson K, Lamba B, et al. An evaluation of utility measurement in Crohn’s disease. Inflamm Bowel Dis. 1997;3:265–76.
Moock J, Kohlmann T. Comparing preference-based quality-of-life measures: results from rehabilitation patients with musculoskeletal, cardiovascular, or psychosomatic disorders. Qual Life Res. 2008;17:485–95.
Stavem K, Froland SS, Hellum KB. Comparison of preference-based utilities of the 15D, EQ-5D and SF-6D in patients with HIV/AIDS. Qual Life Res. 2005;14:971–80.
Gerhards SA, Huibers MJ, Theunissen KA, de Graaf LE, Widdershoven GA, Evers SM. The responsiveness of quality of life utilities to change in depression: a comparison of instruments (SF-6D, EQ-5D, and DFD). Value Health. 2011;14:732–9.
Lamers LM, Bouwmans CA, van Straten A, Donker MC, Hakkaart L. Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ. 2006;15:1229–36.
McCrone P, Patel A, Knapp M, Schene A, Koeter M, Amaddeo F, et al. A comparison of SF-6D and EQ-5D utility scores in a study of patients with schizophrenia. J Ment Health Policy Econ. 2009;12:27–31.
Mulhern B, Mukuria C, Barkham M, Knapp M, Byford S, Soeteman D, et al. Using generic preference-based measures in mental health: psychometric validity of the EQ-5D and SF-6D. Br J Psychiatry. 2014;205:236–43.
Roick C, Heinrich S, Deister A, Zeichner D, Birker T, Heider D, et al. [The regional psychiatry budget: costs and effects of a new multisector financing model for psychiatric care]. Psychiatr Prax. 2008;35:279–85.
Dimdi. [ICD-10-GM 2005 - International Statistical Classification of Diseases and Related Health Problems- German Modification 10. Revision, Version 2005]. Köln: Deutscher Ärzte-Verlag; 2005.
Group EQ. EuroQol--a new facility for the measurement of health-related quality of life. The EuroQol Group Health Policy. 1990;16:199–208.
Dolan P, Gudex C, Kind P, Williams A. The time trade-off method: results from a general population study. Health Econ. 1996;5:141–54.
Greiner W, Claes C, Busschbach JJ, von der Schulenburg JM. Validating the EQ-5D with time trade off for the German population. Eur J Health Econ. 2005;6:124–30.
Brazier J, Green C, McCabe C, Stevens K. Use of visual analog scales in economic evaluation. Expert Rev Pharmacoecon Outcomes Res. 2003;3:293–302.
Brazier J, McCabe C. ‘Is there a case for using visual analogue scale valuations in CUA’ by Parkin and Devlin. A response: ‘yes there is a case, but what does it add to ordinal data?’. Health Econ. 2007;16:645–7. discussion 649–651.
Torrance GW, Feeny D, Furlong W. Visual analog scales: do they have a role in the measurement of preferences for health states? Med Decis Making. 2001;21:329–34.
Brazier J, Deverill M. A checklist for judging preference-based measures of health related quality of life: learning from psychometrics. Health Econ. 1999;8:41–51.
Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35:1095–108.
Trompenaars FJ, Masthoff ED, Van Heck GL, Hodiamont PP, De Vries J. Content validity, construct validity, and reliability of the WHOQOL-Bref in a population of Dutch adult psychiatric outpatients. Qual Life Res. 2005;14:151–60.
Mas-Exposito L, Amador-Campos JA, Gomez-Benito J, Lalucat-Jo L, Research Group on Severe Mental D. The World Health Organization Quality of Life Scale Brief Version: a validation study in patients with schizophrenia. Qual Life Res. 2011;20:1079–89.
Herrman H, Hawthorne G, Thomas R. Quality of life assessment in people living with psychosis. Soc Psychiatry Psychiatr Epidemiol. 2002;37:510–8.
Derogatis L. SCL-90-R: administration, scoring and procedures manual. Minneapolis (MN): National Computer Systems; 1994.
Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41:582–92.
Sloan JA, Cella D, Hays RD. Clinical significance of patient-reported questionnaire data: another step toward consensus. J Clin Epidemiol. 2005;58:1217–9.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. L. Erlbaum Associates: Hillsdale, N.J; 1988.
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53:459–68.
Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK. Responsiveness and minimal important differences for patient reported outcomes. Health Qual Life Outcomes. 2006;4:70.
Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12:349–62.
Norman GR, Wyrwich KW, Patrick DL. The mathematical relationship among different forms of responsiveness coefficients. Qual Life Res. 2007;16:815–22.
Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56:395–407.
Whynes DK, McCahon RA, Ravenscroft A, Hodgkinson V, Evley R, Hardman JG. Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Health. 2013;16:124–32.
Konnopka A, Gunther OH, Angermeyer MC, Konig HH. [Discriminative ability, construct validity and sensitivity to change of the EQ-5D quality of life questionnaire in paranoid schizophrenia]. Psychiatr Prax. 2006;33:330–6.
Terwee CB, Roorda LD, Dekker J, Bierma-Zeinstra SM, Peat G, Jordan KP, et al. Mind the MIC: large variation among populations and methods. J Clin Epidemiol. 2010;63:524–34.
de Vet HC, Terwee CB. The minimal detectable change should not replace the minimal important difference. J Clin Epidemiol. 2010;63:804–5. author reply 806.
Mulhern B, Rowen D, Brazier J, Smith S, Romeo R, Tait R, et al. Development of DEMQOL-U and DEMQOL-PROXY-U: generation of preference-based indices from DEMQOL and DEMQOL-PROXY for use in economic evaluation. Health Technol Assess. 2013;17:v–xv. 1–140.
König HH, Bernert S, Angermeyer MC. [Health Status of the German population: results of a representative survey using the EuroQol questionnaire]. Gesundheitswesen. 2005;67:173–82.
Attema AE, Edelaar-Peeters Y, Versteegh MM, Stolk EA. Time trade-off: one methodology, different methods. Eur J Health Econ. 2013;14 Suppl 1:S53–64.
This study was funded by the German Federal Ministry of Education and Research (grant number 01EH1101B).
The authors declare that they have no competing interests.
MS has made substantial contributions to conception, design, analysis, and interpretation of the data and wrote the manuscript. AK and HHK have made substantial contributions to design, analysis, and interpretation of the data and have been involved in drafting the manuscript. All authors read and approved the final manuscript.