Skip to main content

Advertisement

You are viewing the new article page. Let us know what you think. Return to old version

Research | Open | Published:

Reliability, validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with social phobia

Health and Quality of Life Outcomesvolume 11, Article number: 215 (2013) | Download Citation

Abstract

Objective

The aim of the study was to analyse the psychometric properties of the EQ-5D in patients with social phobia.

Methods

We used a sample of 445 patients with social phobia with five measurement points over a 30 month period. The discriminative ability of the EQ-5D was analysed by comparing the patients’ responses with the general population and between different disease severity levels. For test-retest reliability we assessed the level of agreement in patients’ responses over time, when there was no change in the Liebowitz Social Anxiety Scale (LSAS). Construct validity was analysed by identifying correlations of the EQ-5D with more specific instruments. For responsiveness we compared the means of EQ VAS/EQ-5D index anchored on improved (deteriorated) health status and computed effect sizes as well as a receiver operating characteristic (ROC) curve.

Results

Compared to the general population, patients with social phobia reported more problems in the dimensions “usual activities”, “pain/discomfort”, and “anxiety/depression” and less problems in “mobility” and “self-care”. The EQ-5D was able to distinguish between different disease severity levels. The test-retest reliability was moderate (intraclass correlation coefficient > 0.6). Correlations between the EQ-5D and other instruments were mostly small except for correlations with Beck Depression Inventory. The EQ-5D index seemed to be more responsive than the EQ VAS, but with only medium effect sizes (0.5 < effect size < 0.8) in the British EQ-5D index and only significant in patients with improved health status. The ROC analysis revealed no significant results.

Conclusions

The EQ-5D was moderately reliable and responsive in patients with improved health status. Construct validity was limited.

Trial registration

Current controlled trials ISRCTN53517394

Introduction

The EQ-5D is a generic, preference-based index score instrument to measure health related quality of life (HRQOL). The index score is used to compute quality-adjusted life years (QALYs) in cost-utility analysis. Due to scarce resources, economic evaluations are important tools for decision-making on health care resource allocation. Therefore, the instrument used to measure health effects should show good psychometric properties. The EQ-5D has demonstrated its psychometric properties in various diseases and disorders (e.g. inflammatory bowel disease [1], stroke patients [2], schizophrenic, schizotypal, and delusional disorders [3], anxiety disorders [4]). Although the EQ-5D has been used in patients with social phobia [5–8], no validation of the EQ-5D in this patient group has been conducted so far.

Social phobia (SP), also known as social anxiety disorder, is the second most frequent anxiety-mood disorder with a 12-month prevalence rate of 1.9% in Europe [9]. The main symptoms of SP patients are fear of being potentially embarrassed in social or performance situations as well as avoidance of such situations (ICD-10 [10], DSM-IV [11]). The fears may be associated with specific situations like public-speaking (“discrete” or “specific” SP) or with social interactions in general (“generalized” SP). SP has an early onset [12], tends to become chronic [13], and is often accompanied with other psychiatric disorders (such as bipolar disorder, substance abuse disorder, or personality disorder) [14].

The aim of this study was to test the psychometric properties of the EQ-5D in patients with SP. In particular, we analysed the discriminative ability (ability to discriminate between different health states of SP), the test-retest reliability (ability to repeat the similar results when the underlying construct is unchanged), the construct validity (ability to measure adequately the underlying construct), and the responsiveness of the EQ-5D (ability to detect changes given a change in the underlying construct).

Methods

Subjects and study design

This study is part of a multicenter randomized controlled trial comparing cognitive behavioural therapy and psychodynamic short therapy for SP (ISRCTN53517394). The trial is part of the Social Phobia Psychotherapy Research Network (SOPHO-NET) [15]. Design and results of the trial have been reported elsewhere [16].

Patients were recruited in five outpatient university clinics across Germany (Bochum, Dresden, Göttingen, Jena, and Mainz), from April 2007 until April 2009. The patient sample can be considered as clinically representative [16]. Inclusion criteria were: (I) diagnosis of SP according to the Structured Clinical Interview for DSM-IV [17] and a Liebowitz Social Anxiety Scale (LSAS) score higher than 30 points [18]; (II) age between 18 and 70; (III) SP being the primary diagnosis based on the severity disorder classification of the Anxiety Disorders Interview Schedule [19]. Exclusion criteria were: (I) psychotic and acute substance-related disorders; cluster A and B personality disorders; prominent risk of self-harm; (II) organic mental disorders; (III) severe medical conditions; (IV) concurrent psychotherapeutic or psychopharmacological treatment [16].

495 patients were randomized to one of the therapy groups (n = 416) or a waiting list group (n = 79). After treatments were completed in the therapy groups, waiting list patients were also randomized to one of the therapy groups and treated as well. Data were collected pre-treatment (T0, n = 495) and post-treatment (T1, n = 364), as well as 6 months (T2, n = 321), 12 months (T3, n = 262), and 24 months (T4, n = 183) after completed treatment (T1). The time interval between T0 and T1 was minimum 6 months but varied due to delays in administrative procedures, vacations, or illness of patients or therapists.

Due to missing data in EQ-5D questionnaires, we used a subsample of n = 445 (t0), n = 329 (t1), n = 288 (t2), n = 244 (t3) and n = 166 (t4) for our analyses.

Measures

EQ-5D

The EQ-5D contains three concepts of expressing HRQOL [20]: (I) The patient-reported “EQ-5D descriptive system” has five items, so called “dimensions” (“mobility”, “self-care”, “usual activities”, “pain/discomfort”, “anxiety/depression”). Each of them is recorded with an ordinal three level code (1: “no problems”, 2: “moderate problems”, 3: “severe problems”), resulting in 243 (35) possible health states. These can be expressed as 5-digit codes (e.g. “11233” refers to no problems in “mobility” and “self-care”, moderate problems in “usual activities”, and severe problems in “pain/discomfort” and “anxiety/depression”).

  1. (II)

    The 5-digit code can be transformed into a utility weight, the so called EQ-5D index. The EQ-5D index is based on a valuation of health states by the general population – indicating the preferences from the general population’s perspective. The EQ-5D index ranges to a maximum utility weight of 1 (full health). Death is valued with 0. The worst possible health state (“33333”) is -0.21 for the German EQ-5D index [21] and -0.59 for the British EQ-5D index [22], indicating health states valued worse than death. Both EQ-5D index scores were computed by regression analysis leading to a different valuation of the same health state. In our study we labelled the German EQ-5D index score “EQ-5D index-G” and the British EQ-5D index score “EQ-5D index-UK”. Although we analysed a German patient sample, we used both EQ-5D indexes (being aware of the limited comparability between both populations). The EQ-5D index-G was based on a small population sample (nGerman = 334 vs. nUK = 2997) and must thus be considered less precise for statistical reasons. The German EQ-5D index scores for all 243 EQ-5D health states were estimated from a sample of 36 health states using a regression model. In contrast to the British EQ-5D index, the German EQ-5D index is insensitive to a change from level 1 (“no problems”) to level 2 (“moderate problems”) in the dimension “anxiety/depression” due to omitted regression coefficients. Therefore, the EQ-5D index-G scores must be considered preliminary.

  2. (III)

    Patients are asked to rate their current health state on a visual analogue scale (EQ VAS) ranging from 0 (worst imaginable health state) to 100 (best imaginable health state). The EQ VAS represents the value of HRQOL from patients’ perspective.

Liebowitz social anxiety scale (LSAS)

The LSAS is a 24-item clinician-administered SP screening instrument, measuring anxiety and avoidance [23]. Both subscales (“LSAS avoidance score” and “LSAS anxiety score”) range from 0 to 72, leading to a total range of 0 to 144 (“LSAS total score”). LSAS total scores below 30 indicate remission of SP, scores between 30 and 59 indicate specific SP, and scores above 60 indicate generalised SP [18].

Social phobia and anxiety inventory (SPAI)

The SPAI is a self-reported SP screening instrument, measuring the disease severity level of SP [24]. The German version of SPAI contains 22 items [25]. Each item ranges from “never” (coded as 0) to “always” (coded as 6), leading to a 7 point Likert scale. The SPAI score as the mean of all 22 items ranges from 0 to 6 with an increasing severity level of SP.

Beck Depression Inventory (BDI)

The BDI is a screening instrument for depression [26]. Patients are asked to rate their feelings throughout the last week and today on 21 items. The items range from 0 to 3 with an increasing disease severity level and are added up to a total score ranging from 0 to 63.

Analysis

For statistical analysis, we collapsed “moderate problems” and “severe problems” of the EQ-5D descriptive system into one category “problems” (except for analysing discriminative ability related to the general population), because the number of patients indicating “severe problems” was small.

Discriminative ability reflects the ability of an instrument to discriminate between different health states [27]. We assumed that the EQ-5D discriminates between patients with SP and the general population and between different levels of disease severity in patients with SP. For the comparison with the general population, we used EQ-5D data from a representative survey (n = 3552) in Germany [28] adjusted for age and gender due to the young age in the patient sample. To distinguish between disease severity levels, we grouped patients into quartiles of the LSAS total score and its both subscales, and alternatively, into patients with specific SP (30 to 59 LSAS total score) and generalised SP (≥ 60 LSAS total score). We tested for significance by using χ2-test and Fisher’s exact test (EQ-5D descriptive system) and Mann-Whitney-U-test (EQ-5D index and EQ VAS).

Test-retest reliability reflects the ability of an instrument to produce similar results if the underlying construct has not changed [29, 30]. The LSAS total score was used as clinical anchor. We assumed that the score of both EQ-5D indexes and the EQ VAS stay constant if the change in LSAS total score stays within range of 0 ± 0.5 standard deviations (baseline) which has been recommended by [31, 32], corresponding to 11 LSAS total score points. Additionally, we split the “no change” group into patients with and without social phobia (< 30 LSAS total score points at both time points).

For the EQ-5D index scores and the EQ VAS score, we analysed test-retest reliability using the intraclass correlation coefficient (ICC) with a two way mixed model. We considered an ICC ≥ 0.7 as large [30].

Construct validity reflects how appropriately the instrument refers to the underlying construct [30]. We assumed that there is an association between the EQ-5D and instruments of psychopathology used as the underlying construct (LSAS total score, LSAS avoidance score, LSAS anxiety score, SPAI score, SPAI No. 22 score, and BDI score). Since both EQ-5D index scores and the EQ VAS score did not follow a normal distribution, we computed the non-parametric Spearman rank correlation coefficient (rs) for both EQ-5D index scores and the EQ VAS score. We defined a correlation as small for 0.1 ≤ |rs| < 0.3, moderate for 0.3 ≤ |rs| < 0.5, and large for |rs| ≥ 0.5 [33].

Responsiveness reflects the ability of an instrument to change, given a change in the underlying construct [30]. Again, the LSAS total score was used as clinical anchor. We assumed that both EQ-5D indexes and the EQ VAS score change over time if the LSAS total score has changed. We defined a relevant change as more than ± 0.5 standard deviations (baseline) which has been recommended by [31, 32], corresponding to 11 LSAS total score points. The responsiveness can be assessed in many different ways [34–38]. In our analysis we used the paired t-test statistics and computed the effect size (ES) to assess the association of change in both EQ-5D indexes and the EQ VAS with the change in the LSAS total score. According to Cohen, we defined scores of ES as trivial from ≥ |0.1| to < |0.2|, as small from ≥ |0.2| to < |0.5|, as medium from ≥ |0.5| to <|0.8|, and as large ≥ |0.8| [33]. Alternatively, we calculated the area under curve (AUC) of the receiver operating characteristic (ROC) curve. An AUC of 0.5 indicates that the instrument randomly detects the true change of patients’ health status. The closer the AUC equals 1.0 the more the instrument is able to detect the true change of patients’ health status [39, 40].

As we tested several hypotheses, a Bonferroni correction for the level of significance was computed. Six different instruments were used for analysing construct validity, leading to a corrected level of significance of α = 0.05/6 = 0.0083. Ten different chronological comparison-pairs were used for analysing reliability and responsiveness. Thus, the level of significance was defined as α = 0.05/10 = 0.005.

Statistical analyses were conducted using Statistical Package for the Social Sciences (version 18, SPSS Inc., Chicago, IL, USA).

Results

Patient characteristics

Patient characteristics at baseline are shown in Table 1. Mean age was 35.1 years (SD: 12.1). Most of the participants were female (55.5%), unmarried (67.6%), living with their spouse/partner (41.1%), and had finished the secondary school (68.5%).

Table 1 Patient characteristics at baseline (N = 445)
Full size table

EQ-5D scores

In the EQ-5D descriptive system, 81.8% of patients reported problems in at least one dimension. Specifically, 75.4% of patients reported at least moderate problems in the dimension “anxiety/depression”, followed by “pain/discomfort” (35.1%), “usual activities” (27.2%), and “mobility” (5.4%). In contrast, no patient reported problems in the dimension “self-care”. The health state 11112 was the most frequently reported health state (30.3%), indicating moderate problems in the dimension “anxiety/depression”, followed by 11111 (18.2%), and 11122 (16.0%). While the mean EQ-5D index-UK was 0.78 (SD: 0.18), the mean EQ-5D index-G was 0.92 (SD: 0.13). The mean EQ VAS score was 75.21 (SD: 16.8) (Table 2).

Table 2 Descriptive statistics of the EQ VAS score, the EQ-5D index-G, EQ-5D index-UK, and the comparators at baseline
Full size table

Scores of instruments of psychopathology

Mean LSAS total score was 72.2 (SD: 22.0), indicating marked SP (in detail see Table 2). Mean LSAS avoidance score was 32.8 (SD: 12.1) and LSAS anxiety score was 39.3 (SD: 10.9). The SPAI score displayed a mean of 4.1 (SD: 0.87), indicating moderate SP. Mean of SPAI No. 22 score was 3.2 (SD: 1.04), indicating moderate physiological reactions in social situations. The mean BDI score was 14.2 (SD: 9.1), indicating mild depression.

Discriminative ability

Compared to the general population, patients with SP reported significantly less problems in the EQ-5D dimensions “mobility” and “self-care” but significantly more problems in the EQ-5D dimensions “usual activities”, “pain/discomfort”, and “anxiety/depression” (p < 0.05, see Figure 1).

Figure 1
figure1

Comparison of EQ-5D dimensions between patient sample ( n = 445) and general population ( n = 3137). Data of the general population from [28]. Respondents of the general population were adjusted to age and gender. There were one missing value in “usual activities” (n = 444) and two missing values in “anxiety/depression” (n = 443) in patients with social phobia.

Full size image

With increasing disease severity level (according to LSAS-quartiles), the proportion of patients indicating problems continuously increased in the EQ-5D dimensions “usual activities” and “anxiety/depression”, and the EQ-5D index-UK and the EQ VAS score continuously decreased, respectively (Table 3). However, most of these differences were not significant except for the EQ-5D index-UK for which two of three pair-wise comparisons between LSAS quartiles were significant.

Table 3 Patients reporting problems in the EQ-5D dimensions (%) and mean EQ VAS score/EQ-5D index scores by disease severity at baseline
Full size table

The analysis of LSAS avoidance score and LSAS anxiety score showed similar patterns for the EQ-5D dimensions. However, we could not find any significant differences in the EQ-5D index scores and the EQ VAS except for both EQ-5D indexes between the third (LSAS anxiety score range from 38 to 47) and fourth quartile (above 48 LSAS anxiety score points) in the LSAS anxiety score (results not displayed).

When comparing patients with specific and generalised SP, patients with generalised SP reported significantly more problems in the EQ-5D dimensions “usual activities” and “anxiety/depression”, and had significantly lower EQ-5D index scores and EQ VAS score compared to patients with specific SP.

Test-retest reliability

Due to five measurements, we could test the test-retest reliability for 10 different chronologically paired comparisons. For patients with no health status change, the ICC of the EQ VAS score and of the EQ-5D index-G was mostly about 0.6, indicating moderate correlation (Table 4). The ICC of the EQ-5D index-UK was low regarding comparisons including baseline (t0), whereas the ICC was mostly large in all other chronological comparisons (ICC > 0.7). The EQ-5D index-UK showed slightly higher ICCs compared to the EQ-5D index-G. Thereby, the group of patients with SP had predominantly higher ICCs in comparison to the group of patients without SP.

Table 4 Reliability of the EQ VAS score and EQ-5D index scores anchored by no change of the LSAS total score
Full size table

Construct validity

Both EQ-5D indexes and the EQ VAS score were significantly correlated with the reference instruments, but the correlations were only small (|rs| ≤ 0.27; Table 5) aside from a moderate correlation with the BDI score (|rs| ≥ 0.44). Additionally, the SPAI score showed a slightly moderate correlation with both EQ-5D index scores (|rs| ≥ 0.31).

Table 5 Correlation between EQ VAS score, EQ-5D index scores, and scores of other instruments at baseline
Full size table

Responsiveness

For patients reporting an improvement in their health status on the LSAS total score, both EQ-5D indexes and the EQ VAS score showed significant effect sizes only for comparisons to baseline (t0). The effect sizes were mostly small (ES = 0.2 to 0.5; Table 6). The EQ-5D index-UK was the most responsive score (ES > 0.5). For patients with deterioration in their health status on the LSAS total score, we found no significant effect sizes at all (results not displayed).

Table 6 Responsiveness of EQ VAS score and EQ-5D index scores anchored by LSAS total score change
Full size table

In the ROC analysis, the area under curve was predominantly between 0.5 and 0.6, irrespective of the direction of change of patients’ health status (results not displayed). Furthermore, the area under curve in all time comparisons was not significantly different from the area under the diagonal.

Discussion

While the psychometric properties of the EQ-5D were analysed in many other diseases and disorders, this study was the first to test the psychometric properties in patients with SP.

The lack of precision of the German EQ-5D index in the dimension anxiety/depression, resulting from the small population sample used to derive the German EQ-5D index, strongly hampers its application in mentally ill patients. Therefore, we also used the British EQ-5D index although British health state preferences may be different from German preferences and may possibly bias our results.

Discriminative ability

The EQ-5D showed good discriminative ability between the general population and patients with SP. With respect to the EQ-5D dimensions “usual activity”, “pain/discomfort”, and “anxiety/depression”, patients with SP reported significantly more problems than the gender and age adjusted general population which can be attributed to the characteristics of SP such as the fear of social interactions. With respect to the EQ-5D dimensions “mobility” and “self-care”, patients with SP reported significantly less problems than the gender and age adjusted general population. Therefore, one may argue that these EQ-5D dimensions may not have a substantial effect on HRQOL in patients with SP. Problems in mobility may not refer to SP but rather to other co-morbidities.

As there are no validated cut-offs for the LSAS total score available, we used the following two definitions of cut-offs for the LSAS: firstly, we used quartiles, reflecting the severity of SP, secondly we distinguished between specific and generalized SP, reflecting two diagnostic categories.

Using quartiles, the EQ-5D indexes were only able to discriminate between the first and second quartile and between the third and fourth quartile of the LSAS total score scale, whereas the EQ VAS score was not able to significantly discriminate at all. The limited discriminative ability between the second and third quartile may be based on the fact that in second quartile there were patients with severe specific SP and patients with less severe generalised SP.

The EQ-5D was able to discriminate between patients with specific and generalized SP. These findings indicate that the EQ-5D can differentiate to some extent between patients with different disease severity levels of SP depending on the definition of cut-offs of the disease specific instrument.

The results indicated ceiling effects in both EQ-5D index scores and the EQ-VAS score. The ceiling effects result to some extent from the young study sample in which most of the patients had no problems in self-care and mobility. SP may be in general more related to the dimensions “anxiety/depression” and “usual activities” of the EQ-5D. However, the latter dimensions may not distinguish well between patients with mild SP. Thus, some patients tend to report no problems. Both reasons lead to an upward shift of the EQ-5D index scores.

Taken together, we conclude that there is limited evidence that the EQ-5D has discriminative ability in patients with SP.

Test-retest reliability

We found moderate to large ICCs of the EQ VAS score and EQ-5D index scores in most of the pairwise comparisons. Thereby, the EQ-5D index-UK showed slightly higher ICCs than both other scores. When comparing patients with and without SP, we found that patients with SP had higher ICCs compared to patients without SP. Thus, the EQ-5D seems to be reliable, in particular in patients with SP.

Construct validity

We identified only small negative Spearman rank correlation coefficients related to the EQ VAS score and the EQ-5D index scores, except for the BDI score and partly for the SPAI score, in which the correlation was moderate. One may argue that both the LSAS total score (and its sub-scores) and SPAI No. 22 score measure different aspects of HRQOL than the EQ-5D. The BDI score and the SPAI score cover some aspects of HRQOL measured by the EQ-5D, namely, the “anxiety/depression” dimension of the EQ-5D. Due to this discrepancy, we may explain this low construct validity of the EQ-5D.

Responsiveness

We found significant small to medium effect sizes of the EQ VAS score and the EQ-5D index scores in patients with an improved LSAS total score referring to the baseline. In other chronological comparisons we found no significant effect sizes. We assume that treatment effects mainly led to these different effect sizes. Due to therapy, patients improved their health status, leading to a decrease in the LSAS total score. These improvements in health status may be largest compared to baseline and may flatten over time. This indicates that the EQ VAS score and the EQ-5D index scores respond to improvements of health in patients with SP if the improvement is substantial. The EQ-5D may have problems to detect patients with deterioration in their health status, but in our study the sample of patients reporting worse health states was too small to draw any conclusions.

In the ROC analysis, we did not find any significant results. It is possible that the application of ROC curves may be limited in this study due to the small sample size of patients reporting a relevant change.

Psychometric properties of the EQ-5D in anxiety disorders

We found two articles assessing the psychometric properties of the EQ-5D in anxiety disorders. Lamers et al. [8] analysed discriminative ability and responsiveness of the EQ-5D in a sample of 616 patients with mood and/or anxiety disorders whereas König et al. [4] assessed construct validity and responsiveness in a sample of 389 patients with anxiety disorders.

Regarding the discriminative ability, in the study of Lamers et al. (2006) the EQ-5D index-UK was able to discriminate between different severity subgroups (anchored by the SCL-90 score) except for patients with very severe mood and/or anxiety disorders. In our study, the discriminative ability of the EQ-5D was good in patients with mild and very severe health states. The observed difference in the discriminative ability of the EQ-5D in both disorders may be due to the different properties of the clinical anchors used in the two studies.

Regarding the construct validity, in the study of König et al. (2010) the EQ-5D index-UK and EQ VAS showed large correlations with the BDI scores (rs = 0.59 and rs = 0.54), indicating good construct validity. In our study, the correlation between the BDI scores and the EQ-5D index-UK and EQ VAS, respectively, was similar (rs = 0.47 and rs = 0.44).

Regarding the responsiveness, in the study of Lamers et al. (2006) the responsiveness of the EQ-5D was small (standardised response mean: 0.47). In the study of König et al. (2008) the EQ-5D index-UK showed large effect sizes (0.99) and medium standardised response mean (0.54) in patients reporting worse health status, whereas ES and SRM of the EQ-5D index-UK and EQ VAS were trivial to small in patients with an improved health status. As both cited studies used different clinical anchors for a relevant change compared to our study, the comparability may be limited. Notwithstanding, the responsiveness of the EQ-5D seemed to be similar in patients with an improved health status.

Strengths and limitations

Our study was based on a large multicenter patient sample resulting in good statistical power. With five different measurements in time we could assess very well the reliability and the responsiveness of the EQ-5D.

However, our study has several limitations. First of all, we could only test the psychometric properties of the EQ-5D with disease specific instruments. Therefore, there may be some limitations in generalisation of our results. Notwithstanding, we could find overall at least moderate psychometric properties indicating that the EQ-5D may be a valid instrument to measure HRQOL of patients with SP. Another limitation of our study was that we had no validated instrument to assess the psychometric properties in the EQ-5D dimension “pain/discomfort”. Thus, we used only a not pain specific instrument (SPAI No. 22 score), indicating just small correlation coefficients in case of both EQ-5D indexes and the EQ VAS score.

Implications for further research

We suggest three further research topics: (i) The construct validity of the EQ-5D dimension “pain/discomfort” should be reanalysed with a validated instrument. (ii) The EQ-5D should be compared with other generic HRQOL instruments (e.g. SF-36). (iii) The responsiveness in patients with worsened health states should be analysed.

Conclusion

The EQ-5D seems to be a moderately valid instrument to measure HRQOL in patients with SP. In detail, our study showed a reasonable discriminative ability and reliability. The responsiveness was good as long as the improvement in patients’ health status was clinically substantial. In cases with patients reporting a worse health status, we could not find reasonable results due to small number of patients. Further studies should validate the EQ-5D with another instrument of HRQOL (e.g. SF-36) and for patients reporting a declined health status. Overall, the EQ-5D may be suitable for application in patients with SP.

Abbreviations

BDI:

Beck depression inventory

ES:

Effect size

HRQOL:

Health related quality of life

ICC:

Intraclass correlation coefficient

LSAS:

Liebowitz Social Anxiety Scale

QALYs:

Quality adjusted life years

SOPHO-NET:

Social phobia psychotherapy research network

SP:

Social phobia

SPAI:

Social phobia and anxiety inventory

SRM:

Standardised response mean.

References

  1. 1.

    Stark RG, Reitmeir P, Leidl R, Konig HH: Validity, reliability, and responsiveness of the EQ-5D in inflammatory bowel disease in Germany. Inflamm Bowel Dis 2010, 16: 42–51. 10.1002/ibd.20989

  2. 2.

    Hunger M, Sabariego C, Stollenwerk B, Cieza A, Leidl R: Validity, reliability and responsiveness of the EQ-5D in German stroke patients undergoing rehabilitation. Qual Life Res 2012, 21: 1205–1216. 10.1007/s11136-011-0024-3

  3. 3.

    König HH, Roick C, Angermeyer MC: Validity of the EQ-5D in assessing and valuing health status in patients with schizophrenic, schizotypal or delusional disorders. Eur Psychiatry 2007, 22: 177–187. 10.1016/j.eurpsy.2006.08.004

  4. 4.

    König HH, Born A, Günther O, Matschinger H, Heinrich S, Riedel-Heller SG, Angermeyer MC, Roick C: Validity and responsiveness of the EQ-5D in assessing and valuing health status in patients with anxiety disorders. Health Qual Life Outcomes 2010, 8: 47. 10.1186/1477-7525-8-47

  5. 5.

    Hedman E, Andersson E, Ljotsson B, Andersson G, Ruck C, Lindefors N: Cost-effectiveness of Internet-based cognitive behavior therapy vs. cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther 2011, 49: 729–736. 10.1016/j.brat.2011.07.009

  6. 6.

    Sherbourne CD, Sullivan G, Craske MG, Roy-Byrne P, Golinelli D, Rose RD, Chavira DA, Bystritsky A, Stein MB: Functioning and disability levels in primary care out-patients with one or more anxiety disorders. Psychol Med 2010, 40: 2059–2068. 10.1017/S0033291710000176

  7. 7.

    Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, Lonnqvist J: Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry 2007, 190: 326–332. 10.1192/bjp.bp.106.025106

  8. 8.

    Lamers LM, Bouwmans CA, van Straten A, Donker MC, Hakkaart L: Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ 2006, 15: 1229–1236. 10.1002/hec.1125

  9. 9.

    Olesen J, Gustavsson A, Svensson M, Wittchen HU, Jonsson B: The economic cost of brain disorders in Europe. Eur J Neurol 2012, 19: 155–162. 10.1111/j.1468-1331.2011.03590.x

  10. 10.

    Dimdi: ICD-10-GM 2005 - international statistical classification of diseases and related health problems- German modification 10: revision, version 2005. Köln: Deutscher Ärzte-Verlag; 2005.

  11. 11.

    American Psychiatric Association: Diagnostic and Statistical Manual of Mental Health Disorders. 4th edition. Washington DC: American Psychiatric Association; 2000.

  12. 12.

    Magee WJ, Eaton WW, Wittchen HU, McGonagle KA, Kessler RC: Agoraphobia, simple phobia, and social phobia in the National Comorbidity Survey. Arch Gen Psychiatry 1996, 53: 159–168. 10.1001/archpsyc.1996.01830020077009

  13. 13.

    DeWit DJ, Ogborne A, Offord DR, MacDonald K: Antecedents of the risk of recovery from DSM-III-R social phobia. Psychol Med 1999, 29: 569–582. 10.1017/S0033291799008399

  14. 14.

    Canton J, Scott KM, Glue P: Optimal treatment of social phobia: systematic review and meta-analysis. Neuropsychiatr Dis Treat 2012, 8: 203–215.

  15. 15.

    Leichsenring F, Hoyer J, Beutel M, Herpertz S, Hiller W, Irle E, Joraschky P, Konig HH, de Liz TM, Nolting B, et al.: The social phobia psychotherapy research network: the first multicenter randomized controlled trial of psychotherapy for social phobia: rationale, methods and patient characteristics. Psychother Psychosom 2009, 78: 35–41. 10.1159/000162299

  16. 16.

    Leichsenring F, Salzer S, Beutel ME, Herpertz S, Hiller W, Hoyer J, Huesing J, Joraschky P, Nolting B, Poehlmann K, et al.: Psychodynamic therapy and cognitive-behavioral therapy in social anxiety disorder: a multicenter randomized controlled trial. Am J Psychiatry 2013, 170: 759–767. 10.1176/appi.ajp.2013.12081125

  17. 17.

    Wittchen HU, Zaudig M, Fydrich T: Structured clinical interview for DSM-IV. Goettingen: Hogrefe; 1997.

  18. 18.

    Mennin DS, Fresco DM, Heimberg RG, Schneier FR, Davies SO, Liebowitz MR: Screening for social anxiety disorder in the clinical setting: using the Liebowitz social anxiety scale. J Anxiety Disord 2002, 16: 661–673. 10.1016/S0887-6185(02)00134-2

  19. 19.

    Brown PAD, David H: Barlow TA: Anxiety disorders interview schedule (ADIS-IV) for DSM-IV: includes clinician manual; ADIS-IV client interview schedule (lifetime version); ADIS-IV client interview schedule (adult version). Oxford: Oxford Univ. Press; 1994.

  20. 20.

    Group EQ: EuroQol–a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy 1990, 16: 199–208.

  21. 21.

    Greiner W, Claes C, Busschbach JJ, von der Schulenburg JM: Validating the EQ-5D with time trade off for the German population. Eur J Health Econ 2005, 6: 124–130. 10.1007/s10198-004-0264-z

  22. 22.

    Dolan P: Modeling valuations for EuroQol health states. Med Care 1997, 35: 1095–1108. 10.1097/00005650-199711000-00002

  23. 23.

    Liebowitz MR: Social phobia. Mod Probl Pharmacopsychiatry 1987, 22: 141–173.

  24. 24.

    Turner SM, Beidel DC, Dancu CV, Stanley MA: An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment 1989, 1: 35–40.

  25. 25.

    Fydrich T: SPAI - Social phobia and anxiety inventory. In Diagnostische Verfahren in der Psychotherapie. Edited by: Brähler E, Schumacher J, Straus B. Göttingen: Hogrefe; 2002.

  26. 26.

    Beck AT, Steer RA, Ball R, Ranieri W: Comparison of beck depression inventories -IA and -II in psychiatric outpatients. J Pers Assess 1996, 67: 588–597. 10.1207/s15327752jpa6703_13

  27. 27.

    Luo X, Cappelleri JC: A practical guide on incorporating and evaluating patient-reported outcomes in clinical trials. Clinical Research and Regulatory Affairs 2008, 25: 197–211. 10.1080/10601330802471162

  28. 28.

    König HH, Bernert S, Angermeyer MC: Health status of the German population: results of a representative survey using the EuroQol questionnaire. Gesundheitswesen 2005, 67: 173–182. 10.1055/s-2005-857991

  29. 29.

    Walters SJ: Quality of life outcomes in clinical trials and health-care evaluation: a practical guide to analysis and interpretation. Chichester: Wiley; 2009.

  30. 30.

    Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 4th edition. Oxford; New York: Oxford University Press; 2008.

  31. 31.

    Norman GR, Sloan JA, Wyrwich KW: Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003, 41: 582–592.

  32. 32.

    Sloan JA, Cella D, Hays RD: Clinical significance of patient-reported questionnaire data: another step toward consensus. J Clin Epidemiol 2005, 58: 1217–1219. 10.1016/j.jclinepi.2005.07.009

  33. 33.

    Cohen J: Statistical power analysis for the behavioral sciences. 2nd edition. Hillsdale, N.J: L. Erlbaum Associates; 1988.

  34. 34.

    Revicki DA, Cella D, Hays RD, Sloan JA, Lenderking WR, Aaronson NK: Responsiveness and minimal important differences for patient reported outcomes. Health Qual Life Outcomes 2006, 4: 70. 10.1186/1477-7525-4-70

  35. 35.

    Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM: On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res 2003, 12: 349–362. 10.1023/A:1023499322593

  36. 36.

    Whynes DK, McCahon RA, Ravenscroft A, Hodgkinson V, Evley R, Hardman JG: Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Health 2013, 16: 124–132. 10.1016/j.jval.2012.09.003

  37. 37.

    Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000, 53: 459–468. 10.1016/S0895-4356(99)00206-1

  38. 38.

    Lehman LA, Velozo CA: Ability to detect change in patient function: responsiveness designs and methods of calculation. J Hand Ther 2010, 23: 361–370. quiz 371 10.1016/j.jht.2010.05.003

  39. 39.

    Deyo RA, Centor RM: Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance. J Chronic Dis 1986, 39: 897–906. 10.1016/0021-9681(86)90038-X

  40. 40.

    Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 2006, 27: 861–874. 10.1016/j.patrec.2005.10.010

Download references

Funding/Support

This study was funded by the German Federal Ministry of Education and Research (grant number 01GV1002, 01GV0607, and 01EH1101B).

Author information

Affiliations

  1. Department of Health Economics and Health Services Research, Hamburg Center for Health Economics, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany

    • Michael Sonntag
    • , Alexander Konnopka
    •  & Hans-Helmut König

  2. Clinic of Psychosomatic Medicine and Psychotherapy, Justus-Liebig-University of Giessen, Friedrichstr. 33, 35392, Giessen, Germany

    • Falk Leichsenring

  3. Clinic of Psychosomatic Medicine and Psychotherapy, Georg-August-University of Göttingen, University Medicine, von-Siebold-Str. 5, 37075, Göttingen, Germany

    • Simone Salzer
    •  & Eric Leibing

  4. Clinic and Policlinic for Psychosomatic Medicine and Psychotherapy, University Medical Center, Johannes Gutenberg University Mainz, Langenbeckstraße 1, 55131, Mainz, Germany

    • Manfred E Beutel
    •  & Jörg Wiltink

  5. Department of Psychosomatic Medicine and Psychotherapy, LWL-University Clinic Bochum, Ruhr University Bochum, Alexandrinenstr 1-3, 44791, Bochum, Germany

    • Stephan Herpertz
    •  & Björn Nolting

  6. Department of Clinical Psychology and Psychotherapy, Johannes Gutenberg University Mainz, Wallstr 3, 55122, Mainz, Germany

    • Wolfgang Hiller

  7. Institute of Clinical Psychology and Psychotherapy, Technical University Dresden, Hohe Str. 53, 01187, Dresden, Germany

    • Jürgen Hoyer

  8. Clinic of Psychotherapy and Psychosomatic Medicine, Technical University Dresden, Fetscherstr. 74, 01307, Dresden, Germany

    • Peter Joraschky
    •  & Karin Pöhlmann

  9. Department of Clinical Psychology and Psychotherapy, Goethe University Frankfurt, Varrentrappstr. 40-42, 60486, Frankfurt am Main, Germany

    • Ulrich Stangier

  10. Institute of Psychosocial Medicine and Psychotherapy, Jena University Hospital, Stoystraße 3, 07740, Jena, Germany

    • Bernhard Strauss

  11. Department of Clinical psychology and psychotherapy, Ruhr-University Bochum, Universitätsstr. 150, 44780, Bochum, Germany

    • Ulrike Willutzki

Authors

  1. Search for Michael Sonntag in:

  2. Search for Alexander Konnopka in:

  3. Search for Falk Leichsenring in:

  4. Search for Simone Salzer in:

  5. Search for Manfred E Beutel in:

  6. Search for Stephan Herpertz in:

  7. Search for Wolfgang Hiller in:

  8. Search for Jürgen Hoyer in:

  9. Search for Peter Joraschky in:

  10. Search for Björn Nolting in:

  11. Search for Karin Pöhlmann in:

  12. Search for Ulrich Stangier in:

  13. Search for Bernhard Strauss in:

  14. Search for Ulrike Willutzki in:

  15. Search for Jörg Wiltink in:

  16. Search for Eric Leibing in:

  17. Search for Hans-Helmut König in:

Corresponding author

Correspondence to Michael Sonntag.

Additional information

Competing interest

The authors declare that they have no competing interests.

Authors’ contribution

MS has made substantial contributions to conception, design, analysis, and interpretation of the data and wrote the manuscript. AK and HHK have made substantial contributions to design, analysis, and interpretation of the data and have been involved in drafting the manuscript. FL, EL, SSa, MB, SH, WH, JH, PJ, BN, KP, US, BS, UW, and JW have made substantial contributions to design and acquisition of data and revised the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Authors’ original file for figure 1

Rights and permissions

Reprints and Permissions

About this article

Keywords

  • Social phobia
  • EQ-5D
  • Reliability
  • Validity
  • Responsiveness

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us