Factor structure and reliability of Persian version of hospital anxiety and depression scale in patients with breast cancer survivors

Abstract

Introduction

Anxiety and depression are significant concerns in breast cancer patients, and it may remain for a long term after primary treatments. The hospital anxiety and depression scale (HADS) is widely used to measure depressive and anxiety symptoms in clinical practices. The purpose of this study was to assess the psychometric properties of the Persian version of this scale in Iranian breast cancer survivors.

Methods

A total of 305 patients with breast cancer, refered to Cancer Hospital in northen Iran and completed the primary treatments were enrolled in. All patients responded to a 14-item HADS. We performed confirmatory factor analysis (CFA) to examine the factor structure of HADS and the item-scale analysis in order to estimate the item reliability and consider the Cronbach’s alpha as a measure of internal consistency.

Results

With a threshold of ≥8, the prevalence of anxiety and depression symptoms (moderate/severe) was 78.9 and 66.9%, respectively. The Cronbach’s alpha coefficients for anxiety and depression were 0.81 and 0.78, respectively. The CFA confirmed the two-factor structure model for HADS, indicating a good fitting summary indexes (χ2/df = 2.83, NFI = 0.88, RFI = 0.82, IFI = 0.92, CFI = 0.92, and RMSEA = 0.078).

Conclusion

The CFA and item reliability analysis have indicated an excellent psychometric property of the Persian version of HADS to measure depressive and anxiety symptoms in breast cancer survivors. Thus, HADS is a useful screening tool to identify post-breast cancer anxiety and depressive disorders.

Introduction

Anxiety and depression are the most common psychological disorders in breast cancer patients [1,2,3,4]. Patients are usually concerned about the effectiveness of used treatments, side effects of chemo-radiotherapy and their body shape images because of mastectomy. The psychological distress may stay for a long term among survivors. Besides, the fear of recurrence may be a more significant trigger for imposing an increase in anxiety and depression in women [1]. Several scales have been adapted to measure these psychological factors in breast cancer patients [5, 6]. Among the developed scales, the hospital anxiety and depression scale (HADS) containing 14 items is the most popular one used widely in clinical practices of psychiatric therapy in cancer patients.

Culture influences the way humans think about the environment and the world [7]. Although there are explicit criteria to ascertain anxiety and depression, culture also influences people to experience anxiety and depression. For example, the eastern culture emphasizes strong support for the group rather than individuals, it may produce stressors that provoke loss of individual identities and self-esteem and thus leads to depression and anxiety [8]. One problem of the use of HADS is a specific cutpoint may not be valid with cross-culture. Thus, the difficulties are increasingly being identified in discrepancies of optimal cutoff and factor structures of HADS.

This scale has been originally developed and validated by Zigmond and Snaith [9]. Recently, the HADS has been translated into several languages worldwide [10,11,12,13,14,15]. The validity and reliability of the Persian version of HADS used in breast cancer patients have not been adequately established. Despit, a preliminary validation of the Persian version of this scale was accomplished by Montazeri et al. [15] that had reported acceptable in reliability and validity measures. However, to assess the construct validity of this scale, they did not perform further details in item-scale analysis for item reliability and confirmatory factor analysis.

There is a debate in the literature about the number of factors that contribute to the construction of this scale for psychological distress in patients with cancer and other comorbidities [16, 17]. In a few studies, it was offered as a uni-dimensional factor [18], many others suggested as two- dimensional factors [9, 10, 19] and the others suggested the tri-dimensional [20,21,22,23,24,25] even four-factor model [10]. To validate the Persian version of HDAS, it is advisable to apply the HDAS at other stages of the cancer treatment not only after the primary treatment but also at different times of the cancer treatment and for the long term. Since the construction of the factors and magnitude of loading coefficients for this scale depend on disease conditions and social-culture status. Thus, the aim of this study was to validate the underlying structure of the HADS using confirmatory factor analysis (CFA) and to assess its reliability through item-scale analysis in Iranian breast cancer survivors.

Methods and subjects

Study design and participants

Data of this cross-sectional study were obtained from an educational hospital for cancer therapy, Shahid Rajaii, in the region of the north of Iran. We described this study as a secondary data analysis study. A total of 305 patients who were breast cancer survivors and completed the primary treatments were enrolled in the study from 1st January until the end of July in 2017. This referral cancer hospital has a broad coverage of the catchment population in the north of Iran. The details of the sample selection and characteristics of the study population were described elsewhere [26]. In brief, the patients who attended in periodic examination clinic were enrolled in the study. The prospective mean age (SD) of patients was 49.5 (10.1) years and also the mean (SD) duration from diagnosis was 3.5 (2.7) years. The Institutional Ethical Review Board of Babol University of Medical Sciences approved the study protocol (IRB code: IR.MUBABOL.HRI.REC.1398.361)

Instrument and data collection

The HADS is a 14-item self-reported questionnaire that contains 7 items for anxiety and 7 items for depression [7, 8]. All items were rated on a 4-point Likert scale that shows how often patients suffer from anxiety and depressive disorders. Each item on the questionnaire is scored from 0 (not at all) to 3 (always), and this means that a person can score between 0 and 21 for either anxiety or depression. After transferring the score of reversed items in the uniform direction, in which the higher scores indicate a higher degree of anxiety and depression, the total score for each sub-scales of anxiety and depression can be ranged from 0 to 21, and thus; the total score is from 0 to 42. In the original scale, the score of 0–7, 8–15 and 16–21 indicate no/mild, moderate and severe depression/anxiety, respectively. Therefore, a cut-off point of 16 has been suggested for severe depression and anxiety as well. Additionally, in order to measure the quality of life (QoL) as a criterion of health outcome in breast cancer patients for assessment of HADS validity, the 30-item questionnaire, the European Organization for Research and Treatment of Cancer (EORT-C30) [27, 28] was simultaneously used in the current study. In the present study, a forward and backward translation of the HADS from English to Persian was done by two experts who were fluent in both English and Persian. The data collection was conducted in the waiting room at a periodical clinic with in-person interviews by trained nurses using HADS. Moreover, the demographic and clinical data were collected from all patients.

Data analysis

A confirmatory factor analysis (CFA) was conducted using structural equation modeling (SEM) with a maximum likelihood method to estimate the factor structure and correlations. Before performing the analysis, the scores of reversed items were transferred in a way that the higher score shows a higher degree of severity in anxiety and depression. The single- and two-factor model was used. The single factor model was applied at two steps. Step one, no covariance or correlation was considered between observed indicators (Model 1-A), and step two, the correlations were established in a conceptual testing model (Model 1-B) between some relevant observed indicators. In performing the two-factor model, a correlation structure between the same observed indicators as model 1-B and between two factors were assumed (Model 2). The unifying structure of single-factor and two-factor models was assessed using the summary of fitting indices as χ2/df < 5, CFI > 0.90, RMSEA< 0.08 as a good fit [29]. Besides, in the present study, the comparative measure of fit such as the Akaike information criterion (AIC) was used to compare the two hypothesized models and to assess which model would fit better with observed data. The lower value of AIC is an indicator of a better fit in comparative conditions [30].

Additionally, the item-scale analysis was performed, and the internal consistency of HADS was evaluated using Cronbach’s alpha. Inter-item correlation and corrected-item total correlation were used to further assess construct and convergent validity. In addition, the item scale means, scale variance and Cronbach’s alpha if item deleted were used for assessment of the stability of the scale. Furthermore, the evidence of convergent and divergent validity of the HADS was shown by the pattern of the correlation of corresponded items of anxiety and depression. The total score of QoL for each individual was transferred from 0 to 100 and lower score indicated poorer QoL. Then, the QoL score was categorized as ≤50% or higher. The criterion validity of HADS was performed through estimating the discriminant power of HADS score in predicting the poor QoL using ROC analysis. The area under the curve (AUC), 95% confidence interval (95% CI), optimal cut-points for a total score of the HADS and its subscales were determined in the present study. Meanwhile, in order to identify the content validity, the correlation of item score with total HADS score and its subscales including QoL score were assesed. The SPSS software version 18.0 and AMOS software version 24.0 were used and the p-value less than 0.05 was considered as significant level.

Results

Socio-demographic characteristics of the study participants

The prospective mean age (SD) of participants was 49.5 (10.1) years. Table 1 illustrates the demographic and clinical characteristics of breast cancer patients. About 40 (13.1%) of the patients were under 40 years, 39 (12.8%) were 60 years or older, and the rest were 40–59 years. Roughly, in half of the participants, the duration (time since diagnosis) was ≥3 years. The education level of half of the cases was at the primary level or illiterate and 11.5% was academic.

Table 1 Demographic and clinical characteristics of study sample

Clinical characteristics

With a threshold of ≥8, the prevalence of anxiety and depression symptoms (moderate/severe) was and 78.9 and 66.9%, respectively. The majority of patients had an average level (total score 8–15) of anxiety (67.3%) and depression (62.9%), and the prevalence of high degree (total score ≥ 16) of anxiety and depression was 11.6 and 4.0%, respectively. The QoL of 83 (28.0%) of the participants was lower than 50% of the scale used (Table 1).

Item-reliability analysis and reliability coefficient

In scale analysis, the reliability coefficients measured based on Cronbach’s alpha were 0.81 and 0.78 for anxiety and depression subscales, respectively. Table 2 demonstrates the mean (SD) scores of the items, scale means and scale variance if item deleted. Furthermore, the corrected item-total correlation and Cronbach’s alpha were estimated if item deleted according to anxiety and depression in scale analysis. The mean score of 4 items on anxiety was above the expected average of the scale (i.e. 1.5), while the mean score of items on depression was almost below the expected average. The mean scale for both factors had no significant change if item deleted. The corrected item-total correlations were rather low for item four (A4) in anxiety scale and for item four (D4) in depression scale. However, for both scales, the Cronbach’s alpha did not change sharply if item deleted, which indicates unifying the reliability of items in anxiety and depression scales. Meanwhile, the mean of the total score (SD) for anxiety and depression was 10.74 ± 4.17 and 8.93 ± 4.11, respectively.

Table 2 Item statistics and item –total statistics in scale analysis according to anxiety and depression scale

Construct validity and factor structure

Figures 1 and 2 present the standardized loading factor coefficients of the single and two-factor models respectively. All loading coefficients were significant for both factor models (p = 0.001). In a single factor model, the greatest loading coefficient (beta = 0.81) was for item A6 and the lowest one (beta = 0.18) was for A4. Nevertheless, for the two-factor model, in the subscale of anxiety, the greatest impact of loading coefficient (beta = 0.82) was observed in 6th item (A6) and the lowest one (beta = 0.13) was for 4rth item. The item of D2 had the highest loading coefficient (beta = 0.86) for the depression factor. There was a significant correlation between the two factors of anxiety and depression (r = 0.37, p = 0.001). Table 3 represents that in comparison to single-factor models of 1-A and 1-B, the fitting criteria for model 1-B that conceived the correlations between some indicators (items) slightly improved. Additionally, both models of 1-A and 1-B as a single factor model had poor fitting performance, whearas the two-factor model with the establishment of the correlation structure between two factors and between some indicators indicated a good fitting summary index (NFI = 0.88, RFI = 0.82, IFI = 0.92, CFI = 0.92, RMSEA = 0.078, χ2/df = 2.83). Thus, the CFA confirmed the two-factor structure model for HADS.

Fig. 1

The structure of loading coefficients of a single factor model of the HADS and the correlations between some observed indicators (*p < 0.05; ***p < 0.001; the loading coefficients of all indicators were significant p < 0.001 and p < 0.01 for A4)

Fig. 2

The structural loading coefficients of anxiety and depression and the correlation between two constructs and between some observed variables in CFA of two-factor model (**p < 0.01, ***p < 0.001, and p < 0.001 for all loading coefficients)

Table 3 The summary fitting indexes of a single factor model and two factors model of the HADS

Concurrent and criterion validity

Table 4 displays the spearman inter correlations between HADS items. An interesting finding in Table 4 was the inter-correlations within each subscale of depression and anxiety, which was significantly higher than the correlations of items between two subscales. These results were an indication of the convergent and divergent validity of HADS. Besides, in the assessment of criterion validity, our results suggested that higher score of HADS had the discriminant power to predict the low QoL (AUC = 0.82, 95%CI: 0.77–0.87). The discriminant accuracy of anxiety and depression subscales of HADS for prediction of low QoL was AUC = 0.80 (95%CI: 0.75–0.86) and 0.72 (95%CI: 0.65–0.77) with a cut-off point of 10 and 11, respectively. Table 5 shows a significant correlation between item scores in the subscale of anxiety and depression with corresponded total scores in scales and a total score of HADS. The item score in each subscale had a high correlation with the total score of the corresponded subscales and a lower correlation with other subscales. Additionally, a negative correlation between total scores of anxiety and depression with the score of QoL had been observed.

Table 4 Spearman’s correlations between items of HADS

Table 5 The inter -correlation between item score with total scores of anxiety, depression, total HADS and QoL score

Discussion

The findings of the current study illustrated that the CFA confirmed the underlying structure of the two-factor model for the HADS. All related loading coefficients of observed indicators in the two-factor model were significant. All fitting indexes met the criteria for the goodness of fit for the two-factor model but not for a single factor model. Also, the scale item analysis revealed that the item-deleted reliability measures were ranged from 0.71 to 0.85, and a high-reliability coefficient of the overall score was observed for anxiety and depression. Several studies have explored the factor structure of the HADS in other languages [14, 16,17,18,19,20,21,22,23,24, 31]. Many researchers have support the two-factor structure [32,33,34], others have suggested a single factor model as a uni-dimensional measure of psychological distress [18] and some argue the three or four-factor structures for HADS [19,20,21,22]. These discrepancies of results in the literature are partially attributed to the exploratory factor analysis. Another explanation for the number of factors found in the structure of HADS may assign to the type of disease under investigation. Few studies were performed on CFA of HADS in cancer patients [10, 19], and many others were conducted on HADS in non-clinical settings or other chronic diseases [18,19,20,21,22,23,24,25]. Our findings regarding the factor structure of HADS are similar to those reported by Moorey et al. among cancer patients [19].

Based on current results, the total score of HADS and scores of its two subscales had an adequate discriminant power to predict the poor QoL in cancer patients. Moreover, it was explored that the cut points were 10 and 11 for subscales of anxiety and depression, respectively. The results also demostrated that a high item score correlated with the total score of HADS and the scores of its subscales, which is an indicator of concurrent validity. Meanwhile, different cut-off values for the HADS have been recommended in the literature [9, 10, 17, 35]. A meta-analysis explored the cut-off value of the total score of HADS, which varied from 10 to 15 depending on screening purposes (mental disorder or depressive disorder). In each subscale used, the threshold of 7 produced high sensitivity and specificity in four studies and the optimal threshold varied from 5 to 11 in different studies [17]. In another systematic review of a large number of studies, a cut-off point of 8 was offered for anxiety or depression [10]. In addition, in the original scale developed by Zigmond and Snaith, the cut-off point was 8 for depression and anxiety subscales [9]. In another study, a HADS total score of > 13 had sensitivities of 96% and specificities of 74% [35]. Nevertheless, the variation of cut-off values in different studies can be explained by the type of diseases and screening purposes as well as the objective definition of the used gold standard. One possible explanation for variations in the prevalence of psychological distress, especially anxiety and depression, is using different cut-off points in various studies. However, the ongoing study was not aimed to determine the optimal cut-off value for HADS because of the lack of implementation of the gold standard for assessment of psychological distress. Howsoever, in the present study, a proxy measure as self-reported QoL was established for evaluation of criterion validity.

Furthermore, we used the cut-point score of the original scale of 8 for moderate/severe psychological distress; the majority of our patients had mild depression and anxiety. In the current study, the prevalence of anxiety (moderate/severe) was higher than that of depression. Our findings in the prevalence of anxiety were in accordance with those reported by Montazeri et al. among Tehranian breast cancer women [36] while we found more moderate depression but the lower level of severe depression in comparison to Tehranian breast cancer. Additionally, a meta-analysis has demonstrated that the prevalence of depression was ranged from 14.0 to 95.9% and its pooled estimate was 46.8% among Iranian breast cancer patients [37]. Whereas the HADS identified 58.3% as depressed using the cutoff values of 8 among Italian cancer patients [38]. The differences may be attributed to variations in the clinical stage of the disease and/or socio-economic status and coping strategies used in psychotherapeutic management and cultural characteristics. The relatively high prevalence of moderate depression and anxiety in the current study highlights the need for psychological therapy of breast cancer patients along with standard treatment in the study region.

Based on the current study, the reliability coefficients of total score, measured based on Cronbach’s alpha were 0.81 and 0.78 for anxiety and depression, respectively. These reliability coefficients are similar to those reported in another study [15]. In our item-scale analysis, the scale means, scale variance and scale Cronbach’s alpha if item deleted had a negligible variation. This implies the necessity of all items for HADS. The corrected item-total correlation for the fourth item-- “I can sit at ease and feel relaxed”—in the subscale of depression was rather low. Perhaps, this might happen by error because the direction of the score of this item in terms of severity of anxiety was the opposite of other items in this subscale.

In terms of convergent and divergent validity, we used the correlation matrix of 14 items in HADS. The interesting findings of the current study were the correlation between items within subscales, which was higher than the items between the subscales. In other words, the items which measured the same characteristics were highly correlated, while the correlation of items that measure different constructs was lesser. This is an evidence of the convergent and divergent validity of the scale. Meanwhile, the findings of the ongoing study explored that the total score of HADS and its subscales for anxiety and depression had a good criterion validity in the prediction of QoL. However, the QoL as a proxy measure of criterion was used in the study to assess the criterion validity. We did not implement a gold standard for clinical measure, and our measure for evaluation of QoL was almost self-reported.

Limitations and direction for future research

In this study, since the HADS may depend on the conditions of patients and underlying characteristics of the population, the adequacy of the two-factor model in explanation of the loading structure of HADS among breast cancer patients may not always be generalized. It would also be relevant to validate this version of the HDAS in different types of disease conditions. Another limitation was that we did not apply clinically further valid measures to assess the concurrent validity usually evaluated by other valid measures that are clinically acceptable such as Beck’s depression scale [39] and/or other anxiety and depressive inventory. Besides, in the present study, the QoL was used as a subjective measure to identify the criterion validity of the HADS. Although this study indicated that the Persian version of HADS obtained good validity and reliability, other studies should be conducted to confirm these characteristics in other clinical settings with other types of cancer. Thus, further studies are required to evaluate the discriminant predictive power of this scale in comparison with standard clinical measures among cross-ethnic groups of Iranian cancer patients.

Conclusion

The two-factor model appeared to perform the best fit for the loading structure of HADS but not a single factor model, and our findings implied excellent psychometric properties of the Persian version of HADS in order to measure depressive and anxiety symptoms in breast cancer survivors. Thus, HADS is an effective screening tool to identify post-breast cancer anxiety and depressive disorders and to measure the impact of disease condition on depression and anxiety in Iranian breast cancer survivors.