Skip to main content
Download PDF
Download ePub

Assessment of the consequences of caregiving in psychosis: a psychometric comparison of the Zarit Burden Interview (ZBI) and the Involvement Evaluation Questionnaire (IEQ)

Health and Quality of Life Outcomes volume 15, Article number: 63 (2017) Cite this article

Abstract

Background

The Zarit Burden Interview (ZBI) was originally developed to assess the level of subjective burden in caregivers of people with dementia. The Involvement Evaluation Questionnaire (IEQ) is amongst the leading scales to assess caregiving consequences in severe mental illness. We aimed to compare the psychometric properties of the ZBI, a generic tool, and of the IEQ, a more specific tool to assess the consequences of caregiving in schizophrenia and related disorders.

Methods

Secondary analyses of a 16-week, randomized controlled trial of a psychoeducational intervention in 223 primary caregivers of patients with schizophrenia or schizoaffective disorder. Psychometric properties (internal consistency, convergent and discriminative validity, and sensitivity to change) were evaluated for both ZBI and IEQ.

Results

Internal consistency was good and similar for both scales (ZBI: 0.91, 95% CI: 0.89, 0.94; IEQ: 0.86, 95% CI: 0.83, 0.89). Convergent validity was relevant for similar domains (e.g. ZBI total score vs IEQ-tension r = 0.69, 95% CI: 0.61, 0.75) and at least moderate for the rest of domains (ZBI total score, personal strain and role strain vs IEQ-urging and supervision). Discriminative validity against psychological distress and depressive symptoms was good (Area Under the Curve [AUC]: 0.77, 95% CI: 0.71, 0.83; and 0.69, 95% CI: 0.63, 0.78 – for ZBI against GHQ-28 and CES-D respectively; and AUC: 0.72, 95% CI: 0.65, 0.78; and 0.69, 95% CI: 0.62, 0.77 – for IEQ against GHQ-28 and CES-D respectively). AUCs against the reference criteria did not differ significantly between the two scales. After the intervention, both scales showed a significant decrease at endpoint (p-values < 0.001) with similar standardised effect sizes for change (-0.36, 95% CI: -0.58, -0.15 – for ZBI; -0.39, 95% CI: -0.60, -0.18 – for IEQ).

Conclusions

Both ZBI and IEQ have shown satisfactory psychometric properties to assess caregiver burden in this sample. We provided further evidence on the performance of the ZBI as a general measure of subjective burden.

Trial registration

(ISRCTN32545295).

Background

Schizophrenia is a common and often devastating psychiatric disorder that affects around 0.3–0.7% of people at some point in their life [1]. A recent World Health Organization (WHO) report estimates about 21 millions of people affected by the disease worldwide [2]. Schizophrenia has a major impact on the patient, namely on their ability to carry on day-to-day activities, on the informal caregiver and the wider society [3].

Families constitute a main support for the patient, often providing economic maintenance, health assistance, and supervision of daily tasks [4]. Family caregivers of adults with schizophrenia spend an average of 6–9 h per day providing care and attention [5]. Even if caregiving can be a positive experience [6], it is most often associated with negative consequences, including physical and mental overload, which may be related to psychological morbidity (e.g. anxiety, depression) [7]. Negative consequences were described as “caregiver burden” more than half a century ago [8]. Given their impact on both caregivers and patients, the interest in understanding and managing caregiver burden has grown exponentially, not only in schizophrenia [9] but also in all other chronic health conditions [10].

Caregiver burden includes objective and subjective components [11]. Objective burden mostly concerns the tangible tasks caregivers usually perform to help the patient. Subjective burden mainly regards personal appraisals of objective burden, including emotional reactions to the caregiving experience [12].

The Zarit Burden Interview (ZBI) and the Involvement Evaluation Questionnaire (IEQ) are amongst the most reputable instruments to assess caregiving consequences, although their characteristics differ.

The ZBI was originally developed to assess the level of subjective burden in caregivers of people with dementia [13]. It has been extensively validated in caregivers of frail old people with neuropsychiatric disorders [14], having become a gold-standard in this field. Being arguably the most widely used measure of caregiver burden [15], it has also been used in schizophrenia research to describe the experiences of caregivers [16, 17] and to assess the efficacy of family psychosocial interventions [18–21]. However, most research with the ZBI in schizophrenia has been conducted in the Hispanic or non-Western world [17–26] and the validity and reliability of the ZBI in schizophrenia remains to be established [15, 27]. This led to the recent issue of the Schizophrenia Caregiver Questionnaire (SCQ), adapting the ZBI to this specific clinical context [15] and in different cultures [28, 29]. Overall, given its widespread - albeit sometimes unspecific - use across health conditions, the original ZBI has been considered a generic measure of burden [29–31].

The IEQ is amongst the leading scales to assess caregiving consequences in severe mental illness [32]. It was cross-culturally validated in Europe in the EPSILON study [33, 34], used in longitudinal observational research [35] and in very different cultures [35–40]. While also validated in affective [41] or eating disorders [42], it is mainly considered one of the standards for the evaluation of caregiving consequences in schizophrenia, together with the Family Problems Questionnaire [43] or the Experience of Caregiving Inventory [6]. Despite some contributions [44–46], sensitivity to change has been less explored.

To our knowledge, concurrent use of the original ZBI (as a generic burden measure) and IEQ (as a specific assessment of caregiving consequences and burden in severe mental illness, including schizophrenia) has never been reported in caregivers of psychotic patients.

In this study we aimed to evaluate and compare psychometric properties of the ZBI and the IEQ (reliability, validity, and sensitivity to change) in a large sample of caregivers of psychotic patients from two Southern European countries. By doing so, we were interested in further testing the usefulness of the ZBI as a generic burden measure, applicable to a range of clinical situations.

Methods

Research design and study population

This is a secondary analysis of data from the multicentre EDUCA-III study, a 16-week randomised controlled trial that assessed the efficacy of a group psychoeducational intervention on caregiver burden in schizophrenia (trial registration: ISRCTN32545295) [47].

The intervention consisted of a cognitive-behavioural program designed to improve primary caregivers’ education and skills regarding psychosis, aiming to promote stress management overall. The program was administered over 12 weekly group sessions, lasting 90–120 min each, as detailed elsewhere [47]. Throughout these sessions, caregivers received information about schizophrenia (clinical issues, treatment) and were trained in e.g., caregiving and communication skills, how to address challenging behaviours, the ability to look for and enjoy pleasant events, to seek social support, to use relaxation techniques. The program required active participation (e.g. role playing) and focused on problem-solving, helping caregivers to challenge negative beliefs through positive reframing, and to develop more adaptive caregiving styles. The intervention materials are freely available in Spanish (http://www.fundacion-iip.org/IIP/lineas-investigacion/sobrecarga-cuidador-educa-III.html).

Primary caregivers were eligible if they were (a) 18 years or older, (b) currently caring for a relative with a diagnosis of schizophrenia or schizoaffective disorder, (c) not paid and spending a minimum of 4 h/week caring for the patient. The patients (care receivers) should have been diagnosed at least 2 years before trial recruitment and receiving appropriate outpatient clinical care. Caregivers without time to attend the intervention, or currently receiving or having recently received any standardised psychoeducational intervention were excluded. A total of 223 caregivers were randomised to intervention or control condition, and assessed at baseline and at endpoint (~4 months since baseline). Regarding the present study, these 223 caregivers were all included in the analysable sample.

Rating scales

In order to meet the aims of this secondary analysis, we used the two main outcome measures of the EDUCA-III trial, i.e. those assessing caregiver consequences (ZBI and IEQ). To document their discriminative validity, two other EDUCA-III measures were also used as reference criteria to assess psychological distress (the General Health Questionnaire, 28 item version; GHQ-28) and depressive symptoms (the Center for Epidemiologic Studies Depression Scale; CES-D).

Zarit Burden Interview (ZBI)

The ZBI includes 22 items recorded in a 0–4 Likert scale (total score range 0 to 88). They refer to problems arising in several domains: health and well-being, personal and social life and finances. As the ZBI assesses the feelings/thoughts of informal caregivers on the impact of the disease on their lives, it is considered to focus on the subjective component of burden of care. Higher scores on the ZBI mean higher burden [13]. Besides its total score, which is used most often, personal strain (12 items) and role strain (6 items) domains have been proposed in dementia [48]. We used translations of the ZBI validated in Spain [49] and Portugal [50] in caregivers of people with dementia. In the present study, and although it is not a standard instruction, respondents were asked to focus on the previous 4 weeks to answer the items.

Involvement Evaluation Questionnaire (IEQ)

The IEQ includes a 31-item core module questionnaire recorded in a 0–4 Likert scale, assessing the frequency of a broad array of consequences of caregiving (e.g. feelings, cognitions, behaviours) within the previous 4 weeks. Besides its total score, the IEQ includes four subscales: worrying (6 items), urging (8 items), tension (9 items) and supervision (6 items). Tension refers to the strained interpersonal atmosphere between patient and relatives, supervision to the caregiving tasks of ensuring and guarding related to e.g. patient’s intake of medication or dangerous behaviours, worrying to painful cognitions and concerns about patient’s safety or future, and urging to issues related to activating and motivating the patient. Higher scores mean higher levels of caregiver consequences [34]. The IEQ was translated and validated in Spanish [34] and Portuguese [39].

General Health Questionnaire 28 items (GHQ-28)

The GHQ-28 includes 28 items. In the present study, items were scored according to the classical 0011 method, with a total score range of 0–28. Higher scores on the GHQ-28 mean higher levels of psychological distress [51]. There are validated versions for Spanish [52] and Portuguese [53] populations. The GHQ-28 can also be used in epidemiological studies as a screening for minor psychiatric morbidity caseness (clinically significant anxiety and/or depression). The 4/5 and 5/6 cut-off values are often used [51] and 4/5 is the modal value according to the GHQ Manual, but higher values have been reported [54, 55]. However, evidence of cut-off validity varies across populations. In Spain, 5/6 and 6/7 were proposed [52], while no cut-off validation studies have been conducted in Portugal.

Center for Epidemiologic Studies Depression Scale (CES-D)

The CES-D is a 20-item questionnaire that assesses depressive feelings and related behaviours during the past week. Items are rated on a 0–3 Likert scale, giving a total range from 0 to 60. Higher scores on the CES-D mean higher levels of depressive symptoms [56]. There are Spanish [57] and Portuguese Versions of CES-D [58]. Adopting a 15/16 cut-off, the CES-D has also been used as a screening tool for depression, with good sensitivity and specificity, and high internal consistency across age ranges [59]. This approach seems less contentious than the use of specific GHQ cut-offs.

Statistical analysis

Means and SDs describe continuous variables. Frequencies and percentages describe categorical variables.

Reliability

Internal consistency of the burden scales was evaluated for the whole sample of caregivers at baseline by Cronbach’s coefficient α. A value ≥ 0.80 was considered the minimum level to attain [60].

Convergent validity

Convergent validity between the ZBI (total and domain scores) and the IEQ (total and subscale scores) was calculated for the whole sample of caregivers at baseline with the Pearson correlation coefficient, after checking linear association.

Discriminative validity: receiver operator characteristic (ROC) and area under the curve (AUC) analyses

We used ROC and AUC analyses [61] in the whole sample of caregivers at baseline to assess the ability of both burden scales to discriminate among levels of psychological distress, as reported by the GHQ-28 according to a range of possible cut-off values [62], and CES-D (reference cut-off values 15/16) [56]. The ROC curve plots the sensibility and specificity of the burden scales for every possible cut-off point against the reference criterion (in our case the GHQ-28 and CES-D scales) and gives the AUC as a summary performance index. The AUC is interpreted as the probability to correctly discriminate among subjects categorized by the cut-off values of the reference scales (GHQ-28 and CES-D). A value of 0.5 for the AUC implies that discrimination is not improved beyond chance (flipping a coin) whereas a value of 1 implies a perfect discrimination. We used the following AUC values to interpret the discriminative validity: [0.50, 0.60), bad test; [0.60, 0.75), ordinary or regular test; [0.75, 0.90), good test; [0.90, 0.97), very good test; [0.97, 1.00], excellent test. AUC values for both burden scales were compared with DeLong’s test [63].

Sensitivity to change or responsiveness

It was assessed by the ZBI and IEQ score changes for the intervention group between baseline and endpoint scores (~ 4 months). We used the within-group standardised effect size [64] that takes into account the non-independent difference between the baseline and endpoint scores.

All analyses were performed with Stata v14 (StataCorp, College Station, TX, 2015) and/or R 3.2.3 (R Foundation for Statistical Computing, Vienna, Austria, 2015) with the library pROC [65].

Results

Sample description

The EDUCA-III trial recruited 223 caregivers (109 randomised to intervention and 114 to control) from 23 research sites under the aegis of Sisters Hospitallers, in Spain and Portugal. Caregivers were predominantly women (76%), married (62%), with a mean age of 60 years (SD = 11). They presented a mean caregiving exposure of 15 years (SD = 10), and a mean caregiving load of 5 h per week (SD = 1). The corresponding patients (care receivers) presented a diagnosis of schizophrenia (86%), or schizoaffective disorder (14%). A detailed sample description can be found elsewhere [47].

Reliability

The internal consistency (Cronbach’s alpha) for the ZBI (n = 223) was 0.91 (95% confidence interval [CI]: 0.89, 0.94), whereas for the IEQ (n = 223) it was 0.86 (95% CI: 0.83, 0.89). Both values were above the minimum level established (0.80).

Cronbach’s alphas for ZBI subscales were 0.84 (95% CI: 0.81, 0.87) for personal strain and 0.86 (95% CI:0.83, 0.89) for role strain. Reliability for the IEQ subscales was 0.71 (95% CI:0.66, 0.77) for tension, 0.77 (95% CI:0.73, 0.82) for supervision, 0.77 (95% CI:0.73, 0.82) for worrying and 0.72 (95% CI:0.67, 0.76) for urging.

Convergent validity

Table 1 shows the Pearson’s correlation coefficients between ZBI total score and IEQ total and subscale scores. All correlations are linear (Fig. 1) and present at least a moderate level (r ≥ 0.40; all p-values < 0.0001). The higher correlation (r = 0.69) was found between the ZBI and the tension subscale of the IEQ. Regarding correlations between the ZBI domains (personal and role strain), and IEQ total and subscale scores, the higher coefficient was found between ZBI personal strain and IEQ tension (r = 0.66; p < 0.0001).

Table 1 Pearson’s correlations between ZBI and IEQ scales
Full size table
Fig. 1
figure 1

Correlations between ZBI and IEQ scales

Full size image

Discriminative validity

Table 2 shows the ROC and AUC analyses of both ZBI and IEQ as compared to (i) a range of the GHQ-28 cut-off points (n = 222), and (ii) the CES-D at 15/16 cut-off point (n = 197). Figure 2 shows the ROC and AUC analyses of both ZBI and IEQ as compared against the GHQ-28 at the most usual 4/5 cut-off point (130 [59%] subjects presented a GHQ-28 score ≤ 4; 92 [41%] subjects presented a GHQ-28 score ≥ 5). The AUC for the ZBI was 0.77 (95% CI: 0.71, 0.83), whereas for the IEQ was 0.72 (95% CI: 0.65, 0.78). These AUCs did not differ significantly (p-value = 0.25).

Table 2 Receiver Operating Curve (ROC) analysis of the ZBI and IEQ against the GHQ-28 and CES-D
Full size table
Fig. 2
figure 2

ROC and AUC analyses of ZBI and IEQ compared against the GHQ-28 at 4/5 cut-off point

Full size image

ROC and AUC analyses (n = 197) of both ZBI and IEQ as compared against the CES-D at 15/16 cut-off point show that 115 (58%) subjects presented a CES-D score ≤ 15 and 82 (42%) subjects presented a CES-D score ≥ 16. The AUC for the ZBI was 0.69 (95% CI: 0.63, 0.78), whereas for the IEQ was 0.69 (95% CI: 0.62, 0.77). These AUCs did not differ significantly (p-value = 0.99).

Overall, both scales presented similar performance with values corresponding to a regular to good test when discriminating between levels of psychological distress (GHQ-28), or depressive symptoms (CES-D).

Sensitivity to change

Table 3 presents the results of the sensitivity to change (~ 4 months) in subjects randomly allocated to the intervention (n = 109). Both scales’ scores showed a significant decrease at endpoint (p-values < 0.001) presenting a similar and moderate standardized effect size for change (-0.36 for the ZBI, -0.39 for the IEQ).

Table 3 Sensitivity to clinical change at 4 months since baseline
Full size table

Discussion

Main findings

The main aim of this study was to evaluate and compare the psychometric properties of the ZBI and the IEQ in a large sample of caregivers of psychotic patients from Spain and Portugal. The EDUCA III intervention study was a golden opportunity to conjointly assess aspects of the performance of both measures, including sensitivity to change. We found good internal consistency for both scales. Correlations between ZBI and IEQ total scores were moderate, demonstrating adequate convergent validity. As expected, only to a certain degree did their results converge, especially regarding information from IEQ domains. We found higher values on correlations between ZBI and IEQ tension, and ZBI and IEQ worrying, both being ‘interpersonal’ IEQ domains and the most related to subjective burden. Noteworthy, correlations between ZBI and IEQ total scores, and between ZBI total score and IEQ tension were similar. According to Schene et al. [32], perhaps the integrated evaluation of caregivers tasks and problems is best represented by the tension domain. This is corroborated by the fact that the IEQ item on global burden (which reads similar to the ZBI one) contributes both to the IEQ total score and to the tension subscale [32].

The AUC analysis showed an appropriate ability of the ZBI and the IEQ to discriminate between levels of psychological distress. Finally, both scales proved to be valid and reliable tools overall to longitudinally evaluate the impact of psychosis in this sample of caregivers.

Sensitivity to change is one of the psychometric properties more difficult to document. In schizophrenia caregiving, even a robust measure such as the IEQ is no exception to this, albeit having been conceived to ensure adequate sensitivity to change [32]. The ZBI, could be expected to perform less well in psychoses at this regard: some ZBI items relate to issues as guilt or stigma, which are less prone to change over time [32], even by means of an effective family intervention. The choice of any caregiver outcome requires thoughtful consideration of the likely effects of the intervention [14], and this was our concern during the design of the EDUCA III trial. We could not exclude, at the beginning, that the ZBI would be more sensitive to some aspects of the intervention package (e.g. therapist and peer-related emotional support), whereas the IEQ could be more sensitive to others (e.g. behavioural changes). It may also be that the specification of a 4-week time frame for the ZBI, overcoming the lack of a specific recall period, contributed to a better performance of this measure regarding sensitivity to change.

Comparison with other studies using the ZBI in schizophrenia

While the ZBI has been used in schizophrenia caregiver related research in e.g. South American, Hispanic north-American, African, Eastern populations [17–26, 47, 66], only one study seemed to report internal consistency in the corresponding sample (Cronbach’s alpha = 0.89) [25]. Others reported some contributions to construct or factorial validity [23, 24], or evidence suggesting sensitivity to change [18–21, 26]. Overall, these studies tended to support the ZBI as a measure of subjective burden in schizophrenia, able to discriminate between levels of strain and to assess the efficacy of interventions designed to reduce caregiver burden, even lacking schizophrenia-specificity. Our results add to this line of research by further detailing some psychometric properties of the ZBI in the field of psychoses, in an unprecedented way.

The ZBI as a generic measure of subjective burden in a range of clinical context?

There were different reasons for our interest in testing the ZBI, which was never fully validated as a specific measure in psychosis caregiving, concurrently with the IEQ, a well-validated specific tool in the area. We had experience with the ZBI in dementia, in observational [50] and intervention [47, 67] studies, and with the IEQ in psychosis, in observational [68] and intervention research [45]. Realizing that the ZBI would not be enough as primary outcome measure in a trial of persons with psychosis, we decided to use it conjointly with the IEQ. We hypothesized that ZBI and IEQ grasped different facets of caregiving in schizophrenia and related disorders. Strictly speaking, these measures are not ‘psychological tests’; they cover constructs that are diffuse, and boundaries with each other and with other constructs may be less clear [34]. On the whole, the ZBI could be seen as a general approach to a wide array of caregiving situations, and most related to subjective burden issues. The IEQ stands as a more specific approach to caregiving consequences in schizophrenia and other severe mental illnesses, also encompassing objective burden components.

Besides its tentative previous use in schizophrenia, the ZBI is being used extensively in very different clinical contexts, including studies where different populations of caregivers are compared (e.g. chronic obstructive pulmonary disease, acquired brain injury, palliative care) [69, 70]. Therefore, further documenting ZBI’s psychometric properties in schizophrenia could help to bridge existing gaps in the design of comparison studies including schizophrenia caregivers. Despite that a specific measure will always be needed to fully evaluate caregiving consequences in a given field, the ZBI may perform well as a measure to be used across some conditions, provided its psychometric properties are documented. In sum, our findings allow for an elaboration on the ZBI as a generic burden measure, partly applicable to a range of clinical situations including schizophrenia and related disorders.

Strengths and limitations of the study

This study was a secondary analysis of the psychometric properties of two important caregiver measures (ZBI and IEQ) concurrently used in a large multicentre trial in two south-European countries. The ZBI had never been tested comprehensively in caregivers of people with psychosis neither in Spain nor Portugal. Moreover, this exploration had never been systematically conducted, as far as we are aware of, in the Anglo-Saxon world or elsewhere.

We did not replicate test-retest reliability studies for any of the two scales, as this would not be feasible in the context of the EDUCA III trial.

Research implications

At time of writing of our study, an adaptation of the original ZBI to specifically evaluate caregiver burden in psychoses was published [15]. This revised version (the SCQ) modifies some expressions, introduces a recall period, and incorporates new items about aspects related with caregiver burden. It presents face and content validity [15], and is now beginning to be tested in multicentre studies with promising results [28]. We acknowledge this step forward regarding the evaluation of specific caregiving consequences in schizophrenia.

However, even at the light of these developments, our results remain an important contribution to this field of research. The psychometric properties of the original ZBI were overall satisfactory in our EDUCA-III trial, as compared to a schizophrenia-specific and robust measure, i.e. the IEQ. This strongly supports the original ZBI as a valid option to complement more specific instruments, whenever the research aims call for including a measure with established validity in multiple clinical contexts, facilitating comparison studies across health conditions.

Conclusions

The ZBI and the IEQ are robust caregiver assessments, originally validated in different clinical fields (the former in dementia and frail old age populations, the latter in schizophrenia and severe mental illness in general). Both scales performed well regarding their psychometric properties (e.g. sensitivity to change) in this large sample of psychotic patients’ caregivers. As the ZBI has been increasingly used across health conditions, our study provides further evidence-base to the ZBI as a generic subjective burden measure. This may be helpful in comparison studies including caregivers of persons with psychosis

Abbreviations

AUC:

Area under the curve

CES-D:

Center for epidemiologic studies depression scale

CI:

Confidence interval

GHQ-28:

General Health Questionnaire 28 items

IEQ:

Involvement evaluation questionnaire

r:

Pearson’s correlation coefficient

SCQ:

Schizophrenia caregiver questionnaire

SD:

Standard deviation

WHO:

World Health Organization

ZBI:

Zarit burden interview

References

  1. van Os J, Kapur S. Schizophrenia. Lancet. 2009;374:635–45.

    Article  PubMed  Google Scholar 

  2. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382:1575–86.

    Article  PubMed  Google Scholar 

  3. Chong HY, Teoh SL, Wu DB, Kotirum S, Chiou CF, Chaiyakunapruk N. Global economic burden of schizophrenia: a systematic review. Neuropsychiatr Dis Treat. 2016;12:357–73.

    PubMed  PubMed Central  Google Scholar 

  4. Thornicroft G, Tansella M. The balanced care model: the case for both hospital- and community-based mental healthcare. Br J Psychiatry. 2013;202:246–8.

    Article  PubMed  Google Scholar 

  5. Knapp M, Mangalore R, Simon J. The global costs of schizophrenia. Schizophr Bull. 2004;30:279–93.

    Article  PubMed  Google Scholar 

  6. Szmukler GI, Burgess P, Herrman H, Benson A, Colusa S, Bloch S. Caring for relatives with serious mental illness: the development of the experience of caregiving inventory. Soc Psychiatry Psychiatr Epidemiol. 1996;31:137–48.

    Article  CAS  PubMed  Google Scholar 

  7. Gupta S, Isherwood G, Jones K, Van Impe K. Assessing health status in informal schizophrenia caregivers compared with health status in non-caregivers and caregivers of other conditions. BMC Psychiatry. 2015;15:162.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Grad J, Sainsbury P. Problems of caring for the mentally ill at home. Proc R Soc Med. 1966;59:20–3.

    CAS  PubMed  PubMed Central  Google Scholar 

  9. Gater A, Rofail D, Tolley C, Marshall C, Abetz-Webb L, Zarit SH, Berardo CG. “Sometimes it’s difficult to have a normal life”: results from a qualitative study exploring caregiver burden in schizophrenia. Schizophr Res Treatment. 2014;2014:368215.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Adelman RD, Tmanova LL, Delgado D, Dion S, Lachs MS. Caregiver burden: a clinical review. Jama. 2014;311:1052–60.

    Article  CAS  PubMed  Google Scholar 

  11. Hoenig J, Hamilton MW. The schizophrenic patient in the community and his effect on the household. Int J Soc Psychiatry. 1966;12:165–76.

    Article  CAS  PubMed  Google Scholar 

  12. Schene AH. Objective and subjective dimensions of family burden. Towards an integrative framework for research. Soc Psychiatry Psychiatr Epidemiol. 1990;25:289–97.

    Article  CAS  PubMed  Google Scholar 

  13. Zarit SH, Reever KE, Bach-Peterson J. Relatives of the impaired elderly: correlates of feelings of burden. Gerontologist. 1980;20:649–55.

    Article  CAS  PubMed  Google Scholar 

  14. Brodaty H. Meaning and measurement of caregiver outcomes. Int Psychogeriatr. 2007;19:363–81.

    Article  PubMed  Google Scholar 

  15. Gater A, Rofail D, Marshall C, Tolley C, Abetz-Webb L, Zarit SH, Berardo CG. Assessing the impact of caring for a person with Schizophrenia: development of the schizophrenia caregiver questionnaire. Patient. 2015;8:507–20.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Awad AG, Voruganti LN. The burden of schizophrenia on caregivers: a review. Pharmacoeconomics. 2008;26:149–62.

    Article  PubMed  Google Scholar 

  17. Caqueo-Urizar A, Gutierrez-Maldonado J, Ferrer-Garcia M, Darrigrande-Molina P. Burden of care in Aymara caregivers of patients with schizophrenia. Rev Psiquiatr Salud Ment. 2012;5:191–6.

    Article  PubMed  Google Scholar 

  18. Navidian A, Kermansaravi F, Rigi SN. The effectiveness of a group psycho-educational program on family caregiver burden of patients with mental disorders. BMC Res Notes. 2012;5:399.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Leal M, Sales R, Ibanez E, Giner J, Leal C. Evaluation of the effect of a psychoeducational program on the burden in informal caregivers of patients with schizophrenia. Actas Esp Psiquiatr. 2008;36:63–9.

    PubMed  Google Scholar 

  20. Ozkan B, Erdem E, Demirel Ozsoy S, Zararsiz G. Effect of psychoeducation and telepsychiatric follow up given to the caregiver of the schizophrenic patient on family burden, depression and expression of emotion. Pak J Med Sci. 2013;29:1122–7.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Gutierrez-Maldonado J, Caqueo-Urizar A. Effectiveness of a psycho-educational intervention for reducing burden in Latin American families of patients with schizophrenia. Qual Life Res. 2007;16:739–47.

    Article  PubMed  Google Scholar 

  22. Caqueo-Urizar A, Gutierrez-Maldonado J. Burden of care in families of patients with schizophrenia. Qual Life Res. 2006;15:719–24.

    Article  PubMed  Google Scholar 

  23. Adeosun II. Correlates of caregiver burden among family members of patients with schizophrenia in Lagos. Nigeria Schizophr Res Treatment. 2013;2013:353809.

    PubMed  Google Scholar 

  24. Caqueo-Urizar A, Gutierrez-Maldonado J, Ferrer-Garcia M, Morales AU, Fernandez-Davila P. Typology of schizophrenic symptoms and quality of life in patients and their main caregivers in northern Chile. Int J Soc Psychiatry. 2013;59:93–100.

    Article  PubMed  Google Scholar 

  25. Magana SM, Ramirez Garcia JI, Hernandez MG, Cortez R. Psychological distress among latino family caregivers of adults with schizophrenia: the roles of burden and stigma. Psychiatr Serv. 2007;58:378–84.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Tanriverdi D, Ekinci M. The effect psychoeducation intervention has on the caregiving burden of caregivers for schizophrenic patients in Turkey. Int J Nurs Pract. 2012;18:281–8.

    Article  PubMed  Google Scholar 

  27. Gonçalves-Pereira M, Zarit SH. The Zarit Burden interview in Portugal: validity and recommendations in dementia and palliative care. Acta Med Port. 2014;27:163–5.

    Article  PubMed  Google Scholar 

  28. Rofail D, Acquadro C, Izquierdo C, Regnault A, Zarit SH. Cross-cultural adaptation of the Schizophrenia Caregiver Questionnaire (SCQ) and the Caregiver Global Impression (CaGI) Scales in 11 languages. Health Qual Life Outcomes. 2015;13:76.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Rofail D, Regnault A, le Scouiller S, Lambert J, Zarit SH. Assessing the impact on caregivers of patients with schizophrenia: psychometric validation of the Schizophrenia Caregiver Questionnaire (SCQ). BMC Psychiatry. 2016;16:245.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Guevara AB, Demonet JF, Polejaeva E, Knutson KM, Wassermann EM, Grafman J, Krueger F. Association between traumatic brain injury-related brain lesions and long-term caregiver burden. J Head Trauma Rehabil. 2016;31:E48–58.

    Article  PubMed  Google Scholar 

  31. Kim HH, Kim SY, Kim JM, Kim SW, Shin IS, Shim HJ, Hwang JE, Chung IJ, Yoon JS. Influence of caregiver personality on the burden of family caregivers of terminally ill cancer patients. Palliat Support Care. 2016;14:5–12.

    Article  PubMed  Google Scholar 

  32. Schene AH, van Wijngaarden B, Koeter MW. Family caregiving in schizophrenia: domains and distress. Schizophr Bull. 1998;24:609–18.

    Article  CAS  PubMed  Google Scholar 

  33. van Wijngaarden B, Schene A, Koeter M, Becker T, Knapp M, Knudsen HC, Tansella M, Thornicroft G, Vazquez-Barquero JL, Lasalvia A, Leese M. People with schizophrenia in five countries: conceptual similarities and intercultural differences in family caregiving. Schizophr Bull. 2003;29:573–86.

    Article  PubMed  Google Scholar 

  34. van Wijngaarden B, Schene AH, Koeter M, Vazquez-Barquero JL, Knudsen HC, Lasalvia A, McCrone P. Caregiving in schizophrenia: development, internal consistency and reliability of the involvement evaluation questionnaire--European version. EPSILON study 4. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry Suppl. 2000;39:s21–7.

  35. Parabiaghi A, Lasalvia A, Bonetto C, Cristofalo D, Marrella G, Tansella M, Ruggeri M. Predictors of changes in caregiving burden in people with schizophrenia: a 3-year follow-up study in a community mental health service. Acta Psychiatr Scand Suppl. 2007;437:66–76.

  36. Alexander G, Bebee CE, Chen KM, Vignes RM, Dixon B, Escoffery R, Francis C, Francis D, Mendoza Z, Montano S, et al. Burden of caregivers of adult patients with schizophrenia in a predominantly African ancestry population. Qual Life Res. 2016;25:393–400.

    Article  PubMed  Google Scholar 

  37. Bernert S, Kilian R, Matschinger H, Mory C, Roick C, Angermeyer MC. The assessment of burden on relatives of mentally ill people: the German version of the involvement evaluation questionnaire (IEQ-EU). Psychiatr Prax. 2001;28 Suppl 2:S97–101.

    Article  PubMed  Google Scholar 

  38. Sefasi A, Crumlish N, Samalani P, Kinsella A, O'Callaghan E, Chilale H. A little knowledge: caregiver burden in schizophrenia in Malawi. Soc Psychiatry Psychiatr Epidemiol. 2008;43:160–4.

    Article  PubMed  Google Scholar 

  39. Gonçalves-Pereira M, van Wijngaarden B, Xavier M, Papoila AL, Caldas-de-Almeida JM, Schene AH. Caregiving in severe mental illness: the psychometric properties of the involvement evaluation questionnaire in Portugal. Ann Gen Psychiatry. 2012;11:8.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Tang VW, Leung SK, Lam LC. Clinical correlates of the caregiving experience for Chinese caregivers of patients with schizophrenia. Soc Psychiatry Psychiatr Epidemiol. 2008;43:720–6.

    Article  PubMed  Google Scholar 

  41. van Wijngaarden B, Schene AH, Koeter MW. Family caregiving in depression: impact on caregivers’ daily life, distress, and help seeking. J Affect Disord. 2004;81:211–22.

    Article  PubMed  Google Scholar 

  42. Martin J, Padierna A, van Wijngaarden B, Aguirre U, Anton A, Munoz P, Quintana JM. Caregivers consequences of care among patients with eating disorders, depression or schizophrenia. BMC Psychiatry. 2015;15:124.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Magliano L, Fadden G, Madianos M, de Almeida JM, Held T, Guarneri M, Marasco C, Tosini P, Maj M. Burden on the families of patients with schizophrenia: results of the BIOMED I study. Soc Psychiatry Psychiatr Epidemiol. 1998;33:405–12.

    Article  CAS  PubMed  Google Scholar 

  44. Stam H, Cuijpers P. Effects of family interventions on burden of relatives of psychiatric patients in The Netherlands: a pilot study. Community Ment Health J. 2001;37:179–87.

    Article  CAS  PubMed  Google Scholar 

  45. Pereira MG, Papoila A, Xavier M. S44-03 The FAPS study on severe mental illness: Views on the implementation of psychoeducational family work in Portuguese settings. Eur Psychiatry. 2009;24:S232.

  46. Schutzwohl M, Koch R, Kallert TW. On the efficacy of acute psychiatric day-care treatment in a one-year-follow-up. A comparison to inpatient treatment within a randomised controlled trial. Psychiatr Prax. 2007;34:34–7.

    Article  PubMed  Google Scholar 

  47. Martin-Carrasco M, Fernandez-Catalina P, Dominguez-Panchon AI, Gonçalves-Pereira M, Gonzalez-Fraile E, Munoz-Hermoso P, Ballesteros J. A randomized trial to assess the efficacy of a psychoeducational intervention on caregiver burden in schizophrenia. Eur Psychiatry. 2016;33:9–17.

    Article  CAS  PubMed  Google Scholar 

  48. Whitlatch CJ, Zarit SH, von Eye A. Efficacy of interventions with caregivers: a reanalysis. Gerontologist. 1991;31:9–14.

    Article  CAS  PubMed  Google Scholar 

  49. Martin-Carrasco M, Otermin P, Perez-Camo V, Pujol J, Aguera L, Martin MJ, Gobartt AL, Pons S, Balana M. EDUCA study: psychometric properties of the Spanish version of the Zarit caregiver burden scale. Aging Ment Health. 2010;14:705–11.

    Article  CAS  PubMed  Google Scholar 

  50. Gonçalves-Pereira M, Carmo I, da Silva JA, Papoila AL, Mateos R, Zarit SH. Caregiving experiences and knowledge about dementia in Portuguese clinical outpatient settings. Int Psychogeriatr. 2010;22:270–80.

    Article  PubMed  Google Scholar 

  51. Goldberg DP, Hillier VF. A scaled version of the General Health Questionnaire. Psychol Med. 1979;9:139–45.

    Article  CAS  PubMed  Google Scholar 

  52. Lobo A, Perez-Echeverria MJ, Artal J. Validity of the scaled version of the General Health Questionnaire (GHQ-28) in a Spanish population. Psychol Med. 1986;16:135–40.

    Article  CAS  PubMed  Google Scholar 

  53. Pais-Ribeiro JL, Antunes S. Contribution to the study of adaptation of the 28 items General Health Questionnaire (GHQ 28) into Portuguese. Revista Portuguesa de Psicossomatica. 2003;5:8.

    Google Scholar 

  54. Goldberg D, Williams P. A user’s guide to the General Health Questionnaire. 1991. NFER-Nelson.

    Google Scholar 

  55. Goldberg DP, Gater R, Sartorius N, Ustun TB, Piccinelli M, Gureje O, Rutter C. The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychol Med. 1997;27:191–7.

    Article  CAS  PubMed  Google Scholar 

  56. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385–401.

    Article  Google Scholar 

  57. Soler J, Perez-Sola V, Puigdemont D, Perez-Blanco J, Figueres M, Alvarez E. Validation study of the Center for Epidemiological Studies-Depression of a Spanish population of patients with affective disorders. Actas Luso Esp Neurol Psiquiatr Cienc Afines. 1997;25:243–9.

    CAS  PubMed  Google Scholar 

  58. Gonçalves B, Fagulha T. The Portuguese version of the Center for Epidemiologic Studies Depression Scale (CES-D). Eur J Psychol Assess. 2004;20:339–48.

    Article  Google Scholar 

  59. Lewinsohn PM, Seeley JR, Roberts RE, Allen NB. Center for Epidemiologic Studies Depression Scale (CES-D) as a screening instrument for depression among community-residing older adults. Psychol Aging. 1997;12:277–87.

    Article  CAS  PubMed  Google Scholar 

  60. Shrout PE. Measurement reliability and agreement in psychiatry. Stat Methods Med Res. 1998;7:301–17.

    Article  CAS  PubMed  Google Scholar 

  61. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.

    Article  CAS  PubMed  Google Scholar 

  62. Vieweg BW, Hedlund JL. The General Health Questionnaire (GHQ): a comprehensive review. J Operational Psychiatry. 1983;14:7.

    Google Scholar 

  63. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45.

    Article  CAS  PubMed  Google Scholar 

  64. Dunlap WP, Cortina JM, Vaslow JB, Burke M. Meta-analysis of experiments with matched groups or repeated measures designs. Psychol Methods. 1996;1:7.

    Article  Google Scholar 

  65. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Muller M. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics. 2011;12:77.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Durmaz H, Okanli A. Investigation of the effect of self-efficacy levels of caregiver family members of the individuals with schizophrenia on burden of care. Arch Psychiatr Nurs. 2014;28:290–4.

    Article  PubMed  Google Scholar 

  67. Martin-Carrasco M, Dominguez-Panchon AI, Gonzalez-Fraile E, Munoz-Hermoso P, Ballesteros J. Effectiveness of a psychoeducational intervention group program in the reduction of the burden experienced by caregivers of patients with dementia: the EDUCA-II randomized trial. Alzheimer Dis Assoc Disord. 2014;28:79–87.

    Article  PubMed  Google Scholar 

  68. Gonçalves-Pereira M, Xavier M, van Wijngaarden B, Papoila AL, Schene AH, Caldas-de-Almeida JM. Impact of psychosis on Portuguese caregivers: a cross-cultural exploration of burden, distress, positive aspects and clinical-functional correlates. Soc Psychiatry Psychiatr Epidemiol. 2013;48:325–35.

    Article  PubMed  Google Scholar 

  69. Harding R, Gao W, Jackson D, Pearson C, Murray J, Higginson IJ. Comparative analysis of informal caregiver burden in advanced cancer, dementia, and acquired brain injury. J Pain Symptom Manage. 2015;50:445–52.

    Article  PubMed  Google Scholar 

  70. Higginson IJ, Gao W, Jackson D, Murray J, Harding R. Short-form Zarit caregiver burden interviews were valid in advanced conditions. J Clin Epidemiol. 2010;63:535–42.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

BS was supported by the Post Doctoral Research Contract from the University of the Basque Country (UPV/EHU).

JB thanks the support of the Research Grant GIU 14/27 from the University of the Basque Country (UPV/EHU).

Funding

The study was entirely funded by a public research grant (FIS PI10/01049, Spain).

Availability of data and materials

Data are unsuitable for public deposition due to ethical and legal restrictions and are therefore available upon request with the signature of a data privacy form. To request the data, the readers may contact Prof. Eduardo González-Fraile (email: iip@fundacion-iip.org)

Authors’ contributions

MMC and MGP designed the study. ADP, PFC and PMH collected the data. JB and BSZ performed the statistical analysis. MGP, EGF, JB, and BSZ wrote the manuscript. MMC, ADP, PFC, and PMH, contributed to the discussion and reviewed and edited the manuscript. EGF is the guarantor of this work and as such, had full access to all of the data. EGF assumes responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The trial protocol was approved by appropriate Institutional Review Boards of Spain and Portugal (Ethical and Scientific Research Committees of Navarra, Spain; and Sisters Hospitallers, Portugal). All participants (caregivers and patients) signed an informed consent form prior to randomization and trial inclusion.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. CEDOC, NOVA Medical School/Faculdade de Ciências Médicas, Universidade Nova de Lisboa, Lisboa, Portugal

    Manuel Gonçalves-Pereira

  2. Clínica Psiquiátrica de S. José (Sisters Hospitallers), Lisboa, Portugal

    Manuel Gonçalves-Pereira

  3. Institute of Psychiatric Research (Sisters Hospitallers), Bilbao, Spain

    Eduardo González-Fraile & Manuel Martín-Carrasco

  4. Universidad Internacional de La Rioja, Logroño, Spain

    Eduardo González-Fraile

  5. University of the Basque Country, UPV/EHU, Leioa, Spain

    Borja Santos-Zorrozúa & Javier Ballesteros

  6. Padre Menni Psychiatric Clinic (Sisters Hospitallers), Pamplona, Spain

    Manuel Martín-Carrasco & Paula Muñoz-Hermoso

  7. CIBER Mental Health, Vitoria, Spain

    Manuel Martín-Carrasco

  8. Psychosocial Rehabilitation Resource (Sisters Hospitallers), Madrid, Spain

    Paola Fernández-Catalina

  9. Aita-Menni Hospital (Sisters Hospitallers), Arrasate-Mondragón, Spain

    Ana I. Domínguez-Panchón

  10. CIBER Mental Health, Leioa, Spain

    Javier Ballesteros

Authors
  1. Manuel Gonçalves-Pereira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eduardo González-Fraile
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Borja Santos-Zorrozúa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manuel Martín-Carrasco
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paola Fernández-Catalina
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ana I. Domínguez-Panchón
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Paula Muñoz-Hermoso
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Javier Ballesteros
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eduardo González-Fraile.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gonçalves-Pereira, M., González-Fraile, E., Santos-Zorrozúa, B. et al. Assessment of the consequences of caregiving in psychosis: a psychometric comparison of the Zarit Burden Interview (ZBI) and the Involvement Evaluation Questionnaire (IEQ). Health Qual Life Outcomes 15, 63 (2017). https://doi.org/10.1186/s12955-017-0626-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-017-0626-8

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us