- Research Article
- Open Access
Cross-cultural adaptation of the Schizophrenia Caregiver Questionnaire (SCQ) and the Caregiver Global Impression (CaGI) Scales in 11 languages
Health and Quality of Life Outcomesvolume 13, Article number: 76 (2015)
The Schizophrenia Caregiver Questionnaire (SCQ) was developed to provide a comprehensive view of caregivers’ subjective experiences of the impacts of caring for someone with schizophrenia. The Caregiver Global Impression (CaGI) scales were designed to assess their perception of the severity of the schizophrenia symptoms, of change in schizophrenia symptoms and in the experience of caring since the beginning of the study. The objectives of the study were to translate the SCQ and CaGI scales in 11 languages [French (Canada, France), English (Canada, UK, Australia), German (Germany), Italian (Italy), Spanish (Spain), Dutch (the Netherlands), Finnish (Finland), and Swedish (Sweden)], to present evidence that the translations capture the concepts of the original questionnaires and are well understood by caregivers of patients with schizophrenia in each target country.
The different language versions were developed using a standard or adjusted linguistic validation process fully complying with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recommended procedures.
Interviews were conducted with 55 caregivers of patients with schizophrenia from 10 countries representing the 11 different languages. Participants ranged in age from 28 to 84 years and had 5 to 16 years of education. Women represented 69.1 % (38/55) of the sample. Fourteen out of the 32 items of the SCQ generated difficulties which were mostly of semantic origin (13 items). The translation of the CaGI scales did not raise any major difficulty. Only five out of the 55 caregivers had difficulty understanding the meaning of the translations of “degree” in the expressions “degree of change in experience of caring” and “degree of change in symptoms”.
Translations of the SCQ and CaGI scales into 11 languages adequately captured the concepts in the original English versions of the questionnaires, thereby demonstrating the conceptual, semantic, and cultural equivalence of each translation.
Schizophrenia is a severe mental illness affecting 0.3-0.7 % of the population worldwide , characterized by three domains of psychopathology, including negative symptoms (social withdrawal, lack of motivation and emotional reactivity), positive symptoms (hallucinations, delusions) and cognitive deficits (working memory, attention executive function) . It is considered a leading cause of disability .
With the transition in care from formal hospital based healthcare systems to outpatient and community services and informal caregivers, it is estimated that 50-90 % of people with chronic psychiatric illness live with their families or friends [4, 5]. Informal caregivers (defined as “a person who has significant responsibility for managing the well-being of a person diagnosed with schizophrenia in an unpaid capacity” ) provide an important service by reducing the need for formal care and the burden upon healthcare systems .
The Schizophrenia Caregiver Questionnaire (SCQ) was developed to provide a comprehensive view of caregivers’ subjective experiences of the impacts of caring for someone with schizophrenia . It was adapted from the Zarit Burden Interview (ZBI)  in accordance with best practice recommendations for the development and modification of self-report measures . The ZBI was originally developed to measure subjective burden among caregivers of adults with dementia. Items were generated based on clinical experience with caregivers and prior studies resulting in a 22-item self-report inventory that examines burden associated with functional/behavioural impairments and the home care situation. Based on findings from the literature, review of the ZBI, expert opinion, and face-to-face, semi-structured interviews with 19 US English speaking caregivers , changes were made to address concerns regarding relevance and sensitivity of the ZBI in the population of caregivers of patients with schizophrenia. The main changes consisted in the rewording of some items, the development of eleven additional items focusing on issues important to caregivers, the deletion of one item (i.e., item 9 of the ZBI - Do you feel strained when you are around your relative?), and the addition of a recall period (i.e., the past four weeks). In addition, the 5-point Likert-type response scale was replaced by an 11-point numerical rating scale (0–10 NRS). This change was decided with the hope that this modified response scale would allow more subtle changes to be captured by the questionnaire. The version of the SCQ that underwent cultural adaptation was a 32-item version, which was also the one that underwent psychometric validation.
The final version of the SCQ (after psychometric validation) is composed of 30 items covering 9 domains including: humanistic impact, exhaustion with caregiving role, lack of support, patient dependence, worries for the patient, perception of the care provided, financial dependence of the patient, financial impact of caregiving, overall difficulty of caregiving role.
In addition, a series of Caregiver Global Impression (CaGI) scales were also developed. These were designed for completion by caregivers to assess their perception of the severity of the schizophrenia symptoms of the person they care for over the past four weeks [“Please rate the severity of his/her symptoms during the past 4 weeks” scored “no symptoms” (0) to “very severe symptoms” (5)]; change in the schizophrenia symptoms of the person they care for since the beginning of the study [“Overall, how have his/her symptoms changed (if at all) since the beginning of the study (before starting treatment)?” scored from “very much improved” (1) to “very much worse” (7)]; and change in the experience of caring since the beginning of the study [“Overall, how much have your experiences of caring for a person with schizophrenia changed (if at all) since the beginning of the study (before the person started treatment)?” scored from “very much improved” (1) to “very much worse” (7)].
As for other conditions, clinical research in schizophrenia has become global . In this context, outcome assessment has to be done in a multi-cultural framework; questionnaires need to be available in various languages to be included in multinational clinical trials and they need to appropriately capture the experience of individuals (patients or caregivers) with different linguistic and cultural backgrounds. Guidance for developing translations which are linguistically and culturally sound and respect the content validity of the original version has been developed by several organizations [13, 14]. In parallel, the Food and Drug Administration (FDA) requires that evidence about similarity of content validity and other measurement properties between the translated questionnaires and the original version be provided .
The objectives of the study were to prepare the SCQ and CaGI for use in a multicultural clinical research setting by conducting a proper translation of these instruments originally developed in US English in 11 languages, to present evidence that the translations capture the concepts of the original questionnaires and are well understood by caregivers of patients with schizophrenia in each target country. The translation of the SCQ was carried out on the instrument prior its psychometric validation (i.e., 32-item version).
Linguistic validation process
The instruments (SCQ and CaGI) were translated into languages that can be grouped into two “language families” (Indo-European and Uralic) based on their origins (Table 1).
The different language versions were developed using a standard or adjusted linguistic validation process fully complying with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recommended procedures . Fig. 1 illustrates the standard process. The conceptual analysis of the original questionnaires was performed with the developers of the original questionnaires in order to provide all translation teams with a document explaining the meaning of each item and suggesting terms to denote each concept. This was the basis for ensuring that all translations are harmonized between each other and faithful to the meaning of the original. Translations were developed by linguists through a process of dual forward translation (as per the ISPOR guidelines) and single back translation and reviews by a local team leader (linguist, psychologist or expert in survey research) and the project manager of the coordinating center who supervised all translations, in accordance with standards presented in Appendix A. The translations were then reviewed by a local clinician and tested via either telephone [French for Canada (n = 5); English for Canada (n = 5), Finnish (n = 2); Dutch (n = 1) and English for Australia (n = 1)] or face-to-face interviews of five caregivers of patients with schizophrenia living in the target countries. The convenience sample of 55 caregivers was recruited through the network of clinicians involved in the study. The interviews were conducted by the local team leader.
Language versions requiring the standard process were: French (Canada, France), German (Germany), Italian (Italy), Spanish (Spain), Dutch (the Netherlands), Finnish (Finland), and Swedish (Sweden).
For the adjusted process, the forward/backward step was replaced by an adaptation or localization step where an existing language version served as a basis for development of a separate local language version, e.g., US English version used as a basis to develop a UK English version. Language versions requiring an adjusted process were: English for Canada, UK, and Australia.
Participants of the interviews had to be native-speaking residents of the target countries and informal caregivers of patients with schizophrenia. Subject selection criteria for a sample of five participants per language were equal representation of gender, and representing people of mixed education (i.e., a minimum of two participants with less than 15 years of education).
In each country, caregivers were asked to complete the local language version of the SCQ and the CaGI, to indicate if they had any difficulties in understanding the instructions, the items, and response scales, and to paraphrase each sentence in the questionnaires or reformulate it with their own words. In each country, the interviewer carefully explored if the subjects had a clear understanding of the concept behind each item (Were they able to provide the meaning of each item?), and if not why (i.e., inaccurate translation or concept not culturally relevant?). The interviewer also checked the cultural relevance of the translation and asked for alternative wording if needed. For each instruction, item and response category, all difficulties and suggestions for changes, were gathered in a summary grid and analyzed to produce the final versions.
All issues encountered for each questionnaire (SCQ, CaGI scales) during the full process and decisions made to solve them were summarized and were categorized as follows: Cultural (C), Idiomatic/Pragmatics (I), Semantic (S) and Syntactic (Sy). Table 2 illustrates each category.
Interviews were conducted with 55 caregivers of patients with schizophrenia from 10 countries representing 11 different languages (see Table 1). The participants ranged in age from 28 to 84 years and had 5 to 16 years of education (Table 3). Caregivers were predominantly female (69 %), which is consistent with previous research in samples of caregivers of patients with schizophrenia [15–17].
Table 4 provides a summary of all difficulties that emerged during the translation process, in particular at the forward/backward translation steps and during the interviews. Fourteen out of the 32 items generated difficulties that raised discussions between the translators, the local team leader, and the central project manager. When an agreement could not be reached, the developer was consulted and gave the final decision. The difficulties were mostly of semantic origin (13 items). For instance, the meaning of “episode” (item 27) was found unclear or too technical by the caregivers and had to be qualified (i.e., psychotic, schizophrenic) or replaced by another word (i.e., crisis, relapse) to improve its clarity. The literal translation of “frustrated” (item 5) was not always possible and was replaced by the closest equivalent in the same semantic field. The only idiomatic expression present in the original version (i.e., “emotional rollercoaster” in item 31) was deleted in the languages of romance origin since it was not possible to find an idiomatic equivalent and the literal translation sounded too awkward (e.g., “montagne russe émotionnelle” in French).
The various types of changes that were required are summarized in Table 4.
The clinician review did not reveal any problematic issue before the test with the caregivers.
An overview of the comprehension rate, language by language and item by item, is provided in Table 5. The SCQ was globally well-understood by most of the respondents (overall = 98.86 %).
On the conceptual level, Anglophone caregivers in Canada argued about the relevance of item 26 (Over the past four weeks, how difficult was it to get him/her to take his/her medication?). They did not see the point of asking this question (“They assume it’s a difficulty? That doesn’t make sense. Not sure what this question is getting at”). Other caregivers in Finland and the Netherlands pointed out that item 26 was not relevant in case of injections. Interestingly, this item was deleted following the outcomes of the psychometric validation.
The translation of the CaGI scales in the 11 languages did not raise any major difficulty. Only five out of the 55 caregivers [one in Finland, four in Canada (two French, two English)] had difficulty understanding the meaning of the translations of “degree” in the expressions “degree of change in experience of caring” and “degree of change in symptoms”. Issues were resolved by either deleting “degree of” [English (Canada), Finnish], or using the word “evolution of” to replace “degree of change” [French (Canada)]. The term “evolution” was chosen for its neutral connotation implying either a worsening or an improvement. The overall comprehension rate of the CaGI scales was 99.17 %.
The results of the linguistic validation process indicate that the translations of the SCQ and the CaGI scales into 11 European languages adequately captured the concepts of the original English-language version of the questionnaires and were easily understood by caregivers of patients with schizophrenia. For each translation, it was important to utilize everyday language, yet remain true to the original meaning of the items. This involved focusing on semantics and required extensive discussion about the meaning of each concept and the adequate word to be chosen to convey it. This was accomplished through steady and continual discussion between the local team of translators, the local team leader, the central project manager and the developers of the original questionnaires. The initial conceptual analysis was crucial to obtaining translations harmonized with each other and faithful to the meaning of the original. The participation of caregivers of patients with schizophrenia greatly improved the initial translations, and provided input essential to the development of versions easily understood by the target population. In most cases, the solutions to each difficulty were decided collegially. Each decision was documented to enable further discussion at the time of the psychometric testing of the translations. The involvement of the caregivers in the development of the original version of the SCQ and its translations was essential. This is in the line with recent reviews which stress the need for tools with relevant content based on caregivers’ views [18, 19].
Cross-cultural equivalence is a critical factor/an essential component for instruments used in multi-cultural studies. Demonstrating cross-cultural equivalence entails investigating that the instrument measures the same concepts in a similar way across the different languages and cultures [20, 21]. It facilitates the pooling of data collected by the different languages versions of the instrument, and in the context of clinical trials, it optimizes the chance of demonstrating treatment benefit by improving the quality of measurement of the outcomes of interest . Applying proper linguistic validation methodology contributes to the achievement of cross-culturally equivalent versions of instruments by optimizing the different languages versions. In addition, this process can generate useful data to document cross-cultural equivalence. During the linguistic validation of the SCQ and CaGI scales in 11 languages, no major cultural issues emerged. This shows that the concepts that were identified in the development of the original US English version of the questionnaire were relevant to the caregivers in other countries, supporting the existence of an overall common experience of the caregivers of patients with schizophrenia in a range of countries. This finding is important, given the recognized importance of cultural aspects in schizophrenia .
We have identified several limitations to our research: first, the use of a convenience sample (not representative of the entire population of caregivers of patients with schizophrenia), and the use of telephone interviews for some languages [French for Canada (n = 5); English for Canada (n = 5), Finnish (n = 2); Dutch (n = 1) and English for Australia (n = 1)], which may have prevented the interviewer to capture all the subtleties of body language during the completion of the questionnaire, and finally the fact that this research was conducted in Western countries only. It would be of great interest to extend this cross-cultural research on the experience of caregivers of patients with schizophrenia in a wider spectrum of countries and cultures. A recent review has shown that sociocultural and ethnic characteristics play an important role in the perception of family caregivers’ burden . However, published research on cross-cultural perspectives in caring for someone with schizophrenia is still limited. A PubMed search with key words such as “schizophrenia,” “cross-cultural” and “caregiver” showed that publications in this area represent only 4 % (n = 38) of the papers published in schizophrenia and cross-cultural research (n = 942). Most of the studies operate within one continent [25–27] or within relatively similar cultural settings (i.e., Chinese-speaking countries) . Very few compare populations such as ethnic groups within one country [29, 30] or caregivers from very different geographical areas or levels of development . In a study comparing the health-related quality of life of French and Chilean caregivers, Boyer et al.  use a generic questionnaire (i.e., the SF-36) and show similar levels of health-related quality of life.
The availability in 11 European languages of disease-specific questionnaires such as the SCQ and the CaGI scales to assess the impact of caring for patients with schizophrenia is the first step to wider development and use in various cultural settings. International studies assessing differences of impact across cultures would be of great interest. They would enable cross-cultural comparisons, improve awareness, tracking, and management of impact on caregivers of patients with schizophrenia in different cultures, thus providing opportunity for increased support.
Translations of the Schizophrenia Caregiver Questionnaire and the Caregiver Global Impression scales into 11 languages adequately captured the concepts in the original English version of the questionnaires, thereby demonstrating the conceptual, semantic, and cultural equivalence of each translation.
After psychometric testing, the instruments will be available for use in clinical trials facilitating international comparison and pooling of data and will provide new insights into the area of caregiving of schizophrenia.
Caregiver Global Impression
Food and Drug Administration
International Society for Pharmacoeconomics and Outcomes Research
Schizophrenia Caregiver Questionnaire
Short Form (36) Health Survey
Zarit Burden Interview
van Os J, Kapur S. Schizophrenia. Lancet. 2009;374:635–45.
Tandon R, Nasrallah HA, Keshavan MS. Schizophrenia, just the facts 4. Clinical features and conceptualization. Schizophr Res. 2009;110:1–23.
Switaj P, Anczewska M, Chrostek A, Sabariego C, Cieza A, Bickenbach J, et al. Disability and schizophrenia: a systematic review of experienced psychosocial difficulties. BMC Psychiatry. 2012;12:193.
Rossler W, Salize HJ, Cucchiaro G, Reinhard I, Kernig C. Does the place of treatment influence the quality of life of schizophrenics? Acta Psychiatr Scand. 1999;100:142–8.
Honkonen T, Saarinen S, Salokangas RK. Deinstitutionalization and schizophrenia in Finland II: discharged patients and their psychosocial functioning. Schizophr Bull. 1999;25:543–51.
Nevada Revised Statutes (NRS) 453A.080. 2012 [http://definitions.uslegal.com/c/caregiver/ ]
Arno PS, Levine C, Memmott MM. The economic value of informal caregiving. Health Aff. 1999;18:182–8.
Adam Gater A, Rofail D, Marshall C, Abetz L, Zarit SH, Galani-Berardo C. Assessing the impact of caring for a person with schizophrenia: Development of the Schizophrenia Caregiver Questionnaire. Patient. 2015. doi:10.1007/s40271-015-0114-3.
Zarit SH, Reever KE, Bach-Peterson J. Relatives of the impaired elderly: correlates of feelings of burden. Gerontologist. 1980;20:649–55.
Food and Drug Administration. Patient-reported outcome measures: use in medical product development to support labeling claims. Fed Regist. 2009;74:65132–3. http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf.
Gater A, Rofail D, Tolley C, Marshall C, Abetz-Webb L, Zarit SH, et al. “Sometimes It’s Difficult to Have a Normal Life”: Results from a Qualitative Study Exploring Caregiver Burden in Schizophrenia. Schizophr Res Treat. 2014;2014:368215.
Hong J, Novick D, Brugnoli R, Karagianis J, Dossenbach M, Haro JM. Clinical consequences of switching from olanzapine to risperidone and vice versa in outpatients with schizophrenia: 36-month results from the Worldwide Schizophrenia Outpatients Health Outcomes (W-SOHO) study. BMC Psychiatry. 2012;12:218.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8:94–104.
Acquadro C, Conway K, Giroudet C, Mear I. Linguistic validation manual for health outcome assessments. Lyon: Mapi Institute; 2012.
Jungbauer J, Wittmund B, Dietrich S, Angermeyer MC. Subjective burden over 12 months in parents of patients with schizophrenia. Arch Psychiatr Nurs. 2003;17:126–34.
Roick C, Heider D, Bebbington PE, Angermeyer MC, Azorin JM, Brugha TS, et al. Burden on caregivers of people with schizophrenia: comparison between Germany and Britain. Br J Psychiatry. 2007;190:333–8.
Grandón P, Jenaro C, Lemos S. Primary caregivers of schizophrenia outpatients: burden and predictor variables. Psychiatry Res. 2008;158:335–43.
Zendjidjian XY. Challenges in measuring outcomes for caregivers of people with mental health problems. Dialogues Clin Neurosci. 2014;16:159–69.
Testart J, Richieri R, Caqueo-Urízar A, Lancon C, Auquier P, Boyer L. Quality of life and other outcome measures in caregivers of patients with schizophrenia. Expert Rev Pharmacoecon Outcomes Res. 2013;13:641–9.
Herdman M, Fox-Rushby J, Badia X. ‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res. 1997;6:237–47.
Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7:323–35.
Regnault A, Hamel JF, Patrick DL. Pooling of cross-cultural PRO data in multinational clinical trials: How much can poor measurement affect statistical power? Qual Life Res. 2015;24:273–7.
Murphy HBM. Culture and schizophrenia. In: Al-Issa I, editor. Culture and psychopathology. Baltimore: University Park Press; 1982. p. 221–49.
Caqueo-Urízar A, Miranda-Castillo C, Lemos Giráldez S, Lee Maturana SL, Ramírez Pérez M, Mascayano Tapia F. An updated review on burden on caregivers of schizophrenia patients. Psicothema. 2014;26:235–43.
van Wijngaarden B, Schene A, Koeter M, Becker T, Knapp M, Knudsen HC, et al. People with schizophrenia in five countries: conceptual similarities and intercultural differences in family caregiving. Schizophr Bull. 2003;29:573–86.
Talwar P, Matheiken ST. Caregivers in schizophrenia: A Cross Cultural Perspective. Indian J Psychol Med. 2010;32:29–33.
Gonçalves-Pereira M, Xavier M, van Wijngaarden B, Papoila AL, Schene AH, Caldas-de-Almeida JM. Impact of psychosis on Portuguese caregivers: a cross-cultural exploration of burden, distress, positive aspects and clinical-functional correlates. Soc Psychiatry Psychiatr Epidemiol. 2013;48:325–35.
Li D, Li SM, Tsang HW, Wong AH, Fung KM, Tsui MC, et al. Development and validation of perceived rehabilitation require questionnaires for caregivers of people with schizophrenia. Int J Psychiatry Clin Pract. 2013;17:264–72.
Lloyd H, Singh P, Merritt R, Shetty A, Yiend J, Singh S, et al. A comparison of levels of burden in Indian and white parents with a son or daughter with schizophrenia. Int J Soc Psychiatry. 2011;57:300–11.
Lloyd H, Singh P, Merritt R, Shetty A, Singh S, Burns T. Sources of parental burden in UK sample of first-generation North Indian Punjabi Sikhs and their white British counterparts. Int J Soc Psychiatry. 2013;59:147–56.
Boyer L, Caqueo-Urízar A, Richieri R, Lancon C, Gutiérrez-Maldonado J, Auquier P. Quality of life among caregivers of patients with schizophrenia: a cross-cultural comparison of Chilean and French families. BMC Fam Pract. 2012;13:42.
We are extremely grateful to the caregivers who have contributed to this study.
We would like to thank Carmen Berardo (formely Roche Pharmaceuticals, now Genentech Inc.) for her support and critique of the study.
The manuscript was financed by Roche Pharmaceuticals. DR is a full employee of Roche Pharmaceuticals. AR, CA and CI are consultants paid by Roche Pharmaceuticals. SHZ and Roche Pharmaceuticals share the copyright of the SCQ (original and translations). SHZ may obtain royalties from any use of the SCQ and translations.
DR conceived, designed the project and helped to draft the manuscript. CI coordinated the project and helped to draft the manuscript. CA and AR analyzed the data and drafted the manuscript. SHZ developed the original SCQ and reviewed the process of translation. All authors read and approved the final manuscript.
Appendix A. Translation procedures
Appendix A. Translation procedures
Two translators who are native speakers of the target language and are experienced in translating health questionnaires independently translate the document.
After both translations are complete, the local team leader compares the two translations and produces a third translation. If difficulties arise, discussions with both translators take place to reach agreement. This process of discussion and review is known as “reconciling” and the resulting third translation is referred to as the target language version #1.
The translation is then given to a native English-speaking translator for translation back into English. This document is referred to as the “back-translation.”
The local team leader and the project manager of the coordinating center (central project manager) compare the original English to the back-translation and either approve or question each item in the back-translation.
The central project manager discusses concerns with the local (in-country) team leader who may change the translation, change the back-translation, or leave the translation as it is, providing a justification to the central project manager.
This process is repeated until all translation issues have been resolved and the revised back-translation is approved. The resulting translation is the target language version #2 which will be reviewed by a clinician and tested with subjects (interviews).