Research | Open | Published:
Translation and cultural adaptation of the CLEFT-Q for use in Colombia, Chile, and Spain
Health and Quality of Life Outcomesvolume 15, Article number: 228 (2017)
Cleft lip and/or palate (CL/P) is a common congenital craniofacial anomaly that may negatively affect an individual’s appearance, health-related quality of life, or speech. In Spain, Colombia, and Chile the overall prevalence of CL/P ranges from 0.53 to 1.59 cases per 1000 live births. Currently, there is no patient-reported outcome (PRO) instrument that is specific for patients with CL/P. The CLEFT-Q is a new PRO instrument developed to measure outcomes of treatment in patients 8 to 29 years of age with CL/P. The aim of this study was to translate and culturally adapt the CLEFT-Q for use in Colombia, Chile, and Spain.
The CLEFT-Q was translated from English to 3 Spanish language varieties (Colombian, Chilean, and Spanish (Spain)) and Catalan. Translation and cultural adaptation guidelines set forth by the International Society for Pharmacoeconomics and Outcomes Research were followed.
The field- test version of the CLEFT-Q consisted of 13 scales (total 154 items) measuring appearance, health-related quality of life, and facial function. Forward translations revealed 10 (7%) items that were difficult to translate into Chilean, and back translations identified 34 (22%) and 21 (13%) items whose meaning differed from the English version in at least 1 of the 3 Spanish varieties and Catalan respectively. Twenty-one participants took part in cognitive debriefing interviews. Participants were recruited from plastic surgery centres in Bogotá, Colombia (n = 4), Santiago, Chile (n = 7), and Barcelona, Spain (n = 10). Most participants were males (n = 14, 67%) and were diagnosed with CL/P (n = 17, 81%). Participants reported difficulty understanding 1 item in the Colombian, 1 item in the Spanish (Spain), and 11 items from the Catalan version. Comparison of the 3 Spanish varieties revealed 61 (40%) of the 154 items whose wording differed across the 3 Spanish versions.
Translation and cultural adaptation processes provided evidence of transferability of the CLEFT-Q scales into 3 Spanish varieties and Catalan, as semantic, idiomatic, experiential, and conceptual equivalence of the items, instructions, and response options were achieved.
Cleft lip and/or palate (CL/P) is a common craniofacial condition with a global annual prevalence of 7.94 cases per 10,000 live births . In Spain, Chile, and Colombia, the prevalence of CL/P has been reported between 0.53 to 1.59 cases per 1000 live births [2,3,4].
A diagnosis of CL/P may negatively impact one’s appearance, health-related quality of life (HRQOL), and/or speech . Treatment of CL/P often requires a multidisciplinary team of experts, who follow patients from birth through to adulthood . Patients with CL/P may undergo intensive treatment involving a combination of surgical and non-surgical procedures . Although the goal of treatment is to improve ones’ appearance, psychosocial function, and speech, the measurement of treatment outcomes have traditionally focused on objective clinician- or observer-reported assessments [8,9,10,11,12,13,14]. The inclusion of the patient perspective through the use of a specific patient-reported outcome (PRO) instrument for CL/P may increase our understanding of patient concerns, as PRO instruments enable the measurement of a patients’ health concerns .
Developing or adapting PRO instruments into Spanish requires careful consideration of the linguistic characteristics of each Spanish variety. Hudson (1996) defines language varieties as “a set of linguistic items with similar distribution” . Spanish has been classified as 3 distinct varieties for Spain including, Castilian, Andalusian, and Canary varieties; and 5 distinct varieties for Latin America including, Caribbean, Mexico-Central American, Andean, Rioplatense, and Chilean [17, 18]. Linguistic characteristics of the regional Spanish varieties are distinguished based on differences in phonology (how sounds are used), morphosyntax (the morphological and syntactic properties), and vocabulary . These linguistic features reveal the different categorizations and divisions of the cultural varieties . In a study by García-García et al. (2000), the authors aimed to develop a Spanish (Castillian) versions of the Child Health Assessment Questionnaire (cHAQ), a 30-item disease-specific questionnaire for children with juvenile idiopathic arthritis and other pediatric rheumatic diseases [19, 20]. As part of this study, the authors compared their final Spanish (Castillian) version to the Mexican and Costa Rican translations. Comparison of the Mexican and Spanish (Castillian) versions reveal 24 (80%) items that differed, while the Costa Rican version showed even more semantic differences in 90% of the items when compared to the Spanish (Castillian) . Only 1 question was identical when comparing the Costa Rican and Mexican versions of the questionnaire, with the remaining items indicating some differences . Findings from this study reveal that even among 2 neighboring countries (Mexico and Costa Rica), different adaptations of the cHAQ were needed to meet linguistic and socio-cultural demands, thus supporting the need to develop independent translations that address the linguistic characteristics of Spanish for each Spanish-speaking country or region .
In a 2009 report from the United States Food and Drug Administration (FDA) “Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims” the FDA recommended the provision of “...evidence that the content validity and other measurement properties are adequately similar between all [translated] versions...” . There is an increasing demand for PRO instruments that are available in multiple languages and can be used across different cultures . The CLEFT-Q is a new PRO instrument developed for patients with CL/P to measure the impact of surgery and treatment on ones’ appearance, speech, and HRQOL. To facilitate the involvement of hospitals located in Colombia, Chile, and Spain in an international field- test, a process was required to translate and culturally adapt the CLEFT-Q. Providing translations of the CLEFT-Q that are developed following rigorous methodologies to ensure conceptual and cultural equivalence may enable global benchmarking of outcomes for patients with CL/P who vary by language and culture. The aim of this study was to develop Colombian, Chilean, Spanish (Spain), and Catalan versions of the CLEFT-Q that are conceptually equivalent to the source language version yet are culturally and linguistically appropriate for use in the target country or culture. Translating the CLEFT-Q for use in these countries will facilitate the pooling and comparison of data and will enable assessment of the CLEFT-Q’s transferability, i.e. the degree to which the CLEFT-Q can be transferred to other contexts with other respondents [23, 24]. Best-practice guidelines set forth by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) for the translation and cultural adaptation of instruments were used .
This study was approved by the Research Ethics Board at the coordinating centre (Hamilton Integrated Research Ethics Board (HiREB)) and each of the following participating hospitals: Fundación Gantz Hospital del Niño con Fisura in Santiago, Chile; and Hospital Sant Joan de Déu in Barcelona, Spain. For Fundación Operación Sonrisa Colombia and Centro de Atención Multidisciplinaria Gilberto Mariño Contreras in Bogotá, Colombia, the CLEFT-Q study was performed in accordance with the laws set forth by the Ministry of Health Colombia (Resolucion N°008430 De 1993 (4 De Octubre De 1993)). CLEFT-Q study procedures conformed with policies for ethical conduct in research involving humans, and all participants and/or their legal guardians provided written informed consent or assent according to each center’s policy.
The CLEFT-Q is a self-report PRO instrument developed for patients with CL/P aged 8 to 29 years, to evaluate the impact of surgery and treatment on a patients’ appearance, speech, and HRQOL . The CLEFT-Q was developed according to guidelines of the United States Food and Drug Administration , the Scientific Advisory Committee of the Medical Outcomes Trust , and the International Society for Pharmacoeconomics and Outcomes Research . The initial development (Phase I) of the CLEFT-Q involved a literature review  followed by qualitative interviews with 138 patients from 6 countries . Results from the literature review was used to develop an initial CLEFT-Q conceptual framework that was refined from the qualitative data and used to inform the development of a set of scales . Revisions to the scales (items, instructions, and response options) were made using feedback from patients during a series of cognitive interviews as well as experts in the field of CL/P .
The field- test version of the CLEFT-Q comprised 154 items distributed across 3 domains and 13 concepts as follows: appearance of the face, nose, nostrils, teeth, lips, jaws, cleft scar; HRQOL, i.e., psychological, social, school, and speech-related distress; and facial function i.e., speaking and eating/drinking . The 7 appearance scales ask respondents to answer each item thinking of how their face (or specific area of their face) looks now and respondents are then asked to answer for each item “how much do you like…” using the following 4 response options: “Not at all”, “A little bit”, “Quite a bit”, “Very much” . The HRQOL and facial function scales ask respondents to answer each item in relation to the past week, and in terms of the following frequency response options: “Never”, “Sometimes”, “Often”, “Always” . Mean Flesch–Kincaid (F–K) grade-reading level for the CLEFT-Q items was 1.4 (range, 0–5.2), most of which were below the fifth-grade reading level, with the exception of 2 items .
The CLEFT-Q field- test was performed in 30 hospitals across 12 countries . Rasch Measurement Theory (RMT) analysis was used to refine the CLEFT-Q scales and to examine its reliability and validity . The psychometric findings of the final item-reduced CLEFT-Q as well as normative values for age, gender, and cleft type are reported elsewhere .
Selection of translators
For each Spanish variety or Catalan, 3 translators were involved. Two translators whose mother tongue was in 1 of the 3 Spanish varieties or Catalan (target language), and who were fluent in English (source language) were recruited to perform forward translations. Definitions of the key terms used throughout this paper are available in Additional file 1. One additional translator for each Spanish variety or Catalan whose mother tongue was in 1 of the 3 target Spanish varieties or Catalan, and who was fluent in English, was recruited to perform back translations. At least 1 in-country representative (i.e., an individual who lives in the country of the target language) was included as a translator for all Spanish varieties and Catalan . For the Spanish (Spain) and Catalan translations, the same 3 translators performed both translations.
Selection of study participants for cognitive debriefing interviews
Cognitive debriefing interviews involved participants from each of the participating centers. Eligibility criteria included the following: individuals with CL/P; aged between 8 and 29 years; and could read and understand 1 of the CLEFT-Q target Spanish varieties or Catalan. We aimed to recruit a sample of convenience of 5 participants per Spanish variety and Catalan from the plastic surgery or orthodontics clinics at each center. Sample size for the cognitive debriefing interviews aimed to adhere to the ISPOR recommendations, which is to perform interviews on 5 to 8 participants in the target country . A member of the healthcare team at each center approached potential participants in clinic to invite their participation in the study.
Translation and cultural adaptation process
Translation and cultural adaptation of the CLEFT-Q into the 3 Spanish varieties and Catalan took place between November 2014 and June 2016. Best-practice guidelines outlined by ISPOR were used for the translation and cultural adaptation of the CLEFT-Q . The use of these methods ensured the development of high quality reliable translations (Fig. 1).
A member of the CLEFT-Q team (ET) was assigned as the project manager. The project manager reviewed CLEFT-Q concepts with the 2 forward translators for the 4 translations, to ensure that all concepts were clearly understood by the translators as intended by the CLEFT-Q developer. Translations were performed to maintain comparable meaning to the source language version of the items, instructions, and response options . Translators were asked to prepare translations using simple terminology, rather than literal translations, and were encouraged to provide feedback on any words or phrases that were difficult to translate, i.e. due to the items construction, language differences, or any items that may not be culturally acceptable . Difficulty to translate any of the items, instructions, or response options was rated as none (no problems with the translation), minor (some differences in the grammatical or linguistic structure, requiring the item to be expressed in an alternative, yet conceptually equivalent manner), or major (significant differences in the grammatical or linguistic structure such that conceptual equivalence cannot be obtained). The project manager facilitated the translations and analyses for all 4 translations.
Steps for the translation and cultural adaptation the CLEFT-Q were as follows:
Step 1. The project manager oversaw the translation work, trained the translators on the translation procedures to follow to ensure consistency across all translation versions, explained the CLEFT-Q concepts to the 2 individuals performing the forward translation for each of the 4 translations, and reviewed the work after each translation step.
Step 2. Two forward translators whose mother tongue was Colombian, Spanish (Spain), or Catalan, and who were fluent in the source language (English) performed independent forward translations . Translation of the Chilean version entailed 2 forward translators, whose mother tongue was Chilean and who were fluent in the source language (English), who independently reviewed the English version of the CLEFT-Q and used the final Colombian version as a template to suggest modifications that were necessary to achieve semantic, idiomatic, experiential, and conceptual equivalence using acceptable language for the Chilean population .
Step 3. After the 2 independent forward translations into the target Spanish variety or language were completed, consensus meetings were held between the 2 forward translator pairs to reconcile their independent forward translations. The Microsoft Excel (2016) worksheet used to reconcile and analyse the forward translation results can be found in Additional file 2. Consensus and reconciliation of the 2 forward translations resulted in Version 1 of each target Spanish variety and Catalan .
Step 4. One back translator for each translation, who had not seen the source language (English) version of the CLEFT-Q, translated the target Spanish variety or Catalan Version 1 back into English .
Step 5. The project manager compared the back translations for each Spanish variety and Catalan to the source language version to identify discrepancies . More specifically, the project manager compared each item, instruction, and response option in terms of their semantic and idiomatic equivalence (Additional file 1) . The template Excel (2016) worksheet for the analysis of the back translation results can be found in Additional file 3.
Step 6. The project manager, the forward translators, and/or the back translators for each respective Spanish variety and Catalan met to discuss discrepancies between the back translation and the source language version. Challenges in obtaining semantic, idiomatic, experiential, and conceptual equivalence (Additional file 1) of the items, instructions, or response options were further discussed . Items whose meaning was not maintained were re-translated in an iterative manner until an acceptable result was achieved . These steps resulted in Version 2 of the target Spanish varieties and Catalan.
Step 7. For each translation, an in-country representative who was fluent in the target language conducted cognitive debriefing interviews with participants. To maintain consistency in the data collection across all Spanish varieties and Catalan, individuals who performed the cognitive debriefing interviewers were trained by the project manager. Using the ‘think aloud’ approach [35, 36] participants completed the CLEFT-Q while verbalizing each item and what they thought it was asking, which made it possible for the interviewer to identified words and/or phrases that were difficult to understand. For any difficulties identified, the interviewer explained the meaning to the participant, who was then asked to suggest alternative words/phrases to enhance comprehension. This process made it possible to assess the experiential or conceptual equivalence of the CLEFT-Q [25, 34].
Step 8. The project manager and the in-country representative reviewed findings from the cognitive debriefing interviews, which were used to further modify the target Spanish varieties and Catalan versions. This process resulted in Version 3 of the 4 translations . The template Excel worksheet for the analysis of the cognitive debriefing interview results can be found in Additional file 4.
Step 9. The final target Spanish variety and Catalan versions were proofread by 1 of the translators for spelling and grammatical errors. The target Spanish varieties and Catalan versions were included within REDCap (Research Electronic Data Capture, a secure web application for building and managing online surveys and databases ) surveys to facilitate the participation of each hospital in the international field- test.
Translation and cultural adaptation of the CLEFT-Q resulted in the development of 3 equivalent Spanish varieties and a Catalan version for use in Colombia, Chile, and Spain. Translations were developed to be cross-culturally equivalent to the source language version, and the items, instructions, and response options were worded using common language for each Spanish variety and Catalan, so that participants could easily understand them.
Three translators for each Spanish variety and Catalan were recruited to perform the translations. One in-country representative from Colombia and Spain were involved as translators, and 2 from Chile. Individuals performing translations had either no medical background (Colombia, n = 1; Chile, n = 1; and Spain, n = 2) or were healthcare professionals (Colombia, n = 2; Chile, n = 2; and Spain, n = 1).
Results from the forward translations of the CLEFT-Q into Colombian, Chilean, Spanish (Spain), and Catalan
Reconciliation of the 2 forward translations for each Spanish variety and Catalan revealed some inconsistencies (Fig. 2a). Translation of the CLEFT-Q into Colombian led to a greater number of inconsistencies between the 2 forward translations (n = 114, 74%) compared to Chilean (n = 17, 11%), Spanish (Spain) (n = 85, 55%), and Catalan (n = 93, 60%) (Fig. 2a). These inconsistencies were related to the wording or phrasing of the items. For example, in the Colombian version translator 1 translated the item “it’s easy for me to make friends” as “es facil hacer amigos” and translator 2 as “para mi, es facil hacer amigos”. During the consensus and reconciliation meeting, the 2 forward translators agreed that “para mi, es facil hacer amigos” was the best version of the item to depict the source English meaning. Furthermore, of the 154 items in the CLEFT-Q scales, only 10 (7%) items were reported as difficult to translate by the 2 forward translators of the Chilean version, and none were reported as difficult to translate by the forward translators of the Colombian, Spanish (Spain), and Catalan versions. Difficulties expressed by the Chilean translators were considered to be minor. For example, items such as “I feel okay about myself” and “I feel like I fit in” were difficult to translate, as “okay” and “fit in” are phrases not commonly used in Chile. Difficulties with the translations were appropriately resolved after a consensus meeting held between the 2 forward translators and the project manager.
Results from the back translations of the CLEFT-Q into Colombian, Chilean, Spanish (Spain), and Catalan
Back translation revealed some inconsistencies in the words or phrases of the items for each Spanish variety and Catalan. A total of 144 (94%), 142 (92%), 133 (86%), and 131 (85%) items in the Spanish (Spain), Chilean, Catalan, and Colombian versions respectively had achieved semantic, idiomatic, cultural, and conceptual equivalence. In some instances, when the back translations were compared to the source English version, the meaning of items in the Colombian (n = 23, 15%), Catalan (n = 21, 14%), Chilean (n = 12, 8%), and Spanish (Spain) (n = 10, 7%) translations were changed and required re-wording (Fig. 2b). A change in the meaning of an item was more common in the Colombian and Catalan translations. For instance, the item “I stand up for myself” was back translated as “I know how to fend for myself” (Colombian) and “I know how to look after myself” (Catalan). These translations were considered to have a slightly different meaning than the source version and required revision. All discrepancies were resolved after a meeting held between the project manager and the translators for each of the 4 languages.
Semantic equivalence was difficult to achieve for all 4-response option in Colombian, Chilean, and Catalan; however, equivalent translations were later derived. Instructions and response options for the 4 HRQOL scales and 2 facial function scales were easily translated into the 3 Spanish varieties and Catalan. Minor changes to spelling, punctuation, and grammar were required upon final proofreading of the different Spanish varieties and the Catalan versions of the CLEFT-Q.
Results from cognitive debriefing interviews with participants
Cognitive debriefing interviews involved 21 participants from 3 countries, including Colombia, Chile, and Spain (Table 1). Most participants were male (14, 67%) and had CL/P (17, 81%) (Table 1). For each Spanish variety and Catalan, the number of participants ranged between 4 to 7. In Spain, 5 participants whose mother tongue is Spanish (Spain) and 5 whose mother tongue is Catalan were selected. Catalan-speaking participants expressed the most difficulty interpreting some of the CLEFT-Q items (n = 11, 7%) (Fig. 2c). Items such as “how your face looks when you look your best?” and “I feel safe at school (not bullied)” were difficult concepts for some participants. For these items, the words “when you look your best” and “bullied” respectively were identified as difficult to understand. Since no difficulty was expressed for a single item from multiple participants, no changes were made to the translation or to the source version of the CLEFT-Q.
Example results from the Chilean translation and cultural adaptation process of the CLEFT-Q
Table 2 provides an example of the changes made throughout the process of translating the Chilean version of the CLEFT-Q. Reconciliation of the 2 forward translations revealed 17 (11%) items that were translated differently by the 2 forward translators. Among these items, 10 (7%) consisted of words or phrases that were considered difficult to translate (Table 2). For example, the item “how your cleft lip scar looks from far away?” was translated as “how do you see the lip scar from afar?” by translator 1 and “how does the scar on your lips look from afar?” by translator 2. The translation of translator 1 was considered to be the most appropriate to maintain the meaning of the source item and was retained in Version 1. Back translation revealed 135 (87%) items whose wording differed slightly from the source version, among which the meaning of 12 (8%) items was considered different (Table 2). Items whose meaning was changed from the source language version were re-translated until a satisfactory result was achieved. Cognitive debriefing interviews conducted with 7 Chilean-speaking participants reveal no difficulty understanding the words or phrases of the items.
Comparison of item wording between the final Colombian, Chilean, and Spanish (Spain) versions of the CLEFT-Q
A total of 61 (40%) items differed across the 3 Spanish varieties. Comparison of the 2 South American versions (Colombian and Chilean) revealed that although the meaning of the items was maintained, the item construction or wording of 84 (55%) items differed. Similarly, 84 (55%) items differed between the Colombian and Spanish (Spain) versions, while comparison of the Chilean and Spanish (Spain) version revealed that 98 (64%) items differed in there item construction or wording. Table 3 outlines the total number of differences of the CLEFT-Q item wording by domain between the 3 Spanish varieties. Interestingly, more differences between items in the appearance scales were identified compared to items in the HRQOL and facial function scales (Table 3). An example of the differences in the items of the cleft lip scar scale between the 3 Spanish varieties can be found in Table 4.
Our team has developed 4 conceptually equivalent translations of the CLEFT-Q prior to commencing our international field-test. Performing advanced translations was essential to gaining input from different cultural and linguistic backgrounds before finalizing the source questionnaire for cross-cultural implementation . To achieve maximum equivalence of items, instructions, and response options, it is crucial that the process of cross-cultural translation of a PRO instrument follows a valid and scientifically sound methodology . Achieving cross-cultural equivalence of the CLEFT-Q was crucial to enable its use in multiple Spanish-speaking countries, and to facilitate their participation in the international field- test study .
Comparison of the 2 forward translations for the Chilean version revealed fewer inconsistencies compared with the Colombian, Spanish (Spain), and Catalan versions. These fewer inconsistencies may be attributed to the fact that the Colombian version was used as a template, alongside the English version, to develop the Chilean translation. Analysis of the back translations revealed some discrepancies in the items’ meaning when compared to the source language version. However, all of the items whose meaning was changed during the translation process were easily modified for the final version to reflect the meaning of the source language version. Finally, comparisons of the 3 Spanish varieties reveal substantial differences between each version. These findings, which highlight the importance of having separate translations for different Spanish countries, are consistent with results from the study by García-García et al. (2000) who identified that over 80% of the items differed between the Mexican, Costa Rican, and Spanish (Spain) versions of the cHAQ .
It was important to develop conceptually equivalent, rather than literal translations for each Spanish variety and Catalan . To achieve conceptual equivalence, initial explanations of the items, instructions, and response options, as well as frequent discussion between the translators, project manager, and the instrument developers was necessary. Despite the significant grammatical differences between English (ie. a Germanic language) and Spanish (ie. a Romance language), no major challenges arose during the translation and cultural adaptation of the CLEFT-Q into the multiple Spanish varieties and Catalan due to the easy application of the ISPOR guidelines, as well as the simple and objective organization and wording of the CLEFT-Q items, instructions, and response options. Translation and cultural adaptation of the CLEFT-Q allowed us to make critical changes to the items, instructions, or response options prior to launching our international field- test. Input from participants with CL/P was essential to ensure that the CLEFT-Q was easily understood and applicable to the target populations, and contributed to some improvements to the initial translations. Analysis of semantic, idiomatic, cultural, and conceptual equivalence confirmed that the CLEFT-Q constructs are appropriate and are equally valid for the target Spanish variety and Catalan.
Two different versions of the CLEFT-Q were prepared for use in Spain, Spanish and Catalan. Despite the fact that Spanish and Catalan are spoken within the same country and are both Romance languages, comparison of the 2 versions revealed no overlap between the items, instructions, or response options of the CLEFT-Q. Therefore, translation of the CLEFT-Q into both languages was necessary to facilitate the use of the CLEFT-Q in Spain, particularly Barcelona. Also, using the Colombian version as a template to develop the Chilean version proved to be effective, and reduced the time needed to prepare the Chilean translation. Future translations of the CLEFT-Q into other Spanish varieties from neighboring countries may warrant the use of either the Colombian, Chilean, or Spanish (Spain) versions as a template to prepare appropriate translations for their populations. However, translation and cultural adaptation of the CLEFT-Q into other languages, including other Romance languages, would require their own translations using the source English version of the CLEFT-Q.
Since the goal for our international field- test (Phase II) was to include multiple countries , our team decided it was critical to perform the translation and cultural adaptation work prior to validating the scales. This approach enabled us to ensure that the content of the CLEFT-Q resonated well with participants with CL/P who vary by country and language. Therefore, an important strength of our study is the inclusion of the translation and cultural adaptation procedures during Phase I of the CLEFT-Q development. Furthermore, the inclusion of an international sample of participants for the cognitive debriefing interviews simultaneously proved to be advantageous for confirming the transferability of the CLEFT-Q. Finally, consistent methodology used throughout the translation and cultural adaptation process was maintained by having a member of the CLEFT-Q team (ET) train all the translators and cognitive debriefing interviewers on the procedures.
A potential limitation of the present study was that the 3 translators used to perform the translations of each Spanish variety and Catalan were not professional translators. Also, each translator who performed the back translations had a mother tongue in the respective Spanish variety or Catalan, and were fluent in English. ISPOR recommendations are to use professional translators, and for the back translations to be performed by someone fluent in the target language with their mother tongue in English. However, we think it is unlikely these deviations from ISPOR guidelines had any impact on the quality of the final translations. Another limitation is our use of a convenience sample of participants for the cognitive debriefing interviews. Given that a small number of participants are required for this final step of the ISPOR translation and cultural adaptation process, it is not possible to ensure a representative sample is chosen. For example, our sample mostly included participants with CL/P as opposed to other cleft types. However, this difference reflects the distribution of cleft types in the literature . Lastly; only 4 participants were included in the cognitive debriefing interviews for the Colombian translations, which is 1 fewer than the ISPOR recommendations. Since multiple translations were completed simultaneously, the feedback obtained from a large sample of Spanish participants completing the other translations, we feel it unlikely that the addition of 1 more participant would have changed the final Colombian version.
Translation and cultural adaptation processes provided evidence of transferability for the CLEFT-Q scales into 3 Spanish varieties and Catalan, as semantic, idiomatic, experiential, and conceptual equivalence of the items, instructions, and response options was achieved. Upon completion of the CLEFT-Q development the scales will be available for use in clinical practice, research, and benchmarking of outcomes internationally. Methods for the translation and cultural adaptation of the CLEFT-Q described here can be used to assess the quality and validity of our translation, and to inform new translation of the CLEFT-Q as well as other PRO instruments.
Child Health Assessment Questionnaire
Cleft lip and/or palate (CL/P)
United States Food and Drug Administration
Hamilton Integrated Research Ethics Board
Health-related quality of life
International Society for Pharmacoeconomics and Outcomes Research
Research Electronic Data Capture
Rasch Measurement Theory
Tanaka SA, Mahabir RC, Jupiter DC, Menezes JM. Updating the epidemiology of cleft lip with or without cleft palate. Plast Reconstr Surg. 2012;129(3):511e–8e.
Mastroiacovo P, Maraschini A, Leoncini E, Mossey P, Bower C, Castilla EE, Feldkamp ML, Halliday J, Little J, Robert-Gnansia E, Castilla EE, Boulyjenkov V, Harris J, Bower C, Dolk H, Calzolari E, Feldkamp M, Castilla EE, Zezza S, Abramsky L, Addor MC, Arias W, al-Gazali L, Amar E, Baker MA, Barisic I, Bianca S, Nesima G, Bourne D, Boyd P, Calder D, Castilla EE, Cocchi G, Copeland GE, Correa A, Csáky-Szunyogh M, Dutra Mda G, Daley B, Devolz M, De Vigan C, de Walle HE, Dias CM, Doray B, Feldkamp ML, Fornoff J, Garne E, Gatt M, Gillerot Y, Halliday J, Haeusler M, Hilliard M, Hirahara F, Horacek J, Latos-Bielenska A, Law DJ, Lowry R, Luna L, Zubira S, McDonnell R, Merlob P, Merz RD, Morgan M, Mosquera Tenreiro C, Mosley BS, Mutchinick O, Zubira S, Nelen V, Pearson KA, Pierini A, Poetzsch S, Portillo I, Queisser-Luft A, Rautio J, Rickard R, Ritvanen A, Sayed R, Scarano G, Siffel C, Sípek A, Szabova E, Tenconi R, Veazey H, Veghova E, Wertelecki W, Yevtushock L, Zhuchenko LA. IPDTOC Working Group. Prevalence at Birth of Cleft Lip With or Without Cleft Palate: Data From the International Perinatal Database of Typical Oral Clefts (IPDTOC). Cleft Palate Craniofac J. 2011;48(1):66–81.
Troncoso1 GS, Zúñiga HP, Araya JC. Prevalence of cleft lip and palate and risk indicators: study of the reference population of Felix Bulnes university hospital, Santiago de Chile. Rev Esp Cir Oral y Maxilofac 2008;30(1):17–25.
Zarante I, Franco L, López C, Fernández N. Frequencies of congenital malformations: assessment and prognosis of 52,744 births in three cities of Colombia. Biomedica. 2010;30(1):65–71.
Wehby GL, Cassel CH. The impact of orofacial clefts on quality of life and healthcare use and costs. Oral Dis. 2010;16:3–10.
Locker D, Jokovic A, Stephens M, Kenny D, Tompson B, Guyatt G. Family impact of child oral and orofacial conditions. Community Dent Oral Epidemiol. 2002;30:438–48.
Sitzman TJ, Allori AC, Thorburn G. Measuring outcomes in cleft lip and palate treatment. Clin Plast Surg. 2014;41(2):311–9.
Semb G, Brattstrom V, Molsted K, Prahl-Andersen B, Shaw WC. The Eurocleft study: intercenter study of treatment outcome in patients with complete cleft lip and palate. Part 1: introduction and treatment experience. Cleft Palate Craniofac J. 2005;42:64–8.
Long RE Jr, Hathaway R, Daskalogiannakis J, et al. The Americleft study: an inter-center study of treatment outcomes for patients with unilateral cleft lip and palate part 1. Principles and study design. Cleft Palate Craniofac J. 2011;48:239–43.
Heliövaara A, Küseler A, Skaare P, et al. SCANDCLEFT randomised trials of primary surgery for unilateral cleft lip and palate: 6. Dental arch relationships at 5 years. J Plast Surg Hand Surg. 2016;25:1–6.
Brattstrom V, Molsted K, Prahl-Andersen B, Semb G, Shaw WC. The Eurocleft study: intercenter study of treatment outcome in patients with complete cleft lip and palate. Part 2: craniofacial form and nasolabial appearance. Cleft Palate Craniofac J. 2005;42:69–77.
Molsted K, Brattstrom V, Prahl-Andersen B, Shaw WC, Semb G. The Eurocleft study: intercenter study of treatment outcome in patients with complete cleft lip and palate. Part 3: dental arch relationships. Cleft Palate Craniofac J. 2005;42:78–82.
Semb G, Brattstrom V, Molsted K, et al. The Eurocleft study: intercenter study of treatment outcome in patients with complete cleft lip and palate. Part 4: relationship among treatment outcome, patient/parent satisfaction, and the burden of care. Cleft Palate Craniofac J. 2005;42:83–92.
Shaw WC, Brattstrom V, Molsted K, Prahl-Andersen B, Roberts CT, Semb G. The Eurocleft study: intercenter study of treatment outcome of patients with complete cleft lip and palate. Part 5: discussion and conclusions. Cleft Palate Craniofac J. 2005;42:93–8.
Acquadro C, Berzon R, Dubois D, Leidy NK, Marquis P, Revicki D, Rothman M. Incorporating the patient's perspective into drug development and communication: an ad hoc task force report of the patient-reported outcomes (PRO) harmonization group meeting at the Food and Drug Administration, February 16, 2001. Value Health. 2003;6(5):522–31.
Hudson RA. Sociolinguistics. 2nd ed. Cambridge: Cambridge University Press; 1996.
Fernández MF, Roth OJ. Atlas de la lengua española en el mundo. 2nd ed. Spain: Ariel and Fundación Telefónica; 2008.
Oliveras LM. Spanish dialectal variation in the foreign language classroom: students’ attitudes, instructors’ beliefs and teaching practices, and treatment of variation in textbooks. Dissertation thesis for the Department of Modern Languages and Cultural Studies: University of Alberta; 2015.
Singh G, Athreya BH, Fries JF, Goldsmith DP. Measurement of health status in children with juvenile rheumatoid arthritis. Arthritis Rheum. 1994;37:1761–9.
J.-J. García-García, E. González-Pascual, J. Pou-Fernández, G. Singh1, R. Jiménez. Development of a Spanish (Castillian) version of the childhood health assessment questionnaire. Measurement of health status in children with juvenile chronic arthritis. Clin Exp Rheumatol 2000; 18: 95–102.
US Food and Drug Administration Guidance for Industry. Patient-Reported Outcome Measures: use in medical product development to support labeling claims. Rockville, MD: Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, 2009.
Patrick DL, Wild DJ, Johnson ES, Wagner TH, Martin MA. Cross-cultural validation of quality of life measures. International Perspectives, ed. J. Orley and W. Kuyken. Springer-Verlag, Heidelberg: In Quality of Life Assessment; 1994.
Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs. 2004;48(4):388–96.
Bitsch V. Qualitative research: a grounded theory example and evaluation criteria. J. Agribusiness. 2005;23(1):75–91.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 2005;8(2)i:94–104.
Wong Riff KWY, Tsangaris E, Goodacre T, Forrest CR, Pusic AL, Cano SJ, Klassen AF. International multiphase mixed methods study protocol to develop a cross- cultural patient-reported outcome instrument for children and young adults with cleft lip and/or palate (CLEFT-Q). BMJ Open. 2017;7:e015467.
Aaronson N, Alonso J, Burnam A, Lohr KN, Patrick DL, Perrin E, Stein RE. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193–205.
Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, Ring L. Content validity: establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report, part 2: assessing respondent understanding. Value Health. 2011;14(8):978–88.
Klassen AF, Tsangaris E, Forrest CR, Wong KW, Pusic AL, Cano SJ, Syed I, Dua M, Kainth S, Johnson J, Goodacre T. Quality of life of children treated for cleft lip and/or palate: a systematic review. J Plast Reconstr Aesthet Surg. 2012;65(5):547–57.
Wong Riff KWY, Tsangaris E, Forrest CR, Lawson J, Pusic AL, Klassen AF. What Matters to Patients with Cleft Lip and/or Palate: An International Qualitative Study Informing the Development of the CLEFT-Q. Manuscript submitted for publication.
Tsangaris E, Wong Riff KWY, Goodacre T, Forrest CR, Dreise M, Sykes J, de Chalain T, Harman K, O’Mahony A, Pusic AL, Thabane L, Thoma A, Klassen AF. Establishing content validity of the CLEFT-Q: a new patient-reported outcome instrument for cleft lip/palate. PRS GO. 2017;5(4):e1305.
Klassen A Wong Riff K, Longmire N, Albert A, Baker S, Cano S, Chan A, Courtemanche D Dreise M, Goldstein J, Goodacre T, Harman K, Munill M, Palomares MA, Peterson P, Pusic A, Slator R, Stiernman M, Tholpady S, Tsangaris E, Vargas F, Forrest C. Psychometric Findings and Normative Values for the CLEFT-Q based on 2,434 Children and Young Adult Patients with Cleft Lip and/or Palate from 12 Countries. Manuscript submitted for publication.
Hunt SM, Bhopal R. Self-report in clinical and epidemiological studies with non-English speakers: the challenge of language and culture. J Epidemiol Community Health. 2004;58(7):618–22.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–32.
Willis GB. Analysis of the cognitive interview in questionnaire design: understanding qualitative research. Toronto: Oxford University Press; 2015.
Willis GB. Cognitive interviewing: a tool for improving questionnaire design. New York: Sage Publications; 2005.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.
Dorer B. Advance translation in the 5th round of the European social survey (ESS). FORS working paper series, paper 2011-4. Lausanne: FORS. http://forscenter.ch/wp-content/uploads/2013/10/FORS_WPS_2011-04_Dorer-3.pdf. Accessed 7 June 2016.
Regnault A, Hamel JF, Patrick DL. Pooling of cross-cultural PRO data in multinational clinical trials: how much can poor measurement affect statistical power? Qual Life Res. 2015;24:273–7.
Tolarova MM, Al-Kharafi L, Tolar M. Boyd C. Pediatric Cleft Lip and Palate Available from: http://emedicine.medscape.com/article/995535-overview. Accessed 10 Nov 2016.
We would like to acknowledge the following individuals for their help with translating the CLEFT-Q into the various Spanish varieties and Catalan, or in conducting the cognitive debriefing interviews: Laura Vargas, Ivan Dario Flórez Gomez, Claudia Albornoz, Pablo Montero, Núria Fernández, David Madell, and Maria Luna. We would also like to acknowledge our partners at the cleft care centers around the world for participating in data collection for the cognitive debriefing interviews.
The research described in this paper was supported by a grant from the Canadian Institute of Health Research. The Article Processing Charge was paid from the CIHR grant.
Availability of data and materials
Ethics approval and consent to participate
This study was approved by the Research Ethics Board of each of the following participating hospitals: Fundación Gantz Hospital del Niño con Fisura in Santiago, Chile; and Hospital Sant Joan de Déu in Barcelona, Spain. For Fundación Operación Sonrisa Colombia and Centro de Atención Multidisciplinaria Gilberto Mariño Contreras in Bogotá, Colombia, the CLEFT-Q study was performed in accordance with the laws set forth by the Ministry of Health Colombia (Resolucion N°008430 De 1993 (4 De Octubre De 1993)). The study was conducted in accordance with policies for ethical conduct in research involving humans, and all participants and/or their legal guardians provided written informed consent or assent according to each center’s policy.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Key definitions. (DOCX 86 kb)
Template data collection and analysis form for forward translation. (DOCX 65 kb)
Template data collection and analysis form for back translation. (DOCX 67 kb)
Template data collection and analysis form for cognitive debriefing interviews. (DOCX 65 kb)