Validation of the Turkish version of the Celiac Disease Questionnaire (CDQ)
Health and Quality of Life Outcomes volume 13, Article number: 82 (2015)
The aim of the study was to translate, adapt and validate the Celiac Disease Questionnaire (CDQ), which was developed in Germany, for use in Turkey.
The questionnaire was translated by a forward-backward translation method. Total CDQ score and four subscores (emotional state, gastrointestinal symptoms, worries, social problems) were calculated and their reliability assessed by internal consistency. Reliability of scales was evaluated by internal consistency. Test-retest reliability was assessed by means of a retest after 15 days. Face validity was assessed by patient volunteers and physicians and construct validity was assessed by means of confirmatory factor analysis. Convergent validity was determined by comparing responses to the CDQ with similar subscale scores of the Short Form-36 (SF-36) health survey. Discriminative concurrent criterion validity was determined by comparing the CDQ scores of patients with celiac disease (CD) on a gluten-free diet (GFD) with CD patients not on a GFD.
The Turkish version of the CDQ was completed by 205 patients with celiac disease (Female 146, mean age 31.1 year, ± 10.61). The Cronbach-α coefficent of the subscores ranged between 0.73 and 0.93. Test-retest reliability was 0.99 for all subscores. 42 patients with CD and five gastroenterologists assessed the items of the CDQ to be comprehensible and relevant to the health related quality of life (HRQOL) of CD patients. The confirmatory factor analysis demonstrated acceptable fit indices for the original four subscales of the CDQ. The correlations between the scales of the CDQ and the instrument for validation covering similar dimensions of the HRQOL ranged between 0.61 and 0.93. In all subscores and in the total score, patients not on a GFD showed a significantly reduced HRQOL (all p < 0.05) compared to patients on a GFD.
The Turkish version of the CDQ proved to be a reliable and valid instrument for measuring HRQOL in Turkish patients with celiac disease.
Celiac disease (CD), is a prevalent chronic autoimmune disorder that is triggered by the ingestion of wheat gluten and related proteins of rye and barley in genetically susceptible individuals [1–4]. According to the results of different recently-published studies, CD affects between 1:100 and 1:200 individuals in the general population of Turkey [5–7]. Currently the cornerstone of the treatment is a lifelong strict gluten-free diet (GFD) , under which gluten is entirely eliminated from food intake and medications. Adherence to a GFD has a positive effect in general on the medical condition of CD patients  and, following introduction of the GFD, most patients with CD show improvement not only in terms of gastrointestinal symptoms but also with regards to their psychological well-being. Study results imply that before starting the diet, even CD patients classified as asymptomatic may in fact have had mild symptoms of which they became aware only after having being prescribed a gluten-free diet . Compliance with the diet has been found to be a factor associated with health related quality of life (HRQOL) [10–12], and with improved quality of life in the majority of patients with CD [4, 13, 14].
In recent years, there has been increased medical interest in patients’ subjective perception of the impact chronic disorders have on their lifestyle and general state of health. These factors have therefore become important criteria when assessing the effectiveness of therapeutic intervention [15, 16]. Two basic approaches have been developed for the measurement of quality of life: generic instruments that provide a summary of HRQOL; and specific instruments that focus on problems associated with particular disease states, patient groups, or areas of function . Generic instruments do not assess specific aspects of a certain disease such as the possible social and financial restrictions associated with adherence to a GFD in CD, and are considered to be less sensitive to changes in the patients’ health state . Therefore, the use of disease-specific HRQOL instruments is necessary for clinical studies in gastroenterology [17, 18]. The Celiac Disease Questionnaire (CDQ) is a disease–specific HRQOL questionnaire developed and validated for adult CD patients . Good psychometric properties have been demonstrated for both the German  and the Italian version .
The purpose of the present study was to translate and validate the CDQ  for use in Turkey.
Two bilingual medical doctors and two interpreters worked on the translation of the CDQ into Turkish. The English version was used as the basis for translation. Translation was carried out by the forward-backward method: First, one bilingual doctor translated the questionnaire from English into Turkish. Subsequently, it was translated back into English by the other bilingual doctor. Finally, these two doctors met together with two interpreters and a doctor with expertise in the field of celiac disease to compare the two English versions and the Turkish translation, and to reconcile discrepancies in order to create one single version.
The abbreviation “CDQ” was kept for the Turkish version for ease of international communication. The Turkish translation of the CDQ is available from the corresponding author on request.
Patient members of the Ankara Celiac Association were recruited into the study. Inclusion criteria were: age >19 and <65 years, CD diagnosis based on duodenal biopsy showing a certain degree of villous atrophy and positive endomysial antibodies; the ability to read and understand Turkish; no additional health problems; no vitamin or trace element supplementation within the last year; no tobacco or regular alcohol consumption. The members of Ankara Celiac Association were informed about the study and its inclusion criteria, and of those who had volunteered for study participation, 250 randomly-chosen patients were contacted by telephone or e-mail with a request to complete the CDQ. A total of 239 CDQs were returned. Two weeks after first completing the CDQ, a hundred of the same patients were asked to complete it for a second time. In this second round, 81 CDQs were returned. In addition, 25 randomly-selected bilingual patients were requested to fill out the English version of the CDQ to assess whether the meaning was clear, and whether it was also the same in both languages (21 of the 25 CDQs were returned). The 81 patients who had completed the CDQ a second time were contacted after a further two weeks and asked to fill out the Short Form-36 (SF-36), a similar HRQOL questionnaire. All of those contacted returned the SF-36. Clinical and sociodemographic data of all study participants were collected in order to prevent misinterpretation of results. All patients included in the study had given their prior voluntary informed consent after full written explanation of the aims of the study, including considerations regarding ethics and data protection.
Psychometric criteria determined by the IQOLA (International Quality of Life Assessment) project  were used to assess the psychometric properties of the Turkish version of the CDQ. Evaluation of data quality involved the floor and ceiling effect (i.e. the percentage of patients scoring the highest or lowest possible score, where the lowest possible percentage is considered an acceptable criterion) and completeness of data (i.e. percentage of items and scales completed, where 90–95 % is considered an acceptable criterion). Scaling assumptions involved item internal consistency (i.e. percentage of items with a Pearson item-scale correlation ≥40 %, criterion being 100 %), discriminant validity (i.e. percentage of items which have a higher Pearson correlation with other scales than with their own scale, criterion is 0 %), internal consistency reliability (Cronbach’s alpha coefficient, criterion is >0.7) and test-retest reliability (Pearson correlation, criterion is >0.7).
The CDQ is an instrument consisting of 28 items divided into four subscales : emotion (seven items), gastrointestinal symptoms (seven items), worries (seven items), social problems (seven items). The emotional states include depressed, relaxed, happy, restless, physically fatigued and tearful; gastrointestinal symptoms include abdominal cramps, bloating, incomplete bowel evacuation, loose bowels, aberrant bowel movement, belching and nausea; worries include fear of medical examinations, health insurance issues, fear of cancer, fears concerning inheritance to children, gluten-free diet costs and concerns associated with living a gluten-free life; social problems include lack of social understanding, exclusion from others, family/friends, sports, a professional career, social or meal invitations and sexual activities [17, 19].
Each subscale is scored using a seven point Likert scale in which “7” corresponds to the best state and “1” to the worst, with 2 of the items requiring reverse coding. The scores of each area range from 0 to 49 and the total CDQ score ranges from 0 to 196 .
The sociodemographic questionnaire includes demographic questions to assess gender, marital status, age, lifestyle variables (regular cigarette smoking, regular alcohol intake, regular participation in sport), present occupational status and educational status.
The medical questionnaire includes questions to assess medical history of the disease, adherence to a gluten-free diet, body mass index, prior or current celiac-associated disease, other diseases and current medication.
The Medical Outcome Study Short Form-36 (SF-36)  was used for validation. SF-36 has been shown to be a reliable and valid instrument in Turkish patients , and consists of 36 items with eight subscales: physical functioning (ten items), social functioning (two items), role limitations due to physical problems (four items), role limitations due to emotional problems (three items), mental health (five items), energy and vitality (four items), pain (two items), and general perception of health (five items). For each variable item, scores are coded, added and transformed onto a scale from 0 (worst possible health state measured by the questionnaire) to 100 (best possible health state) [21, 22].
Validation methods and hypothesis
The methods used to validate the CDQ were as follows:
Acceptance, assessed by the proportion of missing or invalid items.
Reliability of the scales, assessed by internal consistency as determined by Cronbach’s α coefficient, which measures the overall correlation between items within a scale. A correlation level of 0,7 and higher is considered desirable .
Test-retest reliability was assessed in 81 patients who completed the CDQ twice within 15 days.
Face validity in CD patients had been assessed in German subjects for the original questionnaire . In this research, face validity of the Turkish version was evaluated by 42 patients with CD and five physicians. We tested face validity by asking the patients and physicians to evaluate whether the CDQ subsections were relevant or irrelevant to CD.
Factorial/construct validity was assessed by confirmatory factor analysis, which was used to confirm the factors or sub-scales determined in the original scale. Normed fit index (NFI), comparative fit index (CFI) and chi-squared statistics were used for evaluating model fit.
Convergent validity was determined by comparing responses to the CDQ with similar subscale scores of the SF-36, which has been shown to be a reliable and valid instrument in Turkish patients. The convergent validity was fulfilled when the scale scores for related concepts showed moderate to high correlation (Spearman rank correlation coefficients >0,4) . The expectation is of a higher correlation in similar dimensions (shown bold in Table 3) and a lower correlation in dissimilar dimensions, indications that the CDQ has clear outcomes.
Discriminant concurrent criterion validity was determined by comparing the CDQ scores of patients with CD on a GFD with those patients not on a GFD. We predicted that patients on a GFD would show increased HRQOL scores compared with patients not on a GFD.
The Statistical Package for Social Sciences (SPSS 21.0 package for Windows) was used to analyze the data.
Descriptive statistics were applied to report continuous variables as means ± standard deviation (SD). Categorical data were given as counts and percentages. Chi-square and Analysis of Variance (ANOVA) were used for analysis of categorical and continuous data, respectively, while the correlation between CDQ and other dependent variables were described by Pearson and Spearman correlation tests. Pearson correlation analysis was calculated for normally-distrubuted and Spearman correlation for abnormally-distributed variables.
Confirmatory factor analysis was executed to determine factorial/construct validity. NFI (>0.90 acceptable fit), CFI (>0.90 acceptable fit), Root Mean Square Residual (<0.08 acceptable fit) were calculated and chi-squared statistics were used for evaluating model fit .
Cronbach’s alpha was computed in order to assess internal consistency and test–retest reliability, respectively. Discriminant validity was evaluated by Mann Whitney rank-sum test. All tests were two-tailed with the significance level set at p < 0.05.
The study was approved by Hacettepe Üniversitesi Girişimsel Olmayan Klinik Araştırmalar Etik Kurulu with the reference number HEK 12/113–24.
Twenty-one patients were excluded due to the exclusion criteria of the study (12 patients due to tobacco consumption, 9 patients due to additional health problems), while thirteen patients originally included in the study could not be contacted or were considered to be lost to follow-up and eleven patients never returned the questionnaire. At study completion, two hundred and five (146 females, 59 males, mean age 31.1 years ± 10.61) patients with CD were included. Sociodemographic and medical data of the patients are presented in Table 1.
Floor and ceiling effect was found to be 0 % for the total score, 1 % for the emotional and social subscale scores, and 0 % for the worries and gastrointestinal symptoms subscale scores. Completeness of data was 100 %, item internal consistency was 100 %, discriminant validity was 0 %, minimum internal consistency reliability was 0.73, and minimum test-retest reliability was 0.99. Based on these evaluations, the psychometric properties of the Turkish version of the CDQ were found to be acceptable.
Data on the internal consistency of the scales are presented in Table 2. Cronbach’s α ranged between 0.73 and 0.93, and test-retest reliability was 0.99 for all subscales.
Face validity; 42 volunteers recruited from the participating patients with CD and all physicians assessed the items of the CDQ to be comprehensible, and indicated that the items were relevant to HRQOL for CD patients. The patients and the doctors agreed that the listed CDQ items are relevant issues for individuals with celiac disease.
Construct validity; The subscale characteristics are presented in Table 3. There were no significant differences in the CDQ subscales or in the total score between males and females or between patients of different educational backgrounds. Furthermore, there were no significant correlations with age (Table 4).
Confirmatory factor analysis was performed to verify the construct validity of the scale. As a result of analysis of the model, fit indices were examined (NFI = 0.91, CFI = 0.93, RMR = 0.073). Accordingly, the chi-square value was found to be statistically significant (χ2 = 794.79, p <0.001, χ2/dfa: 794.79/344 = 2,31). Fit indices accepted < 5 for χ2/dfa, >0.90 for NFI and CFI, <0.08 for RMR .
Convergent validity; The correlations (Spearman rank-order correlation) between the scales of the CDQ and the instrument for validation covering similar dimensions of the HRQOL ranged between 0.61 and 0.93 (Table 3). High scores in CDQ and SF-36 indicate a good HRQOL.
Discriminant concurrent criterion validity: Differences in the CDQ subscales between patients on a GFD and those not on a GFD are presented in Table 5. In all subscales and in terms of total score, patients not on a GFD showed a significantly reduced HRQOL (total p < 0.05) compared to patients adhering to a GFD.
The number of individuals diagnosed with celiac disease has increased in recent years . Due to the necessity for lifelong changes in lifestyle in persons with CD, health-related quality of life has become an important focus of attention [17, 26].
The CDQ is an economic, reliable and valid disease-specific instrument for the assessment of HRQOL in patients with CD . In this study, the Turkish adaptation of the CDQ was validated for the first time for patients with CD in living Turkey.
The enrollment rate of approximately 82 % of patients who had expressed interest in study participation is acceptable. A natural sounding, easily comprehensible translation of the CDQ was obtained in order to reduce all possible cultural bias to a minimum. Most sociodemographic parameters of this Turkish sample are similar to those of other celiac health surveys in Germany  and Italy  but HRQOL scores in all subscales and in total were lower in this Turkish study population than in German  and Italian  samples. Results of the study show that scale scores were unaffected by the gender, age and educational backgrounds of those completing the questionnaire.
Regarding the construct validity of the CDQ, our study confirmed the factorial structure by confirmatory factor analysis for the first time. The confirmatory factor analysis demonstrated the homogeneity of the items and also the internal consistency to be satisfactory for the original four dimensions of the CDQ. Furthermore, the Turkish version of CDQ showed good overall psychometric properties with excellent internal consistency for the overall score and each of the four subscores.
The correlations of the Turkish CDQ with the SF-36, an HRQOL scale instrument validated in Turkish, were significant (Spearman correlation 0.61-0.93) and similar to the external validity coefficients of other validation studies of the CDQ [17, 19].
Our analysis also confirmed the ability of the CDQ to discriminate between patients on a gluten-free diet and those not on a gluten-free diet. Due to the discriminant validity of the Turkish questionnaire, the scores of patients on a gluten-free diet were - as expected - observed to be significantly higher than in patients who did not adhere to a gluten-free diet. This criterion was therefore identified as a classifying parameter.
Some limitations of the study must be considered: Within the setting of this study, a test of responsiveness (the ability of a questionnaire to detect clinically important changes over time) was not possible. The patients were recruited from the Celiac Disease Association (Çölyak Derneği) and the selection process offers no guarantee that these patients were representative for individuals with celiac disease in the Turkish population as a whole. Therfore, a potential selection bias in our sample cannot be entirely excluded.
The use of internationally validated instruments is strongly recommended to allow international comparison of the results of national studies. Transcultural comparisons of adult celiac patients can be conducted using the CDQ. There are also validated celiac-specific quality of life instruments available for children and adolescents  which should be validated in future.
In conclusion, this study showed the new Turkish version of the CDQ to be a valid and reliable instrument for measuring HRQOL in Turkish patients with celiac disease. The Turkish version of the CDQ including information on copyright and contact information are included in the electronic Additional file 1.
Analysis of Variance
Celiac Disease Questionnaire
Comparative fit index
Detrended fluctuation analysis
Health-related quality of life
International quality of life assessment
Normed fit index
Root mean square residual
Short form-36 health survey
Green PHR, Jabri B. Coeliac disease. Lancet. 2003;362(9381):383–91.
Briani C, Samaroo D, Alaedini A. Celiac disease: from gluten to autoimmunity. Autoimmun Rev. 2008;7(8):644–50.
Lee AR, Ng DL, Diamond B, Ciaccio EJ, Green PH. Living with coeliac disease: survey results from the U.S.A. J Hum Nutr Diet. 2012;25(3):233–8.
Nachman F, Mauriño E, Vázquez H, Sfoggia C, Gonzalez A, Gonzalez V, et al. Quality of life in celiac disease patients: prospective analysis on the importance of clinical severity at diagnosis and the impact of treatment. Dig Liver Dis. 2009;41(1):15–25.
Gursoy S, Guven K, Simsek T, Yurci A, Torun E, Koc N, et al. The prevalence of unrecognized adult celiac disease in Central Anatolia. J Clin Gastroenterol. 2005;39(6):508–11.
Tatar G, Elsurer R, Simsek H, Balaban YH, Hascelik G, Ozcebe OI, et al. Screening of tissue transglutaminase antibody in healthy blood donors for celiac disease screening in the Turkish population. Dig Dis Sci. 2004;49(9):1479–84.
Elsurer R, Tatar G, Simsek H, Balaban YH, Aydinli M, Sokmensuer C. Celiac disease in the Turkish population. Dig Dis Sci. 2005;50(1):136–42.
Garcia-Manzanares A, Lucendo AJ. Nutritional and dietary aspects of celiac disease. Nutr Clin Pract. 2011;26(2):163–73.
Mustalahti K, Lohiniemi S, Collin P, Vuolteenaho N, Laippala P, Maki M. Gluten-free diet and quality of life in patients with screen-detected celiac disease. Eff Clin Pract. 2002;5(3):105–13.
Zarkadas M, Cranney A, Case S, Molloy M, Switzer C, Graham ID, et al. The impact of a gluten-free diet on adults with coeliac disease: results of a national survey. J Hum Nutr Diet. 2006;19(1):41–9.
Usai P, Minerba L, Marini B, Cossu R, Spada S, Carpiniello B, et al. Case control study on health-related quality of life in adult coeliac disease. Dig Liver Dis. 2002;34(8):547–52.
Kurppa K, Collin P, Mäki M, Kaukinen K. Celiac disease and health-related quality of life. Expert Rev Gastroenterol Hepatol. 2011;5(1):83–90.
Nachman F, del Campo MP, González A, Corzo L, Vázquez H, Sfoggia C, et al. Long-term deterioration of quality of life in adult patients with celiac disease is associated with treatment noncompliance. Dig Liver Dis. 2010;42(10):685–91.
Cranney A, Zarkadas M, Graham ID, Butzner JD, Rashid M, Warren R, et al. The Canadian celiac health survey. Dig Dis Sci. 2007;52(4):1087–95.
Bech P. Quality of life measurements in chronic disorders. Psychother Psychosom. 1993;59(1):1–10.
Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118(8):622–9.
Häuser W, Gold J, Stallmach A, Caspary WF, Stein J. Development and Validation of the Celiac Disease Questionnaire (CDQ), a disease-specific health-related quality of life measure for adult patients with celiac disease. J Clin Gastroenterol. 2007;41(2):157–66. doi:10.1097/01.mcg.0000225516.05666.4e.
Yacavone RF, Locke 3rd GR, Provenzale DT, Eisen GM. Quality of life measurement in gastroenterology: what is available? Am J Gastroenterol. 2001;96(2):285–97.
Marchese A, Klersy C, Biagi F, Balduzzi D, Bianchi PI, Trotta L, et al. Quality of life in coeliac patients: Italian validation of a coeliac questionnaire. Eur J Intern Med. 2013;24(1):87–91.
Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. J Clin Epidemiol. 1998;51(11):945–52.
Ware JE, Kosinski M. SF-36 physical & mental health summary scales: a manual for users of version 1: Quality Metric Inc. 2001.
Kocyigit H, Aydemir O, Olmez N, Memis A. Reliability and validity of the Turkish version of Short-Form-36 (SF-36). Turkish J Drugs Therap. 1999;12:102–6.
Fletcher A, Gore S, Jones D, Fitzpatrick R, Spiegelhalter D, Cox D. Quality of life measures in health care. II: Design, analysis, and interpretation. BMJ (Clin Res). 1992;305(6862):1145–8.
Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Int J Methods Psychiatr Res. 2003;8(2):23–74.
Ludvigsson JF, Rubio-Tapia A, van Dyke CT, Melton 3rd LJ, Zinsmeister AR, Lahr BD, et al. Increasing incidence of celiac disease in a North American population. Am J Gastroenterol. 2013;108(5):818–24.
Dorn SD, Hernandez L, Minaya MT, Morris CB, Hu Y, Leserman J, et al. The development and validation of a new coeliac disease quality of life survey (CD-QOL). Aliment Pharmacol Ther. 2010;31(6):666–75.
van Doorn RK, Winkler LM, Zwinderman KH, Mearin ML, Koopman HM. CDDUX: a disease-specific health-related quality-of-life questionnaire for children with celiac disease. J Pediatr Gastroenterol Nutr. 2008;47(2):147–52.
The authors extend their thanks to all study participants, and to Mrs Şebnem Ercebeci Çınar, head of the Turkish Celiac Association, for motivating patients and supporting the study. The authors also thank Janet Collins (Interdisciplinary Crohn-Colitis Center Rhein-Main, Frankfurt, Germany) for proof-reading the manuscript.
Aksan A, Mercanlıgil SM, Häuser W designed and performed the the research, Aksan A and Karaismailoğlu E analyzed the data, Aksan A and Häuser W wrote the paper.
The authors declare that they have no competing interests.
All authors read and approved the final manuscript.
About this article
Cite this article
Aksan, A., Mercanlıgil, S.M., Häuser, W. et al. Validation of the Turkish version of the Celiac Disease Questionnaire (CDQ). Health Qual Life Outcomes 13, 82 (2015). https://doi.org/10.1186/s12955-015-0272-y