Depressive symptoms following natural disaster in Korea: psychometric properties of the Center for Epidemiologic Studies Depression Scale
Health and Quality of Life Outcomes volume 15, Article number: 230 (2017)
Depressive symptoms have been recognized as one of the most frequent complaints among natural disaster survivors. One of the most frequently used self-report measures of depressive symptoms is the Center for Epidemiologic Studies Depression Scale (CES-D). To our knowledge, no study has yet examined the factor structure, reliability, and validity of the CES-D in a sample of natural disaster survivors. Thus, the present study investigated the factor structure, reliability, and validity of a Korean language version of the CES-D (KCES-D) for natural disaster survivors.
We utilized two archived datasets collected independently for two different periods in 2008 in the same region of Korea (n = 192 for sample 1; n = 148 for sample 2). Participants were survivors of torrential rains in the mid-eastern region of the Korean peninsula. For analysis, Samples 1 and 2 were merged (N = 340). Confirmatory factor analysis was performed to evaluate the one-factor model, the four-factor model, and the bi-factor models, as well as the second-order factor model. Composite reliability was computed to examine the internal consistency of the KCES-D total and subscale scores. Finally, Pearson’s r was computed to examine the relationship between the KCES-D and the trauma-related measures.
The four-factor model provided the best fit to the data among the alternatives. The KCES-D showed adequate internal consistency, except for the ‘interpersonal difficulties’ subscale. Also regarding concurrent validity, weak to moderate positive correlations were observed between the KCES-D and the trauma-related measures.
The results support the four-factor model and indicate that the KCES-D has adequate psychometric properties for natural disaster survivors. If these findings are further confirmed, the KCES-D can be used as a useful, rapid, and inexpensive screening tool for assessing depressive symptoms in natural disaster survivors.
Depressive symptoms have been recognized as one of the most frequent complaints among natural disaster survivors [1, 2]. It has been reported that depressive symptoms and depressive disorders of trauma survivors are associated with their poor health-related quality of life [3,4,5]. The development, validation, and utilization of instruments to measure depressive symptoms in trauma survivors are essential for planning and applying interventions designed to reduce depressive symptoms and improve quality of life. A number of self-report measures have been developed to evaluate the degree of depressive symptoms. One of the most frequently used self-report measures of depressive symptoms is the Center for Epidemiologic Studies Depression Scale (CES-D).
The CES-D contains 20 items rated on a 4-point Likert scale, ranging from 0 to 3 (total range 0-60) . There is an extensive body of research demonstrating its sound psychometric properties, including high internal consistency, fair stability, good concurrent, convergent, and discriminant validity in a variety of samples (e.g., [7,8,9,10]). Numerous investigations have been conducted to investigate the factor structure of the CES-D. The original study found a four-factor structure in the general population; ‘depressive affect,’ ‘positive affect,’ ‘somatic and retarded activity,’ and ‘interpersonal difficulties’ . The four original factors have been extensively replicated (e.g., [10,11,12,13]) and confirmed with meta-analytic methods . However, many other studies have suggested that the factor structure of the CES-D may vary with the study populations and culture. For example, several studies have suggested the presence of one-, two-, three-, four-, five-, and seven-factor structures in different populations and subpopulations (e.g., [11, 15]). To our knowledge, no study has yet examined the factor structure, reliability, and validity of the CES-D in a sample of natural disaster survivors. Although the CES-D has shown adequate psychometric properties in Korean clinical and nonclinical samples [8, 16], it has not been validated in a sample of Korean natural disaster survivors.
Thus, the objectives of the present study were twofold. First, we aimed to identify the best-fitting factor model for a Korean language version of the CES-D (KCES-D) in a sample of natural disaster survivors. To this end, confirmatory factor analyses (CFAs) were performed to evaluate the one-factor model, the four-factor model, and the bi-factor models (one general factor and four specific factors or three specific factors excluding depressive affect factor) , as well as the second-order model (the four-factor model with a single second-order factor) . Second, we attempted to investigate the reliability and validity of the KCES-D for natural disaster survivors. As evidence for concurrent validity, we hypothesized that the KCES-D has a moderately positive correlation with the Impact of Event Scale-Revised (IES-R) , Peri-Traumatic Dissociation (PTD) Scale , Post-Traumatic Cognition (PTC) Scale , and Post-Traumatic Social Support (PTSS) Scale .
We utilized two archived datasets collected independently for two different periods in 2008 in the same region of Korea (n = 192, 60.4% women for sample 1; n = 148, 50.0% women for sample 2). Participants were survivors of torrential rains in the mid-eastern region of the Korean peninsula. Data from one participant who did not respond to half of the KCES-D was excluded, resulting in a final sample size of 340. Their sociodemographic characteristics are presented in Table 1. Data were analyzed with informed consent by participants.
Depressive symptoms were assessed using the CES-D . Four variables were used to assess the concurrent validity of the KCES-D. Post-traumatic stress symptoms were assessed by the IES-R , peri-traumatic dissociation was assessed by the PTD Scale , post-traumatic cognition by the PTC Scale (PTCS) , and social support by the PTSS Scale . Korean versions of these measures showed good reliability and validity [8, 19,20,21].
All analyses were performed using the SPSS 22.0 and Mplus 7.4 software for Windows. A sample size of at least 10 cases for each item is recommended for confirmatory factor analysis , and thus Samples 1 and 2 were merged (N = 340). We estimated the factor structure using weighted least squares with mean- and variance-adjusted (WLSMV). Radloff suggested only the use of CES-D total score , and the correlated four-factor (i.e., first-order) model of Radloff  was compared to the one-factor model, the bi-factor models , and the second-order factor model. Goodness-of-fit of the model was assessed using the root-mean square error of approximation (RMSEA), comparative fit index (CFI), and Tucker-Lewis index (TLI). For the RMSEA, values < .05 indicate a close fit to the data, values in the range of .05 to .08 indicate a fair fit, and that values greater than .10 indicate a poor fit . For the CFI and TLI, values > .90 indicate a good fit to the data . Composite reliability was computed to examine the internal consistency of the total and subscale scores of the KCES-D. Although Cronbach’s alpha is the most commonly used measure for the reliability of the scales, it presupposes a tau-equivalent measurement model; otherwise it could be biased. The measurement models of the scales are clearly congeneric. Therefore, we used composite reliability as an appropriate measure for reliability in this study [25, 26]. Finally, Pearson’s r was computed to examine the relationships between the KCES-D and the trauma-related measures.
Confirmatory factor analysis indicated a poor fit for the one-factor model and a good fit for the correlated four-factor (i.e., first-order) model (see Table 2). Improper solutions [model specification errors such as a non-positive definite latent variable covariance matrix (psi)] were obtained for both the bi-factor models and the second-order factor model. Figure 1 display the path diagram of the correlated four-factor model, and Table 3 presents descriptive statistics for the KCES-D. The internal consistency for ‘depressive affect,’ ‘positive affect,’ ‘somatic and retarded activity,’ ‘interpersonal difficulties,’ and the total scale of the KCES-D yielded composite reliability = .84, .74, .83, .63, and .94, respectively. The distribution of the total scores of the KCES-D indicated that 45.4% of the sample had scores of 21 or higher (cutoff score) . Table 4 presents the Pearson correlations between the KCES-D and the trauma-related measures. The KCES-D had weak to moderate positive correlations with the IES-R, PTD Scale, PTC Scale, and PTSS Scale.
To the best of our knowledge, this study is the first to investigate the psychometric properties of the KCES-D for natural disaster survivors. The KCES-D showed a good fit for the correlated four-factor structure and adequate internal consistency, indicating a high interrelatedness of items, except for the ‘interpersonal difficulties’ subscale (composite reliability = .63), possibly due to its small number of items . In addition, 45.4% of the current sample had scores of 21 or higher (cutoff score), which is somewhat higher than the rate (25.0%) found in a community sample of Korean adults . Regarding concurrent validity, weak to moderate positive correlations were observed between the KCES-D and the trauma-related measures. This finding suggests that greater depressive symptoms are associated with greater post-traumatic stress symptoms, peri-traumatic dissociation, and post-traumatic cognition, as well as lower social support. Overall, the KCES-D appears to be an adequate instrument for assessing depressive symptoms in natural disaster survivors.
The four-factor structure is consistent with that in the Korean study  as well as the original study . Notably, the present study findings indicated a relatively high mean score (positively-keyed items for which a higher score indicates a lower positive affect) on the positive affect subscale. However, this is not surprising given the similar findings consistently shown in East Asia (e.g., Korea, Japan, China, Philippines) . In East Asia, people tend to suppress the expression of positive emotion, especially in the presence of others and are less likely to endorse positive affect, compared to those in North and South America [30, 31]. Given this, the cutoff score (21 or higher) of the KCES-D has been established higher than the CES-D (16 or higher) .
Radloff suggested only the use of CES-D total score , but the study findings did not seem to provide such justification. For example, although its internal consistency coefficient for the total score was high (composite reliability = .94) and exceeded that for the subscale scores, the one-factor model of the KCES-D did not fit the data well. Further, improper solutions were obtained for both the bi-factor models and the second-order factor model, and the four subscales of the KCES-D showed weak to strong intercorrelations and varied correlations with each trauma-related measure. Thus, its total score needs to be used carefully and further research is needed to examine whether the subscale scores have unique impacts on various trauma-related measures using multiple regression analysis .
Interestingly, there was a very low correlation between the positive affect subscale and the interpersonal difficulties subscale of the KCES-D. Also, the positive affect subscale had a weak correlation (r = .04 - .14) with the trauma-related measures. Quality of life includes positive and negative affect , and generally the lower the positive affect and the higher the negative affect represents lower quality of life . However, the results do not seem to support this, and positive affect appeared to be mutually independent of quality of life, unlike negative affect. There are two possible explanations for these results. First, the tripartite model of anxiety and depression  consists of symptoms in three groups: 1) ‘general distress’ which includes the common elements of both anxiety and depression, 2) ‘physiological hyperarousal’ that is exclusive to anxiety, and 3) ‘anhedonia’ that is exclusive to depression. Given that the positive affect subscale may be exclusive to depression, it is possible to have such low correlation. Second, the other three subscales of the KCES-D and the trauma-related scales consist of negatively-keyed items (straightforward scoring), whereas the positive affect subscale consists of positively-keyed items (reverse scoring). Thus, it is possible that the different scoring systems elicited different responses from participants [36, 37].
This study has some limitations. First, there was no diagnostic assessment for either depression or post-traumatic stress disorder. Second, this study employed natural disaster survivors living in rural areas and thus should be interpreted with caution in generalizing the study findings. Third, the test-retest stability of the KCES-D was not assessed. Fourth, improper solutions were obtained for both the bi-factor models and the second-order factor model, which may indicate wrong model specifications or low number of participants. Thus, further research is needed to assess the models with higher number of participants.
Nevertheless, the results support the correlated four-factor model and indicate that the KCES-D has adequate psychometric properties concerning application for natural disaster survivors. If these findings are further confirmed, the KCES-D can be used as a useful, rapid, and inexpensive screening tool for assessing depressive symptoms in natural disaster survivors. Certainly, the KCES-D alone should not be used as a diagnosis and treatment recommendation for depression in natural disaster survivors .
Center for Epidemiologic Studies Depression Scale
Comparative Fit Index
Impact of Event Scale-Revised
Korean version of the Center for Epidemiologic Studies Depression Scale
Post-Traumatic Social Support
Root-Mean Square Error of Approximation
McFarlane AC, Papay P. Multiple diagnoses in posttraumatic stress disorder in the victims of a natural disaster. J Nerv Ment Dis. 1992;180:498–504.
Toukmanian SG, Jadaa D, Lawless D. A cross-cultural study of depression in the aftermath of a natural disaster. Anxiety, Stress, and Copin. 2000;13:289–307.
Painter JM, Gray K, McGinn MM, Mostoufi S, Hoerster KD. The relationships of posttraumatic stress disorder and depression symptoms with health-related quality of life and the role of social support among veterans. Qual Life Res. 2016;25:2657–67.
Tremblay MA, Blanchard CM, Pelletier LG, Vallerand RJ. A dual route in explaining health outcomes in natural disaster. J Appl Soc Psychol. 2006;36:1502–22.
Wickrama T, Ketring SA. Change in the health of tsunami-exposed mothers three years after the natural disaster. Int J Social Psychiatr. 2011;58:278–88.
Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psych Meas. 1977;1:385–401.
Chin WY, Choi EPH, Chan KTY, Wong CKH. The psychometric properties of the Center for Epidemiologic Studies Depression Scale in Chinese primary care patients: factor structure, construct validity, reliability, sensitivity and responsiveness. PLoS One. 2015;10:e0135131.
Chon K, Rhee M. Preliminary development of a Korean version of the CES-D. Korean. J Clin Psychol. 1992;11:65–76.
Herniman SE, Allott KA, Killackey E, Hester R, Cotton SM. The psychometric validity of the Center for Epidemiological Studies – depression scale (CES-D) in first episode schizophrenia spectrum. Psychiatry Res. 2017;252:16–22.
Knight RG, Williams S, McGee R, Olaman S. Psychometric properties of the Center for Epidemiologic Studies Depression Scale (CES-D) in a sample of women in middle life. Behav Res Ther. 1997;35:373–80.
Makambi KH, Williams CD, Taylor TR, Rosenberg L, Adams-Campbell LL. An assessment of the CES-D scale factor structure in black women: the black Women’s health study. Psychiatry Res. 2009;150:173–80.
Nguyen HT, Kitner-Triolo M, Evans MK, Zonderman AB. Factorial invariance of the CES-D in low socioeconomic status African American compared with a nationally representative sample. Psychiatry Res. 2004;126:177–87.
Williams CD, Taylor TR, Makambi K, Harrell J, Palmer JR, Rosenberg L, Adams-Campbell LL. CES-D four-factor structure is confirmed, but not invariant, in a large cohort of African American women. Psychiatry Res. 2007;150:173–80.
Shafer A. Meta-analysis of the factor structure of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. J Clin Psychol. 2006;62:123–46.
Carleton RN, Thibodeau MA, Teale MJN, Welch PG, Abrams MP, Robinson T, Asmundson GJG. The Center for Epidemiologic Studies Depression Scale: a review with a theoretical and empirical examination of item content and factor structure. PLoS One. 2013;8:1–11.
Chon K, Choi S, Yang B. Integrated adaptation of the CES-D in Korea. Korean J Health Psychol. 2001;6:59–76.
Fong TCF, Chan CLW, Hol RTH, Chan JSM, Chan CHY, Ng SM. Dimensionality of the Center for Epidemiologic Studies Depression Scale: an exploratory bi-factor analytic study. Qual Life Res. 2016;25:731–7.
Weiss DS, Marmar CR. The impact of event scale-revised. In: Wilson JP, Keane TM, editors. Assessing psychological trauma and PTSD: a practitioner’s handbook. New York: Guilford Press; 1997. p. 399–411.
Cho Y, Yang S. Peritraumatic dissociation, post-traumatic negative beliefs, and poor social support as predictors of long-term psychological symptoms following a natural disaster. Korean. J Clin Psychol. 2013;32:955–79.
Joo H, Ahn H. A study on the development of a Posttrauma risk checklist. Korean J Gen Psychol. 2008;27:235–57.
Ahn Y, Cho Y. Psychosocial risk factors for posttraumatic stress disorder symptom severity in victims of artillery attack on Yeonpyeong island. Korean J Clin Psychol. 2014;33:875–90.
Velicer WF, Fava JL. Effects of variable and subject sampling on factor pattern recovery. Psychol Methods. 1998;3:231–51.
Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing structural equation models, Newbury Park, CA: Sage; 1993:136-162.
Bentler PM. Comparative fit indices in structural models. Psychol Bull. 1990;107:238–46.
Raykov T. Estimation of composite reliability for Congeneric measure. Appl Psychol Meas. 1997;21:173–84.
Raykov T, Shrout PE. Reliability of scales with general structure: point and interval estimation using a structural equation modeling approach. Struct Equ Modeling. 2002;9:195–212.
Cho MJ, Kim KH. Diagnostic validity of the CES-D (Korean version) in the assessment of DSM-III-R major depression. J Korean Neuropsychiatr Assoc. 1993;32:381–99.
Osburn HG. Coefficient alpha and related internal consistency reliability coefficients. Psychol Methods. 2000;5:343–55.
Yoon SY, Lim JH, Han C. Rating scales for measurement-based clinical practice of depression. Korean. J Psychopharmacol. 2012;23:136–46.
Lim YJ, Ko YG, Shin HC, Cho Y. Prevalence and correlates of complete mental health in the south Korean adult population. In: Keyes CLM, editor. Mental well-being: international contributions to the study of positive mental health. New York: Springer; 2013.
Iwata N, Buka S. Race/ethnicity and depressive symptoms: a cross-cultural/ethnic comparison among university students in East Asia, north and South America. Soc Sci Med. 2002;55:2243–52.
Cho S, Kim HY, Lee JH. Validation of the Korean version of the pain Catastrophizing scale in patients with chronic non-cancer pain. Qual Life Res. 2013;22:1767–72.
Diener E, Scollon CN, Lucas RE. The evolving concept of subjective well-being: the multifaceted nature of happiness. Adv Cell Aging and Gerontol. 2003;15:187–219.
Kim JH, Lim SK, Kim SJ, You JM, Suh KH, Kim M, Gong S. Types of experience of positive affect and negative affect. Korean J Stress Res. 2008;16:343–50.
Clark LA, Watson D. Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol. 1991;100:316–36.
Brown TA. Confirmatory factor analysis of the Penn State worry questionnaire: multiple factors or method effects? Beh Res Ther. 2003;41:1411–26.
Cho Y, Hong S. The new factor structure of the Korean version of the difficulties in emotion regulation scale (K-DERS) incorporating method factor. Meas Eval Couns Dev. 2013;46:192–201.
Bush BA, Novack TA, Schneider JJ, Madan A. Depression following traumatic brain injury: the validity of the CES-D as a brief screening device. J Clin Psychol Med S. 2004;11:195–201.
This study was supported by a grant of the Korean Mental Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HM15C1058).
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
At the time of data collection, the Institutional Review Board did not exist at the author’s institution and was not approved for research ethics. However, the study was conducted with the consent of all participants in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Cho, S., Cho, Y. Depressive symptoms following natural disaster in Korea: psychometric properties of the Center for Epidemiologic Studies Depression Scale. Health Qual Life Outcomes 15, 230 (2017). https://doi.org/10.1186/s12955-017-0811-9