- Open Access
Development and validation of the Chinese version of dry eye related quality of life scale
Health and Quality of Life Outcomesvolume 15, Article number: 145 (2017)
To develop the Chinese version of quality of life scale for dry eye patients based on the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire and to assess the reliability and validity of the developed scale.
The original IDEEL was adapted cross-culturally to Chinese language and further developed following standard procedures. A total of 100 Chinese patients diagnosed with dry eye syndrome were included to investigate the psychometric properties of the Chinese version of scale. Psychometric tests included internal consistency (Cronbach’s ɑ coefficients), construct validity (exploratory factor analysis), and known-groups validity (the analysis of variance).
The Chinese version of Dry Eye Related Quality of Life (CDERQOL) Scale contains 45 items classified into 5 domains. Good to excellent internal consistency reliability was demonstrated for all 5 domains (Cronbach’s ɑ coefficients range from 0.716 to 0.913). Construct validity assessment indicated a consistent factorial structure of the CDERQOL scale with hypothesized construct, with the exception of “Dry Eye Symptom-Bother” domain. All domain scores were detected with significant difference across three severity groups of dry eye patients (P < 0.05) except for “Satisfaction with Treatment” domain, indicating good known-groups validity.
The results indicated that the CDERQOL scale is a reliable and valid instrument for patients with dry eye syndrome among Chinese population, and could be used as a supplementary diagnostic and treatment-effectiveness measure.
Dry eye syndrome is a relatively common disease of the tear film and ocular surface that results in eye discomfort, visual disturbance, and often ocular surface damage [1, 2]. Previous researches showed dry eye syndrome has long been prevalent in Chinese population [3, 4]. A recently published meta-analysis showed the pooled prevalence of dry eye syndrome in mainland of China was 17.0%, among which female and elder individuals were more likely to suffer . The current therapeutic options are largely symptomatic, including artificial tear substitutes, or occlusion of the tear drainage. These treatment modalities give satisfactory results in mild cases. However, they seem to be insufficient in severe cases. Severe dry eye could cause corneal ulceration, opacification, even blindness. Microvascular autologous transplantation of the submandibular gland (SMG) has been suggested to be an effective treatment for severe cases of dry eye syndrome [6,7,8,9].
Due to its symptom-based nature, dry eye syndrome could have detrimental effects on patients’ health-related quality of life (HRQL) . In this regard, it seems to be necessary that the diagnosis and evaluation of the severity of the disease depend not only on objective clinical tests, but also assessments of perceived symptoms, as well as patients’ quality of life [11, 12]. There has been only a few well-developed quality of life scales specific on dry eye patients , including the Ocular Surface Disease Index (OSDI) , the Impact of Dry Eye on Everyday Life (IDEEL) questionnaire , and a newly developed single-item questionnaire named the University of North Carolina Dry Eye Management Scale (UNC DEMS) . Among these dry eye scales, the IDEEL is considered to be a reliable and validated questionnaire that fully assesses symptoms together with the effect of dry eye on daily life. The IDEEL generated in American English contains 57 items organized into 3 modules, covering 6 relevant domains which are Dry Eye Symptom Bother, Dry Eye Impact on Daily Life (impact on daily activities, emotional impact due to dry eye, impact on work due to dry eye), and Dry Eye Treatment Satisfaction (satisfaction with treatment effectiveness and treatment-related bother/inconvenience) .
Nevertheless, no dry eye-specific quality of life scale has been developed in China yet that aims to assess the severity of dry eye syndrome and to evaluate the clinical effects of surgical treatment for severe dry eye patients. Therefore, the purpose of this study was to develop a Chinese version of quality of life scale for dry eye patients based on the IDEEL questionnaire and to assess the reliability and validity of the developed scale.
Participants were recruited between December 2013 and July 2015 in two specialist hospitals in Beijing, China. Patients’ dry eye status was evaluated by an ophthalmologist using the Schirmer test, break-up time, rose bengal staining and fluorescence staining . After confirmed diagnosis of dry eye syndrome, patients were asked to complete a self-administered questionnaire to test the pilot version of the dry eye scale under the direction of a trained research assistant. For those who did not have enough time or those who had vision defect, telephone interviews were conducted instead during the routine follow-up check by the attending physicians.
Inclusion criteria were: adult subjects ≥18 years, participation on voluntary basis, literate in Chinese. Patients were excluded from the study if they were diagnosed with Sjögren syndrome, or if they had other severe diseases that may influence their quality of life substantially, such as cancer or stroke.
The study was approved by the Institutional Review Board of the Peking University Health Science Center (No. IRB00001052–08048). All of the participants signed an informed consent form prior to the study.
Translation and development of the scale
The procedure of scale development was shown in Fig. 1. A standard forward-backward procedure was used for the translation of original questionnaire. First, two forward translators independently translated the IDEEL questionnaire into Chinese (initial Version 1.0 with 57 items), and then two backward translators translated it back into English in order to maintain accuracy between the two languages and achieve equivalence between resource and target questionnaires . The researchers contacted a professional translation agency to choose those four translators. All of the translators were native speakers of Chinese who are fluent in English and also familiar with medical terminology. The researchers compared two translation and discussed with the translators for consensus.
In order to achieve cross-culture adaptation , we further conducted three focus group interviews with six patients with severe dry eye syndrome in each group. A topic guide was used for the semi-structured interviews, which included three main questions: (1) what are the symptoms of dry eye bothering you? (2) what are the impact of dry eye on your daily life? (3) Do you feel satisfied with the treatment and why? Interviews were transcribed into text and data were coded and analyzed by two experienced qualitative researchers of the team using thematic framework approach . A thematic framework was used for coding (Table 1). New emerging themes from the interviews were added in order to achieve completeness and comprehension of the questionnaire for next stage work. Those items not relevant in Chinese context were deleted. Eventually, we got an 82-item Version 2.0 scale.
Later two ophthalmologists, three stomatologists and one public health expert were invited to further adjust the scale domains and revise the items. As a result, 30 items were deleted, 5 items were combined, 16 items were revised in wording and 3 items were moved to other domains, which turned into scale Version 3.0.
Lastly, Delphi inquiry method was used to collect both qualitative and quantitative assessments from 30 experts of ophthalmology (10), stomatology (10) and public health (10). We asked experts to rate each item from Version 3 a score between 1 to 5 according to its comprehensiveness and clarity. We also invited them to give suggestions for further modification. Finally, several additional deletions and additions were made, yielding pilot scale Version 4.0, which was used to assess scale’s reliability and validity.
The pilot Chinese version of Dry Eye Related Quality of Life (CDERQOL) Scale contains 45 items classified into 5 domains: Dry Eye Symptom Bother (12 items), Dry Eye Impact on Daily Life (impact on daily activities, 7 items; emotional impact, 10 items; impact on work, 7 items), and Satisfaction with Treatment (9 items). Each item was measured using a 5-point Likert scale ranging from “completely disagree” (1) to “completely agree” (5) [19, 20].
We first described the sex and age distributions of study population, and examined differences of sex and age-group proportions across three dry-eye severity groups using chi-square tests. Then we evaluated the reliability and validity of the scale using multiple psychometric properties and tests. In detail, the construct validity was evaluated using exploratory factor analysis (EFA), which combined principal components analysis (PCA) with promax rotation analysis to testify the conceptual framework and item-dimension structures of the scale. In order to test whether the data was suitable for factor analysis, the Kaiser-Meyer-Olkin Measure of Sampling Adequacy test and the Bartlett test of sphericity were conducted before we performed EFA. Factors were retained if their eigenvalues were above 1.0 or according to the scree plot, and in combination with the theoretical structure of the scale. We considered item loadings satisfactory if loadings were above 0.40 with their own factor and larger than loadings with other factors . The internal consistency reliability was assessed using Cronbach’s ɑ coefficients. The analysis of variance (ANOVA) was then conducted to evaluate the known-groups validity, which means to test for differences in domain scores among patients with different levels of dry eye severity. We also performed post-hoc pairwise comparisons using Least Significant Difference tests.
Statistical analysis was performed using PASW Statistics 18 (SPSS, Chicago, IL). Where applicable, a P value of less than 0.05 was considered statistically significant.
Study population demographics
The initial sample size was 100. After exclusion of missing data or abnormal value, 90 subjects remained in the analyses. The demographic characteristics of the study participants are presented in Table 2.
Among the 90 participants, 60 were diagnosed with “mild or moderate dry eye syndrome”, while 30 with “severe dry eye syndrome”. Among the 30 severe patients, the etiologies were Stevens–Johnson syndrome in 25 patients, acute conjunctivitis in 3 patients, corneal pemphigoid in 1 patient, corneal chemical burns in 1 patient, and unknown in 4 patients.
The majority of the population was female (71.7%) and the mean age was 50.0 ± 13.8 years (range: 20–70 years old). Results of chi-square tests showed that the “severe dry eye” group was significantly younger than both “mild dry eye” and “moderate dry eye” groups, while the “mild” and “moderate groups” did not differ significantly by age. As for sex, the “severe group” contained a significantly higher proportion of male subjects (53.6%) than the other two groups, while the “mild” and “moderate groups” did not differ significantly by sex.
Psychometric validation of the scale
Given that three modules of “Dry Eye Symptom Bother”, “Dry Eye Impact on Daily Life” and “Satisfaction with Treatment” belong to different concepts [22, 23], it was hypothesized that each module could develop its own set of items and be considered as distinct sub-scales . Therefore, we conducted factor analysis of each module separately.
The three domains of Impact on Daily Activities, Emotional Impact and Impact on Work set up the “Dry Eye Impact on Daily Life” module. Results of the Kaiser-Meyer-Olkin Measure of Sampling Adequacy test and the Bartlett test of sphericity indicated that the data was suitable for factor analysis (KMO = 0.840; Bartlett = 1527.1, P < 0.001). We then conducted the factor analysis using PCA method and obtained 5 eigenvalues >1. But according to the scree plot, it was reasonable to extract 3 common factors, of which the accumulated variance contribution rate was up to 59.6% (Table 3).
We further conducted promax rotation analysis to distinguish the 3 common factors. The results showed that most items of Emotional Impact could be explained by factor 1, all items of Impact on Work could be explained by factor 2, and most items of Impact on Daily Activities could be explained by factor 3, which suggested that the construct validity for the “Dry Eye Impact on Daily Life” module was good (Table 4). Although several items didn’t load well on their own factors or loaded high on more than one factor, we didn’t make further adjustments to items so as to retain comparability with the original scale.
For “Dry Eye Symptom Bother” module, the results suggested 2 dimensions, which was not quite consistent with the theoretical conceptual framework. The accumulated variance contribution rate of the 2 factors was only 45.0%. The results are presented in (Additional file 1: Tables S1 and S2).
The “Satisfaction with Treatment” module yielded 2 distinct factors with eigenvalues >1, of which the accumulated variance contribution rate was up to 60.1%, indicating a structure of 2 dimensions. The dimensions could be clinically interpreted as Satisfaction with Treatment Effectiveness and Satisfaction with Tear Amount. The results are presented in (Additional file 1: Tables S3 and S4).
Internal consistency reliability
The internal consistency reliability of the scale is presented in Table 5. The internal consistency reliability was acceptable in all 5 domains (Dry Eye Symptom Bother, Impact on Daily Activities, Emotional Impact, Impact on Work and Satisfaction with Treatment), with the Cronbach’s ɑ coefficients ranging from 0.716 to 0.913.
The mean scores of all domains were found significantly different across three dry-eye severity levels (P < 0.001), except for the domain of Satisfaction with Treatment (Table 6). Results of pairwise comparisons showed that for domains of Dry Eye Symptom Bother and Impact on Daily Activities, the scores of mild and moderate patients group both differed significantly from that of the severe group (P < 0.05). As for domains of Emotional Impact and Impact on Work, all pairwise comparisons between the three severity groups resulted in P < 0.05. The results suggested the known-groups validity of the CDERQOL scale was good.
This study is one of the first studies that targeted at development and validation of the Chinese version of quality of life scale among dry eye patients. We have fulfilled the translation and cross-cultural adaptation of the widely-used IDEEL questionnaire. The results of psychometric analyses showed that the CDERQOL scale obtained good reliability and validity among Chinese dry eye patients.
In contrast to the IDEEL, the CDERQOL scale was developed based on the symptom complaints and life quality situation of Chinese patients, and emphasized more on the severe group of patients. In consideration of the severe patients’ symptoms and feelings, we added specific items such as “Vision loss”, “Little or no tears when crying” and “Lose confidence in treatment”. Moreover, the items “Afraid of economic burden of the treatment for dry eye” and “Afraid of trouble brought to your family members” were added in consideration of social-support for dry eye patients. Since more patients in China are in or over their middle ages than in other countries , we deleted the items of “Wearing contact lenses” and “Wearing make-up near or on my eyes” in the original IDEEL according to the Chinese patients’ daily lifestyle and social context. We also replaced the item “Working on a computer” with “Watching TV for a long time” because computers have not yet been widely used in some parts of China, especially in rural areas. When we interviewed Chinese patients and experts, we realized few reported “Headaches associated with dry eye symptoms” and the emotion of “Feeling older than I really are”, so we deleted the items based on the information from focus group interviews with patients and expert consultation.
The reliability analyses performed in this study indicated the CDERQOL scale has high internal consistency within all 5 domains, which is consistent with the original IDEEL. To be noted, the Cronbach’s ɑ coefficients demonstrated relatively low reliability of the domain “Satisfaction with Treatment”, with similar results also found in IDEEL . This may be due to the relatively distinct aspects of items in this domain. However, the coefficients we got all surpassed the empirical reliability criterion of 0.70 [24, 25], which confirmed strong internal reliability of the scale.
As for the validity assessment, the construct validity results of the CDERQOL scale were basically consistent with the hypothesized conception structure except for the “Dry Eye Symptom Bother” domain. The factor analysis results indicated two dimensions for “Dry Eye Symptom Bother”. But the two factors only accounted for 45.0% of the total variance, which means they cannot fully represent or explain the whole set of items, thus need further investigation. Same with the IDEEL, “Satisfaction with Treatment” domain yielded two distinct factors, but we focused more on “Satisfaction with Tear Amount” after the treatment instead of the “Treatment-Related Bother/Inconvenience” in the original IDEEL questionnaire.
The known-groups validity of all domains was good except for the domain of “Satisfaction with Treatment”. This is highly understandable because there are currently limited treatment methods for dry eye syndrome and treatment effects have not been confirmed yet. Thus there could be little difference of the treatment satisfaction among different severity groups of patients.
The current study still has several limitations. First of all, the sample size for psychometric validation was relatively small due to practical difficulties in recruiting eligible dry eye patients in hospitals, which could possibly compromise our results. However, some studies demonstrated that parametric statistics remain robust even with small sample size in the psychometric analysis . Secondly, instead of in-person interview, a few patients in our study were interviewed through telephone due to realistic conditions, which could possibly lead to information bias . There also remains a methodology problem questioning whether it is appropriate to use parametric methods (such as ANOVA and EFA conducted above) to analyze ordinal Likert Scale data. In fact, there is still a lot of discussion on this topic [26, 28]. Moreover, some researches indicated Likert scale could be biased under different cultural background and has so-called “reference-group effect” [29,30,31], which were not detected in this study. Finally, after the process of cross-cultural adaptation and item modification, the Chinese version of scale may not be reliably comparable with the original version, although most of the items overlap between the two versions.
In light of next steps, further research into the comparability between the Chinese version of dry eye scale and original IDEEL is warranted. Moreover, as the Chinese population is experiencing dramatic change in lifestyle and social context, some items of the scale may not be suitable in the future. Therefore, future research is needed to evaluate the content validity of the scale. Besides of the psychometric properties assessed in this study, several other properties merit further investigation, such as test-retest reliability, concurrent validity and responsiveness. Furthermore, it is worth consideration to combine the CDERQOL scale with clinical tests of dry eye syndrome in clinical research.
The CDERQOL scale we developed in this study has been proved to be a reliable and valid instrument for the measurement of Quality of Life of Chinese dry eye patients. The scale could have various applications including diagnosis and severity assessment of dry eye syndrome, as well as the evaluation of treatment effectiveness among dry eye patients.
Analysis of Variance
Chinese version of Dry Eye Related Quality of Life Scale
Exploratory Factor Analysis
Health-related Quality of Life
Impact of Dry Eye on Everyday Life
Ocular Surface Disease Index
Principal Components Analysis
- UNC DEMS:
University of North Carolina Dry Eye Management Scale
Perry HD. Dry eye disease: pathophysiology, classification, and diagnosis. Am J Manag Care. 2008;14(Suppl 3):S79–87.
The definition and classification of dry eye disease: report of the Definition and Classification Subcommittee of the International Dry Eye WorkShop (2007). Ocul Surf. 2007;5(2):75–92.
Li J, Zheng K, Deng Z, Zheng J, Ma H, Sun L, Chen W. Prevalence and risk factors of dry eye disease among a hospital-based population in southeast China. Eye Contact Lens. 2015;41(1):44–50.
Lin PY, Tsai SY, Cheng CY, Liu JH, Chou P, Hsu WM. Prevalence of dry eye among an elderly Chinese population in Taiwan: the Shihpai eye study. Ophthalmology. 2003;110(6):1096–101.
Liu NN, Liu L, Li J, Sun YZ. Prevalence of and risk factors for dry eye symptom in mainland china: a systematic review and meta-analysis. J Ophthalmol. 2014;2014:748654.
Yu GY, Zhu ZH, Mao C, Cai ZG, Zou LH, Lu L, Zhang L, Peng X, Li N, Huang Z. Microvascular autologous submandibular gland transfer in severe cases of keratoconjunctivitis sicca. Int J Oral Maxillofac Surg. 2004;33(3):235–9.
Qin J, Zhang L, Cai ZG, Mao C, Liu XJ, Lv L, Zou LH, Peng X, Su JZ, Wu J, et al. Microvascular autologous transplantation of partial submandibular gland for severe keratoconjunctivitis sicca. Br J Ophthalmol. 2013;97(9):1123–8.
Borrelli M, Schröder C, Dart JK, Collin JR, Sieg P, Cree IA, Matheson MA, Tiffany JM, Proctor G, van Best J, et al. Long–term follow–up after submandibular gland transplantation in severe dry eyes secondary to cicatrizing conjunctivitis. Am J Ophthalmol. 2010;150(6):894–904.
Jacobsen HC, Hakim SG, Lauer I, Dendorfer A, Wedel T, Sieg P. Long-term results of autologous submandibular gland transfer for the surgical treatment of severe keratoconjunctivitis sicca. J Craniomaxillofac Surg. 2008;36(4):227–33.
Uchino M, Schaumberg DA. Dry eye disease: impact on quality of life and vision. Curr Ophthalmol Rep. 2013;1(2):51–7.
Mizuno Y, Yamada M, Miyake Y. Association between clinical diagnostic tests and health-related quality of life surveys in patients with dry eye syndrome. Jpn J Ophthalmol. 2010;54(4):259–65.
Lin PY, Cheng CY, Hsu WM, Tsai SY, Lin MW, Liu JH, Chou P. Association between symptoms and signs of dry eye among an elderly Chinese population in Taiwan: the Shihpai eye study. Invest Ophthalmol Vis Sci. 2005;46(5):1593–8.
Grubbs JJ, Tolleson-Rinehart S, Huynh K, Davis RM. A review of quality of life measures in dry eye questionnaires. Cornea. 2014;33(2):215–8.
Schiffman RM, Christianson MD, Jacobsen G, Hirsch JD, Reis BL. Reliability and validity of the ocular surface disease index. Arch Ophthalmol. 2000;118(5):615–21.
Abetz L, Rajagopalan K, Mertzanis P, Begley C, Barnes R, Chalmers R. Development and validation of the impact of dry eye on everyday life (IDEEL) questionnaire, a patient-reported outcomes (PRO) measure for the assessment of the burden of dry eye on patients. Health Qual Life Outcomes. 2011;9:111.
Grubbs JJ, Huynh K, Tolleson-Rinehart S, Weaver MA, Williamson J, Lefebvre C, Davis RM. Instrument development of the UNC dry eye management scale. Cornea. 2014;33(11):1186–92.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.
Jane R, Jane L. Qualitative research practice: a guide for social science students and researchers. London: SAGE Publications Inc.; 2003.
Likert R. A technique for the measurement of attitudes. Arch Psychology. 1932;22(140):55.
Sullivan GM, Artino AJ. Analyzing and interpreting data from likert-type scales. J Grad Med Educ. 2013;5(4):541–2.
Hays RD, Hayashi T. Beyond internal consistency reliability: rationale and user’s guide for multitrait analysis program on the microcomputer. Behav Res Methods Instrum Comput. 1990;22(2):167–75.
Wilson IB, Cleary PD. Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. JAMA. 1995;273(1):59–65.
Shikiar R, Rentz AM. Satisfaction with medication: an overview of conceptual, methodologic, and regulatory issues. Value Health. 2004;7(2):204–15.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.
CRONBACH LJ. A case study of the split-half reliability coefficient. J Educ Psychol. 1946;37(8):473–80.
Norman G. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Educ Theory Pract. 2010;15(5):625–32.
Marcus AC, Crane LA. Telephone surveys in public health research. Med Care. 1986;24(2):97–112.
Carifio J, Perla R. Resolving the 50-year debate around using and misusing Likert scales. Med Educ. 2008;42(12):1150–2.
Flaskerud JH. Is the Likert scale format culturally biased? Nurs Res. 1988;37(3):185–6.
Lee JW, Jones PS, Mineyama Y, Zhang XE. Cultural differences in responses to a Likert scale. Res Nurs Health. 2002;25(4):295–306.
Heine SJ, Lehman DR, Peng K, Greenholtz J. What’s wrong with cross-cultural comparisons of subjective Likert scales?: the reference-group effect. J Pers Soc Psychol. 2002;82(6):903–18.
We acknowledge the constructive comments from experts of ophthalmology, stomatology and public health during the development of the scale. We are grateful to the study participants at Peking University Hospital of Stomatology and Beijing Tongren Hospital.
This study was funded by the National Natural Science Foundation of China (No. 81271161, 81470756).
Availability of data and materials
The datasets analyzed during the current study are not publicly available due to patients’ confidentiality issues but are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by the Institutional Review Board of the Peking University Health Science Center, with case number of No. IRB00001052–08048. All of the participants signed an informed consent form prior to the actual study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Results of exploratory factor analysis for “Dry Eye Symptom Bother” and “Satisfaction with Treatment” modules. (DOCX 18 kb)