Cross-cultural adaptation and validation of the Chinese version of the Malocclusion Impact Scale for Early Childhood (MIS-EC/C)

Abstract

Background

The Malocclusion Impact Scale for Early Childhood (MIS-EC) is a newly developed questionnaire used to measure the parental perceptions of the impact of malocclusion on oral health-related quality of life (OHRQoL) of preschool children aged 3–5 years. This study describes the cross-cultural adaptation and validation of the MIS-EC questionnaire into Chinese version (MIS-EC/C).

Methods

The MIS-EC/C was developed in accordance with international standards. The scale was then evaluated in a cross-sectional study comprising 210 preschool children aged 3–5 years. The reliability of the MIS-EC/C was tested using internal consistency and test-retest reliability analyses. Cross-cultural validity, discriminant validity and convergent validity were tested.

Results

The Cronbach’s α value and intraclass correlation coefficient (ICC) value for the MIS-EC/C were 0.943 and 0.873, respectively. Confirmatory factor analysis indicated that the fitting indicators of the two-factor model all reached the standard. The MIS-EC/C can differentiate preschool children with malocclusion from those without malocclusion. In addition, there is a good relationship between the MIS-EC/C and the general oral health question.

Conclusion

The MIS-EC/C is a reliable and effective assessment tool for assessing the effect of malocclusion on the OHRQoL of preschool children in China.

Introduction

Malocclusion is a common condition of primary dentition and is caused by the interaction of environmental, genetic, and behavioral factors [1, 2]. It is considered a very common public health problem. Recent study has shown that approximately 56% of children and adolescents worldwide show some type of malocclusion [3]. Some common types of malocclusion in children, such as anterior open bite and posterior crossbite, can affect the aesthetics and oral health-related quality of life (OHRQoL) of children [4,5,6]. Patient-reported outcomes (PROs) are increasingly being recognized as important in oral epidemiological studies and clinical trials. Subjectively assessing oral health’s impact on mental health, social behavior, and daily functioning is possible with these tools.

In the past few decades, many assessment tools have emerged to evaluate the OHRQoL of children and adolescents [7,8,9]. However, the number of OHRQoL questionnaires involving preschool children is very small. Currently, there are only three questionnaires designed for this population, i.e., the Early Childhood Oral Health Impact Scale (ECOHIS) [10], the Scale of Oral Health Outcomes for 5-year-old children (SOHO-5) [11], and the Pediatric Oral Health-Related Quality of Life (POQL) [12]. In addition, these three questionnaires mainly address the impact of dental caries on the quality of life. There is no questionnaire that specifically assesses the effects of malocclusion on preschool children. Therefore, it is necessary to develop a questionnaire for preschool children with malocclusion to more sensitively and accurately assess the impact of malocclusion on the quality of life of preschool children. To address this problem, Homem et al. recently developed the Malocclusion Impact Scale for Early Childhood (MIS-EC) [13]. The MIS-EC questionnaire is a tool to assess the parental perceptions of the impact of malocclusion on the quality of life of preschool children aged 3 to 5 years. It includes the impact on the pediatric patients and the family and contains a total of 8 items [13]. The MIS-EC questionnaire was found to be reliable and valid in a preliminary study [13].

The original MIS-EC questionnaire was compiled in Brazilian Portuguese and English. Therefore, to facilitate its use in other languages and cultures, it should be properly translated, followed by cultural adjustments and psychological assessments. To date, no Chinese version of the MIS-EC questionnaire has been verified. Therefore, a Chinese version of the MIS-EC (MIS-EC/C) questionnaire is needed to provide services to Chinese preschool children. In this context, the aim of this study was to translate the MIS-EC questionnaire and adapt it to China’s national context. In addition, the measurement performance of the Chinese version was evaluated to determine whether the MIS-EC/C serves as an effective measure for assessing OHRQoL in Chinese preschool children with malocclusion. The hypothesis is that the MIS-EC/C is similar to the original version and has adequate psychometric properties.

Methods

Ethical considerations

This study was approved by the ethics committee of our hospital (no. 2018(009)). Parents of all participants who sought treatment in the Women and children’s hospital of Chongqing Medical University provided written informed consent and comprehended the study’s details.

Participants

Using convenience sampling, 210 preschool children who sought treatment in the Women and children’s hospital of Chongqing Medical University were recruited. The recommended sample size was 7 times the number of items (8 items*7 = 56), but the confirmatory factor analysis (CFA) required the sample size to be greater than 200 [14]. Thus, the final sample size was 210, which was in compliance with the standard. The exclusion criteria were toothache caused by dental caries, a history of dental trauma one month before the clinical examination and the use of orthodontic appliances in the past.

The questionnaire was applied to all preschool-aged children in the presence of their guardians before the dental examination. If the participants had any questions, the investigators could be contacted at any time. It took approximately 10 min to complete each assessment. The oral examination was performed by an experienced dentist in our hospital (CQ). WHO criteria, i.e., the decayed, missing and filled teeth (dmft) index, was adopted to evaluate caries, which were classified based on number: no caries, dmft = 0; and caries, dmft > 0 [15]. Malocclusion was assessed using previously published standards proposed by Foster et al. [16]. For clinical calibration, repeated examinations were performed on 20 preschool children after one week to confirm the intra-examiner agreement. The Kappa values of the intra-examiner agreement were 0.92 and 0.95, for caries and malocclusion, respectively.

MIS-EC

The MIS-EC was compiled and studied by Homem et al. [13]. The scale includes 8 items in 2 domains: the Child Impact Sect. (6 items) and the Family Impact Sect. (2 items). For scoring, a Likert scale was used, with scores ranging from 0 (never) to 4 (very often). If the response is “I don’t know,” the item is not scored and considered missing data. The higher the score is, the greater the impact; the total score of the scale ranges from 0 to 32 points. To test the convergent validity, a general oral health question (“How would you evaluate the health of your child’s teeth, mouth, lips and jaws (bones of the oral cavity)?“) was added at the end of the MIS-EC. The possible answers to the general oral health question are “very good (0),“ “good (1),“ “fair (2)” “poor (3)” and “very poor (4).”

Translation and cross-cultural adaptation

In accordance with standard guidelines [17], I translated and cross-culturally adapted the questionnaire in 5 steps. In the first step, the questionnaire was translated into Chinese by two bilingual translators with dental experience. Two drafts of the questionnaire were then generated. Both translators were proficient in Chinese and English. A second step was to translate the two Chinese versions back into English by two local dental experts who were not familiar with the MIS-EC and resolve the differences between the two versions. Two dental experts and a medical English professor evaluated the translation quality, resulting the second Chinese version. A team of experts studied the conceptual and semantic equivalence of the second draft, revised the draft, and conducted a preassessment with 30 participants. Each item of the evaluation was analyzed separately after the evaluation. We modified the translated version (MIS-EC/C) to keep the original meaning. This was done to avoid any confusion.

Statistical analysis

Statistical analysis was performed using SPSS software 25.0 and AMOS 25.0 (IBM Corp. NY; USA).A statistical significance level of 0.05 was used.

Reliability analysis

Internal consistency and test-retest reliability were used to evaluate the reliability of the MIS-EC/C. Internal consistency was evaluated by calculating Cronbach’s α value. Two weeks after completing the MIS-EC/C for the first time, 30 preschool children were randomly selected, and test-retest reliability was evaluated by calculating the intraclass correlation coefficient (ICC). Prior to completing the MIS-EC/C survey, all participants received no treatment.

In general, when the Cronbach’s α value is 0.70 or higher, the difference between the test value and the retest value is comparable. It is recommended, however, the Cronbach’s α value does not exceed 0.95 in order to avoid redundancy [14]. ICC values range from 0 to 1. In general, repeatability is better when the ICC value is high. ICCs can be divided into 4 categories: poor (< 0.50), moderate (0.50–0.75), good (0.75–0.90), and excellent (> 0.90) [18].

Validity analysis

Cross-cultural validity, discriminant validity, and convergent validity were used to evaluate the validity of the MIS-EC/C. Confirmatory factor analysis (CFA) was used to assess cross-cultural validity. To evaluate the goodness of fit between the model and the data, we used the following parameters: the ratio of chi-square to degrees of freedom (chi-square/DF), the goodness-of-fit index (GFI), the Tucker‒Lewis index (TLI), the comparative fit index (CFI), and root mean square error of approximation (RMSEA). According to traditional standards, an acceptable model has a chi-square/DF lower than 3.0, a TLI greater than 0.90, and a RMSEA less than 0.08 [19].

The discriminant validity of the MIS-EC/C was evaluated using the Mann‒Whitney U test, and the questionnaire scores for participants with and without malocclusion were compared. The convergent validity was evaluated by calculating the correlation coefficient between the MIS-EC/C score and the general oral health question score. Spearman coefficients of 0-0.20, 0.21–0.40, 0.61–0.80, and 0.81-1.0 are broken down into weak, fair, good, and excellent correlations [14]. On the basis of previous study [13], we predicted that there was a good positive correlation between the MIS-EC/C score and the total score of overall oral health problems.

Results

Participant characteristics

In this study, 210 preschoolers were included. All preschool guardians said the MIS-EC/C was easy to understand and answered all the questions. No participants answered ‘don’t know’, and no questionnaire item needed to be excluded. It contains the same number of domains and items as the original version. Participants’ basic characteristics are listed in Table 1.The mean age of the participants was 4 ± 1.4 years. There were 92 males (43.8%) and 118 females (56.2%). The majority of preschool children lived in urban areas.In terms of household income, more than half of the households with preschool children had an annual income of more than 50,000 yuan. Regarding the malocclusion status, 64% of the preschool children had malocclusion. In terms of dental caries, the prevalence among the preschool children was 52.9%.

Table 1 Characteristics of preschool children (n = 210)

Reliability

Table 2 provides the mean scores and reliability results for the MIS-EC/C.

Table 2 Mean scores and reliability results for the MIS-EC/C

Table 3 provides the internal consistency and test-retest reliability results for the MIS-EC/C. Cronbach’s alpha ranged from 0.935 to 0.959. The total Cronbach’s alpha value for the MIS-EC/C was 0.943. After 2 weeks, 30 preschool children were retested to calculate the reliability (ICC). The ICC values ranged from 0.844 to 0.895. The total ICC score was 0.873.

Table 3 Internal consistency and test-retest reliability of the MIS-EC/C

Validity

CFA was used to assess cross-cultural validity. The CFA results indicated that the two-factor model had an acceptable goodness of fit (chi-square/DF = 2.067, GFI = 0.946, TLI = 0.956, CFI = 0.958, and RMSEA = 0.078). The correlation between these factors was high and satisfactory (Fig. 1).

Fig. 1

The CFA results of the MIS-EC/C

Table 4 provides the discriminant validity results for the MIS-EC/C. Discriminant validity was assessed by comparing the average scores of preschool children with or without malocclusion. The average MIS-EC/C score for the group without malocclusion was 5.59 points and that for the group with malocclusion was 9.76 points. The difference between the two groups was significant, indicating that the MIS-EC/C has good discriminant validity.

Table 4 Discriminant validity of the MIS-EC/C

Table 5 shows the convergent validity results for MIS-EC/C. This result indicates that MIS-EC/C has a good relationship with general oral health question.

Table 5 Convergent validity of the MIS-EC/C

Discussion

To our knowledge, this is the first cross-cultural translation and adaptation of the English version of the MIS-EC into Chinese, with a subsequent evaluation of its psychometric properties. All guardians of the preschool children reported that they had no difficulty understanding the content of the MIS-EC/C. The results confirmed the hypothesis that the MIS-EC/C had high reliability and validity with regard to measuring OHRQoL in Chinese preschool children.

In recent years, clinical and epidemiological studies on PROs have been conducted by many Chinese researchers, which have been increasingly used to quantify the impact of oral health on diverse populations [20,21,22]. The cross-cultural adaptation of these scales must strictly follow the procedures proposed by international standards. In China, there are 870 million people who speak Mandarin, so clinical research requires a Chinese version of the MIS-EC questionnaire.

For the reliability analysis, the Cronbach’s α value for the MIS-EC/C was 0.943, higher than the value for the original scale (0.87). The ICC of the test-retest reliability was slightly lower than that for the original scale (0.94), indicating that the MIS-EC/C showed good repeatability when completed at 2 different times. The differences in these results may involve cultural and social factors. Among the relevant literature [23], retest intervals range from 2 days to 1 month. Similar to the assessment of the original scale, we retested participants 2 weeks after the first test. In summary, the results indicate that the MIS-EC/C is a reliable measurement tool.

We performed CFA to evaluate the cross-cultural validity of the MIS-EC/C. Based on the CFA results, it was confirmed that the two-factor model fit the data well. Chi-square/DF and RMSEA are the two most suitable indices for evaluating CFA [24]. It was considered acceptable to have chi-square/DF values of 3.0 and RMSE values of 0.08 in this study.

In addition, questionnaire scores for participants with and without malocclusion were used to evaluate the discriminant validity of the MIS-EC/C. The difference in the average scores for those without malocclusion and those with malocclusion was statistically significant, indicating that the scale had good discriminant validity. According to its convergent validity, the MIS-EC/C shows a good relationship with the general oral health question. These findings are consistent with previous study [13].

The main limitation of this study is that we did not examine the sensitivity of the MIS-EC/C since it requires a longitudinal study. Research will be conducted on the scale’s sensitivity in the future.

In summary, the MIS-EC/C has good reliability and validity and can be applied to preschool children with malocclusion in China for research or clinical purposes. For further validation and improvement of the scale, we need to conduct a sensitivity analysis through a large-scale longitudinal study.

Conclusions

The MIS-EC/C is a reliable and effective assessment tool for assessing the parental perceptions of the effect of malocclusion on the OHRQoL of preschool children in China.