Skip to main content

The development, validation, and psychometric properties of the Japanese version of the Child Oral Health Impact Profile-Short Form 19 (COHIP-SF 19) for school-age children

Abstract

Background

This study was performed to develop and validate a Japanese version of Child Oral Health Impact Profile-Short Form (COHIP-SF) 19 and to assess its psychometric properties in Japanese school-age children.

Methods

The original English COHIP-SF 19 was translated into Japanese (COHIP-SF 19 JP) using a standard forward and backward translation procedure. The psychometric properties of the COHIP-SF 19 JP were assessed in 379 public school students between 7 and 18 years of age in Fukuoka, Japan. Internal consistency (Cronbach’s alpha) and test-retest reliability (intraclass correlation coefficient, ICC) were the metrics used for evaluation of this questionnaire. The discriminant validly was examined using the Wilcoxon rank sum test to identify significant differences in COHIP-SF 19 JP scores according to the results of dental examinations. The convergent validity was examined using the Spearman correlations to determine the relationships between COHIP-SF 19 JP scores and the self-perceived oral health ratings. Confirmatory factor analyses (CFA) were performed to verify the factor structure of the questionnaire.

Results

The COHIP-SF 19 JP revealed good internal consistency (Cronbach’s alpha, 0.77) and test-retest reliability (ICC, 0.81). Discriminant validity indicated that children with dental caries or malocclusion had significantly lower COHIP-SF 19 JP scores (P <  0.05); convergent validity indicated that the self-perceived oral health rating was significantly correlated with the COHIP-SF 19 JP total score and subscores (rs = 0.352–0.567, P <  0.0001), indicating that the questionnaire had a sufficient construct validity. CFA suggested that the modified four-factor model had better model fit indices than the original three-factor model.

Conclusion

The collected data showed that the COHIP-SF 19 JP possesses sufficient psychometric properties for use in Japanese school-age children.

Background

Oral health is an important component of overall health, as oral disorders can have a significant impact on physical, social, and emotional well-being [1]. For example, among oral disorders, dental caries (tooth decay) [2], missing teeth [3], malocclusion [4, 5] and craniofacial anomalies [6] can adversely affect quality of life (QoL). Therefore, oral health-related quality of life (OHRQoL) is becoming increasingly important in both population research and clinical practice [1].

A variety of questionnaires measuring OHRQoL have been developed for adults [7,8,9]. However, age-specific instruments are still required for better analysis of OHRQoL. As children and adolescents have different QoL-related issues compared to adults [10], various instruments for measurement of OHRQoL in pediatric populations have been developed over the past several decades, despite the difficulties associated with the development and validation of such instruments [11]. These include the Scale of Oral Health Outcomes for 5-year-old children [12], the Pediatric Oral Health-Related Quality of Life Measure [13] and the Child Oral Impacts on Daily Performances Index [14]. However, the most frequently used self-completed QoL scales for children are the Child Perceptions Questionnaire (CPQ) [15] and Child Oral Health Impact Profile (COHIP) [16].

The CPQ was the first validated questionnaire specifically designed to measure OHRQoL in children and adolescents [15]. The developers of the CPQ considered theories of child developmental psychology, and created different versions for specific age ranges, e.g. the CPQ8–10 for 8–10-year-old children and CPQ11–14 for adolescents [17, 18]. However, it is unclear whether the different versions are consistent, i.e. whether scores are comparable among them [19]. Therefore, care is required when conducting longitudinal research utilizing the CPQ [20].

The COHIP, which was originally developed to assess “oral–facial well-being” over a range of ages (8–15 years of age) [21] and ethnicities [22,23,24], is also a well-validated and comprehensive questionnaire for determining children’s OHRQoL. It contains 34 questions and five subscales (oral health, functional well-being, socio-emotional well-being, school environment, and self-image). The COHIP questions cover the oral and maxillofacial areas. An important characteristic of this scale is the inclusion of positive aspects of OHRQoL (e.g. confidence and attractiveness). Child Oral Health Impact Profile-Short Form (COHIP-SF) 19 is a shortened version of the scale, developed in 2012, containing 19 items and three subscales (oral health, functional well-being, and socio-emotional well-being); the psychometric properties of the original version are well-maintained [25]. The short form can be administered more quickly, which facilitates QoL assessment in clinical studies [20, 25]. COHIP-SF 19 has been translated into Arabic [26], German [19] and Chinese (Mandarin) [27]. As models of OHRQoL should take account of cultural factors [1], the COHIP-SF 19 is a good instrument for international comparisons of OHRQoL in child and adolescent populations. In addition, because its target age has been extended from 8–15 to 7–18 years of age [25], the COHIP-SF 19 is suitable for longitudinal research, such as QoL studies in patients with cleft palate who require long-term treatment commencing after birth and continuing into adulthood [20].

The present study was performed to develop and validate a Japanese version of the COHIP-SF 19 to assess its psychometric properties in Japanese school-age children. The development of different language versions of the COHIP is beneficial for future international comparisons of children’s OHRQoL as an outcome of clinical interventions in dental and craniofacial/maxillofacial regions.

Methods

Translation and pilot test of Japanese version of COHIP-SF 19 (COHIP-SF 19 JP)

This study protocol was reviewed and approved by the Kyushu University Institutional Review Board (IRB) for Clinical Research (#30–186). The original English version of the COHIP-SF 19 was obtained from the developer, then translated and adapted in accordance with standard guidelines [28]. The instrument was first independently translated into Japanese by two native Japanese speakers, both of whom were the dentists and fluent in Japanese and English. A native English speaker who was not familiar with the area of research discussed and revised the translation along with the two translators; a single consensus version was then compiled. This consensus version was pilot-tested on a sample of 20 young patients, 8–17 years of age, at the Department of Orthodontics, Kyushu University Hospital. Based on the feedback received from the participants, the members of the research team reviewed and modified the questionnaire for proper wording and layout. It was back-translated to English by a professional translator who was not familiar with the area of research. The back-translated English version was then evaluated by the developer and revised in accordance with her comments. Finally, the Japanese version of COHIP-SF 19 JP was compiled.

Setting of variables

The COHIP-SF 19 JP questionnaire consists of 19 questions, which form three conceptual subscales: oral health (five items), functional well-being (four items), and socio-emotional well-being (10 items). Two of the 19 items were positively worded questions. Children were asked how often they had experienced oral impacts during the past 3 months; each question was answered using a five-point Likert scale, which ranged from “never” to “almost all the time.” Responses to the two positively worded questions were recorded as “never” = 0, “almost never” = 1, “sometimes” = 2, “fairly often” = 3, and “almost all the time” = 4. Scoring for the 17 negatively worded items was reversed. Therefore, higher scores reflected a more positive OHRQoL [25]. The overall score was calculated by summing the scores for all 19 items within a range of 0–76. In addition, there was one self-rated item concerning health/oral health, which was scored from excellent to poor.

Data collection

Prior to data collection, we calculated the minimum sample size required for Cronbach’s coefficient alpha according to Bonett [29] with stringent parameters: minimum acceptable Cronbach’s alpha (H0), 0.6; expected Cronbach’s alpha (H1), 0.75; significance level (α), 0.05; two-tailed; power (1 − β), 90%; and number of items (k), 19. The minimum sample size needed was estimated as n = 102. For confirmatory factor analysis (CFA), we used ‘a rule of thumb’ for covariance structure analysis [30, 31], i.e. an ideal sample size-to-item ratio would be 20:1 (n = 380) and a less ideal ratio would be 10:1 (n = 190). We estimated a required sample size of 300 to allow both the reliability and structure analysis of the questionnaire.

All applied questionnaires were paper-based and self-administered. The cross-sectional study was conducted in Fukuoka, Japan, with a target population of students 7–18 years of age. Initially, four of 271 urban public schools were invited to participate in the study, and three schools (an elementary school, a junior high school, and a high school) agreed to participate in the study: all classes from grades 2 to 6 in the elementary school, which were equivalent to 8–12 years of age; all classes from each grade equivalent to 13–15 years of age in the junior high school; and two randomly selected classes from each grade equivalent to 16–18 years of age in the high school. The participating classes in the high school were randomly chosen by the school. The 20 patients who contributed to this pilot study did not participate in the survey.

The inclusion criteria [25] were as follows: age between 7 and 18 years, absence of cognitive impairment or other chronic illnesses, and no history of orthodontic treatment. The exclusion criteria [25] were as follows: age above or below the specified range, presence of cognitive impairments or other chronic illnesses, presence of severe oral pain and limited range of jaw movement, and current or prior orthodontic treatment. Prior to data analysis, participants who did not complete more than 75% of the questions in the COHIP-SF 19 JP were excluded. At the subscale level, if more than two thirds of the items were missing in a specific subscale, the sample was classified as missing. If fewer items were missing, the missing values were replaced with the mean score of available items. Of the 2043 children recruited for the study, the 520 responded, and the 379 fulfilled the inclusion/exclusion criteria and provided complete questionnaires that were usable for analysis. The reliability and validity of the COHIP-SF 19 JP were assessed based on these 379 participants. To assess the test-retest reliability, the same questionnaire was distributed to 210 participants who agreed to take the retest 3–4 weeks after the first survey. The “retest questionnaire” was administered only to those who provided written consent at the time of the initial test.

Information regarding dental caries, gingivitis, plaque retention, and malocclusion

In addition to the questionnaire, we obtained general information regarding dental status for each participant from the annual dental examination conducted by the schools. Decayed-missing-filled teeth (df/DMF), gingivitis, plaque retention, and malocclusion were examined by fully trained school dentists, in accordance with the basic procedures of the Ministry of Education, Culture, Sports, Science and Technology of Japan [32]. The questionnaires were administered after the examination and collected within 1 month.

Reliability and validity assessment

Internal consistency was assessed by calculating Cronbach’s alpha for the overall scale and for each subscale (oral health, functional well-being, and socio-emotional well-being). The magnitude of Cronbach’s alpha was judged in accordance with published guidelines [33]; a coefficient ≥ 0.7 was considered to indicate satisfactory internal consistency. In addition, Cronbach’s alpha for the instrument was computed for each item by sequentially removing the items from the instrument. Test-retest reliability was assessed using the intraclass correlation coefficient (ICC). Discriminant validity was also tested using four major indicators of dental status: dental caries, gingivitis, plaque retention, and malocclusion. Participants were divided into two groups according to the presence or absence of df/DMF, gingivitis, plaque retention, and malocclusion. The nonparametric Wilcoxon rank sum test was used to identify significant relationships between COHIP-SF 19 JP scores and the results of dental examinations. Convergent validity was assessed by measuring the coefficients of Spearman correlations between the self-perceived oral health rating score and scores from the COHIP-SF 19 JP. Self-perceived oral health ratings were surveyed using the independent question, “Overall, what is your oral health?”; the question was answered using a five-point Likert scale as “poor” = 0, “fair” = 1, “average” = 2, “good” = 3, and “excellent” = 4. These analyses were performed using JMP Pro 14 (SAS Institute Inc., Cary, NC, USA). In all analyses, P <  0.05 was taken to indicate statistical significance.

Factor analysis

To evaluate factor loading of the subscales of the COHIP-SF 19 JP, confirmatory factor analysis (CFA) was conducted utilizing SPSS AMOS 26 (IBM Corp., Armonk, NY, USA).

The goodness of fit of the explored models was evaluated using several different model indices, including χ2/DF = chi-squared/degree of freedom, RMSEA = Root Mean Square Error of Approximation, GFI = Goodness of Fit Index, AGFI = Adjusted Goodness of Fit Index, CFI = Comparative Fit Index, AIC = Akaike Information Criterion. Values for acceptable fit were determined with reference to the literature [34], as follows: χ2/DF ≤ 3, RMSEA ≤0.08, 0.90 ≤ GFI, 0.85 ≤ AGFI, 0.95 ≤ CFI, AIC < AIC for comparison model.

Results

Descriptive statistics

The mean COHIP-SF 19 JP score was 60.7 (standard deviation [SD], ± 7.4) and the median was 62 (range, 32–76). Means, medians, ranges, and quartiles for all COHIP-SF 19 JP responses, with each subscale score, are shown in Table 1. The Shapiro–Wilk test showed that the distributions of overall COHIP-SF 19 JP scores and subscale scores were significantly different from a normal distribution (P <  0.001).

Table 1 Descriptive statistics for COHIP-SF 19 JP and subscale scores (n = 379)

The COHIP-SF 19 JP scores by sex and age were examined using the Wilcoxon rank sum test and the data are presented in Table 2. There were no significant differences in either the overall COHIP-SF 19 JP score or the subscale score for oral health according to sex or age. However, females had a significantly higher socio-emotional well-being subscale score than males (P = 0.02). There were significant differences in the subscale scores for functional well-being and socio-emotional well-being by age (school). Compared to the younger age group, the older age group had significantly higher functional well-being scores (P = 0.02) but significantly lower social-emotional well-being scores (P = 0.03).

Table 2 Descriptive analysis of COHIP-SF 19 JP scores by sex and age

Reliability

Cronbach’s alpha of the total COHIP-SF 19 JP score was 0.77 (Table 3), indicating satisfactory internal consistency according to published guidelines [33]. Cronbach’s alphas for the subscales of oral health, functional well-being, and socio-emotional well-being were 0.57, 0.45, and 0.68, respectively (Table 3). The item-test correlation, item-rest correlation, and “alpha if item deleted” are indicated in Tables 3 and 4. The item-test correlation and item-rest correlation represent the correlations between an individual item and the total score, and between the item and the sum of the rest of the item scores, respectively. The “alpha if item deleted” represents the recalculated Cronbach’s alpha if each item was removed from the questionnaire. As shown in Table 4, the alpha increased slightly if the three items with the lowest item-rest correlations (Q7, Missed school for any reason; Q8, Been confident; Q15, Felt that you were attractive [good-looking]) were deleted.

Table 3 Internal reliability analysis of COHIP-SF 19 JP and each subscale (n = 379)
Table 4 Item discrimination and reliability analysis of COHIP-SF 19 JP (n = 379)

In terms of test-retest reliability, the ICC was 0.81 for the overall COHIP-SF 19 JP score, which indicated good test-retest reliability. In addition, ICCs for the three subscales—oral health, functional well-being, and socio-emotional well-being—were 0.75, 0.67, and 0.76, respectively.

Discriminant validity

Although the clinical dental indicators (df/DMF, gingivitis, plaque retention, and malocclusion) were recorded as continuous variables during the annual dental examination, the majority of variables had a value of 0 for all indicators. Therefore, we compared the COHIP-SF 19 JP total and subscale scores between groups with and without df/DMF, gingivitis, plaque retention, and malocclusion to analyze the discriminant validity (Table 5).

Table 5 Discriminant validity: COHIP-SF 19 JP scores based on the clinical dental indicators

Children without df/DMF had significantly higher overall scores in total COHIP-SF 19 JP (P = 0.03) and functional well-being subscale (P = 0.002). Children without malocclusion also had significantly higher overall scores in total COHIP-SF 19 JP (P = 0.003) and the socio-emotional well-being subscale (P = 0.001). There were no significant relationships between plaque retention or gingivitis and COHIP-SF 19 JP scores.

Convergent validity

The convergent validity of the COHIP-SF 19 JP is shown in Table 6. The average self-perceived oral health rating was 2.69 (± 0.99 SD). Correlations of total COHIP-SF 19 JP score or three subscale scores with the perceived oral health ratings were significant in all pairs (P <  0.0001), and the coefficients were positive (rs = 0.352–0.567).

Table 6 Convergent validity: Spearman correlations of the self-perceived oral health rating with the COHIP-SF 19 JP scores

Confirmatory factor analysis

The fit values of the three-factor model, which is identical to the original COHIP-SF 19, satisfied the acceptable fit criterion (Table 7). Inter-factor correlation coefficients showed relatively higher correlations, ranging from 0.68 to 0.84 (Fig. 1). Three items (Q7, Q8, Q15) had small factor loadings of < 0.1. The strong correlation of the error covariances between Q8 and Q15 (0.61) suggested that the two items share some common characteristics, which are unique to them and are not well represented in the three-factor model.

Table 7 Comparison of measures of fit values of three-factor and four-factor models using CFA
Fig. 1
figure 1

Three-factor model of COHIP-SF 19 JP by confirmatory factor analysis. This three-factor model maintained the same structure model as the original COHIP-SF 19. Inter-factor correlation coefficients showed correlations ranging from 0.68 to 0.84. Three items, Q7, Q8, and Q15, had small factor loadings < 0.1. Correlations of error covariances between two items were indicated only when correlations were > 0.2. Error covariances of Q8 and Q15 were strongly correlated

We explored a more reasonable model in which questions Q8 and Q15 were extracted as a new factor (Fig. 2). The factor loadings of the two positive questions, Q8 and Q15, were 0.75 and 0.81, respectively, indicating a better model for four potential factors. The two questions had belonged to an independent subscale known as “Self-image” in the original long-version, COHIP-34. This four-factor structure model showed slightly better fit indices in RMSEA = 0.06, GFI = 0.91, AGFI = 0.89, and AIC = 436.50, compared with the three-factor model [34] (Table 7). Inter-factor correlation coefficients among the three original factors were unaltered even in the four-factor model.

Fig. 2
figure 2

Four-factor model of the COHIP-SF 19 JP by confirmatory factor analysis. The four-factor model provided better factor loadings than the three-factor model. Inter-factor correlation coefficients remained high among the three existing subscales, but low correlations were observed with the new factor. Only one item, Q7, had small factor loading < 0.1. Correlations of error covariances between two items were indicated only when correlations were > 0.2

Discussion

The development of a validated Japanese questionnaire is essential for the efficient and effective assessment of the OHRQoL of school-age children in Japan. This study was performed to adapt the original English COHIP-SF 19 to a Japanese cultural context and to test the psychometric properties of the COHIP-SF 19 JP in school-age children. In this study, the COHIP-SF 19 JP was developed in accordance with published guidelines [28], including the procedures, translation, back translation, conceptual equivalence confirmation by the original developer, and reliability and validity assessment with a population sample. Our results indicated that the COHIP-SF 19 JP possesses satisfactory psychometric properties for use in the targeted age group.

We have obtained 379 completed questionnaires for the assessments, which was sufficient for Cronbach’s alpha and covariance structure analyses, such as CFA. However, the response rate was relatively low. This may have been because the questionnaire was paper-based and answered at home rather than being completed at school; moreover, there was no compensation for participation, and each parent and child had to sign a consent form at home.

Interestingly, females had a significantly higher socio-emotional well-being subscore than males, which was opposite to the results obtained using the Dutch COHIP 34 [22] and Korean COHIP 34 [23]. A previous study using the Chinese COHIP-SF 19 found no sex differences in total or socio-emotional well-being subscores, but oral health and functional well-being subscores were higher in females than in males [27]. With regard to the differences that we noted according to age group, the increased functional well-being subscore in the older group may have been related to the fact that the younger (elementary school) group often had mixed dentition. In addition, the social-emotional well-being subscore was lower in the older age group, suggesting increased concern regarding appearance in Japanese adolescents. General health-related quality of life (HRQoL) has often been reported to be higher in adolescents than children, and females tend to show lower values than males [35, 36]. Future studies using COHIP-SF 19 JP should assess whether sex and age differences are due to specific characteristics of Japanese culture.

In this study, we investigated the internal consistency of COHIP-SF 19 JP reliability using Cronbach’s alpha coefficient. Cronbach’s alpha for the overall COHIP-SF 19 JP was 0.77, similar to Cronbach’s alpha in the original study (0.82–0.88) [25], the Chinese version (0.81) [27], and the German version (0.78–0.80) [19]; this finding indicated good internal consistency of the COHIP-SF 19 JP. Subscales showed relatively low Cronbach’s alpha values (0.45–0.68), although they tended to be similar to the Cronbach’s alpha values in the Chinese (0.59–0.74) and Arabic (0.57–0.67) versions. Notably, Cronbach’s alpha values for Oral health and Functional well-being subscales had lower scores than in previous studies, which may have been due to the small number of items included in these two subscales [37]. Three items (Q7, Missed school for any reason; Q8, Been confident; Q15, Felt that you were attractive [good-looking]) had relatively low item-rest correlations (< 0.2). These results were similar to the findings of the German version [19]; conversely, in the Chinese version [27], Cronbach’s alpha did not increase even if any of the items were deleted. Generally, items with inadequate psychometric properties may be either removed from the questionnaire or modified. However, these items were retained in our study, to allow comparison with international studies, as suggested by a study using the German version [19].

The test-retest reliability (ICC) for the overall scale of the COHIP-SF 19 JP was excellent and above the recommended threshold [38]. In addition, our ICC score for the overall scale was 0.82, which was higher than ICC scores observed in different language versions, such as the Arabic (0.76) and Chinese (0.77) versions [26, 27]; this finding suggested that the COHIP-SF 19 JP demonstrates sufficient stability over time.

Construct validity was assessed by examining discriminant and convergent validity [25]. The COHIP-SF 19 JP discriminant validity showed significant relationships with the statuses of dental caries and malocclusions. Children without dental caries reported a higher OHRQoL than children with dental caries; this finding was also observed with respect to malocclusion in the present study. Broder et al. [25] reported that US Latino children with dental caries in their permanent teeth had significantly lower scores in the overall COHIP-SF 19 and oral health subscale. Our data also showed that participants with malocclusion appeared to have lower COHIP-SF 19 JP scores than those without malocclusion, consistent with the findings of previous studies that used the Arabic and Chinese versions [26, 27]. Therefore, the COHIP-SF 19 JP exhibits sufficient discriminant validity for these oral clinical outcomes. However, gingivitis and plaque retention scores showed no significant associations with COHIP-SF 19 JP scores, which was presumably because the impacts of plaque and gingivitis on OHRQoL might have been insufficient for detection by the COHIP-SF 19 JP in our sample. The results regarding convergent validity of COHIP-SF 19 JP were satisfactory, as higher self-perceived oral health rating was associated with higher COHIP-SF 19 JP score, which was consistent with the findings of previous studies.

CFA is commonly used to examine the structure of instruments, such as OHRQoL [39,40,41,42]. With CFA, it is possible to specify precisely which items should load onto which factor. All relationships between factors and variables can be specified in advance in the model. Subsequently, the fit of the model to the data can be tested. An overall test statistic, along with a number of descriptive fit measures, may be obtained to evaluate the degree to which the model fits the data [43]. The main test statistic is the chi-square statistic. However, chi-square is an extremely sensitive statistical test, which is not interpretable in a standardized way and is not a practical test of model fit. Therefore, we used the chi-square/degree of freedom (χ2/DF) ratio, which is less affected by sample size [44]. In accordance with previous reports [34, 44], several different model indices were also used to evaluate the degree of fit of the data to the model, including RMSEA, GFI, AGFI, CFI, and AIC. RMSEA describes how closely the model fits the population, with lower values indicating better fit. GFI is a different type of measure where the model of interest is assigned a score between 0 and 1, with higher values indicating better fit. AGFI adjusts for the GFI model’s degrees of freedom relative to the number of observed variables, and therefore favors less complex models with fewer parameters. CFI is derived from comparison of the χ2/DF ratios between the null and alternative hypotheses. AIC adjusts the chi-square statistic for the number of parameters estimated, and can be used to compare competing models that do not need to be nested [34]. Our CFA demonstrated that the data collected with the three-factor model showed acceptable fit values, according to the previous report [34]; the three-factor model is the same structure as the original COHIP-SF 19. However, the CFA for the four-factor model provided better factor loadings and slightly better acceptable fit values, suggesting that the COHIP-SF 19 JP should include an additional factor. The two items, Q8 and Q15, composed the potential additional factor in our four-factor model. Exploratory factor analysis of the Arabic version of COHIP-SF 19 suggested that the four-factor model exhibited better fit, with the same two questions composed the additional factor [26]. These two items showed small factor loadings, strong correlation between error covariances in the three-factor model (Fig. 1), and low item-rest correlations (Table 4). Only these two items were actually positively worded questions, which originally belonged to a separate subscale, “Self-image,” with four other items in the full version of the COHIP-34. When developing the short version, only these two items remained, and were integrated into a single “Socio-emotional well-being” subscale. Although it appears inappropriate to include them in the Socio-emotional well-being subscale, we eventually chose to retain them for the purpose of international comparisons, as discussed above. However, care is needed when analyzing data from Q8 and Q15, as some characteristics of Japanese culture would have an influence. Indeed, modesty/humility is still one of the most important virtues in Japanese culture, so the positive questions regarding self-image may not reflect the QoL of Japanese children as well as those in other cultures.

Q7: Missed school for any reason because of your teeth, mouth, or face, also showed the smallest factor loading and the lowest item-rest correlation among all items. This was presumably due to differences in cultural background or the inclusion/exclusion criteria in our study. Because we excluded children who had current or prior orthodontic treatment, the majority of children requiring periodic visits to a dental clinic/hospital during the day had been omitted; this may have led to the high score with minimal variation. However, this question appears to be very important, especially when assessing the outcomes of patients with cleft lip and palate who frequently visit dental hospitals in Japan.

Use of the COHIP-SF 19 provides a number of opportunities for researchers and clinicians. Because of its short length, it places less burden on the patient, relative to the original 34-item version or other long instruments, such as the 37-item CPQ11–14 [15]. Another advantage of the COHIP is the wide age range, which allows longitudinal assessments that involve the COHIP in long-term prospective studies of treatment effects and prognoses. Moreover, the COHIP asks questions regarding the oral area and the maxillofacial region. For example, one question in the CPQ8–10 is “In the past 4 weeks, how often have you: Been concerned what other people think about your teeth or mouth?”; a similar question in the COHIP is “In the past 3 months, how often have you: Been worried about what other people think about your teeth, mouth, or face?”. Therefore, the COHIP may enable more effective evaluation when researchers and/or clinicians assess patients with diseases that affect the maxillofacial area (e.g. cleft lip and palate), which require a very long treatment period.

The International Consortium for Health Outcomes Measurement (ICHOM), has recently focused on the development of standardized datasets of subjective and objective outcomes and case-mix factors for use in clinical practice [45]. To measure the outcomes of patients with cleft lip and palate, the COHIP is recommended by the ICHOM for assessment of the oral area, along with CLEFT-Q [46]. Therefore, the development and use of the COHIP-SF 19 JP are likely to be especially beneficial for longitudinal studies or international comparisons of children’s OHRQoL.

This study had some limitations: the sampling was unbalanced and was conducted in a non-random manner. The difference between DMFT and malocclusion indices had a significant but modest impact on OHRQoL values. The sampling bias associated with the lower prevalence of oral diseases in urban schools could have led to the relatively low discriminant validity. In addition, the quality of clinical dental examination and the low response rate may also have affected the discriminant validity. As we did not use the results from the clinical examination specifically conducted for the purpose of this study, it was not possible to implement a calibration process for the examinations. In addition, the low response rate may have made the survey vulnerable to nonresponse bias. Evaluation of discriminant validity in additional pediatric populations is warranted. Further longitudinal and interventional studies may be required to better evaluate longitudinal validity and the sensitivity of the measurements. It should be noted that COHIP-SF 19 JP had better model fit indices when using the four-factor model.

Conclusions

The Japanese version of the COHIP-SF 19 was validated in a representative community sample of 7–18-year-old Japanese schoolchildren. The COHIP-SF 19 JP was successfully developed in accordance with the standard procedure for cross-cultural adaptation of a self-reported instrument; it showed sufficient psychometric properties for use in Japanese school-age children.

Availability of data and materials

The datasets used and/or analyzed during the present study and the COHIP-SF 19 JP questionnaire are available from the corresponding author on reasonable request.

Abbreviations

QoL:

Quality of life

OHRQoL:

Oral health-related quality of life

COHIP:

Child Oral Health Impact Profile

COHIP-SF 19:

Child Oral Health Impact Profile-Short Form 19

COHIP-SF 19 JP:

Japanese version of Child Oral Health Impact Profile-Short Form 19

SD:

Standard deviation

ICC:

Intra-class correlation coefficient

CPQ:

Child Perception Questionnaire

df:

The number of decayed-filled teeth for deciduous or mixed dentition

DMF:

The number of decay-missing-filled index for permanent dentition

CFA:

Confirmatory factor analysis

χ2/DF:

Chi-squared/degree of freedom

RMSEA:

Root Mean Square Error of Approximation

GFI:

Goodness of Fit Index

AGFI:

Adjusted Goodness of Fit Index

CFI:

Comparative Fit Index

AIC:

Akaike Information Criterion

ICHOM:

International Consortium for Health Outcomes Measurement

References

  1. Sischo L, Broder HL. Oral health-related quality of life: what, why, how, and future implications. J Dent Res. 2011;90:1264–70 https://doi.org/10.1177/0022034511399918.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Batista MJ, Perianes LBR, Hilgert JB, Hugo FN, da LR de Sousa M. The impacts of oral health on quality of life in working adults. Braz Oral Res. 2014;28:1–6 https://doi.org/10.1590/1807-3107bor-2014.vol28.0040.

    Article  Google Scholar 

  3. Sandberg GE, Wikblad KF. Oral dryness and peripheral neuropathy in subjects with type 2 diabetes. J Diabetes Complicat. 2003;17:192–8 https://doi.org/10.1016/S1056-8727(02)00220-9.

    Article  Google Scholar 

  4. Sun H, Shang HT, He LS, Ding MC, Su ZP, Shi YL. Assessing the quality of life in patients with Dentofacial deformities before and after Orthognathic surgery. J Oral Maxillofac Surg. 2018;76:2192–201 https://doi.org/10.1016/j.joms.2018.03.026.

    Article  PubMed  Google Scholar 

  5. Liu Z, McGrath C, Hagg U. The impact of malocclusion/orthodontic treatment need on the quality of life a systematic review. Angle Orthod. 2009;79:585–91 https://doi.org/10.2319/042108-224.1.

    Article  PubMed  Google Scholar 

  6. de Queiroz Herkrath APC, Herkrath FJ, Rebelo MAB, Vettore MV. Measurement of health-related and oral health-related quality of life among individuals with nonsyndromic orofacial clefts: a systematic review and meta-analysis. Cleft Palate-Craniofacial J. 2015;52:157–72 https://doi.org/10.1597/13-104.

    Article  Google Scholar 

  7. Atchison KA, Dolan TA. Development of the geriatric Oral health assessment index. J Dent Educ. 1990;54:680–7.

    Article  CAS  PubMed  Google Scholar 

  8. Locker D, Slade G. Oral health and the quality of life among older adults: the oral health impact profile. J Can Dent Assoc. 1993;59(830–833):837–838,844.

    Google Scholar 

  9. Leao A, Sheiham A. The development of a socio-dental measure of dental impacts on daily living. Community Dent Health. 1996;13:22–6.

    CAS  PubMed  Google Scholar 

  10. De Civita M, Regier D, Alamgir AH, Anis AH, Fitzgerald MJ, Marra CA. Evaluating health-related quality-of-life studies in paediatric populations: some conceptual, methodological and developmental considerations and recent applications. Pharmacoeconomics. 2005;23:659–85 https://doi.org/10.2165/00019053-200523070-00003.

    Article  PubMed  Google Scholar 

  11. Hettiarachchi RM, Kularatna S, Byrnes J, Scuffham PA. Pediatric Quality of Life Instruments in Oral Health Research: A Systematic Review. Value Health. 2019;22:129–35 https://doi.org/10.1016/j.jval.2018.06.019.

    Article  PubMed  Google Scholar 

  12. Tsakos G, Blair YI, Yusuf H, Wright W, Watt RG, Macpherson LMD. Developing a new self-reported scale of oral health outcomes for 5-year-old children (SOHO-5). Health Qual Life Outcomes. 2012;10:1–8 https://doi.org/10.1186/1477-7525-10-62.

    Article  Google Scholar 

  13. Huntington NL, Spetter D, Jones JA, Rich SE, Garcia RI, Spiro A 3rd. Development and validation of a measure of pediatric oral health-related quality of life: the POQL. J Public Health Dent. 2011;71:185–93.

    PubMed  PubMed Central  Google Scholar 

  14. Gherunpong S, Tsakos G, Sheiham A. Developing and evaluating an oral health-related quality of life index for children; the CHILD-OIDP. Community Dent Health. 2004;21:161–9.

    PubMed  Google Scholar 

  15. Jokovic A, Locker D, Stephens M, Kenny D, Tompson B, Guyatt G. Validity and reliability of a questionnaire for measuring child oral-health-related quality of life. J Dent Res. 2002;81:459–63 https://doi.org/10.1177/154405910208100705.

    Article  CAS  PubMed  Google Scholar 

  16. Broder HL, McGrath C, Cisneros GJ. Questionnaire development: face validity and item impact testing of the child Oral health impact profile. Community Dent Oral Epidemiol. 2007;35:8–19 https://doi.org/10.1111/j.1600-0528.2007.00401.x.

    Article  PubMed  Google Scholar 

  17. Jokovic A, Locker D, Tompson B, Guyatt G. Questionnaire for measuring oral health-related quality of life in eight- to ten-year-old children. Pediatr Dent. 2004;26:512–8.

    PubMed  Google Scholar 

  18. Foster Page LA, Thomson WM, Jokovic A, Locker D. Validation of the child perceptions questionnaire (CPQ11-14). J Dent Res. 2005;84:649–52 https://doi.org/10.1177/154405910508400713.

    Article  CAS  PubMed  Google Scholar 

  19. Sierwald I, John MT, Sagheri D, Neuschulz J, Schüler E, Splieth C, et al. The German 19-item version of the child Oral health impact profile: translation and psychometric properties. Clin Oral Investig. 2016;20:301–13 https://doi.org/10.1007/s00784-015-1503-7.

    Article  PubMed  Google Scholar 

  20. Genderson MW, Sischo L, Markowitz K, Fine D, Broder HL. An overview of children’s oral health-related quality of life assessment: from scale development to measuring outcomes. Caries Res. 2013;47:13–21 https://doi.org/10.1159/000351693.

    Article  PubMed  Google Scholar 

  21. Broder HL, Wilson-Genderson M. Reliability and convergent and discriminant validity of the child Oral health impact profile (COHIP Child’s version). Community Dent Oral Epidemiol. 2007;35:20–31 https://doi.org/10.1111/j.1600-0528.2007.0002.x.

    Article  PubMed  Google Scholar 

  22. Calis EM, Geels LM, Prahl-Andersen B, Zentner A. Oral health-related quality of life and dental esthetics in Amsterdam schoolchildren. J Dent Child. 2009;76:130–5.

    Google Scholar 

  23. Ahn YS, Kim HY, Hong SM, Patton LL, Kim JH, Noh HJ. Validation of a Korean version of the child Oral health impact profile (COHIP) among 8- to 15-year-old school children. Int J Paediatr Dent. 2012;22:292–301 https://doi.org/10.1111/j.1365-263X.2011.01197.x.

    Article  PubMed  Google Scholar 

  24. Asgari I, Ahmady AE, Broder H, Eslamipour F, Wilson-Genderson M. Assessing the Oral health-related quality of life in Iranian adolescents: validity of the Persian version of the child Oral health impact profile (COHIP). Oral Health Prev Dent. 2013;11:147–54.

    PubMed  Google Scholar 

  25. Broder HL, Wilson-Genderson M, Sischo L. Reliability and validity testing for the child Oral health impact profile-reduced (COHIP-SF 19). J Public Health Dent. 2012;72:302–12 https://doi.org/10.1111/j.1752-7325.2012.00338.x.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Arheiam AA, Baker SR, Ballo L, Elareibi I, Fakron S, Harris RV. The development and psychometric properties of the Arabic version of the child oral health impact profile-short form (COHIP- SF 19). Health Qual Life Outcomes. 2017:1–9 https://doi.org/10.1186/s12955-017-0796-4.

  27. Li C, Xia B, Wang Y, Guan X, Yuan J, Ge L. Translation and psychometric properties of the Chinese (mandarin) version of the child Oral health impact profile-short form 19 (COHIP-SF 19) for school-age children. Health Qual Life Outcomes. 2014;12:3 https://doi.org/10.1186/s12955-014-0169-1.

    Article  PubMed Central  Google Scholar 

  28. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clio Itpidemiol. 1993;46:1417–32 https://doi.org/10.1016/0895-4356(93)90142-N.

    CAS  Google Scholar 

  29. Bonett DG. Sample size requirements for testing and estimating coefficient alpha. J Educ Behav Stat. 2002;27:335–40 https://doi.org/10.3102/10769986027004335.

    Article  Google Scholar 

  30. Jackson DL. Structural equation modeling : a adding missing-data-relevant variables to FIML-based structural equation models. A. 2003;5511:37–41 https://doi.org/10.1207/S15328007SEM1001_4.

    Google Scholar 

  31. Kline RB. Principles and practice of structural equation modeling. Third edit. New York: Guilford Press; 2011.

    Google Scholar 

  32. Gakko shikai no katsudo shishin [Activity guidelines for school dentists]. Tokyo: Japan Association of School Dentists; 2015.

  33. Bland JM, Altman DG. Cronbach’s alpha. BMJ. 1997;314:572.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. MPR-Online. 2003;8:23–74.

    Google Scholar 

  35. Bisegger C, Cloetta B, von Rueden U, Abel T, Ravens-Sieberer U, Duer W, et al. Health-related quality of life: gender differences in childhood and adolescence. Soz Praventivmed. 2005;50:281–91 https://doi.org/10.1007/s00038-005-4094-2.

    Article  PubMed  Google Scholar 

  36. Michel G, Bisegger C, Fuhr DC, et al. Age and gender differences in health-related quality of life of children and adolescents in Europe: a multilevel analysis. Qual Life Res. 2009;18:1147–57 https://doi.org/10.1007/s11136-009-9538-3.

    Article  PubMed  Google Scholar 

  37. Streiner DL. Research methods in psychiatry: a checklist for evaluating the usefulness of rating scales. Can J Psychiatr. 1993;38:140–8.

    Article  CAS  Google Scholar 

  38. Jum CN, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill, Inc; 1994.

    Google Scholar 

  39. Geels LM, Hoogstraten J, Prahl-Andersen B. Confirmative factor analysis of the dimensions of the child Oral health impact profile (Dutch version). Eur J Oral Sci. 2008;116:148–52 https://doi.org/10.1111/j.1600-0722.2007.00515.x.

    Article  PubMed  Google Scholar 

  40. Lau AWH, Wong MCM, Lam KF, McGrath C. Confirmatory factor analysis on the health domains of the child perceptions questionnaire. Community Dent Oral Epidemiol. 2009;37:163–70 https://doi.org/10.1111/j.1600-0528.2008.00452.x.

    Article  PubMed  Google Scholar 

  41. Bendo CB, Paiva SM, Viegas CM, Vale MP, Varni JW. The PedsQL™ Oral health scale: feasibility, reliability and validity of the Brazilian Portuguese version. Health Qual Life Outcomes. 2012;10:42 https://doi.org/10.1186/1477-7525-10-42.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Kavaliauskiene A, Šidlauskas A, Zaborskis A. Modification and psychometric evaluation of the child perceptions questionnaire (CPQ11-14) in assessing oral health related quality of life among Lithuanian children. BMC Oral Health. 2019;19:1–15 https://doi.org/10.1186/s12903-018-0701-5.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Bollen KA. Sructural equations with latent variables. New York: Wiley; 1989. p. 226–35.

    Google Scholar 

  44. Cheung GW, Rensvold RB. Structural equation modeling : a evaluating goodness-of- fit indexes for testing measurement invariance. Struct Equ Model A Multidiscip J. 2002;9:233–55.

    Article  Google Scholar 

  45. ICHOM: International consortium for health outcomes measurement. 2012. https://www.ichom.org/. (Accessed 25 Feb 2020).

    Google Scholar 

  46. Allori AC, Kelley T, Meara JG, Albert A, Bonanthaya K, Chapman K, et al. A standard set of outcome measures for the comprehensive appraisal of cleft care. Cleft Palate Craniofac J. 2017;54:540–54 https://doi.org/10.1597/15-292.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We thank all of the children and their parents for participating in the study. We thank Dr. Hillary L. Broder and her assistant for helping the development of the COHIP-SF 19 JP. We thank Dr. Jane Harland for helping the revision of the COHIP-SF 19 JP. We also thank all of the principals and teachers of the schools where the questionnaire survey was conducted. In addition, we thank Dr. Toshihiro Shimokawa for assisting in data arrangement.

Funding

The authors declare that they have not received any funding in relation to this study.

Author information

Authors and Affiliations

Authors

Contributions

TM contributed to the conception and design of the study, development of the COHIP-SF 19 JP, acquisition of the data, analysis, and interpretation of data, and drafting of the manuscript. NH contributed to the conception and design of the study, development of the COHIP-SF 19 JP, interpretation of data and critical manuscript review, and critical revision of the article. IT contributed to the conception of the study and critical manuscript review and revision. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Naoto Haruyama.

Ethics declarations

Ethics approval and consent to participate

Prior to data collection, ethical approval for the study was obtained from the Kyushu University Institutional Review Board (IRB) for Clinical Research (#30–186). All children assented to participate in the survey, and informed consent was obtained from the children and their parents/guardians.

Consent for publication

No details of individual participants are described in this paper.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Minamidate, T., Haruyama, N. & Takahashi, I. The development, validation, and psychometric properties of the Japanese version of the Child Oral Health Impact Profile-Short Form 19 (COHIP-SF 19) for school-age children. Health Qual Life Outcomes 18, 224 (2020). https://doi.org/10.1186/s12955-020-01469-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-020-01469-y

Keywords