Differences in responses to English and Korean versions of the Caregiver Priorities & Child Health Index of Life with Disabilities (CPCHILD)

Abstract

Background

The purpose of this study was to identify differences in caregiver responses to Korean-language and English-language versions of the Caregiver Priorities & Child Health Index of Life with Disabilities (CPCHILD) questionnaire.

Methods

Patient data were acquired from the Cerebral Palsy Hip Outcomes Project database, which was established to run a large international multicenter prospective cohort study of the outcomes of hip interventions in cerebral palsy. Thirty-three children whose caregivers had completed the Korean version of CPCHILD were matched by propensity scoring with 33 children whose parents completed the English version. Matching was performed on the basis of 12 covariates: age, gender, gross motor function classification system level, migration percentage of right and hip, seizure status, feeding method, tracheostomy status, pelvic obliquity, spinal deformity, parental report of hip pain and contracture interfering with care.

Results

There were no significant differences in CPCHILD scores for section 4 (Communication and Social Interaction), and section 5 (Health) between two groups. Korean-language CPCHILD scores were significantly lower than English-language CPCHILD scores for section 1 (Personal Care/Activities of Daily Living), section 2 (Positioning, Transferring and Mobility), section 3 (Comfort and Emotions) and section 6 (Overall Quality of Life) as well as in terms of total score.

Conclusions

Cultural influences, and the community or social environment may impact the caregivers’ perception of the health-related quality of life of their children. Therefore, physicians should consider these differences when interpreting the study outcomes across different countries.

Background

Cerebral palsy (CP) comprises a group of permanent disorders of movement and posture that are attributed to a non-progressive disturbance in the developing fetal or infant brain [1]. Reduced activity levels and participation restrictions due to these disorders may lead to a reduced quality of life (QOL) in children with CP compared to typically developing peers [2, 3]. Due to an increasing emphasis placed on measuring health-related QOL (HRQOL) in patients with CP, various assessment tools and questionnaire have been developed. The Caregiver Priorities & Child Health Index of Life with Disabilities (CPCHILD) was developed to use caregivers’ perspectives to assess the HRQOL of children with severe developmental disabilities [4]. The CPCHILD has been reported as one of the most valid measures of QOL in children with CP [5].

The CPCHILD questionnaire has been translated and adapted in several languages and cultures. The Dutch, German, Scandinavian, and Korean versions of the CPCHILD have shown relevant validity in terms of known-group validity, convergent validity, internal consistency, and test-retest reliability [6,7,8,9]. Recently, the CPCHILD questionnaire was used to evaluate QOL-related outcomes after hip reconstructive surgery among children with CP, and previous studies have used the CPCHILD questionnaire to report improved HRQOL after surgery [10, 11].

International standards guide the process of transcultural adaptation and validation of questionnaires between different languages [12,13,14], and the CPCHILD questionnaire has been translated, adapted, and validated according to these rules. Although the CPCHILD has been validated according to international guidelines, there is a concern when comparing the scores of original questionnaires and translations. Translation and transcultural adaptation attempt to render similar meanings between two languages but do not always reflect cultural, community-related or social differences, which can impact responses to the questions. For example, would parent respondents of children who are otherwise similar, generate similar scores in Korean and English-speaking communities when the culture and society of each community is potentially vastly different?

The purpose of this study was to explore the assumption that patients with similar demographic and comorbid profiles would generate similar CPCHILD scores in different countries. Specifically, this study aimed to identify differences in responses between versions of the CPCHILD by comparing scores between matched participants in Korea and several English-language countries.

Methods

This study was approved by the institutional review board of our hospital, which is a tertiary referral center for patients with CP. The need to acquire additional consent was waived because of the secondary nature of this study. Patient data were acquired from the existing Cerebral Palsy Hip Outcomes Project (CHOP) database [15], which was established to run a large multicenter prospective cohort study of the outcomes of hip interventions in cerebral palsy being conducted at 28 sites in 11 countries. There were 41 Korean-speaking and 406 English-speaking participants in the CHOP database at the time of this study (January 2018).

CPCHID questionnaire

The CPCHILD questionnaire consists of 37 items over six domains: Personal Care/Activities of Daily Living (Section 1, 9 items); Positioning, Transferring and Mobility (Section 2, 8 items); Comfort and Emotions (Section 3, 9 items); Communication and Social Interaction (Section 4, 7 items); Health (Section 5, 3 items); and Overall QOL (Section 6, 1 item) [4, 7]. For sections 1, 2 and 4, each item was rated on a 7-point ordinal scale from 0 to 6. For sections 3, 5 and 6, each item was rated on a 6-point ordinal scale from 0 to 5. Standardized scores from 0 (worst) to 100 (best) were calculated for each of the six domains as well as the total survey. These scores were derived from the raw item scores divided by the maximum item score, multiplied by 100. A higher score corresponds to a higher QOL.

Propensity score matching

Differences in characteristics between the Korean-speaking group and English-speaking group were adjusted using propensity score matching to reduce selection bias. Propensity scores represent the relationship between the multiple characteristics and the status of each case. In brief, the score is the probability of receiving a case status. The single score was calculated using multivariate logistic regression with the SAS Proc LOGISTIC procedure. A greedy algorithm was used to match the Korean-speaking group and the English-speaking group. The Korean-speaking group was first matched to the English-speaking group on five digits of the propensity score. For those that did not match, four-digit matches were identified, and this process continued down to a one-digit match of propensity scores [16].

In this study, propensity score matching was performed on the basis of 12 covariates: age, migration percentages of the right and left hip, gender, Gross Motor Function Classification System (GMFCS) level, seizure status, feeding method, tracheostomy status, pelvic obliquity, spinal deformity, parent report of hip pain and contracture interfering with care. Two groups were formed using 1:1 matching and their differences in baseline CPCHILD scores were analyzed.

Statistical analysis

Descriptive statistics including the mean, standard deviation, and proportion were used to summarize patient demographics. The Shapiro-Wilk test verified the normality of the distribution of variables. Differences in patient demographics and CPCHILD scores between the two groups were analyzed using the chi-square test and two-tailed t-test. Data were analyzed using SAS version 9.4.2 (SAS Institute Inc., Cary, NC, USA). All tests were two-tailed, and p-values < 0.05 were considered statistically significant.

Results

Two groups were established on the basis of propensity score matching from the current CHOP cohort. One group comprised 33 patients whose caregivers completed the Korean version of the CPCHILD (mean age 8.8 ± 3.4 years, 22 males and 11 females) and the other group comprised 33 patients whose caregivers completed the English version of CPCHILD (mean age 8.0 ± 3.5 years, 23 males and 10 females). Korean-speaking participants were from South Korea, and English-speaking participants were from Canada (n = 1), the United States (n = 23), Australia (n = 3), New Zealand (n = 1) and the United Kingdom (n = 5).

No significant differences between groups were observed in demographic variables, including age, migration percentages of the right and left hip, sex, GMFCS level, involvement (unilateral vs. bilateral), seizure status, feeding method, tracheostomy status, history of fragility fracture, history of spine surgery, history of non-hip related surgical procedure, use of intrathecal baclofen pump, spinal deformity, and parental report of hip pain or contracture interfering with care. However, there was significant difference in pelvic obliquity between groups (Table 1). There were no significant differences in caregiver demographics, including age, gender, working status, relationship to child, and education level between groups (Table 2).

Table 1 Patients demographics

Table 2 Caregivers demographics

There were no significant differences in CPCHILD scores for section 4 (Communication and Social Interaction; p = 0.182), and section 5 (Health; p = 0.547) between the two groups. Korean parents reported significantly lower CPCHILD scores than English-speaking parents in section 1 (Personal Care and Activities of Daily Living; p = 0.026), section 2 (Positioning, Transferring, and Mobility; p = 0.001), section 3 (Comfort and Emotions; p = 0.018), and section 6 (Overall QOL; p < 0.001) and in terms of the total score (p = 0.007). The mean total score for the English CPCHILD (54.3 ± 11.7) responses was 1.3 times higher than that for the Korean CPCHILD (42.6 ± 19.4) responses (Table 3). The largest differences in the CPCHILD mean scores between the two groups were in section 6 (21.2; 95% CI, 9.6 to 32.8) followed by section 3 (16.4; 95% CI, 4.1 to 28.7) and section 2 (13.2; 95% CI, 3.7 to 22.8).

Table 3 Comparison of CPCHILD scores between Korean and English language-base populations

Discussion

In children who are otherwise similar, parents from English speaking countries report significantly higher CPCHILD total scores than the Korean parents, as well as higher scores in the subscales for Personal Care and Activities of Daily living; Positioning, Transferring and Mobility; Comfort and Emotion; and Overall QOL. Similar scores were found between the two groups in the subscales of Communication and Social Interaction, and Health.

Several factors may explain the differences between the English-language and Korean-language CPCHILD responses. Language-related factors intrinsic to the questionnaires used, such as the subtle nuances of meaning or understanding that cannot be directly translated, could influence the responses. However, the translation and transcultural adaptations are performed according to the international guidelines, which are believed to correspond to the best available current practice. During the transcultural adaptation process, the equivalence between the source and target version is evaluated in four areas, that is, semantic, idiomatic, experiential, and conceptual equivalence [12]. Semantic equivalence indicates whether the words mean the same thing. Regarding idiomatic equivalence, colloquialisms or idioms are difficult to translate. Thus, the committee has to formulate an equivalent expression in the target version. In terms of experiential equivalence, a given task may simply not be experienced in a different country or culture even if it is translatable. Therefore, the questionnaire item would have to be replaced by a similar item that is in fact experienced in the target culture. Conceptual equivalence indicates whether the conceptual meaning between cultures is different. It is notable that the transcultural adaptation process does not consider the community and social background.

Aside from linguistic factors, caregiver responses to QOL questionnaires could also be influenced by the community or social environment, and differences between these environments in Korean and English-speaking contexts could have influenced differences in the responses in our study. For example, differences were noted in positioning, transferring, and mobility between the two groups. These differences could be influenced by the presence or absence of available public infrastructure to facilitate accessibility, such as ramps for wheelchairs, which could have influenced the caregivers’ responses to difficulty in “moving about outdoors” and “visiting public places”. For these items in section 2, scores in the English CPCHILD were significantly higher than those in the Korean CPCHILD. Cultural differences and societal attitudes could have influenced the difference in responses for items in the subscales of section 3, 5, and 6. In section 3 responses, reports of pain or discomfort “while eating/drinking or being fed,” “during toileting,” “while dressing/undressing,” “during transfers or position changes” and “while seated” were significantly lower in the Korean CPCHILD than in the English CPCHILD. In section 5 and 6, scores regarding the child’s overall health and overall QOL were also significantly lower in the Korean CPCHILD than in the English CPCHILD (Table 4).

Table 4 Comparison of CPCHILD scores for each item between Korean and English language-base populations

The impact of activity restrictions and limitation of participation in persons with disabilities are of international interest. Disability arises from a mismatch between individual ability and environmental needs [17]. QOL in individuals with disabilities is influenced not only by the functional abilities but also by the environment which can pose both as a barrier or a facilitator. Governmental laws and regulations, such as the American Disability Act (ADA) in the US and similar regulations in other English-speaking countries, mandate enforceable standards to ensure accessibility for public transportation, and public settings and services. These policies reduce the impact of activity restrictions imposed by the severity of the CP. The items of the CPCHILD span all domains of the International Classification of Functioning, Disability and Health including environmental factors, and has the potential to assess the efficacy of government policy and enforcement of regulations. However, this needs to be validated in a future study.

This study has some limitations. First, although the groups were closely matched for the selected covariates, there remains the possibility that the groups might differ substantially in other areas that influence the CPCHILD scores. Potentially confounding factors such as individual caregivers’ socio-economic status and education level were not controlled for between the two groups. There was no significant difference in caregiver education level between groups. However, we could not acquire information regarding the caregivers’ socio-economic status. Second, English-speaking responses included participants from a variety of countries, such as Canada, US, Australia, and Great Britain. Responses were not compared between each English-language country, as more participants than our available sample size would be required for such a comparison. The US has mixed health care system that includes public or private funding for the care of children with disabilities, while the three other English-speaking countries all have national or provincial wide publicly funded health care systems. Nevertheless, these countries are comparable in socio-economic terms.

Conclusions

In conclusion, this study revealed significant differences in caregiver responses between English-language and Korean-language versions of the CPCHILD, even though they were otherwise similar in characteristics that might influence their HRQOL. Cultural influences, environmental factors, and community or social contexts may impact caregivers’ perception of QOL of their children. Therefore, physicians should consider these differences when interpreting the study outcomes across different countries.