- Research
- Open Access
- Published:
Comparing the Chinese versions of two knee-specific questionnaires (IKDC and KOOS): reliability, validity, and responsiveness
Health and Quality of Life Outcomes volume 15, Article number: 238 (2017)
Abstract
Background
The International Knee Documentation Committee Subjective Knee Form (IKDC) and the Knee Injury and Osteoarthritis Outcome Score (KOOS) are knee-specific questionnaires that have been widely used and translated into numerous languages. However, the differences in the psychometric properties between the Chinese IKDC and KOOS remain unclear. The purpose of this study was to conduct a cross-cultural adaptation of the Chinese IKDC and Chinese KOOS and to compare the psychometric properties of these two measures in patients with various knee injuries from the acute stage up to 12Â weeks after receiving treatment.
Methods
The original IKDC and KOOS were translated into Chinese based on the guidelines of cross-cultural adaptation and translation protocols. One hundred and seventy-three patients with various knee injuries were recruited in this study and completed both Chinese IKDC and Chinese KOOS as well as a generic health status questionnaire (Chinese Short Form-36 [SF-36]). The reliability, internal consistency, content validity, convergent and divergent validity and responsiveness of both IKDC and KOOS were assessed with appropriate indices.
Results
The Chinese IKDC showed excellent reliability (ICC = 0.97) and strong internal consistency (Cronbach alpha = 0.87). The Chinese KOOS also presented good reliability with ICCs ranging from 0.89 to 0.95 and internal consistency (Cronbach alpha coefficients ranging from 0.76 to 0.97). The content validity of these two questionnaires were excellent, yielding no floor or ceiling effects. Both the Chinese IKDC and KOOS were highly associated with the physical component summary (PCS) score and weakly related to the mental component summary (MCS) score of the SF-36. Responsiveness to change was large (effect size =0.95) for the Chinese IKDC and moderate (effect sizes = 0.49~0.60) at 12-week after physical therapy.
Conclusion
Both the Chinese IKDC and KOOS demonstrated good psychometric properties. However, the Chinese IKDC was more sensitive to changes over a period of 2, 4, 8, 12 weeks of physical therapy than the Chinese KOOS. The ROC analyses revealed a value of area under the curve (0.83 for the Chinese IKDC and 0.67–0.79 for the subscales of Chinese KOOS). Minimal clinically important difference values were 9.8 for the Chinese IKDC and 0.79, 0.76, 0.76, 0.76, 0.67 for the Symptoms, Pain, Activities of Daily Living, Sport/Recreation, and Quality of Life subscales of Chinese KOOS, respectively. The current study provides information for clinicians and researchers to use these appraisal tools for Chinese-speaking patients with various knee disorders.
Background
Clinical outcome research is required to evaluate the benefits and cost effectiveness of new diagnostic, surgical, and rehabilitative approaches for treating knee problems [1]. Both performance-based and self-reported measures are often used to evaluate clinical outcomes of orthopedic patients. To be used among various language groups and in diverse countries, patient-oriented measures (represented by self-administered questionnaires) must be translated, adapted to distinct cultural characteristics, and validated using common processes to evaluate their psychometric properties [2].
In 2007, the International Knee Documentation Committee Subjective Knee Form (IKDC) and Knee Injury and Osteoarthritis Outcome Score (KOOS) were identified as the eminent instruments for assessing general knee quality of life, involving numerous questions that assess the symptoms and disabilities relevant to patients with knee disorders [3]. Quality of life measures capture the patient perspective regarding the disease and treatment, perceived need for health care, and preferences concerning treatment and outcomes [4].
The IKDC and KOOS have been translated to and validated in several languages and have been widely used to evaluate various knee injuries [5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23]. To employ these questionnaires among multiple language groups and in diverse cultural settings, they must be translated, adapted based on cultural characteristics, and validated against the original versions. The cross-cultural adaptation guidelines described by Guillemin et al. [2] are widely used to translate and adapt questionnaires. The criteria recommended for selecting instruments include the characteristics of patients for whom the instrument was developed, the instrument content, and its psychometric properties [24].
In Chinese-speaking countries, few translated knee-specific questionnaires have been validated. Questionnaires designed as subjective scoring systems can be used in various countries if they are translated and validated to target a specific language and population [2, 25]. In addition, using culturally equivalent, standardized questionnaires simplifies the problems involved in meta-analyses during clinical research, enabling the comparison of studies and minimizing the reporting bias in various countries [26, 27].
A review of the available outcome measurements for knee ligament injuries indicated that the IKDC is the preferred measurement tool [28]. The IKDC provided the optimal overall measure of the critical symptoms and disabilities of a population of postoperative articular cartilage repair patients [29]. The IKDC was found more useful than the KOOS for evaluating patients with anterior cruciate ligament (ACL) ruptures [30]; however, at present the differences in the psychometric properties between the Chinese IKDC and KOOS remain unclear. Responsiveness of an outcome measure referring to the ability to detect changes of a construct of interest over time, is considered essential. Several researchers examined the responsiveness of both the IKDC and KOOS; however, most of them provided responsiveness information for detecting changes over a period of more than 3 months. The clinical utility of these instruments on reflecting improvement of patient’s status in a shorter period of time (<3 months) is unknown. Therefore, the purposes of this study were to (1) translate the English versions of the IKDC and KOOS into Chinese versions based on cross-cultural adaptation guidelines, (2) to evaluate and compare the reliability and validity of the Chinese IKDC and Chinese KOOS in patients with a variety of knee conditions, and (3) to determine and compare the responsiveness of the Chinese IKDC and KOOS in detecting clinical changes over 4 time points (2-, 4-, 8-, and 12-week) following treatment.
Methods
Cross-cultural adaptation process
The IKDC and KOOS were translated and adapted from English to traditional Chinese versions by using a forward-backward translation protocol based on the guidelines of Guillemin et al. and the recommendations for the cross-cultural adaptation of health status measures of the American Academy of Orthopaedic Surgeons (AAOS) [2].
Two independent bilinguals (native Chinese speakers) translated the original English versions of IKDC and KOOS into Chinese. The informed translator was a physical therapist who possessed 20Â years of clinical experience treating adults with orthopedic disorders, and the uninformed translator was a computer engineer. A consensus meeting was held to resolve the discrepancies between the two translations of both questionnaires. The synthesized versions for both the IKDC and KOOS were produced after making several word expression amendments. Then, the synthesized Chinese versions of two questionnaires were back-translated into English by two independent bilinguals (native English speakers) who were blind to the original versions of both questionnaires. None of the back translators was aware or informed of the concepts used in the questionnaires.
An expert committee comprising 2 forward translators, 2 backward translators, a methodologist, a clinician (rehabilitation physician) and a language specialist reviewed all the translation versions of both questionnaires to assure the semantic, idiomatic, experiential, and conceptual equivalence between languages. After consolidating all the versions of the questionnaires, the committee developed the pre-final versions of Chinese IKDC and Chinese KOOS for pre-testing. Ten patients with various knee pathologies participated in the pre-testing step of the validation process and completed the pre-final versions of two questionnaires. Comprehensibility and cultural relevance of the questionnaire items were discussed with the subjects through a face-to-face interview.
Participants
The Research Ethics Committee at National Taiwan University Hospital approved this clinical trial. A convenience sample of 173 patients with various knee injuries undergoing physical therapy at the Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital were recruited for participating in this study (Table 1). All patients provided their informed consents before entering in the study. Patients were excluded if they exhibited other joint problems affecting the lower extremities or back, systematic inflammatory rheumatic disease, neurological or vascular conditions, or psychiatric disorders. During the study period, all patients received physical therapy including physical agents, joint mobilization, stretching and strengthening exercises, etc. for their knee symptoms.
Instruments
Two disease-specific questionnaires, the Chinese IKDC and Chinese KOOS, the Chinese SF-36 [31] and a 15-point global rating of change (GROC) scale [32] were used in this study. The IKDC was originally designed to measure the symptoms and functional limitations in sports activities caused by various knee impairments [33]. High IKDC scores indicate a low level of symptoms and a high level of function, whereas low scores indicate a high level of symptoms and a low level of function. Thus, a score of 100 indicates no symptoms and no limitations regarding daily or sports activities [33].
The original KOOS questionnaire is an extension of the Western Ontario and McMaster Universities Arthritis Index, and is a well-designed, and simple self-administered instrument that was developed to assess the short- and long-term symptoms and function of patients with knee injuries and osteoarthritis [34]. It is a 42-item disease-specific questionnaire comprising 5 subscales: symptoms, pain, activities of daily living (ADL), sports and recreation (Sport/Rec) and knee-related quality of life (QOL). The raw scores are separately calculated for each subscale and transformed to a 0–100 scale on which 0 indicates severe problems and 100 indicates no problems [20]. The KOOS questionnaire has demonstrated reliability, validity, and responsiveness among distinct populations exhibiting varying pathologies, injury durations, ages, and activity levels [5, 6, 8, 9, 19,20,21, 23, 34].
The SF-36 comprises 8 subscales: physical functioning (PF), role-physical (RP), bodily pain (BP), general health (GH), vitality (VT), social functioning (SF), role-emotional (RE), and mental health (MH) [35]. The PF, RP, and BP scales are most highly correlated with the physical component summary (PCS), contributing the most to the PCS score. The MH, RE, and SF scales are most highly correlated with the mental component summary (MCS), contributing the most to the MCS score. The VT, GH, and SF scales are notably correlated with both the PCS and MCS [35]. These 8 subscales are scored from 0 to 100, where high scores indicate a superior health status [36, 37]. The Chinese version of the SF-36 has been validated for use in Taiwan [31, 38].
A 15-point (−7~ + 7) GROC was used to monitor changes occurred between two time points [32]. The scale ranges from −7 (a very great deal worse) through 0 (no change) to +7 (a very great deal better) with the score of +4 or more representing moderately better (+4), a good deal better (+5), a great deal better (+6), or a very great deal better (+7). For the test-retest reliability analysis, patients scoring between 2 (a little bit better) and −2 (a little bit worse) were considered to have stable clinical states and included for analysis. GROC has also been used to measure the subject’s impression of the change following an intervention. A cutpoint can be chosen to dichotomize patients as achieving significant improvement or not.
Procedure
The Chinese IKDC, Chinese KOOS, and Chinese SF-36 were administered to the study participants during their first visits to the outpatient department. Before the first treatment, 173 patients completed the Chinese IKDC, Chinese KOOS, and the Chinese SF-36 questionnaires. To assess the test-retest reliability, 40 patients (mean age, 43 y) filled out the Chinese IKDC and Chinese KOOS again after a 5-to-7-day interval. The GROC was also rated by this patient cohort. This interval was long enough for the patients to have forgotten previous responses but not so long that their condition would have changed. To minimize the clinical changes, no treatment was provided to these patients over the test-retest interval.
For the purpose of analyzing the responsiveness of the Chinese IKDC and KOOS, follow-up reassessments were performed at 2, 4, 8, and 12Â weeks following treatment. In addition, the GROC was administered again at the 12-week follow-up as the external criterion for indicating significant improvement with treatment.
Data management and analysis
The statistical analysis was conducted using SPSS version 20.0 (SPSS Inc., Chicago, IL). The Kolmogorov–Smirnov test was used for normality check of all scores. The level of significance for all statistical procedures was P < 0.05.
The interpretability was evaluated by assessing the occurrence and distribution of floor and ceiling effects regarding baseline scores. A floor or ceiling effect of <15% was considered to be acceptable, which means that less than 15% of the respondents achieve the minimum or maximum possible scores [39]. Skewness statistics are usually evaluated informally; values < −1 or > +1 signal substantially non-normal distributions potentially in need of additional evaluation [40].
Reliability analysis
The test-retest reliability was assessed by the intraclass correlation coefficient (ICC), using a two-way mixed effects model for absolute agreement [41]. ICCs of 0.70 or greater indicated acceptable test-retest reliability (0.81~0.90, good; 0.91~1.0, excellent) [7, 42].
To determine the measurement precision, the standard error of measurement (SEM) was calculated by multiplying the square root of 1 minus the ICC by the standard deviation (SD) of the baseline score of the instrument. The minimum detectable change (MDC) based on the 95% confidence interval of SEM was then computed with multiplying the SEM by 1.96 and the square root of 2 [43].
The internal consistency of the first administration of each questionnaire was calculated using the Cronbach alpha to estimate the average correlations among items within a subscale [44]. An alpha value of 0.70 or greater indicated satisfactory internal consistency [45]; however, a value greater than 0.95 could indicate redundancy of one or more items [39].
Validity analysis
Construct validity refers to the degree to which the questionnaire measures the characteristic to be measured. We tested the construct validity of the Chinese IKDC and KOOS by calculating the Spearman’s correlation coefficients of the two instruments with the Chinese SF-36 scores. Convergent and divergent validity were both assessed [46]. It was hypothesized a priori that the correlations between the IKDC and KOOS subscales with the SF-36 subscales of physical health (PF, RP, BP, and PCS) should be strong (convergent validity) while the correlations of the IKDC and KOOS subscales with the SF-36 subscales of mental health (GH, VT, SF, RE, MH, and MCS) should be weak (divergent validity). Spearman’s correlation coefficients of >0.50, 0.35~0.50, and <0.35 were considered strong, moderate, and weak, respectively [23].
Responsiveness analysis
Responsiveness of two instruments was assessed by the effect size (ES) as well as the receiver operating characteristic (ROC) curve method. ES is calculated by the difference between the mean baseline and follow-up scores of a measure, divided by the standard deviation (SD) of its baseline score [47]. Four ESs were computed for the Chinese IKDC and 5 subscales of Chinese KOOS at 4 time points of follow-up. An ES value between 0.20 and 0.50 represents a change of approximately one-fifth of the baseline SD and is considered small; between 0.51 and 0.80 reflects a change of at least half the baseline SD and is considered moderate; an ES value of 0.80 or greater represents a change of at least four-fifths the baseline SD and is considered large [47]. Larger ES indicates a greater ability to detect clinical changes. Pair-t tests were used to compare the baseline and follow-up scores of Chinese IKDC and KOOS following 2, 4, 8, and 12Â weeks of physical therapy treatment.
The ROC curve analysis was used to establish the minimal clinically important difference (MCID) scores for Chinese IKDC and the subscales of Chinese KOOS. The score of GROC ≥ 4 (moderately better) was chosen as the cutoff point for discriminating between patients who perceived themselves to achieve significant improvement from those who did not. The optimal cut off point was computed using the Youden index and taken as the MCID, which indicated the change score associated with the least misclassification [48]. For each value of change of the Chinese IKDC and the subscales of Chinese KOOS, the sensitivity and specificity were calculated and used to plot the ROC curves: the sensitivity values and false-positive rates (1-specificity) were plotted on the y and the x axis of the curve, and the area under the curve (AUC) showed the probability that a measure correctly classifies patients as either meaningfully improved or not. An AUC of more than 0.70 is considered to be acceptable.
Results
Cross-cultural adaptation process
During the translation and adaptation stages, the pre-final versions of both the Chinese IKDC and KOOS were well accepted by subjects in the pre-testing. All subjects completed both questionnaires without missing items and demonstrated a clear understanding of the scale items. No major conceptual or cultural differences were found between the Chinese and English-speaking populations. Therefore, the pre-final versions of Chinese IKDC and KOOS were not modified further and were considered the final versions. To complete the final step of cross-cultural adaptation, the Chinese IKDC was submitted to the developer. It is now available for download at the website of the American Orthopaedic Society for Sports Medicine (AOSSM): https://www.sportsmed.org/AOSSMIMIS/members/downloads/research/IKDCChineseTraditional.pdf [49].
Interpretability
The mean, standard deviation (SD), median, mode, minimum, maximum, and skewness for the Chinese IKDC and 5 KOOS subscales have been shown in Table 2. The Chinese IKDC scores indicated a normal distribution and negligible numbers of patients who demonstrated floor or ceiling effects. The Chinese KOOS scores were also distributed normally. In addition, the percentage of subjects who received the minimum possible scores in the subscales Sport/Rec and QOL were 8.7 and 1.7%, respectively. Maximum possible scores in the subscales symptoms, pain, ADL, Sport/Rec and QOL were 0.6, 0.6, 4.6, 1.7 and 0.6%, respectively. We consider that no ceiling or floor effect occurred in the Chinese KOOS.
Reliability analysis
Over the 5-to-7 day interval, 32 out of 40 subjects were considered to have remained stable (−2 to +2 on the GROC). Eight patients reported that their scores were ≥3, and excluded in the test-retest reliability analysis. Of the 32 patients, 8 (24.2%) exhibited osteoarthritis, 8 (24.2%) ACL injuries, 4 (12.1%) patellofemoral pain syndrome, 3 (9.1%) posterior cruciate ligament (PCL) injuries, 3 (9.1%) nonspecified knee sprain, and one patient each exhibited derangement (3.0%), medial collateral ligament injury (3.0%), patellar fracture (3.0%), meniscal and cartilage injuries (3.0%), tendinitis and bursitis (3.0%), total knee arthroplasty (3.0%), and PCL reconstruction (3.0%).
The test-retest reliability was excellent for the Chinese IKDC with an ICC of 0.97 (P < 0.001). Good test-retest reliabilities were also found in the Chinese KOOS questionnaire with the ICCs of 0.89 or higher (Table 3).
The SEM and MDC values of the Chinese IKDC were 3.2 and 8.9, which was smaller than the SEM and MDC of the 5 subscales Chinese KOOS (SEM range: 5.1~8.8; MDC range: 14.2~24.3) (Table 3).
The Chinese IKDC demonstrated a high internal consistency, yielding a Cronbach alpha value of 0.87. Moderate to high internal consistency was also found in the Chinese KOOS subscales with the values ranging from 0.76 to 0.97 (Table 3).
Validity analysis
Table 4 shows the correlations among the Chinese IKDC, 5 subscales of Chinese KOOS, and the Chinese SF-36 scores.
Responsiveness analysis
Table 5 shows the mean baseline scores, mean scores after treatment, and ES for the Chinese IKDC and KOOS at the 2-, 4-, 8-, and 12-week follow-up. The Chinese IKDC demonstrated relatively larger responsiveness than did the 5 subscales of Chinese KOOS at 4 time points of follow-up.
The ESs of the Chinese IKDC were moderate (0.61) after the 8-week follow-up and large (0.95) at the 12-week follow-up while the Chinese KOOS subscales only demonstrated moderate ESs (0.49–0.60) at the 12-week follow-up. At the 2-, 4-, 8-week follow-up, only the Chinese IKDC score had moderate effect size (0.61 at 8-week follow-up), the rest scores of Chinese IKDC and all of the Chinese KOOS demonstrated small effect sizes (0.09~0.46).
Results of the within-group comparisons showed that at 8- and 12-week follow-up, the differences of both the Chinese IKDC and all of the Chinese KOOS subscales were statistically significant. At the 2- and 4-week time points, even with small effect sizes (0.37 and 0.46), the differences of the Chinese IKDC scores from the baseline were still significant, while the differences of the Chinese KOOS subscales were mostly nonsignificant.
The area under the ROC curve, minimum clinically important difference, and the sensitivity and specificity for the minimum clinically important differences are displayed in Table 6. At 12 weeks after intervention, the area under the ROC curve was significantly different from 0 for the Chinese IKDC and all of the Chinese KOOS subscales. The AUC of Chinese IKDC (0.83) was larger than all of the KOOS subscales (0.67~0.79). The AUCs of Chinese KOOS subscales were good except for the QOL subscale (0.67) which was less than optimal.
Discussion
In this study, the original versions of the IKDC and KOOS were translated and validated to facilitate assessing Chinese-speaking patients with a variety of knee injuries. To our knowledge, our study is the first one to concurrently examine and compare the psychometric properties of the Chinese IKDC and KOOS. When assessing various knee injuries, both the Chinese IKDC and Chinese KOOS demonstrated excellent reliability and good validity. Consistent with the findings of other studies, Chinese IKDC and Chinese KOOS are reliable and valid instruments. Cross-culture adapted instruments are valuable, especially when international comparisons need to be made.
The SEM and MDC analysis indicated that the Chinese IKDC values (SEM 3.2; MDC 8.9) were smaller compared with the American data from Greco et al. [43] at 6 (SEM 5.6; MDC 15.6) and 12 (SEM 4.9; MDC 13.7) months after surgery, Dutch version [50] (SEM 5.3; SDD 14.6), and Turkish version [7] (SEM 6.0; SDD 16.4); comparable with Irrgang et al. [33] (SEM 4.6; MDC 9.0); but larger than the American data from Crawford et al. [51] (SEM 3.2; MDC 8.8) and Brazilian version [14] (SEM 2.4; MDC 6.7). The Chinese KOOS values (SEM 5.1~10.6; MDC 10.4~29.4) were smaller compared with those of the Dutch version [50] (SEM 7.0~12.6; SDD 19.4~35.0); but larger than the Persian version [52] (SEM 2.1~3.1; MDC 5.8~8.5) and the Polish version [19] (SEM 3.9~7.3; MDC 10.9~20.2). In summary, our data are in agreement with results from other versions from different countries and support the responsiveness of both the Chinese IKDC and KOOS questionnaires as outcome measures for various knee conditions.
The internal consistency of the Chinese IKDC was high (Cronbach alpha, 0.87), demonstrating similarity to that of the original version of the IKDC (Cronbach alpha, 0.92) [33]. Satisfactory Cronbach alpha values were also found in the Chinese KOOS symptoms subscale (0.76), QOL subscale (0.77), pain subscale (0.88), and Sport/Rec subscale (0.91). Our data is similar to the Swedish version of KOOS [53], in which the Cronbach alpha values were 0.74 for the symptoms subscale and 0.71 for the QOL subscales. Results of this study also showed that the Chinese KOOS ADL subscale had the highest Cronbach alpha (0.97), similar to the value (0.95) of the Swedish KOOS ADL subscale [53]. However, since these Cronbach alpha values were greater than 0.95, redundancy of items may exist in Chinese KOOS ADL subscale.
Following the same validation process of the original IKDC, we used the Chinese SF-36 to evaluate the construct validity of both the Chinese IKDC and KOOS questionnaires. Strong correlations (Spearman’s rhos = 0.54~0.79) between the Chinese IKDC and the physical health dimensions of the Chinese SF-36 confirms the convergent validity of the Chinese IKDC. Weak correlations (Spearman’s rhos = 0.21~0.34) between the Chinese IKDC and the mental function dimensions of the SF-36 supports the divergent validity of the Chinese IKDC. The strong correlations between the Chinese IKDC and the PF and BP domains of the Chinese SF-36 demonstrated values comparable to the original IKDC and other translated questionnaires [7, 10, 12, 13, 17, 33].
Our results showed that the correlations between the role physical subscale of the Chinese SF-36 and each of the 5 subscales of the Chinese KOOS were all moderate (Spearman’s rhos = 0.41~0.48). The calculated correlation coefficients of 0.70 (between the Chinese KOOS ADL and Chinese SF-36 PF), 0.43 (between the Chinese KOOS Sport/Rec and Chinese SF-36 RP), and 0.45 (between the Chinese KOOS Sport/Rec and Chinese SF-36 BP) were similar to the values 0.68, 0.43, and 0.43, respectively, calculated in a study on the Swedish version of the KOOS [53].
Both instruments demonstrated their largest changes occurred at the end test time point (12-week follow-up), although only the Chinese IKDC had large effect size (0.95), while most of the KOOS subscales demonstrated moderate effect sizes (0.49~0.60). The Chinese IKDC demonstrated larger effect sizes compared with each of the Chinese KOOS subscales at the 2-, 4-, 8-, and 12-week follow-up; therefore, we believe that the Chinese IKDC was more responsive to changes over time than the Chinese KOOS.
The ES of the Chinese IKDC at week 12 was similar to that in the study of Irrgang et al. [54] (ES = 1.13; 207 patients with various knee problems at 19-month follow-up) and Greco et al. [43] (ES = 1.06; 72 patients with focal articular cartilage defects at 12-month follow-up). Interpretation of the responsiveness indices point to the Chinese IKDC as the instrument of choice for evaluating clinical changes occurred less than 12 weeks.
The responsiveness analysis showed that both the Chinese IKDC and KOOS were able to detect change over time. Increased effect sizes over time observed in the Chinese IKDC and KOOS subscales were expected because all of the participants were under physical therapy treatment.
As far as we know, there is no other study that has examined the responsiveness of the IKDC and the KOOS at 2, 4, and 8-week after conservative treatments. These time intervals for responsiveness were chosen because they corresponded to common treatment durations of physical therapy for knee disorders. Improvement from the commencement of treatment was expected along a time line. It should be detected by a reliable, valid, and responsive outcome measure. Therefore, the responsiveness information regarding shorter (less than 12Â weeks) time intervals still have a certain degree of reference for clinical application and research.
In this study, we successfully constructed the data on the AUC and MCID of the Chinese IKDC and KOOS. The MCID score (9.8) of the Chinese IKDC during the 12 weeks follow-up was smaller compared with those of Irrgang et al. [54] (MCID = 11.5 and 20.5; 207 patients with various knee injuries at the 19-month follow up), but larger than that of Greco et al. [43] (MCID = 6.3; 72 patients with focal articular cartilage defects at the 6-month follow up). The Chinese KOOS yielded an AUC (0.67~0.79) and MCID (8.1~16.1) at the 12 weeks follow-up. Our findings of the AUC for each of the Chinese KOOS subscales (0.79, 0.76, 0.76, 0.76, 0.67) was smaller than the Italian KOOS subscales (0.88, 0.89, 0.94, 0.93, and 0.85) for the Symptoms, Pain, Activities of Daily Living, Sport/Recreation, and Quality of Life subscales, respectively [55]. The MCIDs of the Chinese KOOS subscales on Symptoms, Pain, and Sport/Recreation (10.9, 16.1, 12.5) were comparable to the Italian KOOS (10.7, 16.7, 12.5; 148 patients undergoing a 4-week rehabilitation program after total knee arthroplasty), while the MCIDs of the Chinese KOOS subscales on Activities of Daily Living and Quality of Life were smaller than those in the Italian KOOS (18.4, 15.6) [55]. Since the MCIDs may vary with patient groups, clinical characteristics, and analytical approaches, interpretations of the study findings need to be cautious.
Comparisons between the Chinese IKDC and KOOS in their psychometric properties have been made in several studies [30, 50]. A cross-sectional cohort study involving patients who were on the waiting list for meniscal surgery, and patients between 6Â weeks and 6Â months after meniscal surgery showed favorable results for reliability and validity of the Dutch IKDC compared with the Dutch KOOS. Despite a tendency toward the KOOS as the outcome measure for meniscal injuries, the author suggests that the IKDC Subjective Knee Form is the best applicable instrument for patients with meniscal injuries [50]. van Meer et al. conducted another study to compare the Dutch IKDC and the Dutch KOOS in a group of patients with recent anterior cruciate ligament ruptures. Their results showed that all KOOS subscales and the IKDC had good reliability. However, the KOOS did not perform optimally on the following measurement properties: relevance of the questions, construct validity, responsiveness, and ceiling effects, while the IKDC satisfied the criteria for all properties in this specific group of patients. They concluded that the Dutch IKDC is more useful than the Dutch KOOS questionnaire to evaluate patients with ACL injuries [30].
This study has some limitations. First, considering the heterogeneity in diagnosis of the study participants, comparison of the psychometric properties among various knee-injury groups for the Chinese IKDC and KOOS could not be made. However, these two instruments are considered the site-specific patient-reported outcome measures and are intended to measure the same construct for patients with a variety of knee problems. When testing the same group of patients with these two questionnaires at the same time, we could still compare the measurement properties between them. Further studies evaluating different subgroups of knee injury will be needed before generalizations are applicable. Second, the responsiveness follow-up period of 12Â weeks was relatively short; this measure should not be used to infer the 6-month (medium term) and 12-month (long term) outcomes. We recommend conducting further studies to compare the Chinese IKDC and KOOS by using various patient groups and extended follow-up times.
Conclusion
The Chinese IKDC and KOOS were both culturally adapted and validated in a group of Chinese-speaking patients with various knee injuries. Both the Chinese IKDC and KOOS demonstrated high levels of reliability and validity. However, the Chinese IKDC showed better performance on the psychometric properties including ICC, SEM, MDC, and Cronbach alpha than the Chinese KOOS. Chinese IKDC was also more sensitive to changes over a period of 2, 4, 8, 12Â weeks of treatment than the Chinese KOOS. Both Chinese IKDC and most of the Chinese KOOS subscales demonstrated good discriminative capacities in detecting clinically meaning changes occurred at 12Â weeks after treatment. The MCIDs of the two instruments were also revealed in this study. The current study provides information for clinicians and researchers to use these appraisal tools for Chinese-speaking patients with various knee disorders.
Abbreviations
- AAOS:
-
The American Academy of Orthopaedic Surgeons
- ACL:
-
Anterior cruciate ligament
- AUC:
-
Area under curve
- BP:
-
Bodily pain
- ES:
-
Effect size
- GH:
-
General health
- ICC:
-
Intraclass correlation coefficient
- IKDC:
-
International knee documentation committee subjective knee form
- KOOS:
-
The knee injury and osteoarthritis outcome score
- MCID:
-
The minimal clinically important difference
- MCS:
-
The mental component summary
- MDC:
-
The minimum detectable change
- MH:
-
Mental health
- PCL:
-
Posterior cruciate ligament
- PCS:
-
Physical component summary score
- PF:
-
Physical functioning
- QOL:
-
Quality of life
- RE:
-
Role-emotional
- RP:
-
Role-physical
- SD:
-
Standard deviation
- SEM:
-
Standard error of measurement
- SF:
-
Social functioning
- SF-36:
-
The 36-item short form health survey
- VT:
-
Vitality
References
Irrgang JJ, Anderson AF. Development and validation of health-related quality of life measures for the knee. Clin Orthop Relat Res. 2002;402:95–109.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–32.
Tanner SM, Dainty KN, Marx RG, Kirkley A. Knee-specific quality-of-life instruments - which ones measure symptoms and disabilities most important to patients? Am J Sports Med. 2007;35:1450–8.
Carr AJ, Higginson IJ. Are quality of life measures patient centred? BMJ. 2001;322:1357–60.
Almangoush A, Herrington L, Attia I, et al. Cross-cultural adaptation, reliability, internal consistency and validation of the Arabic version of the knee injury and osteoarthritis outcome score (KOOS) for Egyptian people with knee injuries. Osteoarthr Cartil. 2013;21:1855–64.
Bekkers JEJ, de Windt TS, Raijmakers NJH, Dhert WJA, Saris DBF. Validation of the knee injury and osteoarthritis outcome score (KOOS) for the treatment of focal cartilage lesions. Osteoarthr Cartil. 2009;17:1434–9.
Celik D, Coskunsu D, Kilicoglu O, Ergonul O, Irrgang JJ. Translation and cross-cultural adaptation of the international knee documentation committee subjective knee form into Turkish. J Orthop Sports Phys Ther. 2014;44:899–909.
de Groot IB, Favejee MM, Reijman M, Verhaar JA, Terwee CB. The Dutch version of the knee injury and osteoarthritis outcome score: a validation study. Health Qual Life Outcomes. 2008;6:16.
Goncalves RS, Cabri J, Pinheiro JP, Ferreira PL. Cross-cultural adaptation and validation of the Portuguese version of the knee injury and osteoarthritis outcome score (KOOS). Osteoarthr Cartil. 2009;17(9):1156–62.
Haverkamp D, Sierevelt IN, Breugem SJM, Lohuis K, Blankevoort L, van Dijk CN. Translation and validation of the Dutch version of the international knee documentation committee subjective knee form. Am J Sports Med. 2006;34:1680–4.
Kim JG, Ha JK, Lee JY, Seo SS, Choi C-H, Lee MC. Translation and validation of the Korean version of the international knee documentation committee subjective knee form. Knee Surg Relat Res. 2013;25(3):106–11.
Lertwanich P, Praphruetkit T, Keyurapan E, et al. Validity and reliability of Thai version of the international knee documentation committee subjective knee form. J Med Assoc Thail. 2008;91:1218–25.
Metsavaht L, Leporace G, Riberto M, Sposito M, Batista LA. Translation and cross-cultural adaptation of the Brazilian version of the international knee documentation committee subjective knee form validity and reproducibility. Am J Sports Med. 2010;38:1894–9.
Monticone M, Ferrante S, Salvaderi S, et al. Development of the Italian version of the knee injury and osteoarthritis outcome score for patients with knee injuries: cross-cultural adaptation, dimensionality, reliability, and validity. Osteoarthr Cartil. 2012;20:330–5.
Nakamura N, Takeuchi R, Sawaguchi T, Ishikawa H, Saito T, Goldhahn S. Cross-cultural adaptation and validation of the Japanese knee injury and osteoarthritis outcome score (KOOS). J Orthop Sci. 2011;16:516–23.
Ornetti P, Parratte S, Gossec L, et al. Cross-cultural adaptation and validation of the French version of the knee injury and osteoarthritis outcome score (KOOS) in knee osteoarthritis patients. Osteoarthr Cartil. 2008;16(4):423–8.
Padua R, Bondi R, Ceccarelli E, et al. Italian version of the international knee documentation committee subjective knee form: cross-cultural adaptation and validation. Arthroscopy. 2004;20:819–23.
Paker N, Budayci D, Sabirli F, Ozel S, Ersoy S. Knee injury and osteoarthritis outcome score: reliability and validation of the Turkish version. Turkiye Klinikleri Tip Bilimleri Dergisi. 2007;27(3):350–6.
Paradowski PT, Witonski D, Keska R, Roos EM. Cross-cultural translation and measurement properties of the polish version of the knee injury and osteoarthritis outcome score (KOOS) following anterior cruciate ligament reconstruction. Health Qual Life Outcomes. 2013;11:7.
Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee injury and osteoarthritis outcome score (KOOS) - development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28:88–96.
Salavati M, Mazaheri M, Negahban H, et al. Validation of a Persian-version of knee injury and osteoarthritis outcome score (KOOS) in Iranians with knee injuries. Osteoarthr Cartil. 2008;16:1178–82.
Vaquero J, Longo UG, Forriol F, Martinelli N, Vethencourt R, Denaro V. Reliability, validity and responsiveness of the Spanish version of the knee injury and osteoarthritis outcome score (KOOS) in patients with chondral lesion of the knee. Knee Surg Sports Traumatol Arthrosc. 2014;22:104–8.
Xie F, Li SC, Roos EM, et al. Cross-cultural adaptation and validation of Singapore English and Chinese versions of the knee injury and osteoarthritis outcome score (KOOS) in Asians with knee osteoarthritis in Singapore. Osteoarthr Cartil. 2006;14:1098–103.
Garratt AM, Brealey S, Gillespie WJ, Team DT. Patient-assessed health instruments for the knee: a structured review. Rheumatology. 2004;43:1414–23.
Guillemin F. Cross-cultural adaption and validation of health-status measures. Scand J Rheumatol. 1995;24:61–3.
Amadio PC. Outcomes measurements. J Bone Joint Surg Am. 1993;75:1583–4.
Shapiro ET, Richmond JC, Rockett SE, McGrath MM, Donaldson WR. The use of a generic, patient-based health assessment (SF-36) for evaluation of patients with anterior cruciate ligament injuries. Am J Sports Med. 1996;24:196–200.
Johnson DS, Smith RB. Outcome measurement in the ACL deficient knee - what's the score? Knee. 2001;8:51–7.
Hambly K, Griva K. IKDC or KOOS? Which measures symptoms and disabilities most important to postoperative articular cartilage repair patients? Am J Sports Med. 2008;36:1695–704.
van Meer BL, Meuffels DE, Vissers MM, et al. Knee injury and osteoarthritis outcome score or international knee documentation committee subjective knee form: which questionnaire is most useful to monitor patients with an anterior cruciate ligament rupture in the short term? Arthroscopy. 2013;29:701–15.
Fuh JL, Wang SJ, Lu SR, Juang KD, Lee SJ. Psychometric evaluation of a Chinese (Taiwanese) version of the SF-36 health survey amongst middle-aged women from a rural community. Qual Life Res. 2000;9:675–83.
Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15. doi: 10.1016/0197-2456(89)90005-6.
Irrgang JJ, Anderson AF, Boland AL, et al. Development and validation of the international knee documentation committee subjective knee form. Am J Sports Med. 2001;29:600–13.
Roos EM, Lohmander LS. The knee injury and osteoarthritis outcome score (KOOS): from joint injury to osteoarthritis. Health Qual Life Outcomes. 2003;1:64.
Ware JE, Gandek B, Project I. Overview of the SF-36 health survey and the international quality of life assessment (IQOLA) project. J Clin Epidemiol. 1998;51:903–12.
McHorney CA, Ware JE, Raczek AE. The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care. 1993;31:247–63.
Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care. 1992;30:473–83.
Huang IC, Wu AW, Frangakis C. Do the SF-36 and WHOQOL-BREF measure the same constructs? Evidence from the Taiwan population. Qual Life Res. 2006;15:15–24.
Terwee CB, Bot SDM, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Holmes W, Bix B, Shea J. SF-20 score and item distributions in a human immunodeficiency virus-seropositive sample. Med Care. 1996;34:562–9.
Bland JM, Altman DG. Measurement error and correlation coefficients. BMJ. 1996;313:41–2.
Fayers PM, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes 2nd ed. Hoboken: Wiley; 2007.
Greco NJ, Anderson AF, Mann BJ, et al. Responsiveness of the international knee documentation committee subjective knee form in comparison to the western Ontario and McMaster universities osteoarthritis index, modified Cincinnati knee rating system, and short form 36 in patients with focal articular cartilage defects. Am J Sports Med. 2010;38:891–902.
Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52:281–302.
DeVellis RF. Scale development : theory and applications 2nd ed. Thousand Oaks: Sage Publications; 2003.
Bland JM, Altman DG. Statistical-methods for assessing agreement between 2 methods of clinical measurement. Lancet. 1986;1:307–10.
Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53:459–68.
Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12:349–62.
IKDC forms, American Orthopaedic Society for Sports Medicine https://www.sportsmed.org/AOSSMIMIS/members/downloads/research/IKDCChineseTraditional.pdf Accessed 31 Oct 2017.
van de Graaf VA, Wolterbeek N, Scholtes VA, Mutsaerts EL, Poolman RW. Reliability and validity of the IKDC, KOOS, and WOMAC for patients with meniscal injuries. Am J Sports Med. 2014;42:1408–16.
Crawford K, Briggs KK, Rodkey WG, Steadman JR. Reliability, validity, and responsiveness of the IKDC score for meniscus injuries of the knee. Arthroscopy. 2007;23:839–44.
Salavati M, Akhbari B, Mohammadi E, Mazaheri M, Khorrami M. Knee injury and osteoarthritis outcome score (KOOS); reliability and validity in competitive athletes after anterior cruciate ligament reconstruction. Osteoarthr Cartil. 2011;19:406–10.
Roos EM, Roos HP, Ekdahl C, Lohmander LS. Knee injury and osteoarthritis outcome score (KOOS) - validation of a Swedish version. Scand J Med Sci Sports. 1998;8:439–48.
Irrgang JJ, Anderson AF, Boland AL, et al. Responsiveness of the international knee documentation committee subjective knee form. Am J Sports Med. 2006;34:1567–73.
Monticone MI, Ferrante S, Salvaderi S, Motta L, Cerri C. Responsiveness responsiveness and minimal important changes for the knee injury and osteoarthritis OutcomeScore in subjects undergoing rehabilitation after total knee arthroplasty. Am J Phys Med Rehabil. 2013;92(10):864–70.
Acknowledgements
The authors are grateful to all participants and assessors for their contribution.
Funding
The study did not receive funding.
Availability of data and materials
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Author information
Authors and Affiliations
Contributions
CCH and TJW contributed to the conception and design of the study. CCH and WSC performed the experiments. CCH, TJW and MWT contributed to the analysis and interpretation of data. TJW takes responsibility for the integrity of the work as a whole, from inception to finished article. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The Research Ethics Committee at National Taiwan University Hospital (NTUH) approved this clinical trial (200909038R). All participants handed in a written informed consent.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Huang, CC., Chen, WS., Tsai, MW. et al. Comparing the Chinese versions of two knee-specific questionnaires (IKDC and KOOS): reliability, validity, and responsiveness. Health Qual Life Outcomes 15, 238 (2017). https://doi.org/10.1186/s12955-017-0814-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12955-017-0814-6
Keywords
- Patient-reported outcome measurement
- International knee documentation committee (IKDC)
- The knee injury and osteoarthritis outcome score (KOOS)
- Cross-cultural adaptation
- Psychometric properties