- Open Access
Polish adaptation and validation of the hip disability and osteoarthritis outcome score (HOOS) in osteoarthritis patients undergoing total hip replacement
Health and Quality of Life Outcomes volume 18, Article number: 135 (2020)
The Hip disability and Osteoarthritis Outcome Score (HOOS) is a frequently used patient-reported outcome measure (PROM) for assessment of hip disorders and treatment effects following hip surgery. The objective of the study was to translate and adapt the Hip disability and Osteoarthritis Outcome Score (HOOS) into Polish and to investigate the psychometric properties of the HOOS in patients with osteoarthritis undergoing total hip replacement (THR).
Materials and methods
The Polish version of the HOOS was developed according to current guidelines. Patients completed the HOOS, Short Form 36 Health Survey (SF-36), the visual analogue scale (VAS) for pain and the global perceived effect (GPE) scale. Psychometric properties including interpretability (floor/ceiling effects), internal consistency (Cronbach’s alpha), test-retest reliability (intra-class correlation coefficient, ICC), convergent construct validity (a priori hypothesized Spearman’s correlations between the HOOS subscales, the generic SF-36 measure and the VAS for pain) and responsiveness (effect size, association between the HOOS and GPE scores) were analyzed.
The study included 157 patients (mean age 66.8 years, 54% women). Floor effects were found prior to THR for the HOOS subscales Sports and Recreation and Quality of Life. The Cronbach’s alpha was over 0.7 for all subscales indicating satisfactory internal consistency. The test–retest reliability was good for the HOOS subscale Pain (0.82) and excellent for all other subscales with ICCs ranging from 0.91 to 0.96. The minimal detectable change ranged from 12.0 to 26.2 on an individual level and from 1.4 to 3.0 on a group level. Seven out of eight a priori hypotheses were confirmed indicating good construct validity. Responsiveness was high since the expected pattern of effect sizes in all subscales was found.
The Polish version of the HOOS demonstrated good reliability, validity and responsiveness for use in patient groups having THR.
Assessment of pain and function in patients with osteoarthritis (OA) has become routine in both clinical practice and research. For patients with hip and knee OA, the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) is still a highly recommended and frequently used patient-relevant outcome measure (PROM) . However, since the WOMAC does not cover all important aspects of outcome, especially in subjects with higher physical demands, it has been further developed by completing available subscales and adding two new dimensions: Sport and Recreation Function and joint-related Quality of Life. The Knee Injury and Osteoarthritis Outcome Score (KOOS), an extension of the WOMAC, was initially constructed as a measure of PRO in studies of the treatment of anterior cruciate ligament and meniscus injury and later validated even for middle-aged patients with OA . Another measure, the Hip disability and Osteoarthritis Outcome Score (HOOS) was adapted from the KOOS to be used in patients eligible for both, basic and surgical treatment of OA [3, 4].
So far, there have been no available formally cross-culturally adapted PROs that could be used for assessment of functional status and quality of life following hip surgery in Poland. Thus, the objective of this study was 1) to linguistically and cross-culturally translate the HOOS into Polish and 2) to test its psychometric properties as expressed by reliability, validity and responsiveness of the Polish version of the HOOS in patients with end-stage hip OA who had undergone THR.
Linguistic and cross-cultural translation process
Translation of the questionnaire
The translation and cross-cultural adaptation of the HOOS from the source Swedish and English versions was performed according to the recommendations by Beaton et al. .
A total of five persons were involved in the translational process. Two independent forward translations (T1, T2) were performed from the English version by an orthopaedic surgeon, who was a native speaker of Polish and fluent in English and a professional translator. Another independent translation (T3) was performed from the Swedish version by a medical professional of Polish origin, fluent in Swedish. A final unified version of these three translations was reached after a consensus meeting. Then two native English-speaking persons of Polish origin (BT1 and BT2), with medical and technical professions respectively, independently provided back-translations of the consensus version into English. Both translators were unfamiliar with the original questionnaire and its concept. During the meeting with all translators involved, all versions of the HOOS questionnaire were combined and a consensus on semantic, idiomatic, experiential and conceptual equivalence was reached, resulting in a pre-final version of the questionnaire.
The pre-final Polish version of the HOOS questionnaire was tested on 21 Polish native speaking outpatients with OA of the hip (9 men and 12 women with a mean and median age of 69 years, range 48–80 years). The patients completed the questionnaire in the presence of the project manager (PTP). Subjects were asked whether they fully understood the questions (items), whether they found any items ambiguous and whether they had any problems in answering them. The Polish version of the HOOS is available free of charge from www.koos.nu  (Supplementary material 1).
Clinical validation study
One hundred and eighty-three patients were eligible for THR at the Department of Orthopaedics, Ministry of the Interior and Administration Hospital in Olsztyn, Poland, over a three-year period between April 2013 and April 2016. All hip procedures were performed through the posterolateral approach. Patients had undergone either cementless (146 hips, 79%) or cemented (37 hips, 21%) THR.
Inclusion criteria were: primary or secondary hip OA, according to the American College of Rheumatology criteria , ability to understand Polish written language and to understand and complete self-report questionnaires. Subjects with inflammatory arthritis, neurologic deficits, tumors and alcohol abuse were excluded from the study. Out of 183 subjects, 169 (92%) met the criteria and agreed to participate. Of those, 12 subjects were lost due to incomplete or discrepant records. Thus, 157 subjects formed the baseline study group (Fig. 1).
Data were collected three times: before THR (at baseline, for assessing internal consistency and validity), at routine follow-up 1 year after THR (for testing responsiveness) and, finally, one to 3 weeks after follow-up (for test-retest reliability).
The preoperative (baseline) and follow-up assessments were done in the clinic. During the preoperative assessment, the participants were asked to complete the Polish version of HOOS, the SF-36 and the Visual Analog Scale (VAS) for pain. At the follow-up assessment, the participants completed the HOOS questionnaire and the Global Perceived Effect (GPE) scale. For retest purposes, the HOOS questionnaire was completed once again, at home and returned by mail. All self-reported questionnaires, demographics and relevant information were processed by one orthopaedic surgeon (MKG).
The HOOS is a 40-item self-administered hip-specific questionnaire including five subscales: Pain (10 items), Symptoms (5 items), Function in Daily Living (or Activity in Daily Living, ADL Function, 17 items), Sports and Recreation Function (4 items) and hip-related Quality of Life (QOL, 4 items). Each item is responded to by marking one of five response options from 0 (best) to 4 (worst) on a Likert scale. A normalized score from 0 (extreme problems) to 100 (no problems at all) are calculated separately for each subscale.
The user’s guide can be downloaded from www.koos.nu . The format is user-friendly and the questionnaire takes about 10 min to complete. It is self-explanatory and patients can complete it in the waiting room or it can be used as a mailed survey.
The SF-36 Health Survey is a generic self-administered questionnaire that includes 36 items, combined in eight health domains of which four cover physical health perceptions (Physical Functioning – PF, Role limitations because of physical problems – RP, Bodily Pain – BP, General Health – GH) and four mental health concepts (Vitality – VT, Social Functioning – SF, Role limitations because of emotional problems – RE and Mental Health – MH) . A score from 0 (worst possible health status) to 100 (best possible health status) is independently generated for each domain as well as for two summary scores that have been extracted from the eight original scales and referred to as the Physical Component Summary (PCS) and Mental Component Summary (MCS). In order to prevent the inflation of the MCS scores by poor physical health scores that is observed when commonly used orthogonal-factor analytic model is used , scoring coefficients were calculated according to the oblique-factor analytic model .
SF-36 outcomes were calculated with Scoring Software v. 4.5 delivered by the copyrights holder (Optum Insight, Eden Prairie, MN, USA, license number QM018125). The SF-36 has already been validated in Polish .
VAS for pain
The VAS for pain is a simple way of measuring the intensity of pain. The 100-mm VAS is a unidimensional scale and it is considered valid and reliable .
The GPE scale is designed to quantify a patient’s improvement or deterioration over time, usually either to determine the effect of an intervention or to chart the clinical course of a condition [15, 16]. Patients were asked to rate their perceived hip condition after THR, at one-year follow-up, compared with the condition preoperatively. Patients had the following answer options: much better (3), better (2), somewhat better (1), no change (0), somewhat worse (− 1), worse (− 2) and much worse (− 3).
According to the 2013 Users’ Guide for the HOOS questionnaire, at least 50% of the items should be responded to. In our study, any missing data were handled according to the HOOS scoring instructions (available free of charge from www.koos.nu) with the participate mean substitution method. The missing data were imputed with the mean of the other values within the same subscale . In addition, the multiple imputation method was used to verify the results. With this approach, any missing data from incomplete data sets were imputed to produce three complete data sets. Statistical analysis was then performed on each imputed data set and Cronbach’s α results were computed. Finally, the results were pooled to obtain a single Cronbach’s α .
SF-36 results were calculated using standard scoring procedures whereby missing values were replaced by scale means where valid responses were available for at least half of the scale items .
Floor or ceiling effects were determined preoperatively in patients that attended the baseline assessment, and 1 year after TKR in patients who were controlled at follow-up. They were considered to be present if more than 15% of the participants achieved either the lowest or the highest possible scores . Comparisons of proportions for men and women with the lowest and the highest possible scores were evaluated with the McNemar’s test.
Reliability is an estimation of the consistency and stability of a measure. It includes an analysis of the extent to which a measure is internally consistent and free of measurement error .
Internal consistency refers to an agreement between items on the same subscale and measures their degree of homogeneity. The internal consistency was assessed using Cronbach’s alpha coefficient  with 95% Feld’s confidential intervals (95% CI) and Pearson’s item to total (item-rest) correlation. Cronbach’s α was determined preoperatively and at follow-up. Cronbach’s α value of more than 0.70 was considered satisfactory . An item-rest correlation greater than 0.50 was considered strong, between 0.35 and 0.5 moderate, and less than 0.35 weak .
Test-retest reliability is the extent to which results of the same patient in the same health condition remain unchanged over time . Test–retest reliability of the HOOS subscales was assessed at follow-up, twice, with one to 3 weeks interval. For test-retest studies, the time interval needs to be sufficiently short to ensure that no significant clinical change in the hip joint occurs and long enough to ensure that patients do not remember how they responded in the first questionnaire . A retest interval between two days and 3 weeks is considered appropriate and has previously been used for the validation of the HOOS [23, 24].
Test–retest reliability of the HOOS was established by calculating the intraclass correlation coefficients (ICCs) (single measure, model 3, 1, two-way mixed model for absolute agreement) and 95% CI. ICCs between 0.75 and 0.90 were considered good and ICCs greater than 0.90 excellent [21, 25].
The measurement error is the systematic and random error of a patient’s score that is not attributed to true changes in the construct to be measured. The standard error of measurement (SEM) for absolute agreement of the test–retest reliability estimates how repeated measures of a person on the same instrument tend to be distributed around his or her ‘true’ score. SEM was calculated using one-way analysis of variance (ANOVA) square root of the within groups mean square value [26,27,28]. Then, in turn, the minimal detectable change (MDC), i.e. the smallest threshold of score change that is detectable and greater than random measurement error, was calculated using the formula: MDC=SEM × 1.96 × √2, where 1.96 derives from the 0.95% CI of no change and √2 represents two measurements evaluating the change [26, 29]. The MDC can be modified for group comparison, depending on the size of the group (n = 77), as follows: MDCgroup = MDCindividual/√n .
Content validity is assessed by making a judgment of relevance and comprehensiveness of the items. All subjects recruited for the study group were asked to assess whether the questionnaire items were relevant to their case and/or condition, whether the description of the construct was clear, and whether explanation of the domains was understandable.
Construct validity (hypotheses testing)
Construct validity is defined as the degree to which an instrument measures the characteristic to be measured. Basing on the assumptions of Terwee et al. , we examined the convergent construct validity of the Polish version of HOOS by testing an a priori set of hypotheses about the expected relationships between the HOOS subscales, the generic SF-36 measure and the VAS for pain at baseline.
In order to evaluate the association between domains, the Spearman’s rank correlation was used. Correlation coefficients greater than 0.5 were considered strong, correlations between 0.35 and 0.5 moderate, and less than 0.35 weak .
We expected the highest correlations when comparing the subscales that measure similar constructs. We hypothesized that:
since the HOOS subscale Pain and SF–36 BP measure a sufficiently similar construct, the correlation between these two measures should be strong and in the same direction,
the correlation between the HOOS subscale ADL Function and SF–36 PF should be moderate or strong and in the same direction,
the correlation between the HOOS subscale Sports and Recreation Function and SF–36 PF should be at least moderate and in the same direction,
the correlation between the HOOS subscale ADL Function and SF–36 PF should be higher than the correlation between the HOOS subscale ADL Function and the other subscales of the SF-36,
the correlation between the HOOS subscale Sports and Recreation Function and SF–36 PF should be higher than the correlation between the HOOS subscale Sports and Recreation Function and the other subscales of the SF-36,
the correlation between all HOOS subscales and PCS of the SF–36 should be strong and in the same direction,
all HOOS subscales should correlate stronger with PCS than with MCS of the SF–36,
the correlation between the HOOS subscale Pain and the VAS for pain should be moderate or strong and in the opposite direction.
Responsiveness is an ability of a measure to detect meaningful clinical change over time in the construct to be measured. It is critical for the use and application of a measure. We have expected to be able to detect clinical change that occurred following THR. As suggested by the COSMIN initiative, responsiveness was investigated formulating a priori hypotheses regarding expected 1) correlations of the HOOS score change with the GPE score and 2) effect sizes.
Associations between score change in the HOOS subscales and GPE were calculated with use of the Spearman’s rank correlation. Correlation coefficients greater than 0.5 were considered strong, correlations between 0.35 and 0.5 moderate, and less than 0.35 weak .
The standardized effect size (SES) was calculated in all HOOS subscales. It was defined as a mean score change divided by baseline SD (Kazis’ effect size) . In addition to SES, responsiveness was also presented as standardized response mean (SRM). SRM was calculated by dividing the mean score change by the standard deviation of that score change . Two hypotheses were formulated (a priori hypotheses 9 and 10):
the change in scores in all HOOS subscales between the baseline examination and follow-up control would correlate with the GPE score and that the correlation would be at least moderate.
SRM and ES should be higher for patients who reported their condition to be much better than in patients reporting to be better, somewhat better, no change, somewhat worse, worse and much worse in the GPE score.
Descriptive statistics were used to describe sociodemographic and clinical characteristics preoperatively, at baseline and clinical characteristics after treatment, at follow-up. Data were checked for normality of distribution using the Kolmogorov–Smirnov test and tests for skewness and kurtosis. Since the data were normally distributed, the Student’s t-test was used to compare HOOS scores before THR and at follow-up.
Analyses were performed with the use of IBM SPSS Statistics for Windows V. 24.0.0 (IBM Corp. Armonk, New York, USA). We considered a two-tailed p value less than 0.05 to be significant.
Linguistic and cross-cultural translation process
The translation process revealed some difficulties with the understanding of the description of activities that possibly cause pain (HOOS subscale Pain). Patients’ suggestions were reviewed and minor changes to the pre-final version were introduced. Clarifications of respective movements were added to item P2 “Straightening your hip fully” and to item P3” Bending your hip fully”. In addition, the expression “At night while in bed” in item P6 was supplemented with the phrase “Pain that bothers you while asleep”.
The revised version of the questionnaire was reassessed and found semantically, idiomatically and conceptually equivalent to the original version and then used in a clinical validation study. The Polish version of the pre-final HOOS questionnaire was well-accepted in the pre-test. All questions and response options were considered satisfactory and understandable by the subjects.
Clinical validation study
Internal consistency and validity was studied in 157 patients (84 women, 73 men, aged 25–87 years) who participated in the preoperative (baseline) analysis. Follow-up was carried out between May 2014 and November 2016. Since the study was still ongoing in November 2016, 26 subjects had not completed a one-year period after the surgery and thus could not be analyzed for responsiveness. Out of 131 subjects eligible for follow-up, 36 dropped out (27%). Finally, the responsiveness analysis was performed in 95 patients (59 women, 36 men, aged 40–84 years) at a mean 1.1 years (0.9–1.9) after THR. Of these patients, 77 (46 women and 31 men, aged 43–84 years) completed the HOOS questionnaire twice for the test–retest reliability (response rate of 81%).
The median number of days from test to retest was 9 (ranging from 6 to 20).
To assess a possible inclusion bias, all patients from the baseline study group were analyzed with regard to age and gender, as well as their outcome in the HOOS subscales, SF-36 domains and VAS Pain. We found no significant differences in these characteristics between the subjects included in later analyses and those who were lost to follow-up. Patient characteristics are given in Table 1.
For the HOOS scale preoperatively, a total of 82 items of the possible 40 (number of items) × 157 (number of patients) were missing (1.31%). At follow-up, 51 of the possible 40 × 95 items were missing (1.34%), while at retest analysis, 50 of the possible 40 × 77 items were missing (1.62%). For the SF-36, the number of missing items at baseline was 5 (0.01%) of the possible 36 (items) × 157 (number of patients).
Preoperatively, there were neither ceiling effects, nor any patients with best possible scores in any of the HOOS subscales. The floor effects (indicating worst possible status) were found prior to THR for the subscales Sports and Recreation Function (24%) and QOL (25%). The worst possible scores were reported by 3% of the patients for the HOOS subscale Pain, 7% for Symptoms, and 5% for ADL. At follow-up, there were no ceiling effects in any HOOS subscales. The best possible scores were reported by 12% of the patients for the subscale Pain and Sport and Recreation Function, 14% for the subscale Symptoms, 13% for the subscale ADL and 7% for the subscale QOL. As expected, at follow-up there were neither floor effects nor any patients with the worst possible scores. No differences in the number of patients having the worst or best possible scores related to gender were observed (data not shown).
Cronbach’s α for the HOOS subscales ranged from 0.76 to 0.95 at baseline and 0.87 to 0.97 at follow-up, indicating a good homogeneity of all items in the subscales. (Table 2). An analysis of Pearson’s correlations between each item and the total score (item-to-total correlations) in each subscale showed that all correlation coefficients were strong, except for item Q1 (“How often are you aware of your hip problem?”) preoperatively that was moderate (rp = 0.48) (Table 2). When missing data were handled with the multiple imputation method, Cronbach’s α values obtained after pooling the results from the three data sets were similar to those achieved with the participate mean substitution approach. Differences in Cronbach’s α values and their 95% CI obtained with these two methods did not exceed 0.01. Item-to-total correlations calculated for data handled with multiple imputation method were in some cases (item A16 in the ADL Function subscale, SP4 in the Sports and Recreation Function subscale and Q4 in the QOL subscale) lower than those achieved when the participate mean substitution method was applied. Differences were not higher than 0.06, which did not change the strength of correlation in any case.
The HOOS questionnaire was completed within mean 10.8 days (SD 3.9, range 6–20 days). The reliability of all HOOS subscales was good or excellent, with ICCs ranging from 0.82 to 0.96 and SEM values between 4.32 and 9.46 (Table 3).
Minimal detectable change
At the individual level, the MDC was lowest (12.0) for the HOOS subscale ADL Function, and highest (26.2) for the HOOS subscale Pain. At the group level, MDC ranged from 1.4 to 3.0 (Table 3).
All HOOS items were estimated to be relevant. The description of the domains was assessed to be understandable and the construct appeared to be clearly described. Thus, the items were assessed to be comprehensive.
Seven out of eight a priori established hypotheses were supported. We confirmed a strong correlation between the subscales that intended to measure similar constructs: HOOS Pain vs SF-36 BP (rs = 0.70, 95%CI 0.59 to 0.81) and HOOS Sports and Recreation Function and SF–36 PF (rs = 0.71, 95%CI 0.59 to 0.82) (hypothesis 1 and 3, respectively). Noteworthy, the correlation between HOOS ADL Function vs SF-36 PF was strong (rs = 0.68, 95%CI 0.56 to 0.80), as expected (hypothesis 2), but lower to the correlation between HOOS ADL Function and SF-36 BP (rs = 0.73, 95%CI 0.62 to 0.84). Thus, hypothesis 4 was not confirmed.
The correlation between the HOOS subscale Sports and Recreation Function and SF–36 PF was at least 0.14 higher than the correlation with the other subscales of the SF-36 (hypothesis 5). We confirmed also a strong correlation between all HOOS subscales and the PCS of the SF–36 (rs between 0.62, 95%CI 0.49 to 0.74 in the HOOS subscale Symptoms and 0.70, 95%CI 0.59 to 0.82 in the HOOS subscale ADL) (hypothesis 6). In addition, correlations of HOOS subscales with PCS were stronger than those with MCS of the SF–36 (hypothesis 7). All correlations between the HOOS subscales and the VAS-pain were moderate (hypothesis 8) (Table 4).
The HOOS scores from all subscales increased significantly (p < 0.001) at one-year follow-up after THR as compared to preoperative values (Table 5). All patients examined reported improvement in their hip condition at follow-up scoring ‘somewhat better’, ‘better’, or ‘much better’ in the GPE score (GPE ranging 1–3). There were no subjects who scored ‘no change’, ‘somewhat worse’, ‘worse’ or ‘much worse’. A moderate correlation was observed between GPE score and score change in the HOOS subscales: Sports and Recreation Function and HOOS and QOL (rs = 0.38, 95%CI 0.19 to 0.57, and rs = 0.43, 95%CI 0.25 to 0.62 respectively). In all other subscales, correlations were weak (rs ranging 0.27–0.32) (Table 5). The a priori hypothesis 9 could thus be supported partially. The responsiveness measured with the SES and SRM for entire group was high for all subscales, with SES ranging from 2.91 in the subscale Symptoms to 3.58 in the Sports and Recreation Function and SRM ranging from 1.73 in the subscale Sports and Recreation Function to 2.43 in the subscale ADL Function (data not shown). Since patients who described their hip condition at follow-up as ‘much better’ reported higher responsiveness (in both SES and SRM) in all five HOOS subscales than those who scored ‘better’ or ‘somewhat better’ (Table 5), the a priori hypothesis 10 could be confirmed.
Our study reports on the linguistic and cross-cultural translation and the psychometric properties of the Polish version of the HOOS in patients after THR. The study was performed in accordance with the COSMIN guidelines recommended for validation processes [8, 35].
The Polish version of the HOOS questionnaire was easy to fill in and understandable for patients; they did not need any supplementary instructions to answer the questions independently. This resulted in a high percentage of answers and a low percentage of missing data.
A systematic literature search for psychometric assessment of OA questionnaires allowed Veenhof et al.  to conclude that the HOOS questionnaire was one of the top three measures with the best ratings for its psychometric properties to assess both pain and physical function. Since then, the HOOS has been extensively studied and validated in several languages [23, 37,38,39,40,41,42,43]. All these studies have confirmed that the HOOS questionnaire was reliable, valid and responsive to patient perceptions of hip problems.
In the present study, we found floor effects preoperatively for the HOOS subscales Sports and Recreation Function and QOL. This observation could have been expected since these two subscales were developed as an extension of the WOMAC for younger, more active subjects, thus appeared to be more sensitive and discriminative for older and disabled patients with OA than original WOMAC subscales .
The Polish version of the HOOS questionnaire has a good internal consistency both preoperatively and at follow-up. Since the Cronbach’s alpha values were markedly higher than 0.7 preoperatively and even 0.8 at follow-up, all subscales of the HOOS questionnaire could be considered reliable. Internal consistency for the subscales Symptoms, Sports and Recreation Function and QOL were, however, slightly lower than that observed in respective subscales in a previous study evaluating psychometric properties of the Polish version of the KOOS questionnaire in patients with OA undergoing total knee replacement . A lower value of alpha could be due to a heterogeneous construct of these subscales. Cronbach’s alpha was greatest for the ADL subscale both preoperatively and at follow-up (0.95 and 0.97 respectively), which concurs with previous validation studies (0.94 in the French version, and 0.98/0.95 for OA/THR group in the Dutch version , 0.96 in the Korean , German  and Italian  versions and 0.97 in the Japanese version . However, since it had been reported [46, 47] that subscales showing a high coefficient alpha are not necessarily homogenous or unidimensional, very high Cronbach’s alpha (exceeding 0.9) may suggest that some items of both, the 17-item ADL Function subscale, and the 10-item Pain subscale are redundant as they test the same question in a different guise. Indeed, exploratory principal factor analysis confirmed item redundancy in both subscales (Supplementary material 2).
It has been known, however, that removal of redundant items cannot only make the measurement instrument more reliable but also can easily affect both the content and construct [46, 47]. Since it was not our purpose to develop a new instrument or to revise the existing one, we did not change the questionnaire structure and extract any items from the subscales. Consequently, we accepted that Polish version of the HOOS was multidimensional and that it contained some items that loaded on more than one factor.
Findings from internal consistency analysis in terms of Pearson item-total correlations suggested that all items of the HOOS questionnaire were correlated among themselves within the subscales.
We have found that test-retest for all HOOS subscales was good or excellent, with ICCs ranging from 0.82 to 0.96. This observation is in accordance with previous validation studies [3, 23, 37, 39, 41] and proves that the Polish version of the HOOS was stable and reproducible in the patients examined. In the present study, the highest ICCs were observed in the HOOS subscale ADL Function. The possible explanation is that the questions about daily activities in stable patients after THR were less discriminative than in other subscales.
Another important finding in this study was that the changes observed in all HOOS subscales were clinically and statistically meaningful at the group level. The MDC value for groups was found to be between 1.4 and 3.0 points in different subscales, which indicates that the Polish version of the HOOS has an ability to detect differences of more than 3 points between the measurements. As expected, the sensitivity of the HOOS subscales was lower at the individual level. The MDC should preferably be smaller than the other important benchmark, not calculated here, minimal important change (MIC) that is the smallest change score needed for the effect to be considered clinically relevant. A MIC of 8–10 points was considered to be appropriate for different KOOS subscales  and seems to be convenient even for HOOS subscales. The MDC value of 12 points that was detected in the HOOS subscale ADL was at slightly higher level as the MIC, however not small enough to be classified as clinically relevant even for individual subjects. Since MDCs for other subscales should be between 15 and 26 to be considered remarkable with 95% confidence, they could not be easily detected in individuals. MDC values obtained in our study were higher than those observed by Ornetti et al.  and similar to MDCs reported by Naylor et al.  which ranged from 18 to 24. The smallest MIC values, between 6.1 and 8.6 score points, have been presented by Arbab et al.  who validated the German version of the HOOS. These low values might be related to large size of the study group (251 patients) and to the fact that MDC was calculated basing on the confidence level of 90%.
Since there are no other instruments evaluating pain and function related to the hip validated in Polish, construct validity of the HOOS was determined only by comparing the HOOS subscales with the subscales of the generic measure SF-36. As expected, we found strong correlations between subscales of the HOOS and SF-36 that were intended to measure similar constructs. The correlation values were comparable to those reported by de Groot et al. , Satoh et al.  and Torre et al.  in THR patients with a mean age of 62–66 years and higher than observed by Nilsdotter et al. in Swedish patients over 70 years of age . This observation might have been expected since the outcome in THR is not specific to the joint but to overall impact on health, and therefore sensitive to age.
In analysis of the construct validity we confirmed all a priori hypotheses except for hypothesis 4 in which we expected that the HOOS subscale ADL Function correlates better with SF–36 PF than other SF-36 subscales. Unexpectedly, we observed that the correlation between HOOS ADL Function and SF-36 BP was even stronger than between ADL and PF. This observation may obviously give some difficulty in interpreting the results.
The choice of the responsiveness parameter depends on the focus of interest and the characteristics of the different methods, as outlined in the background. In this study, the HOOS ability to detect clinically relevant changes over time was assessed with use of the GPE. A correlation of at least 0.35 was observed between the GPE score and the score change in HOOS subscales Sports and Recreation Function and QOL. We expected, however, that such effective intervention as THR would be more responsive even within other domains. In our study, all patients reported their hip conditions to be at least ‘better’ than prior to operation. Correlations between the GPE and HOOS score changes would certainly be much higher if patients who did not improve or worsened in the HOOS score reported no change or even deterioration of their hip condition over time. Furthermore, we have found that even confidence intervals of correlation between GPE and HOOS subscales were much wider than those computed in the assessment of correlation between the results of HOOS subscales and SF-36 domains. In our opinion, this may eventuate from the distribution of variables rather than the sample size.
The follow-up questionnaires were completed during hospital visit and gathered by the same surgeon who earlier performed the THR surgeries. Since the GPE questions are put more directly than the items in the HOOS subscales, patients who answer them feel more comfortable when they elevate the score.
We observed large values of SES and SRM. This result may have been expected since THR is the most effective hip intervention. Our results were superior to those reported in other HOOS validation studies with median follow-up of 3 to 7 months [4, 41, 42]. Patients in the present study were assessed for responsiveness at a mean 1.1 years after THR, a period that is thought to be sufficient for adaptation to the new health status . In summary, the results of the responsiveness assessment confirmed that both, the HOOS are able to recognize clinical improvement in patients undergoing THR.
The study’s strength is that we examined a well-defined, relatively large and likely to be representative group of patients with end-stage hip OA undergoing THR. The age and gender profiles of the study participants reflect those of the entire patient populations undergoing THR, as reported in international registries [48, 49]. A single-group design is, however, also a limitation of this study. The subjects assessed did not represent the entire spectrum of patients with hip OA. Elderly patients with end-stage OA have more pain and are not able to maintain a high level of physical activity and are thus are limited in their everyday life more than younger subjects with early OA. Further investigation concerning the psychometric properties in younger patients with hip dysfunctions and earlier stages of OA is advised.
The rate of loss to follow-up in the presented study was approximately 27%. However, since patients who were lost to follow-up and those who were eligible for analysis of responsiveness and test-retest reliability had similar baseline results in all HOOS and SF-36 subscales we believe that this is not a serious limitation.
Although there is no gold standard of construct validity assessment, the fact that construct validity was analysed only by assessing the relationship between the HOOS subscales with matching domains of the SF-36 can be regarded as another weakness of the study. However, up to date, there are no instruments evaluating hip-related pain and function validated in Polish that could be compared with the HOOS and used in the assessment of construct validity.
The Polish version of HOOS demonstrated good psychometric properties and appears to be useful for the evaluation of patient-relevant outcome in subjects with hip OA undergoing THR. Since MDCs for the HOOS subscales, are substantially higher than MIC and thus cannot be detected at an individual level, the Polish version of the HOOS is advocated for assessment of groups of patients.
Availability of data and materials
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
Activities of daily living
Consensus-based Standards for the selection of health Measurements Instruments
Global perceived effect
Hip disability and osteoarthritis outcome score
Intraclass correlation coefficient
Knee injury and osteoarthritis outcome score
Minimal detection change
Minimal important change
Quality of life
Standard error of measurement
Standardized effect size
Short Form 36
Standardized response mean
Total hip replacement
Visual Analogue Scale
Western Ontario and McMaster Universities Osteoarthritis Index
Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15:1833–40.
Roos EM, Lohmander LS. The knee injury and osteoarthritis outcome score (KOOS): from joint injury to osteoarthritis. Health Qual Life Outcomes. 2003;1:64.
Klässbo M, Larsson E, Mannevik E. Hip disability and osteoarthritis outcome score. An extension of the Western Ontario and McMaster universities osteoarthritis index. Scand J Rheumatol. 2003;32:46–51.
Nilsdotter AK, Lohmander LS, Klässbo M, Roos EM. Hip disability and osteoarthritis outcome score (HOOS)--validity and responsiveness in total hip replacement. BMC Musculoskelet Disord. 2003;4:10.
Hip disability and Osteoarthritis Outcome Score. Odense: Institute of Sports Science and Clinical Biomechanics, University of Southern Denmark; 2012–2016:http://www.koos.nu/hoospolish.pdf. Accessed 5 Apr 2013.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.
Consensus-based standards for the selection of health measurement instruments (COSMIN). Amsterdam: Vrije University (VU) Medical Center; 2015:http://www.cosmin.nl/the_cosmin_checklist.html. Accessed 11 Oct 2016.
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, de Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.
Altman R, Alarcon G, Appelrouth D, Bloch D, Borenstein D, Brandt K, Brown C, Cooke TD, Daniel W, Feldman D, et al. The American College of Rheumatology criteria for the classification and reporting of osteoarthritis of the hip. Arthritis Rheum. 1991;34:505–14.
Ware JE, Kosinski M, Keller SD. SF-36 physical and mental health summary scales: a user’s manual. Boston: The Health Institute, New England Medical Center; 1994.
Laucis NC, Hays RD, Bhattacharyya T. Scoring the SF-36 in Orthopaedics: a brief guide. J Bone Joint Surg Am. 2015;97:1628–34.
Farivar SS, Cunningham WE, Hays RD. Correlated physical and mental health summary scores for the SF-36 and SF-12 Health Survey, V.I. Health Qual Life Outcomes. 2007;5:54.
Żołnierczyk-Zreda D. The polish version of the SF-36v2 questionnaire for the quality of life assessment. Przegl Lek. 2010;67:1302–7.
Scott J, Huskisson EC. Graphic representation of pain. Pain. 1976;2:175–84.
Kamper SJ, Maher CG, Mackay G. Global rating of change scales: a review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17:163–70.
Kamper SJ, Ostelo RW, Knol DL, Maher CG, de Vet HC, Hancock MJ. Global perceived effect scales provided reliable assessments of health transition in people with musculoskeletal disorders, but ratings are strongly influenced by current status. J Clin Epidemiol. 2010;63:760–6 e761.
Béland S, Pichette F, Jolani S. Impact on Cronbach’s α of simple treatment methods for missing data. Quant Methods Psychol. 2016;12:57–73.
McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4:293–307.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–333.
Bland JM, Altman DG. Cronbach's alpha. BMJ. 1997;314:572.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Sun Y, Sturmer T, Gunther KP, Brenner H. Reliability and validity of clinical outcome measurements of osteoarthritis of the hip and knee--a review of the literature. Clin Rheumatol. 1997;16:185–98.
de Groot IB, Reijman M, Terwee CB, Bierma-Zeinstra SM, Favejee M, Roos EM, Verhaar JA. Validation of the Dutch version of the hip disability and osteoarthritis outcome score. Osteoarthr Cartil. 2007;15:104–9.
Streiner DL, Norman GR. Health Measurement Scales. A Practical Guide to their Development and Use. 3rd ed. Oxford (NY): Oxford University Press; 2004.
Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63.
Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26:217–38.
Bland JM, Altman DG. Measurement error. BMJ. 1996;313:744.
Stratford PW, Goldsmith CH. Use of the standard error as a reliability index of interest: an applied example using elbow flexor strength data. Phys Ther. 1997;77:745–50.
de Vet HC, Bouter LM, Bezemer PD, Beurskens AJ. Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001;17:479–87.
de Vet HC, Ostelo RW, Terwee CB, van der Roer N, Knol DL, Beckerman H, Boers M, Bouter LM. Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007;16:131–42.
Juniper EF, Gordon HG, Roman J. How to develop and validate a new health-related quality of life instrument. In: Spilker B, editor. Quality of Life and Pharmacoeconomics in Clinical Trials. 2nd ed. Philadelphia: Lippincott-Raven Publishers; 1996. p. 49–56.
Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12:349–62.
Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27:S178–89.
Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials. 1991;12:142S–58S.
Angst F. The new COSMIN guidelines confront traditional concepts of responsiveness. BMC Med Res Methodol. 2011;11:152 author reply 152.
Veenhof C, Bijlsma JW, van den Ende CH, van Dijk GM, Pisters MF, Dekker J. Psychometric evaluation of osteoarthritis questionnaires: a systematic review of the literature. Arthritis Rheum. 2006;55:480–92.
Arbab D, van Ochten JHM, Schnurr C, Bouillon B, König D. Assessment of reliability, validity, responsiveness and minimally important change of the German hip dysfunction and osteoarthritis outcome score (HOOS) in patients with osteoarthritis of the hip. Rheumatol Int. 2017;37:2005–11.
Lee YK, Chung CY, Koo KH, Lee KM, Lee DJ, Lee SC, Park MS. Transcultural adaptation and testing of psychometric properties of the Korean version of the hip disability and osteoarthritis outcome score (HOOS). Osteoarthr Cartil. 2011;19:853–7.
Mousavian A, Kachooie AR, Birjandinejad A, Khoshsaligheh M, Ebrahimzadeh MH. Translation and cross-cultural adaptation of the hip disability and osteoarthritis score into Persian language: reassessment of validity and reliability. Int J Prev Med. 2018;9:23.
Naylor JM, Hayen A, Davidson E, Hackett D, Harris IA, Kamalasena G, Mittal R. Minimal detectable change for mobility and patient-reported tools in people with osteoarthritis awaiting arthroplasty. BMC Musculoskelet Disord. 2014;15:235.
Ornetti P, Parratte S, Gossec L, Tavernier C, Argenson JN, Roos EM, Guillemin F, Maillefert JF. Cross-cultural adaptation and validation of the French version of the hip disability and osteoarthritis outcome score (HOOS) in hip osteoarthritis patients. Osteoarthr Cartil. 2010;18:522–9.
Satoh M, Masuhara K, Goldhahn S, Kawaguchi T. Cross-cultural adaptation and validation reliability, validity of the Japanese version of the hip disability and osteoarthritis outcome score (HOOS) in patients with hip osteoarthritis. Osteoarthr Cartil. 2013;21:570–3.
Trathitiphan W, Paholpak P, Sirichativapee W, Wisanuyotin T, Laupattarakasem P, Sukhonthamarn K, Jeeravipoolvarn P, Kosuwon W. Cross-cultural adaptation and validation of the reliability of the Thai version of the hip disability and osteoarthritis outcome score (HOOS). Rheumatol Int. 2016;36:1455–8.
Paradowski PT, Kęska R, Witoński D. Validation of the Polish version of the knee injury and osteoarthritis outcome score (KOOS) in patients with osteoarthritis undergoing total knee replacement. BMJ Open. 2015;5:e006947.
Torre M, Luzi I, Mirabella F, Del Manso M, Zanoli G, Tucci G, Romanini E. Cross-cultural adaptation and validation of the Italian version of the hip disability and osteoarthritis outcome score (HOOS). Health Qual Life Outcomes. 2018;16:115.
Green SB, Lissitz RW, Mulaik SA. Limitations of coefficient alpha as an index of test unidimensionality. Educ Psychol Meas. 1977;37:827–38.
Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ. 2011;2:53–5.
Swedish hip arthroplasty register. Annual Report 2015. Gothenburg: Svenska Höftprotesregistret; 1979–2018. https://registercentrum.blob.core.windows.net/shpr/r/-rsrapport-2015-B2011dTcO2013Pe.pdf. Accessed 14 Mar 2017.
National Joint Registry. Annual Report 2015/2016. London: Healthcare Quality Improvement Partnership Ltd.; 2002–2018. http://www.njrcentre.org.uk/njrcentre/Reports,PublicationsandMinutes/Annualreports/tabid/86/Default.aspx. Accessed 14 Mar 2017.
The authors would like to thank all patients assessed in this study for filling in the questionnaires, and our co-workers, Robert Lundqvist, M.Sc. for providing assistance in statistical analyses and Robert Foltyn, M.Sc. for his valuable contribution in preparation of the manuscript.
This work received no specific funding but was supported by the Local Chamber of Physicians and Dentists of the Warmia and Mazury Province in Olsztyn, Poland and by the County Council of Norrbotten, Sweden.
Ethics approval and consent to participate
The study was conducted in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The patients were informed in writing and orally by the study personnel, and a written informed consent was obtained from all subjects. Participation was voluntary, and withdrawal was possible at any time.
All patients signed and personally dated the informed consent forms at admission to hospital, before participating in the study. The study was approved by the Medical Ethics Committee of the Local Chamber of Physicians and Dentists of the Warmia and Mazury Province in Olsztyn (Approval no. 37/2013).
Consent for publication
A written informed consent was gained for all participants.
The authors declare no conflict of interest related to this manuscript.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Gojło, M.K., Paradowski, P.T. Polish adaptation and validation of the hip disability and osteoarthritis outcome score (HOOS) in osteoarthritis patients undergoing total hip replacement. Health Qual Life Outcomes 18, 135 (2020). https://doi.org/10.1186/s12955-020-01390-4
- Hip disability and osteoarthritis outcome score (HOOS)
- Total hip replacement
- Patient-relevant outcome
- Cross-cultural adaptation