Skip to main content
Download PDF

The interpretation of change score of the pain disability index after vocational rehabilitation is baseline dependent

Health and Quality of Life Outcomes volume 16, Article number: 182 (2018) Cite this article

Abstract

Background

The Pain Disability Index (PDI) is a widely-used instrument to measure pain-related disability. The aim of this study was to assess the responsiveness and interpretation of change score of the PDI in patients with chronic musculoskeletal pain (CMP) at discharge of vocational rehabilitation.

Methods

Retrospective data of patients with CMP who attended vocational rehabilitation between 2014 and 2017 was used. The anchor-based method was used to assess the responsiveness of the total sample and of PDI baseline quartile groups. A receiver operating characteristic curve was performed, including Area Under the Curve (AUC) and Minimal Important Change (MIC).

Results

The PDI showed responsive to detect clinically relevant changes in pain-related disability at discharge of vocational rehabilitation (AUC 0.79). A PDI change score of 13 points (MIC 12.5) can be considered as a real change in pain-related disability for the total study sample, and a PDI change score of 7–20 points can be considered as a real change in pain-related disability for PDI lowest and highest baseline quartile scores.

Conclusion

The PDI is responsive in patients with CMP at discharge of vocational rehabilitation. The interpretation of change score depends on PDI baseline score. Patients with a PDI baseline score of ≤27 should decrease minimal 7 points, patients with a baseline score between 28 and 42 should decrease minimal 15 points, and patients with a baseline score ≥ 43 should decrease minimal 20 points.

Background

Chronic Musculoskeletal Pain (CMP) negatively affects quality of life, daily activities and social and working lives [1]. A decrease of pain-related disability is a desired outcome measure after rehabilitation for people with CMP [2]. A widely used and studied instrument to measure pain-related disability is the Pain Disability Index (PDI) [2, 3]. The PDI is a generic instrument: it can be administered to different patient groups, for example, chronic low back pain, fibromyalgia, cancer, or chronic widespread pain. The PDI is a valid [4,5,6] and reliable [6, 7] instrument. The utility of the PDI is high because it is easy to comprehend, it can be administered in a very short time, and it consists of only 7 questions [8].

However, the responsiveness, measurement error, and interpretability of change score of the PDI have scarcely been addressed. Responsiveness is the ability of a questionnaire to detect clinically important changes over time (for example, at discharge of a rehabilitation program) [9]. An outcome instrument should be able to distinguish clinically important change from measurement error [10]. The relation between responsiveness and measurement error should be made to interpret the (change) score of a questionnaire [10]. Nevertheless, to our knowledge, only one study [8] has assessed responsiveness and one other study [6] has assessed measurement error of the PDI. Good responsiveness (Area Under the Curve (AUC) of 0.76) was found in patients with chronic low back pain at discharge of a pain rehabilitation program in the Netherlands, and a minimal important change (MIC) of 8.5–9.5 points (depending on which anchor was used) was calculated [8]. In addition, a MIC value of 9.5 means that a decrease in PDI score of 9.5 points or more is a clinically meaningful improvement in pain-related disability. Measurement error, expressed in the Smallest Detectable Change (SDC), of 17.9 points was found in a sample with acute back pain, chronic low back pain, and widespread pain [6]. However, a connection between the MIC and the SDC (which refers to the interpretation of change score of the PDI), respectively, was not provided in the aforementioned studies. If we combine the MIC of 9.5 with the SDC of 17.9, we conclude that the PDI is responsive to change in patients with chronic back pain, but that it is uncertain if these are ‘real’ changes or are due to measurement error [11].

The aforementioned studies on responsiveness and measurement error were performed with patients attending pain rehabilitation in the Netherlands. It is unknown, however, what the responsiveness and interpretation of change score of the PDI is for patients at discharge of vocational rehabilitation (VR). Vocational rehabilitation is a “multi-professional evidence-based approach” that is provided in different settings, services, and activities to working age individuals with health-related impairments, limitations, or restrictions with work functioning, and whose primary aim is to “optimize work participation” [12]. However, it can be expected that the majority of patients referred to VR have paid work. In contrast, in pain rehabilitation samples, less than 50% of the patients have paid work [6, 13]. Since work is generally good for physical and mental health and well-being, and unemployment is associated with poorer physical and mental health and well-being [14], we expect that patients referred to VR are less disabled (i.e. lower PDI score) compared to patients referred to pain rehabilitation. We therefore assume that there is less room for improvement compared to patients with more severe pain-related disability and that this could result in lower MIC and change scores. This has, however, not yet been studied. Therefore, the aim of this study is to assess the responsiveness and interpretation of change score of the PDI in patients with chronic musculoskeletal pain at discharge of vocational rehabilitation.

Methods

The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was applied in the design of the study [9, 15, 16].

Study sample

The study sample consisted of CMP patients who attended vocational rehabilitation (VR) between November 2014 and July 2017 in the Netherlands. Vocational rehabilitation is a multidisciplinary bio-psychosocial group-based program for workers with CMP and decreased work participation. The VR program is described in detail elsewhere [17]. The study sample was derived from seven vocational rehabilitation centers in the Netherlands. These seven centers are part of a nationwide network in the Netherlands and the outline and content of VR is similar at each center. The inclusion criteria for attending VR were: 1) being of working age (18 to 65 years); 2) suffering from subacute (6 to 12 weeks) or chronic (> 12 weeks) nonspecific musculoskeletal pain; 3) decreased work participation (i.e. part-time or full-time sick leave or reduced productivity while at work). The exclusion criteria were: 1) not motivated to participate in the multidisciplinary group-based program; 2) psychiatric disorders; 3) physical disorders with the expectation that tissue and function recovery will take place at normal rates; and 4) conflict situations with employer. Extra inclusion criteria for this study were: 1) being able to complete questionnaires in Dutch; and 2) having completed the Pain Disability Index at baseline and discharge of VR.

Procedures

Data were collected using a core set of standardized web-based patient-reported questionnaires [18]. For this study, we only used the questionnaires on sample characteristics, including Pain Disability Index, assessed at baseline (T0) and discharge (T1); and Global Perceived Effect, assessed at T1 only. At T0 and T1, patients received an email with login data and the request to complete questionnaires (at home) on a website. Baseline questionnaires were sent to patients 1–2 weeks before a multidisciplinary screening, and the discharge questionnaires were sent to patients 1 week before discharge date. Because this study contains routinely collected and anonymous data of care as usual programs, the Medical Ethical Committee of the Academic Medical Center, Amsterdam, the Netherlands, authorized this study and decided that a full application was not required (reference number: A1 17.405).

Outcome instrument: the pain disability index

The Pain Disability Index (PDI) is a 7-item questionnaire to investigate the magnitude of self-reported pain-related disability, independent from region of pain or pain-related diagnosis. The items of the questionnaire are assessed on a 0–10 numeric rating scale in which 0 means no disability and 10 is maximum disability. The sum of the seven items equals the total score of the PDI, which ranges from 0 to 70, with higher scores reflecting higher interference of pain with daily activities. The PDI measures family / home responsibilities, recreation, social activity, occupation, sexual behavior, self-care and life support activity [3]. Missing items were resolved as follows: patients were allowed to miss no more than 1 question on the PDI. In this case, the missing value was replaced by the patient cluster mean. As the PDI only consists of seven questions, the patient was excluded from the study [6] if the patient missed more than one question on the PDI.

Anchor: Global perceived effect of treatment

A global perceived effect (GPE) item was used as the anchor (external criterion) in this study. An anchor is a global rating scale in which patients are asked, in a single question at follow-up, to indicate how much their pain has changed since baseline [19]. The pain anchor was assessed as follows: ‘How are your (pain) complaints at this moment compared to pre-treatment?’. The anchor was assessed on a 7-point Likert scale: extremely worsened, much worsened, little worsened, unchanged, little improved, much improved, completely improved.

Data analyses

Responsiveness

Responsiveness in this study was defined as the ability of the PDI to detect clinically relevant changes in pain-related disability at discharge of vocational rehabilitation [9]. To calculate responsiveness we used the anchor-based receiver operating characteristics (ROC) method [20]. Sensitivity and specificity for change plotted by receiver operating characteristics (ROC) curve and Area Under the Curve (AUC) were calculated [10]. The AUC is the probability of correctly discriminating between improved and unchanged patients. When the AUC was more than 0.70, responsiveness was considered sufficient [10]. Minimal Important Change (MIC) was measured by determining the optimal cut-off point, i.e. the point where the sum of sensitivity and 1-specificity was maximal. Sensitivity and specificity range from 0 to 1.00, where higher numbers reflect higher sensitivity or specificity. Because the objective of the responsiveness analysis was to differentiate between improved and unchanged patients, the anchor scores were dichotomized into a subgroup with the score “improved” (much improved and completely improved) and a subgroup with the score “unchanged” (little worsened, unchanged and little improved) [8]. The group with the score “worsened” (much worsened and extremely worsened) was not included in the analyses (n = 14). We used the improved and unchanged groups to calculate the MIC [10, 20].

Baseline-dependent analyses

In a secondary analysis we stratified the analysis on PDI baseline quartile scores, to assess whether the level of pain-related disability on baseline had a modifying effect on the MIC. Based on earlier research [21, 22] we hypothesized that higher PDI scores at baseline (that is, more disabled patients thus higher PDI score) had more room for improvement, including higher change scores and MIC values compared to patients with lower baseline scores.

Floor and ceiling effects

Floor or ceiling effects were considered to be present if more than 15% of the respondents achieved the lowest or highest possible score (0–70, respectively) [10]. We gave a positive rating for (the absence of) floor and ceiling effects if no floor or ceiling effects were present in the PDI baseline quartiles [10].

Measurement error

Measurement error was analyzed by calculating the Standard Error of Measurement (SEM = SD√1-ICC) [23]. The SD was determined from an ANOVA analysis with the formula (√(SStotal /(n-1)) [10, 23]. As proposed by Terwee et al. [11], we derived the SD from our study sample for the patients with a non-significant change in PDI score (PDI total score T1 – PDI total score T0 = p > 0.05). Independent samples T test showed a non-significant change in PDI score when the PDI change score ranged from − 6 to + 6. The ICC of the SEM formula was obtained from a study with a similar study sample [6]. In a next step, the SEM was converted into the smallest detectable changes at individual level (SDCindividual = 1.96*√2*SEM). This number reflects the smallest within-person change in a score that can be considered to be a real change above any measurement error within one individual. In the final step, the SDC individual was converted into the smallest detectable change for a group (SDC group) by dividing SDC individual by √n.

Interpretability

Interpretability is defined as the degree to which one can assign qualitative meaning to quantitative scores [10]. To enhance interpretability, we will present baseline scores and change scores of various (sub)groups. For the interpretability of change scores, we calculated mean changes and 95% confidence intervals of mean changes of the total study sample and of the PDI baseline quartiles. We gave a positive rating for a real change in decrease of pain-related disability when the PDI change score was larger than the SDC, and if the SDC was smaller than the MIC [10, 19] (see Fig. 1).

Fig. 1
figure 1

Interpretation of PDI change scores. MIC, Minimal Important Change; SDC, Smallest Detectable Change. Figure obtained from Terwee et al. [10]

Full size image

All analyses were performed using SPSS 23 for Windows (SPSS Inc., Chicago, USA). The demographic data of the individuals were described by means and standard deviations (SD), or inter-quartile range in the case of no normal distribution. The assumption of normal data distribution was visually verified using histograms and QQ-plots.

Results

A total of 341 patients completed the PDI questionnaire on baseline and discharge. Mean age was 46.5 (±10.9) years, and 57% of the patients were woman. Ninety-one percent of the patients were employed and 63% were on sick leave in the preceding month prior to baseline measurement. Patients suffered from 3.4 (±2.4) pain locations, which were located in the back (76%), lower extremities (35%) and upper extremities (29%). Seventy-four percent had pain complaints for longer than 6 months. The average pain score was 5.4 (±2.3), the worst pain score was 6.8 (±2.5) and the PDI mean score was 34.7 (±11.7). Mean duration between baseline questionnaires and the start of VR was 8 ± 4.4 weeks and mean duration between the start of VR and completion of the discharge questionnaires was 15 ± 1.1 weeks. Table 1 shows all background characteristics of the study sample.

Table 1 Characteristics of the study sample
Full size table

Responsiveness

The responsiveness parameters (AUC, MIC, sensitivity and specificity) of the total study sample and the baseline quartile scores are presented in Table 2, and the corresponding ROC curves are presented in Fig. 2. The AUC of the total sample was 0.79 (0.74–0.84), with a sensitivity of 0.68, a specificity of 0.73, and a corresponding MIC of 12.5 (Fig. 2a). The AUC of PDI baseline quartile 1 was 0.70 (0.59–0.81), with a sensitivity of 0.68, a specificity of 0.67, and a corresponding MIC of 6.5. The AUC of PDI baseline quartile 2 was 0.87 (0.79–0.95), with a sensitivity of 0.81, a specificity of 0.80, and a corresponding MIC of 14.5. The AUC of PDI baseline quartile 3 was 0.83 (0.73–0.93), with a sensitivity of 0.71, a specificity of 0.73, and a corresponding MIC of 14.5. The AUC of PDI baseline quartile 4 was 0.85 (0.77–0.93), with a sensitivity of 0.79, a specificity of 0.81, and a corresponding MIC of 19.5. In summary, the mean AUC of the total sample and of all PDI quartiles was sufficient, and only for quartile 1 the 95% confidence interval of the AUC felt bellow the cut off of 0.70, indicating slightly insufficient responsiveness for this quartile (also indicated by the shape of the ROC curve (Fig. 2b)).

Table 2 Responsiveness parameters PDI
Full size table
Fig. 2
figure 2

ROC curves of the PDI total sample and baseline quartiles. ROC, receiver operating characteristic; PDI, Pain Disability Index; Q, quartile; AUC, area under the curve. a ROC-curve of total study sample (n = 341). b ROC-curve of the sample with PDI baseline quartile 1 score (n = 89). c ROC-curve of the sample with PDI baseline quartile 12 score (n = 81). d ROC-curve of the sample with PDI baseline quartile 13 score (n = 83). e ROC-curve of the sample with PDI baseline quartile 14 score (n = 88)

Full size image

Floor and ceiling effects

Floor and ceiling effects were absent in this study. The PDI total baseline score (min-max) was 3–60; 2.6% of the study sample had a total PDI baseline score < 10 and 0.3% (1 person) of the study sample had a total PDI baseline score of 60.

Measurement error

The SEM was 1.2, the SDC for group level was 0.3 and the SDC for individuals was 3.4 (Table 2).

Interpretability

The SDC individual was smaller than the MIC in the total sample and in all PDI baseline quartile subgroups (Table 2). Of the total study sample, 70% improved at or above the SDC individual and 42% improved at or above the MIC (Table 3). Of the baseline quartile subgroups, 55–82% improved at or above the SDC individual and 40–46% improved at or above the MIC. Table 4 shows the PDI baseline score of various (sub) groups.

Table 3 Change scores in relation to MIC and SDC
Full size table
Table 4 Reference values baseline PDI scores
Full size table

Discussion

The results show that the PDI is responsive to detect clinically relevant changes in pain-related disability at discharge of vocational rehabilitation (AUC 0.79). A PDI change score of 13 points (MIC 12.5) can be considered as a real change in pain-related disability for the total study sample, and a PDI change score of 7–20 points can be considered as a real change in pain-related disability for PDI lowest and highest baseline quartile scores.

The responsiveness of the total study sample is in line with others [8] who found an AUC of 0.76 in patients with chronic back pain. However, the MIC of this study was 9.5 [8]. Because the sample size, external anchor’s (both 7-item Likert scale), and PDI version (both Dutch language versions) were similar amongst both studies, we hypothesize that the difference in MIC might be caused by the difference in mean change score, namely 10.5 in the current study and 6.8 in the other study [8]. This difference in mean change score might be affected by the different sample characteristics, settings, and interventions, applied in the other study; VR on the one hand versus multidisciplinary rehabilitation, surgery, or anesthesiology [8]. Another explanation for the difference in MIC might be caused by the different ways in questioning the GPE anchor item, which was formulated in the current study as follows: “How are your (pain) complaints at this moment compared to pre-treatment?”, and which was formulated in the other study as follows: “How much did your treated complaints change compared with pretreatment level?”. Finally, the same data was collected in the present study between 2014 to 2017; despite the passage of time, the diversity of centers and professionals involved in the collection of data. These factors also could have influenced the findings on responsiveness. In summary, the different MIC and change scores between the present and discussed study show that the MIC and change score can differ per sample and setting.

The mean change score of the present study (10.5) is somewhat higher compared to a study that found a mean change score in PDI of 9.4 in patients with chronic pain after a multidisciplinary pain program [19]. This is surprising, because the study mentioned had a higher PDI baseline value, namely 37.8, which implicates more room for change, which we actually showed in the present study. Another study showed a mean change score in PDI of 14.0 (baseline score 47.6) in workers’ compensation claimants with musculoskeletal disorders after a functional restoration program [24]. This PDI change score is slightly lower compared with the mean change score of 17.5 of the fourth quartile of the present study, but it supports our finding that interpretation of the PDI change score is baseline dependent.

The interpretation of change score of the PDI can be interpreted as a “real” change in pain-related disability if the mean change score is at or above the MIC and if the SDC for individuals does not exceed the MIC (Fig. 1, Table 2). It is difficult to compare our results with other studies, however, for two reasons. Firstly, we are only aware of one study that found an SDC of 17.9 in patients with acute back pain, chronic low back pain, and widespread pain [6]. The huge discrepancy compared with the current study (SDC 3.4) can be explained by the fact the study in question used the standard deviation of the mean PDI baseline score in the calculation of the SDC (personal communication with first author (RS)). We suppose that it is important for the calculation of the SDC to take the variability between time points into account [11]. Secondly, change scores of longitudinal cohort studies are regularly reported on group level (i.e. mean scores), whereas it is much more interesting to report the percentage of improved patients (according to the MIC), because this “… provides readers with values which are more easily understood and additional information to help them decide whether a treatment should be used.” [22].

The baseline PDI score of the current study is similar compared to patients with chronic back pain [6, 8], but somewhat lower compared to patients with chronic pain and widespread pain. One reason for this difference might be a difference in patients executing paid work, which was 91% in the current study and 48 and 43% in chronic pain and widespread pain [6, 13]. Another difference might be due to a difference in pain baseline score of the present study compared with the chronic and widespread pain samples (5.4 versus 6.7 and 6.9, respectively). Köke et al. showed that higher pain score on baseline is related to significantly higher PDI baseline scores [13].

Methodological considerations

The first methodological consideration of this study was the assessment of the MIC. Two common methods can be used to calculate the MIC: the distribution-based method and the anchor-based method [20]. In the distribution-based method, 50% of the standard deviation of the baseline score (0.5*SD) of the measurement instrument serves as the MIC. In the anchor-based method an external anchor is used as the “gold standard” to discriminate between improved and unchanged persons, and the MIC can be obtained with an ROC curve. Because the MIC can be derived from the sensitivity and specificity provided with an ROC curve, the MIC can be used in scientific research and clinical practice as a cutoff point to determine the number of patients that have significantly changed. Patients with a change score greater than or equal to MIC can be called “responders”. With this method, the difference in percentages of responders between treatment groups can be determined [11]. Because of the aforementioned advantage, and because this method is recommended [20, 25,26,27,28], we used the anchor-based method in the present study. The second methodological consideration was how we dichotomized the anchor item into changed and unchanged groups, which we used for the calculation of the MICs. In the present study, the changed group consisted of patients who were “much improved” and “completely improved” and the unchanged group consisted of patients who were “little worsened”, “unchanged”, and “little improved”. Other papers, however, state that only a “little improved” group can serve as the (minimal important) change group [28, 29], or “little improved”, “much improved” and “completely improved” as the changed group [20]. We, however, agree with Ostelo et al. who stated that “…“little improvement” is in the range of natural fluctuation, and that an “important” improvement should be greater than these (unimportant) fluctuations” [30]. However, it is important to notice that the type of anchor-dichotomization directly influences the AUC and MIC. Therefore, the results of the present study must be interpreted with caution because the used cutoff has a high influence on the findings [20, 30]. The third and final methodological consideration was the number of baseline (sub)groups. We decided a priori to apply four subgroups (i.e. quartiles), because we had enough power. The number of four subgroups used in the present study was arbitrary, however. Nevertheless, there are no guidelines for conducting a particular number of (sub)groups based on baseline score, and there are as yet no subgroup scores known for the PDI based on pain-related disability (for example “low”, “intermediate” and “high” pain-related disability subgroups). Since the second and third baseline quartile of the present study showed similar MICs and mean change scores, future studies might propose to assess the responsiveness of three PDI baseline subgroups based on interquartile range (25th, 50th, and 75th percentile).

Clinical message

Practitioners can use the following cutoff scores to decide if a PDI change score is clinically relevant at discharge of VR: patients with a baseline score of ≤27 should decrease minimal 7 points, patients with a baseline score between 28 and 42 should decrease minimal 15 points, and patients with a baseline score ≥ 43 should decrease minimal 20 points.

Conclusion

The PDI is a responsive questionnaire which can detect real change in decrease of pain-related disability in patients with CMP at discharge of vocational rehabilitation. Future research should focus on assessing the SDC and the MIC of the PDI in various patient samples and settings. Also, when using longitudinal cohorts, researchers are encouraged to report the portion of the sample with a change score at or above the MIC since this will enhance comparability and clinical relevance.

Abbreviations

AUC:

Area under the curve

CMP:

Chronic musculoskeletal pain

COSMIN:

COnsensus-based Standards for the selection of health Measurement INstruments

GPE:

Global perceived effect

ICC:

Intraclass correlation coefficient

MIC:

Minimal Important Change

PDI:

Pain Disability Index

QQ plot:

Quantile-quantile plot

ROC:

Receiver operating characteristics curve

SD:

Standard deviation

SDC:

Smallest Detectable Change

SEM:

Standard Error of Measurement

SPSS:

Statistical Package for the Social Sciences

SStotal:

Sum of squares total

VR:

Vocational rehabilitation

References

  1. Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain. 2006;10(4):287–333. https://doi.org/10.1016/j.ejpain.2005.06.009.

    Article  PubMed  Google Scholar 

  2. Chapman JR, Norvell DC, Hermsmeyer JT, Bransford RJ, DeVine J, McGirt MJ, Lee MJ. Evaluating common outcomes for measuring treatment success for chronic low back pain. Spine (Phila Pa 1976). 2011;36(21 Suppl):S54–68. https://doi.org/10.1097/BRS.0b013e31822ef74d.

    Article  Google Scholar 

  3. Pollard CA. Preliminary validity study of the pain disability index. Percept Mot Skills. 1984;59(3):974. https://doi.org/10.2466/pms.1984.59.3.974.

    Article  CAS  PubMed  Google Scholar 

  4. Chibnall JT, Tait RC. The pain disability index: factor structure and normative data. Arch Phys Med Rehabil. 1994;75(10):1082–6.

    Article  CAS  PubMed  Google Scholar 

  5. Jerome A, Gross RT. Pain disability index: construct and discriminant validity. Arch Phys Med Rehabil. 1991;72(11):920–2.

    Article  CAS  PubMed  Google Scholar 

  6. Soer R, Koke AJ, Vroomen PC, Stegeman P, Smeets RJ, Coppes MH, Reneman MF. Extensive validation of the pain disability index in 3 groups of patients with musculoskeletal pain. Spine (Phila Pa 1976). 2013;38(9):E562–8. https://doi.org/10.1097/BRS.0b013e31828af21f.

    Article  Google Scholar 

  7. Gronblad M, Hupli M, Wennerstrand P, Jarvinen E, Lukinmaa A, Kouri JP, Karaharju EO. Intercorrelation and test-retest reliability of the pain disability index (PDI) and the Oswestry disability questionnaire (ODQ) and their correlation with pain intensity in low back pain patients. Clin J Pain. 1993;9(3):189–95.

    Article  CAS  PubMed  Google Scholar 

  8. Soer R, Reneman MF, Vroomen PC, Stegeman P, Coppes MH. Responsiveness and minimal clinically important change of the pain disability index in patients with chronic back pain. Spine (Phila Pa 1976). 2012;37(8):711–5. https://doi.org/10.1097/BRS.0b013e31822c8a7a.

    Article  Google Scholar 

  9. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. https://doi.org/10.1016/j.jclinepi.2010.02.006.

    Article  PubMed  Google Scholar 

  10. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012.

    Article  PubMed  Google Scholar 

  11. Terwee CB, Roorda LD, Knol DL, De Boer MR, De Vet HC. Linking measurement error to minimal important change of patient-reported outcomes. J Clin Epidemiol. 2009;62(10):1062–7. https://doi.org/10.1016/j.jclinepi.2008.10.011.

    Article  PubMed  Google Scholar 

  12. Escorpizo R, Reneman MF, Ekholm J, Fritz J, Krupa T, Marnetoft SU, Maroun CE, Guzman JR, Suzuki Y, Stucki G, et al. A conceptual definition of vocational rehabilitation based on the ICF: building a shared global model. J Occup Rehabil. 2011;21(2):126–33. https://doi.org/10.1007/s10926-011-9292-6.

    Article  PubMed  Google Scholar 

  13. Koke AJ, Smeets RJ, Schreurs KM, van Baalen B, de Haan P, Remerie SC, Schiphorst Preuper HR, Reneman MF. Dutch dataset pain rehabilitation in daily practice: content, patient characteristics and reference data. Eur J Pain. 2017;21(3):434–44. https://doi.org/10.1002/ejp.937.

    Article  CAS  PubMed  Google Scholar 

  14. Waddel G, Burton AK. Is work good for your health and well-being? London: TSO; 2006.

    Google Scholar 

  15. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49. https://doi.org/10.1007/s11136-010-9606-8.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, de Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22. https://doi.org/10.1186/1471-2288-10-22.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Beemster TT, van Velzen JM, van Bennekom CA, Frings-Dresen MH, Reneman MF. Cost-effectiveness of 40-hour versus 100-hour vocational rehabilitation on work participation for workers on sick leave due to subacute or chronic musculoskeletal pain: study protocol for a randomized controlled trial. Trials. 2015;16:317. https://doi.org/10.1186/s13063-015-0861-4.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Reneman MF, Beemster TT, Edelaar MJ, van Velzen JM, van Bennekom C, Escorpizo R. Towards an ICF- and IMMPACT-based pain vocational rehabilitation core set in the Netherlands. J Occup Rehabil. 2013;23(4):576–84. https://doi.org/10.1007/s10926-013-9423-3.

    Article  CAS  PubMed  Google Scholar 

  19. van Kampen DA, Willems WJ, van Beers LW, Castelein RM, Scholtes VA, Terwee CB. Determination and comparison of the smallest detectable change (SDC) and the minimal important change (MIC) of four-shoulder patient-reported outcome measures (PROMs). J Orthop Surg Res. 2013;8:40. https://doi.org/10.1186/1749-799X-8-40.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Terwee CB, Roorda LD, Dekker J, Bierma-Zeinstra SM, Peat G, Jordan KP, Croft P, de Vet HC. Mind the MIC: large variation among populations and methods. J Clin Epidemiol. 2010;63(5):524–34. https://doi.org/10.1016/j.jclinepi.2009.08.010.

    Article  PubMed  Google Scholar 

  21. Baker DW, Hays RD, Brook RH. Understanding changes in health status. Is the floor phenomenon merely the last step of the staircase? Med Care. 1997;35(1):1–15.

    Article  CAS  PubMed  Google Scholar 

  22. Tubach F, Ravaud P, Baron G, Falissard B, Logeart I, Bellamy N, Bombardier C, Felson D, Hochberg M, van der Heijde D, et al. Evaluation of clinically relevant changes in patient reported outcomes in knee and hip osteoarthritis: the minimal clinically important improvement. Ann Rheum Dis. 2005;64(1):29–33. https://doi.org/10.1136/ard.2004.022905.

    Article  CAS  PubMed  Google Scholar 

  23. Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–40. https://doi.org/10.1519/15184.1.

    Article  PubMed  Google Scholar 

  24. Park J, Esmail S, Rayani F, Norris CM, Gross DP. Motivational interviewing for workers with disabling musculoskeletal disorders: results of a cluster randomized control trial. J Occup Rehabil. 2017; https://doi.org/10.1007/s10926-017-9712-3.

    Article  PubMed Central  Google Scholar 

  25. de Vet HC, Ostelo RW, Terwee CB, van der Roer N, Knol DL, Beckerman H, Boers M, Bouter LM. Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual Life Res. 2007;16(1):131–42. https://doi.org/10.1007/s11136-006-9109-9.

    Article  PubMed  Google Scholar 

  26. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, Haythornthwaite JA, Jensen MP, Kerns RD, Ader DN, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain. 2008;9(2):105–21. https://doi.org/10.1016/j.jpain.2007.09.005.

    Article  PubMed  Google Scholar 

  27. King MT. A point of minimal important difference (MID): a critique of terminology and methods. Expert Rev Pharmacoecon Outcomes Res. 2011;11(2):171–84. https://doi.org/10.1586/erp.11.9.

    Article  PubMed  Google Scholar 

  28. Revicki D, Hays RD, Cella D, Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61(2):102–9. https://doi.org/10.1016/j.jclinepi.2007.03.012.

    Article  PubMed  Google Scholar 

  29. Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15.

    Article  CAS  PubMed  Google Scholar 

  30. Ostelo RW, Deyo RA, Stratford P, Waddell G, Croft P, Von Korff M, Bouter LM, de Vet HC. Interpreting change scores for pain and functional status in low back pain: towards international consensus regarding minimal important change. Spine (Phila Pa 1976). 2008;33(1):90–4. https://doi.org/10.1097/BRS.0b013e31815e3a10.

    Article  Google Scholar 

  31. Mewes R, Rief W, Stenzel N, Glaesmer H, Martin A, Brahler E. What is “normal” disability? An investigation of disability in the general population. Pain. 2009;142(1–2):36–41. https://doi.org/10.1016/j.pain.2008.11.007.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the following vocational rehabilitation centers for their help in data collection: Libra (Eindhoven, Tilburg), Roessingh (Enschede), Adelante (Hoensbroek), Merem (Almere, Huizen), Zintens Groot Klimmendaal (Arnhem), UMCG Center for Rehabilitation (Groningen), and Heliomare (Wijk aan Zee).

Availability of data and materials

Please contact author for data requests.

Author information

Authors and Affiliations

  1. Department of Rehabilitation Medicine, Center for Rehabilitation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands

    T. Beemster & M. Reneman

  2. Department of Research and Development, Heliomare Rehabilitation Center, Wijk aan Zee, The Netherlands

    T. Beemster, C. van Bennekom & J. van Velzen

  3. Amsterdam UMC, University of Amsterdam, Coronel Institute of Occupational Health, Amsterdam Public Health research institute, Amsterdam, The Netherlands

    T. Beemster, C. van Bennekom, J. van Velzen & M. Frings-Dresen

Authors
  1. T. Beemster
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. van Bennekom
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. van Velzen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Reneman
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M. Frings-Dresen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TB initiated the study, conducted the statistical analyses and wrote the paper. All authors contributed to drafting the manuscript and have read and approved the final manuscript.

Corresponding author

Correspondence to T. Beemster.

Ethics declarations

Ethics approval and consent to participate

Patients gave consent to participate in this study. Because this study contains routinely collected and anonymous data of care as usual programs, the Medical Ethical Committee of the Academic Medical Center, Amsterdam, the Netherlands, authorized this study and decided that a full application was not required (reference number: A1 17.405).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Beemster, T., van Bennekom, C., van Velzen, J. et al. The interpretation of change score of the pain disability index after vocational rehabilitation is baseline dependent. Health Qual Life Outcomes 16, 182 (2018). https://doi.org/10.1186/s12955-018-1000-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-018-1000-1

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us