Skip to main content

Initial psychometric validation of the questionnaire on pain caused by spasticity (QPS)

Abstract

Background

The Questionnaire on Pain caused by Spasticity (QPS) is a modular patient- and observer-reported outcome measure of spasticity-related pain (SRP) in children with cerebral palsy (CP). Originally developed for an English-speaking population, we conducted a psychometric validation of a recently developed Chinese language version of the QPS.

Methods

This was a prospective, observational study involving 137 children/adolescents with CP and upper and/or lower limb spasticity and their parents at three sites in China. Six QPS modules were used, three each for upper and lower limb SRP assessment: a patient self-report module; an interviewer-administered module used by site staff based on the cognitive, communicative, and motor abilities of a patient; and a parent/caregiver module administered for all children as an observer-reported outcome to complement the patient-reported outcome. If no assessment by the patient was possible because of age or cognitive impairments, only the parent/caregiver module was completed. Two visits with a 3-week interval provided data to evaluate and establish administrative ease of use, scoring of the QPS (factor analyses, Rasch analyses), reliability (Cronbach’s α, intraclass correlation coefficient), validity (correlations with quality of life [PedsQL™], motor impairment [Gross Motor Function Classification System, Gross Motor Function Measure-66, Manual Ability Classification System], and spasticity [Ashworth Scale, Modified Tardieu Scale]).

Results

For most children, clinic staff reported no difficulties associated with general QPS use or deciding which module to use. Children (and parents) who reported more demanding activities also reported higher levels of associated SRP (or observed SRP behavior). Activity-related SRP items were combined for a total QPS score. Cronbach’s α was low for child self-report, but was acceptable for interviewer-administered and parent reports on SRP. Test–retest reliability was high for all modules. Moderate–strong associations were frequently seen between QPS and quality of life, and were particularly strong in the child self-report group. Relatively weak associations were observed between QPS and motor impairment and spasticity.

Conclusions

This first study was successful in providing initial evidence for the psychometric properties. Clinic staff were able to administer the QPS modules easily, and both children and parents were able to complete the designated QPS appropriately.

Background

Pain in children and adolescents with cerebral palsy (CP) is common (14%–60%), but poorly understood, infrequently recognized and, therefore, often undertreated [1,2,3,4,5]. The high prevalence of pain in this patient population is associated with poor quality of life (QoL), with QoL scores typically low across all domains of the KIDSCREEN-52 health related QoL questionnaire [6,7,8]. Due to the range of impairments and disabilities experienced, particularly those related to the musculoskeletal system, pain can arise from multiple sources (e.g. musculoskeletal, chronic constipation, gastroesophageal reflux disease, stomatological diseases, etc.) [3, 8]. One of the major movement disorders in CP is spasticity [9,10,11,12], defined as muscular tightness and spasms that can lead to deformities, contractures, and dislocations [3]. Thus, one potential source of pain experienced by this population is spasticity-related pain (SRP). SRP can be continuous or recurrent and the incidence and severity of the pain may be affected by movement and different activities throughout the day (e.g., resting, walking, playing, or exercising) [1, 2, 13, 14].

There are currently no well-validated scales for the assessment of SRP in pediatric or adult populations with CP and only general measures exist [15]. The Questionnaire on Pain caused by Spasticity (QPS) was developed to provide an innovative, standardized, patient-reported outcome (PRO) measure that could be used to describe SRP in a heterogeneous population with CP as described in a prior publication [15]. Furthermore, it was anticipated that such a tool might facilitate the evaluation of potential new therapies for the treatment of SRP in children and adolescents with CP; e.g., botulinum toxin, which has been reported to help with pain in adult spasticity [16,17,18]. Originally developed for an English-speaking population, several language versions including a Chinese version of the QPS have recently been developed [19].

The QPS was developed following recommended methodology for PROs and Observer-Reported Outcomes (ObsROs) [20,21,22,23], including concept elicitation with children and caregivers, item generation with clinician expert input, and refinement of the modules via cognitive interviews in the target population [15, 24,25,26]. The questionnaire is designed to be used by parents/caregivers and their children/adolescents (2–17 years of age) with CP who experience limb SRP. To accommodate the wide variation in communication skills among patients with CP, three QPS modules were developed, with each available for upper limb (UL) and lower limb (LL) SRP assessments (a total of six modules): a self-report module for children/adolescents (12 items), an interviewer-administered module for children/adolescents (12 items), and an observer-report module for parents/caregivers (13 items). Information gained from the ObsRO for parents and caregivers was designed to complement the information gained from the child/adolescent assessment. The QPS items ask for SRP at rest, during usual daily activities, active mobilization, and a self-defined physically difficult activity (Fig. 1). Whereas children/adolescents report on their experienced SRP severity for these situations (6- point response scale, 0 = ‘no hurt’ - 10 = ‘hurts worst’), parents/caregivers are asked to report observed SRP locations, behaviors and the frequency of SRP (5-point response scale, 0 = ‘never’ to 4 = ‘always’) for the same activity situations used to capture the child/adolescent reports of pain severity (i.e., at rest, during usual daily activities, active mobilization, and a self-defined physically difficult activity).

Fig. 1
figure 1

Item examples of the QPS. a Item 6 and 7 of the upper extremity child/adolescent module. b Item 10 of the upper extremity parent/caregiver module

The objectives of the observational validation study reported here were to establish the first psychometric characteristics of the QPS, specifically regarding scoring, reliability, and validity in a population of Chinese children and adolescents with CP. Furthermore, the study provides supportive information on administration procedures for the questionnaire in this population, and provides an insight into the SRP reported by the children/adolescents and observed by their caregivers.

Methods

Study design and population

This was a prospective, observational, one-arm, psychometric validation study of a health outcome measure. The a priori construct validity hypothesis of the study was that patients with greater disability or spasticity would experience a greater level of SRP and a lower QoL.

Children or adolescents with CP and their parents/caregivers were recruited between November 2013 and June 2014 from three hospital sites in China: the Foshan Nanhai Affiliated MCH Hospital of Guangzhou, the Hunan XiangYaBoAi Rehabilitation Hospital, and the Dongguan MCH Hospital. Sites recruited from both their inpatient caseload and their outpatient caseload. The study adhered to the ethical principles for human research and approval was provided by the ethical review board at each participating hospital. Each patient or their legally acceptable representative provided written informed consent to participate in the study.

Male or female patients were included in the study if they were between 2 and 17 years of age with either uni- or bilateral CP, UL and/or LL spasticity, and intermittent SRP in either the ULs or LLs on a weekly basis in one of the following clinical patterns: pes equinus, adducted thigh, flexed knee, flexed elbow, or flexed wrist. Patients were also required to have an Ashworth Scale (AS) score of ≥1 in at least one of the pre-defined clinical patterns and were receiving continuous anti-spastic treatment and/or medication. Key exclusion criteria included fixed contractures, predominant forms of muscle hypertonia other than spasticity, constant SRP over very long time periods, LL and/or UL surgery within the past 12 months, and an indication for orthopedic surgery within the next 2 months.

The study planned to recruit 135 child/adolescent together with one parent/caregiver. To enable all key ages to be covered by the QPS modules, three specific groups of children/adolescent–parent pairs were recruited: 1) 120 patients with LL and/or UL SRP who could self-complete the QPS or were able to use the interviewer-administered module; 2) 45 of these 120 patients with UL SRP (this subset of group 1 was included to account for the lower prevalence of UL SRP vs LL SRP among patients with CP); and 3) 15 patients with LL or UL SRP who were incapable of using the QPS (i.e., the parent/caregiver QPS module was used because either the patient was too young or he/she had disabilities that precluded him/her from participating in the assessment).The sample size for these 135 child/adolescents with their parents was based on assumptions including representation of population heterogeneity, number of items and power for convergent validity testing (e.g. n = 75 for 95% power of showing a moderate correlation of 0.4).

Assessments

The study (No.: MRZ99901_0027_4) comprised two clinic visits, a screening/baseline visit (V1/V2) and an end-of-study visit (V3) scheduled for 21 (±3) days later. The QPS was administered at the baseline (V2) and end-of-study visits (V3) at site. Based on the pre-screening of the cognitive, communicative, and motor abilities of a patient, the QPS was self-administered by the patient, or the interviewer-administered module was used by site staff. If no assessment by the patient was possible, due to age or cognitive impairments, only the parent/caregiver module was completed. The parent/caregiver module of the QPS (ObsRO) was completed for each child by the same parent/caregiver throughout the study. The parent/caregiver had regular contact with his/her child/adolescent so that he/she could report reliably on the observed SRP behaviors. Alongside the QPS assessment, the clinic staff responsible for the QPS assessment procedure were asked to complete a questionnaire documenting ease of use of the QPS (e.g. difficulties in selection of modules for children) and any administration issues (e.g. encountered problems and positive experiences).

In addition to the QPS, a number of standard clinical evaluations for the study population and for spasticity were performed during the study. As standard classifications in the CP population, the Gross Motor Classification System – Expanded and Revised [GMFCS] and the Manual Ability Classification System [MACS]) were used [27,28,29]. The GMFCS is a classification of general motor independence with five classification levels (Level I: Walks without limitations – Level V: Transported in a manual wheelchair). The MACS is a classification for CP children with five levels on the self-initiated abilities to handle objects and their need for assistance or adaptation to perform manual activities (Level I: Handles objects easily and successfully – Level V: Does not handle objects and severely limited ability to perform even simple actions). For evaluation of motor function, the Gross Motor Function Measure-66 [GMFM]) was used, which utilizes 66 functional tests that span the spectrum from activities in lying and rolling up to walking, running and jumping skills [30]. Cognitive ability by means of cognitive age was based on the standard tools used by sites (e.g. Gesell Developmental Schedule, Sign-Significant Relations Rehabilitation Rating). The level of spasticity in spastic joints in this study was determined with the AS and Modified Tardieu Scale [MTS]) [31,32,33]. Spasticity with the AS is assessed during passive range of motion of a joint on a 5-point response scale (‘0 = ‘No increase in tone’ - ‘4 = ‘Limb rigid in flexion or extension’). For the MTS, the spasticity angle was documented, which is the difference between the passive full range of motion angle with slow assessment velocity minus the fast stretch speed angle of a spastic joint. The Pediatric Quality of Life Inventory™ (PedsQL™) was used to capture information on patient QoL [34, 35].There are four sub-scales that refer to physical functioning (8 items), emotional functioning (5 items), social functioning (5 items), and school functioning (5 items). The association of the QPS to overall Quality of Life was of main interest, and hence the total score of the PedsQL™ was the focus for the analyses. Patient demographic data and CP history were also recorded.

For all assessment tools, the official Chinese language versions were used during the study. The Chinese version of the QPS was established using a standard linguistic validation process for developing new language versions for data collection measures [19, 36]. The process included forward and backward translation steps, and cognitive interviews with Chinese children with CP and SRP and their parents/caregivers. Finally, an international harmonization step was used for quality control and finalization of the translations.

Statistical analyses

The demographic characteristics of the children/adolescents and their parents were summarized using descriptive statistics, controlling for the actual QPS modules used (LL and/or UL) and whether the QPS was self- or interviewer-administered.

To evaluate the individual QPS items, responses were evaluated by means of standard item-reduction statistics (e.g., ceiling/floor effects, missing data, item-to-item correlation, corrected item-total correlation (0.40 threshold) [37]. Factor analyses (principal component analysis with varimax rotation using Kaiser normalization) were conducted to assess scale dimensionality with factor loadings of at least 0.40 as a cut-off [38]. Rasch Measurement Theory (RMT, one-parameter logistic model, RUMM2030 software) [39] models were utilized to review item functioning of tested constructs. Due to small sample sizes, RMT models were only run for the sample of children with LL SRP using combined results from self-reported and interviewer modules. Based on these results, the final QPS items were selected and a scoring algorithm was created. The following validation analyses of the QPS were then performed based on the final scoring approach.

Internal consistency of the QPS was evaluated by Cronbach’s α analysis using 0.70 as the desired threshold [40]. Test–retest reliability between both visits (V2 and V3) using total score and single items, was demonstrated by intraclass-correlation coefficient (ICC 2,1) estimates, using 0.70 as the desired threshold [41].

Convergent/discriminant validity was investigated by Pearson correlations of QPS variables with other measures of interest, such as GMFCS, AS and MTS scores, GMFM, and PedsQLâ„¢ using associations of at least 0.30 as desired level of association. Construct validity of the QPS was tested by comparison of reported SRP levels in relation to activities and differences in important demographic groups in the study population such as the GMFCS or MACS categories. Specifically, higher levels of SRP to QoL based on the available studies were expected [6,7,8]. Also higher SRP levels were hypothesized to be associated with higher degrees of spasticity (AS, MTS) and disability (GMFM, GMFCS, MACS), but prior studies have indicated not always clear associations in this regard [4, 8, 14]. In addition, ordinal logistic regression analysis models were run with a set of potential predictors for identification of important SRP-related factors. All analyses, with the exception of RMT, were conducted using SPSS [42].

Results

Population

A total of 137 children/adolescents with CP and their parents/caregivers were enrolled and contributed to this study, from which all 137 completed it. None of the children had missing QPS data and only a very small amount of QPS data were missing for the parents/caregivers (maximum 3 cases, 2.4%). Some of the clinical assessments had small amounts of missing data (i.e., AS 21 cases, 15%; MTS 20 cases, 14%).

Most children presented with bilateral LL spasticity (117/137, 85.4%). Although 52 children presented with UL spasticity overall, UL spasticity occurred most often together with LL spasticity and very few (10/137, 7.3%) presented with UL spasticity alone (Fig. 2).

Fig. 2
figure 2

Number of children recruited and analysis sets based on SRP location and QPS module used. LL, lower limb; UL, upper limb; SRP, spasticity-related pain

The study population covered the full age spectrum (range 2–17 years) with a mean (standard deviation, SD) age of 6.6 (3.2) years. Most children were 4–8 years of age; 68.6% were male and 93.4% were Chinese (Table 1). Children who could self-administer the QPS had a mean age of 7.9 (3.1) years, those who completed the interviewer-administered QPS had a mean age of 5.3 (2.3) years and those who couldn’t use the QPS had a mean age of 3.8 (1.5) years.

Table 1 Demographic characteristics of children and parents at baseline visit (V2)

The mean (SD) age of the parents/caregivers was 39.6 (11.0) years (range 24.9–69.1 years) and the majority (83.2%) were female. Most parents were described as not employed outside the home (50.4%) or homemakers (19.0%). The greatest proportion of children (33.6%) were Level II on the GMFCS and 35.8% were Level II on the MACS (Table 1). Overall, the study sample reflected a heterogeneous one, as indicated by the GMFCS classification.

QPS: Key problems and ease of use

To provide information on the ease of use of the QPS in daily practice and identify any administration issues, clinic staff were asked to complete a questionnaire regarding any difficulties. No difficulties were reported in deciding which module of the QPS to use for most (117/137, 85%) children and difficulties related to uncertain cognitive abilities were reported for only a few children (15/137, 10.9%). Furthermore, clinic staff noted no general administration difficulties for most of the children (80/137, 58.4%), although, some difficulties in assigning pain and stiffness using QPS items 1 and 2 were reported (45/137, 32.8% of children), and when defining SRP in general (11/137, 8.0% of children). Based on this experience, for approximately one third of children (49/137, 35.8%), the clinic staff mainly focused on cognitive ability and ability to communicate/express the location of their SRP when deciding on the appropriate module to use.

QPS item analysis

The mean QPS score patterns of the items that contribute to the QPS are shown in Table 2. Similar mean score patterns were noted for all the different child/adolescent QPS modules with relatively high SRP levels associated with exercise (physical therapy or stretching exercises) followed by the general item of SRP when tight. Low levels of SRP were expressed while at rest (sitting, watching TV, or trying to sleep). Similar to the child results, the greatest amount of pain observed by the parent occurred when the child was exercising. Almost no pain was noted by parents when the children were at rest.

Table 2 Important single item results of QPS modules at baseline visit (V2)

The low SRP levels in the study population for the ‘SRP at rest’ items and in some instances for the ‘SRP doing usual activities’ items, resulted in floor effects for these items. This was also reflected in the item-to-item and corrected item-total correlations (Table 2 and Table 3). Conversely, the pain levels supported the hypothesis that easier activities should be related to lower SRP levels than more difficult activities. Since the qualitative work for the QPS creation of these items was shown to be of relevance for some children and their parents, and the SRP levels followed the hypothesized pattern, the items were included in the subsequent scoring analyses. No ceiling effects were found for any of the QPS items and the entire spectrum of the scale was seen, with high SRP levels being reported in some patients.

Table 3 QPS item-to-item and item-to-total correlations (Pearson correlations)

QPS measurement model and scoring

Three scoring algorithms were explored with the data to establish a score for the QPS and included testing to include all QPS items and different combinations of SRP items. In the final scoring system, based on optimal results (IRT and factor analyses), the item on general SRP was removed from the overall score, keeping it as an external overall criterion. The four remaining activity-related SRP items (at rest, usual activities, with exercise and when trying to do a specified hard task) were included to calculate the QPS score. This decision was supported by IRT and factor analyses, in which the general item displayed significant misfit, whereas the other items performed well (50–70% of variance). The other items of the QPS contribute additional information relating to the established overall score. In the children modules they are a useful check of response consistency. In the parent modules, the other items provide further information on the localization of SRP and definition of SRP behaviors [15].

Within the UL modules (self-administered child/adolescent and parent), there were still two 2-dimensional results and not the overall anticipated uni-dimensional score. Here, the exercise item contributed to a second factor, which fitted the assumption that exercise is always reported with a high level of pain. Because all the other factor analyses yielded a uni-dimensional structure it was decided to adopt the single-score approach (the pain level for exercise activity was high here as well), and to revisit these issues when future QPS data become available for analyses.

An overview of the final scoring approach and the conceptual framework of the QPS is presented in Fig. 3. Although not contributing to the score, the general item was reported together with the single activity-related items, to allow reporting of the overall SRP profile of a child with CP and as a general external reference.

Fig. 3
figure 3

Conceptual framework and scoring of the QPS

Furthermore, separate reporting of the items and QPS score was recommended for the six modules to account for the different CP etiologies and age groups (i.e., a higher proportion of self-administered modules than interviewer-administered modules were expected to be completed in older children).

QPS reliability

Using the newly defined QPS score, internal consistency (Cronbach’s α) and test–retest reliability (ICC 2,1) were tested (Table 4). Although not presented in detail in this paper, clinical measures such as the AS remained stable between visits, thus supporting an appropriate setting for testing reliability. While Cronbach’s α was lower than expected for the child self-report group, the coefficients for the child interviewer-administered group were adequate (>0.70, 0.78 for LL and 0.91 for UL) [43]. Parent modules also showed acceptable consistency (0.74 for LL and 0.70 for UL). Test–retest reliability was 0.92 to 0.95 for the QPS score, demonstrating ‘almost perfect’ (>0.81) results [43]. Also for single items, test–retest reliability results were ‘substantial’ (0.61 to 0.80) or ‘almost perfect’ between the 3-week interval of the two study visits (V2 and V3).

Table 4 Cronbach’s α at baseline visit (V2) and test–retest reliability of QPS score V2–V3

QPS validity

With regard to construct validity of the QPS score items, as stated earlier, scores were consistently higher for more difficult activities, with the ‘at rest’ item related to the lowest scores and the ‘exercise’ item to the highest scores (Table 2). For further investigation of convergent/construct validity with other concepts of interest, correlations with the QPS score were performed and QPS scores across groups were explored. According to the 5-point AS rating conducted by the clinicians, SRP was widely reported across the spasticity grades in the main muscle group patterns by children and parents. Thus, associations in the hypothesized direction were not found. In contrast, there was a trend towards some moderate-to-high associations in the hypothesized direction between the QPS score and MTS spasticity angle (Tables 5).

Table 5 QPS Score correlation to AS and MTS at baseline visit (V2)

For the association between QPS and motor function, as measured by the GMFCS and GMFM-66, some conflicting (child LL self-report group), but also clear relations were seen (child interviewer group, Table 6 and Additional file 1: Figure S1). This was not the case for the parent questionnaire modules and for the association to MACS, which fitted the general notion that SRP was reported across the disability spectrums (Additional file 1: Fig. S1). Contrary to these findings, clear associations were found with QoL, as measured by moderate-to-high associations with the PedsQL™ (Table 6, Additional file 2: Figure S2), which reached significance in the QPS LL category (p < 0.01). Although it should be noted that a smaller proportion of those in the child interviewer groups completed the PedsQL™, the overall pattern showed that there seemed to be a close association between reported levels of SRP and general QoL.

Table 6 QPS score correlation to GMFM-66, GMFCS, MACS, PedsQLâ„¢ (Pearson correlation coefficients at baseline visit [V2])

To explore QPS validity further, an exploratory ordinary least squares (OLS) regression model was run on the QPS baseline scores with the following independent variables being included in the model: age, gender, GMFCS, MACS, health state of child (self-report and parent-report), use of assistive devices (yes/no), and therapy (yes/no) [Additional file 3: Table S1]. For ease of analysis and sample size, the self-report and interviewer-administered QPS modules were combined. Most models showed reasonably high variance. Using the child LL model, age, GMFCS, use of assistive devices and therapy had a significant effect on QPS scores, while in the parent LL model GMFCS, overall health of the child, use of assistive devices and therapy had a significant effect on QPS scores (Additional file 3: Table S1). The sample sizes were too small to run the multiple regressions for UL in both the child and parent samples.

Discussion

The objective of this initial QPS validation study was to establish the scoring and evaluate the psychometric characteristics of this questionnaire, specifically relating to reliability and validity. The recruited study population of 137 children/adolescents and their parents covered the complete age range from 2 to 17 years, the major proportion of the patients comprising younger children. The complete CP motor disability spectrum, according to the GMFCS, was well represented. Most of the children had bilateral spasticity, which is commonly reported, while few had UL spasticity alone [12]. This distribution mirrors the typical rehabilitation setting of children and is a more interesting research population compared with a population that is older, particularly when wishing to test how well the QPS can be utilized in younger children. Thus, the overall study population sample was regarded as being a typical and suitable for QPS testing, specifically for the larger LL spasticity group.

Results of the ease-of-use questionnaire provided highly positive feedback from clinic staff on the administration of the QPS. The majority of reported difficulties related to the age of the children and their ability to understand the aim of the QPS and to self-report. This observation suggests that screening a child’s capabilities is warranted before the first QPS administration. In case of any doubt between self- or interviewer module after the screening process, the interviewer-reported module should be the version of choice. Responses for SRP items followed the expected pattern and confirmed previous results that more demanding activities were related to higher levels of pain [2, 4, 13, 14, 44]. The general pain item did not represent the reported SRP maximum or a mean value of the four activity-related SRP items. This observation suggests that it is more meaningful to enquire about specific activities and situations that matter to the patient, otherwise, information on the true severity and diversity of the pain is lost.

While the responses obtained from the interviewer and parent modules increased with more demanding activities, the distribution for some items relating to easier activities in the self-reported modules were more bi-directional, i.e., either no self-reported SRP or then a higher score was reported. This resulted in floor effects for ‘no’ or ‘low-demand’ activities, and the exercise item served as the prominent SRP-reported item besides the general item.

Together with the less well-represented UL spasticity group, the prominence of the exercise item provided the only other issue in terms of achieving uni-dimensionality for the final chosen QPS scoring algorithm and explaining the results of the item-to-total analyses. However, the final chosen QPS scoring algorithm and conceptual framework were well supported in the majority of the modules and were the most homogenous of all the explored solutions, so can be considered to be robust and suitable for future research and application.

Test–retest reliability between the two study visits separated by a 3-week interval showed excellent properties, with ICC values exceeding 0.9 for all QPS modules [43]. Cronbach’s α analyses for consistency of the score showed acceptable ranges for most modules, but not for the self-report modules in which the results were lower than expected. This result was not completely unexpected, because reliability of response is generally lower for child PROs [45,46,47]. Consistent to the feedback of clinical staff and parents discussed prior, this result highlight that screening of a child’s capabilities is extremely important and in case of any doubt the interviewer-reported module should be chosen.

Validity was explored by relating QPS scores to clinical assessments of spasticity, motor function, and QoL. In general, the construct of the QPS was well supported by the fact that more demanding activities corresponded to higher levels of reported SRP. Associations were low-to-moderate for the AS; however, some stronger associations were noted with the MTS. It was hypothesized that SRP could be linked to these spasticity measures, but several factors may explain why this was not the case. The AS has only a limited set of response options, and data were similar due to the fact that only children with spasticity were included in the study. MTS adds linearity to the spasticity measurement [48], which may be one reason why stronger associations were evident between QPS score and MTS. Additionally, these clinical measures rely on passive joint- and muscle-tone evaluation, which may be differentiated from experienced spasticity [33, 49]. In line with this, other recent research indicates that change in muscle tone and pain are not related [16].

Increasing QPS SRP levels were associated with a decrease in motor function as assessed by the GMFCS, especially for LL-reported SRP. In addition, the OLS model on QPS baseline scores showed that age, GMFCS, use of assistive devices and therapy had a significant effect on QPS scores for the child LL group. GMFCS, overall health of the child, use of assistive devices and therapy were also predictive in the parent LL group. Interestingly, QPS scores for the child self-report LL group and child interviewer-administered LL group were also significantly associated with gross motor function as measured by the GMFM-66 score. Other studies have reported a mixed picture on these associations, with some reporting that pain in children with CP is widely distributed across motor impairment levels [4, 14], and others suggesting a dependency [8, 50]. Our results suggested that for specific sub-groups of the study population such an association exists, with higher motor limitation being associated with higher pain levels.

Clear associations were expected for the association between the QPS and QoL, as pain has significant effects on QoL in children/adolescents with CP [6,7,8, 14]. Moderate-to-strong associations between child and parent SRP and QoL (PedsQLâ„¢) were frequent and specifically dominant within the larger sample size groups in the LL category. Based on the general importance of pain for QoL, these results support the convergent validity of the QPS [1, 5, 13].

Study limitations included a highly diverse target population with respect to spasticity patterns, motor disability, cognition, and age. Thus, small sample sizes in this study particularly for patient-sub groups such as patients with UL spasticity are a study limitation, although the distribution of UL spasticity to LL spasticity does reflect the typical etiology of the CP population. The fact that the study only included patients with SRP may have introduced bias towards SRP as the concept of interest, but this was necessary to conduct our research. With testing of the QPS being limited to Chinese children, cultural differences may have influenced outcomes for the different SRP activity items [51], which may be of interest for future research. Finally, there is a need to demonstrate the sensitivity, i.e., responsiveness to change of the QPS (e.g. after botulinum toxin injection) to the effects of spasticity treatment in an appropriately designed interventional study.

Conclusion

This first study conducted, in China, successfully provided initial evidence for the psychometric properties of the QPS. QPS scores were highly reliable and reproducible. Good convergent validity of the QPS was demonstrated for QoL and motor impairment. No clear association was found for clinically rated spasticity. Although further data are required to bolster our findings, such as sensitivity analyses and exploration of the differences between modules found in the study population, the initial reliability and validation results are encouraging and support the QPS as a reliable and valid measure of SRP in patients with CP. The QPS can be obtained by emailing the corresponding author.

Abbreviations

AS:

Ashworth Scale

CP:

cerebral palsy

GMFCS:

Gross Motor Function Classification System – Expanded and Revised

GMFM:

Gross Motor Function Measure-66

IRT:

Item Response Theory

LL:

lower limb

MACS:

Manual Ability Classification System

MTS:

Modified Tardieu Scale

ObsRO:

observer-reported outcome

OLS:

ordinary least squares

PedsQLâ„¢:

Pediatric Quality of Life Inventoryâ„¢

PRO:

patient-reported outcome

QoL:

quality of life

QPS:

Questionnaire on Pain caused by Spasticity

SRP:

spasticity-related pain

UL:

upper limb

References

  1. Doralp S, Bartlett DJ. The prevalence, distribution, and effect of pain among adolescents with cerebral palsy. Pediatr Phys Ther. 2010;22:26–33.

    Article  PubMed  Google Scholar 

  2. Hadden KL, von Baeyer CL. Pain in children with cerebral palsy: common triggers and expressive behaviors. Pain. 2002;99:281–8.

    Article  PubMed  Google Scholar 

  3. Massaro M, Pastore S, Ventura A, Barbi E. Pain in cognitively impaired children: a focus for general pediatricians. Eur J Pediatr. 2013;172:9–14.

    Article  CAS  PubMed  Google Scholar 

  4. Parkinson KN, Gibson L, Dickinson HO, Colver AF. Pain in children with cerebral palsy: a cross-sectional multicentre European study. Acta Paediatr. 2010;99:446–51.

    Article  CAS  PubMed  Google Scholar 

  5. Ramstad K, Jahnsen R, Skjeldal OH, Diseth TH. Mental health, health related quality of life and recurrent musculoskeletal pain in children with cerebral palsy 8-18 years old. Disabil Rehabil. 2012;34:1589–95.

    Article  PubMed  Google Scholar 

  6. Colver A, Rapp M, Eisemann N, Ehlinger V, Thyen U, Dickinson HO, et al. Self-reported quality of life of adolescents with cerebral palsy: a cross-sectional and longitudinal analysis. Lancet. 2015;385:705–16.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Dickinson HO, Parkinson KN, Ravens-Sieberer U, Schirripa G, Thyen U, Arnaud C, et al. Self-reported quality of life of 8-12-year-old children with cerebral palsy: a cross-sectional European study. Lancet. 2007;369:2171–8.

    Article  PubMed  Google Scholar 

  8. Penner M, Xie WY, Binepal N, Switzer L, Fehlings D. Characteristics of pain in children and youth with cerebral palsy. Pediatrics. 2013;

  9. Aisen ML, Kerkovich D, Mast J, Mulroy S, Wren TA, Kay RM, et al. Cerebral palsy: clinical care and neurological rehabilitation. Lancet Neurol. 2011;10:844–52.

    Article  PubMed  Google Scholar 

  10. Centers for Disease Control and Prevention: Facts about Cerebral Palsy [http://www.cdc.gov/ncbddd/cp/facts.html].

  11. Krigger KW. Cerebral palsy: an overview. Am Fam Physician. 2006;73:91–100.

    PubMed  Google Scholar 

  12. SCPE: Prevalence and characteristics of children with cerebral palsy in Europe. Dev Med Child Neurol 2002, 44:633–640.

  13. Chaleat-Valayer E, Parratte B, Colin C, Denis A, Oudin S, Berard C, et al. A French observational study of botulinum toxin use in the management of children with cerebral palsy: BOTULOSCOPE. Eur J Paediatr Neurol. 2011;15:439–48.

    Article  PubMed  Google Scholar 

  14. Ramstad K, Jahnsen R, Skjeldal OH, Diseth TH. Characteristics of recurrent musculoskeletal pain in children with cerebral palsy aged 8 to 18 years. Developmental Medicine & Child Neurology. 2011;53:1013–8.

    Article  Google Scholar 

  15. Geister TL, Quintanar-Solares M, Martin M, Aufhammer S, Asmus F. Qualitative development of the 'Questionnaire on pain caused by spasticity (QPS),' a pediatric patient-reported outcome for spasticity-related pain in cerebral palsy. Qual Life Res. 2014;23:887–96.

    Article  PubMed  Google Scholar 

  16. Brashear A, Elovic EP, Earl NL, Liu C, Dimitrova R. OnabotulinumtoxinA treatment reduces pain in patients with upper limb post-stroke spasticity. In American Academy of physical medicine and rehabilitation annual assembly 2014. San Diego, USA: American Academy of physical medicine and. Rehabilitation. 2014;

  17. Esquenazi A, Mayer N, Lee S, Brashear A, Elovic E, Francisco GE, et al. Patient registry of outcomes in spasticity care. Am J Phys Med Rehabil. 2012;91:729–46.

    Article  PubMed  Google Scholar 

  18. Shaw LC, Price CI, van Wijck FM, Shackley P, Steen N, Barnes MP, et al. Botulinum toxin for the upper limb after stroke (BoTULS) trial: effect on impairment, activity limitation, and pain. Stroke. 2011;42:1371–9.

    Article  CAS  PubMed  Google Scholar 

  19. Kantzer V, Basse S, Martin ML, Geister TL. Linguistic validation interviews in a pediatric cerebral palsy population: approaches for meaningful feedback abstract. Qual Life Res. 2015;24:119.

    Google Scholar 

  20. Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims [http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdf. ].

  21. Matza LS, Patrick DL, Riley AW, Alexander JJ, Rajmil L, Pleil AM, et al. Pediatric patient-reported outcome instruments for research to support medical product labeling: report of the ISPOR PRO good research practices for the assessment of children and adolescents task force. Value Health. 2013;16:461–79.

    Article  PubMed  Google Scholar 

  22. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument. Value Health. 2011;14:967–77.

    Article  PubMed  Google Scholar 

  23. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2--assessing respondent understanding. Value Health. 2011;14:978–88.

    Article  PubMed  Google Scholar 

  24. Bryant AJ, Quintanar-Solares M, Ascoytia CM, Martin ML, Asmus F, Geister TL. Conducting qualitative interviews in compromised child populations: cerebral palsy (CP) as a case study. Value Health. 2013;16:A39.

    Article  Google Scholar 

  25. Martin ML, Quintanar-Solares M, Asmus F, Geister TL. Designing corresponding assessments for children and parents to improve data capture in special populations. Value Health. 2013;16:A44.

    Article  Google Scholar 

  26. Quintanar-Solares M, Martin ML, Bryant AJ, Ascoytia CM, Asmus F, Geister TL. Using questionnaire design to explore reporting differences for spasticity related pain in children and adolescents with cerebral palsy. Value Health. 2013;16:A41.

    Article  Google Scholar 

  27. Eliasson AC, Krumlinde-Sundholm L, Rosblad B, Beckung E, Arner M, Ohrvall AM, et al. The manual ability classification system (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. Dev Med Child Neurol. 2006;48:549–54.

    Article  PubMed  Google Scholar 

  28. Palisano RJ, Rosenbaum P, Bartlett D, Livingston MH. Content validity of the expanded and revised gross motor function classification system. Dev Med Child Neurol. 2008;50:744–50.

    Article  PubMed  Google Scholar 

  29. Rosenbaum PL, Walter SD, Hanna SE, Palisano RJ, Russell DJ, Raina P, et al. Prognosis for gross motor function in cerebral palsy: creation of motor development curves. JAMA. 2002;288:1357–63.

    Article  PubMed  Google Scholar 

  30. Russell DJ, Avery LM, Rosenbaum PL, Raina PS, Walter SD, Palisano RJ. Improved scaling of the gross motor function measure for children with cerebral palsy: evidence of reliability and validity. Phys Ther. 2000;80:873–85.

    CAS  PubMed  Google Scholar 

  31. Ashworth B. Preliminary trial of Carisoprodol in multiple sclerosis. Practitioner. 1964;192:540–2.

    CAS  PubMed  Google Scholar 

  32. Boyd RN, Graham HK. Objective measurement of clinical findings in the use of botulinum toxin type a for the management of children with cerebral palsy. Eur J Neurol. 1999;6:S23–35.

    Article  Google Scholar 

  33. Morris S. Ashworth and Tardieu scales: their clinical relevance for measuring spasticity in adult and paediatric neurological populations. Phys Ther Rev. 2002;7:53–62.

    Article  Google Scholar 

  34. Varni JW, Burwinkle TM, Berrin SJ, Sherman SA, Artavia K, Malcarne VL, et al. The PedsQL in pediatric cerebral palsy: reliability, validity, and sensitivity of the generic Core scales and cerebral palsy module. Dev Med Child Neurol. 2006;48:442–9.

    Article  PubMed  Google Scholar 

  35. Yang X, Xiao N, Yan J. The PedsQL in pediatric cerebral palsy: reliability and validity of the Chinese version pediatric quality of life inventory 4.0 generic core scales and 3.0 cerebral palsy module. Qual Life Res. 2011;20:243–52.

    Article  PubMed  Google Scholar 

  36. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8:94–104.

    Article  PubMed  Google Scholar 

  37. Nunnaly J, Bernstein I: Psychometric Theory. 3rd edition edn: McGraw-Hill; 1994.

  38. Stevens JP. Applied multivariate statistics for the social sciences. 2nd ed. Hillsdale: NJ:Erlbaum; 1992.

    Google Scholar 

  39. Andrich D, Sheridan B, Luo G: Perth: RUMM Laboratory; 2030. Rasch Unidimensional Measurement Model [Computer software] 2008.

  40. Cronbach LJ, Warrington WG. Time-limit tests: estimating their reliability and degree of speeding. Psychometrika. 1951;16:167–88.

    Article  CAS  PubMed  Google Scholar 

  41. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.

    Article  CAS  PubMed  Google Scholar 

  42. SPSS Inc. Released 2009. PASW statistics for windows, version 18.0. Chicago: SPSS Inc.

  43. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  44. Cohen LL, Lemanek K, Blount RL, Dahlquist LM, Lim CS, Palermo TM, et al. Evidence-based assessment of pediatric pain. J Pediatr Psychol. 2008;33:939–55. discussion 956-937

    Article  PubMed  Google Scholar 

  45. Heather Fritzley V, Lindsay RC, Lee K. Young children's response tendencies toward yes-no questions concerning actions. Child Dev. 2013;84:711–25.

    Article  CAS  PubMed  Google Scholar 

  46. Edelbrock C, Costello AJ, Dulcan MK, Kalas R, Conover NC. Age differences in the reliability of the psychiatric interview of the child. Child Dev. 1985;56:265–75.

    Article  CAS  PubMed  Google Scholar 

  47. Schmitt N. Uses and abuses of coefficient alpha. Psychol Assess. 1996;8:350.

    Article  Google Scholar 

  48. Haugh AB, Pandyan AD, Johnson GR. A systematic review of the Tardieu scale for the measurement of spasticity. Disabil Rehabil. 2006;28:899–907.

    Article  CAS  PubMed  Google Scholar 

  49. Alhusaini AA, Dean CM, Crosbie J, Shepherd RB, Lewis J. Evaluation of spasticity in children with cerebral palsy using Ashworth and Tardieu scales compared with laboratory measures. J Child Neurol. 2010;25:1242–7.

    Article  PubMed  Google Scholar 

  50. Houlihan CM, O'Donnell M, Conaway M, Stevenson RD. Bodily pain and health-related quality of life in children with cerebral palsy. Dev Med Child Neurol. 2004;46:305–10.

    Article  PubMed  Google Scholar 

  51. Gureje O, Von Korff M, Simon GE, Gater R. Persistent pain and well-being: a World Health Organization study in primary care. JAMA. 1998;280:147–51.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the research teams at the three hospitals, and all of the children and their parents who participated in, and contributed to, the study.

FoShan Nanhai MCH hospital: Zhao Yong, Qian Xuguang, Zhang Chuntao, Guo Jiayan, Huang Xuyi, Chen Jixinag, Dong Shangsheng, Zhang Yong, Li Lanya;

HuNan XiangYaBoAi Rehabilitation Hospital: Zhang Yilei, Chen Manna, Luo Sha, Tong Yin, Xu Yaxiong, Zhang Yanjun.

MCH Hospital of Dongguan: Ding Jianying, Huang Xiaoling, Liao Jinsheng, Li Jiani.

Editorial support in the preparation of this manuscript (editing for English language) was provided by Complete Medical Communications and funded by Merz Pharmaceuticals GmbH.

Funding

This study was sponsored by Merz Pharmaceuticals, GmbH, Frankfurt, Germany.

Availability of data and materials

The datasets used and/or analysed during the current study are made available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study concept, participated in its design and coordination and in drafting the manuscript. All authors have approved the final version of the manuscript.

Corresponding author

Correspondence to Thorin L. Geister.

Ethics declarations

Ethics approval and consent to participate

The study adhered to the ethical principles for human research and approval was provided by the ethical review board at each participating hospital. Each patient or their legally acceptable representative provided written informed consent to participate in the study.

Consent for publication

Not applicable. No individual patient data reported.

Competing interests

TLG and AH are employees of Merz Pharmaceuticals, GmbH. MM and DB are employees of Health Research Associates. JY, YZ and ZL declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1: Figure S1.

Mean (SD) QPS scores of the six modules in relation to GMFCS levels. GMFCS, Gross Motor Function Classification System; SD, standard deviation. (JPEG 54 kb)

Additional file 2: Figure S2.

QPS score relationship to PedsQLâ„¢, PedsQLâ„¢, Pediatric Quality of Life Inventory. (JPEG 73 kb)

Additional file 3: Table S1.

Ordinal logistic regression analysis model of variables influencing QPS scores at baseline visit (V2). (DOCX 13 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Geister, T.L., Bushnell, D.M., Yang, J. et al. Initial psychometric validation of the questionnaire on pain caused by spasticity (QPS). Health Qual Life Outcomes 15, 229 (2017). https://doi.org/10.1186/s12955-017-0804-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-017-0804-8

Keywords