Skip to main content
Download PDF
Download ePub

Scale agreement, ceiling and floor effects, construct validity, and relative efficiency of the PROPr and EQ-5D-3L in low back pain patients

Health and Quality of Life Outcomes volume 21, Article number: 107 (2023) Cite this article

Abstract

Background

The PROMIS Preference score (PROPr) is a new health state utility (HSU) score that aims to comprehensively incorporate the biopsychosocial model of health and apply favorable psychometric properties from the descriptive PROMIS system to HSU measurements. However, minimal evidence concerning comparisons to the EQ-5D-3L and the PROPr’s capability to differentiate clinical severity are available. Therefore, the aim of this study was to compare the PROPr to the EQ-5D-3L in terms of scale agreement, ceiling/floor effects, distribution, construct validity, discriminatory power, and relative efficiency (RE) in terms of the Oswestry Disability Index (ODI) for patients with low back pain (LBP).

Methods

We used intra-class correlation coefficients (ICC) and Bland–Altman plots to compare the PROPr and EQ-5D-3L with regared to scale agreement in a cross-sectional routine sample of LBP patients. For distribution, we used the Pearson’s coefficient for skewness and for ceiling/floor effects, a 15%-top/bottom threshold. For convergent validity, we used Pearson’s correlation coefficients. For known-groups validity, we applied a linear regression with interaction terms (predictors sex, age, and ODI level) and an analysis of variance (ANOVA). For discriminatory power, we calculated the effect size (ES) using Cohen’s d and the ratio of the area under the receiver-operating characteristics curves (AUROC-ratio = AUROCPROPr/AUROCEQ-5D-3L). RE was measured using the ratio of F-values (RE = FPROPr/FEQ-5D-3L).

Results

Of 218 LBP patients, 50.0% were female and the mean age was 61.8 years. The mean PROPr (0.20, 95%CI: 0.18; 0.22) and EQ-5D-3L scores (0.55, 95%CI: 0.51; 0.58) showed low agreement (d = 0.35, p < 0.001; ICC 0.27, 95%CI: -0.09; 0.59). The PROPr’s distribution was positively skewed, whereas the EQ-5D-3L’s was negative. Neither tool showed ceiling/floor effects, but all EQ-5D-3L dimensions did. Pearson correlation was r = 0.66 (95%CI: 0.58; 0.73). Differences were invariant to sex and age but not to ODI severity: ESEQ-5D-3L > ESPROPr and RE < 1 in higher ODI severity; ESEQ-5D-3L < ESPROPr and RE > 1 in lower ODI severity. AUROC-ratios did not show significant differences in terms of ODI severity.

Conclusions

All PROPr and EQ-5D-3L biopsychosocial dimensions of health showed impairment in LPB patients. The capability of EQ-5D-3L and PROPr to differentiate ODI levels depends on ODI severity. Joint application of both tools may provide additional information.

Background

Low back pain (LBP) is one of the most frequent conditions worldwide with a point prevalence of 11.9% [1]. Economically, LBP is the leading health-related cause of productivity loss with a high share of indirect costs (such as absenteeism) [1]. The etiology of LBP is complex and can best be described using the biopsychosocial model of health [1, 2]. If LBP is chronic, which it frequently is, LBP is associated with changes in blood flow and metabolism [2]. Most importantly, behavioral, and emotional factors influence LBP and vice versa, which leads to an increase in the risk of chronic LBP development [2].

It is therefore crucial that measures used for the cost-effectiveness of LBP treatments assess as many biopsychosocial domains of LPB as possible. Economic evaluations of treatments are usually measured in costs per quality-adjusted life years (QALY) gained by an intervention [3, 4]. A QALY is the product of the number of life years and a health state utility (HSU) score (or preference-based measure [PBM]). QALY scores range from 0 (death) to 1 (full health) and represent the value of an individual’s health state. Negative HSU values are considered “worse than dead” [5, 6].

The European Quality of Life 5 Dimensions 3 Levels (EQ-5D-3L), for example, covers five dimensions: mobility, self-care, usual activities, pain/discomfort, and anxiety/depression [7]. Each dimension is measured on a single 3-level Likert-scale item differentiating 35 = 243 health states. These health states were evaluated using preference elicitation techniques that yield a single EQ-5D-3L index value [7, 8]. The EQ-5D-3L shows good psychometric properties in LBP patients, has a low response burden, and is easily applicable [9, 10]. However, on an individual level, its 3-level descriptive items provide coarse measurements, which need to be counterbalanced by large sample sizes. The EQ-5D-3L’s ceiling effects indicate a limited range of measurement. Furthermore, some of its items compose different constructs (e.g., anxiety/depression). Finally, some biopsychosocial dimensions of health (e.g., fatigue), which are potentially relevant to LBP or other conditions, are not part of the EQ-5D-3L [9, 11,12,13,14,15,16]. The development of its new version, the EQ-5D-5L, improved discriminatory power and reduced ceiling effects [17, 18]. A different approach for covering a comprehensive biopsychosocial LBP model occurred with the introduction of new HSU scores, such as the Patient-Reported Outcome Measurement Information System (PROMIS) Preference Score (PROPr) [19].

The PROPr aims at leveraging the favorable psychometric properties of the descriptive PROMIS system to HSU measurement [12, 19, 20]. PROMIS offers measurement models for health domains (e.g., pain interference) using item response theory (IRT), which allows comparable measurement irrespective of the items used [21, 22]. PROMIS enhances precision and covers a wide range of measurement, mostly showing smaller floor and ceiling effects than comparable measures [11, 23,24,25]. The PROPr, as a preference-based measure, uses seven PROMIS domains: cognition, depression, fatigue, pain interference, physical function, sleep disturbance, and ability to participate in social roles and activities [26].

Even though the EQ-5D-3L is the most commonly used HSU score, so far, only one comparison to the PROPr has been reported [4, 27,28,29,30]. In stroke patients, the EQ-5D-3L and PROPr were strongly correlated [30]. Both scores could differentiate severity levels in terms of modified Rankin Scale [30]. It was suggested that the PROPr is better than the EQ-5D-3L for measuring longitudinal changes at the 1-year follow-up, which, if confirmed, could lead to improved measurements of cost-effectiveness [30]. The authors concluded that the EQ-5D-3L values may be too high for stroke patients in bad health, while PROPr values may be too low for patients in good health [30]. Generally, the PROPr’s face validity as a preference-based measure is disputed as its general population mean was shown to be around only 0.5 on a scale between 0 and 1 [31, 32]. Also, the PROPr with at least 14 but rather 29–33 items poses a higher response burden than the EQ-5D-3L [12, 32,33,34]. Just recently, the EQ-5D-5L, which is related to the EQ-5D-3L, showed better discriminatory power of physician-diagnosed conditions in a large Hungarian general population sample [31]. However, there is still a lack of analyses of the PROPr’s capability of detecting different severity groups in LBP patients.

The aim of this study therefore is: (1) to assess scale agreement of PROPr and EQ-5D-3L in LBP patients, (2) to compare floor and ceiling effects of both scores, (3) to investigate construct validity in terms of association and different severity groups measured based on the Oswestry Disability Index (ODI), sex, age, and (4) to compare discriminatory power and relative efficiency (RE) in terms of ODI groups.

Methods

Sample

We performed a secondary analyses with routine data from a cross-sectional sample of LBP patients before surgery at the multidisciplinary spine center at Charité Universitätsmedizin Berlin. After giving informed consent, patients completed assessment by tablets between April 2019 and November 2020: sociodemographic data, EQ-5D-3L, ODI, and PROMIS-29 profile. All patients presenting with LBP were eligible to participate. Participation was voluntary. No incentives for participation were offered. No explicit exclusion criteria were stipulated. However, illiteracy, vision impairment, and language barriers for non-German-speaking patients were factual barriers for participation. All procedures performed in this study were approved by Charité’s Ethics Committee (EA4/127/16).

Measures

PROMIS Preference Score (PROPr)

The PROPr is a preference-based score based on the PROMIS framework. It covers seven PROMIS domains: cognition, depression, fatigue, pain interference, physical function, sleep disturbance, and ability to participate in social roles and activities [12, 19, 20, 26, 35]. We used the PROMIS-29 v2.0 Profile to measure six of the seven PROPr domains, PROMIS anxiety, and the pain intensity visual analogue scale (VAS) from 0 to 10 [35]. The cognition domain was predicted by a linear regression model from six PROMIS-29 domains [36]. Each domain is measured by four items. Each item is measured on a 5-point Likert-scale and refers to the past seven days, except for physical function, which does not have a specific time frame. These item scores translate into a domain T-score (M = 50 ± standard deviation [SD] = 10) or Theta-score (Z-Scores; M = 0, SD = 1), which is calibrated on the norm of the United States general population [35]. For desirable domains, such as physical function, a higher T-score indicates better health. For undesirable domains, such as pain interference, a higher T-score indicates worse health. Theta scores of all domains were applied to the PROPr multi-attribute utility (MAUT) function to obtain a PROPr between − 0.022 and 1.00, representing the preferences of the US population in 2016 elicited by online standard gamble (SG). Negative values are interpreted as “worse than dead” [12, 19].

EQ-5D-3L

The EQ-5D-3L is a preference-based instrument measuring five health dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) with one item each on three levels: “no problems” (score: 1); “some/moderate problems” (2); and “extreme problems/unable to/confined to bed” (3). The frame of reference is “Today”. The value assigned to each health state was determined through time trade-off (TTO) in the general population of the United States in 2002 [7]. We used the US value set to avoid systematic differences due to different valuation populations as no German valuation for the PROPr exists yet. A health state of 11111 (namely, each of the five items is answered as ‘1’) has a value of 1.00 (representing perfect health), while the worst health state of 33333 corresponds to a value of -0.103, which is negative and considered “worse than dead” [7]. Last, the EQ VAS item from “The worst health you can imagine” (0) to “The best health you can imagine” (100) measures the patient’s own judgement about his or her health state.

Oswestry Disability Index (ODI)

The ODI is a disease-specific index to measure LBP severity. In 10 items with six response options (0–5) for each item, patients rate their disabilities in performing daily routine activities, such as standing and lifting. The sum score is then divided by the maximum sum score of 50 and multiplied by 100, yielding results ranging from 0 to 100%: severity groups are defined as minimal (< 20%), moderate (21%-40%), severe (41%-60%), crippling (61%-80%), and bedridden (> 80%) [37].

Statistical analysis

First, we investigated scale agreement as based on ICC coefficients using the two-way random effect models and single rater unit. Excellent agreement refers to ICC > 0.75, good agreement to ICC > 0.6, fair agreement to ICC > 0.4, and low agreement to ICC < 0.4 [38]. Our hypothesis was to expect ICC > 0.4 as the PROPr is more comprehensive with regard to the biopsychosocial model of LBP health and has a multiplicative instead of linear-additive utility model. Agreement was further assessed using a Bland–Altman-Plot. Levels of agreement (LoA) of 95% were defined by mean (difference) ± 1.96*SD [39].

Second, we compared ceiling and floor effects both on domain and on HSU score level and the skewness of the distribution of both HSU scores. If more than 15% of the sample scored the maximum or minimum of a scale, this defined significant ceiling or floor effect [40, 41]. To account for skewness of the distribution, we used the Pearson’s coefficient for skewness (γ) in which case if γ < 0, the distribution was negatively skewed and if γ > 0, it was positively skewed [32]. Our hypothesis was to expect no ceiling or floor effects in terms of HSU level but significant ceiling and floor effects in terms of EQ-5D-3L dimensions and none in terms of PROMIS domains. However, we expected γPROPr > 0 and γEQ-5D-3L < 0.

Third, we investigated construct validity. For convergent validity in terms of association between the PROPr and the EQ-5D-3L and domains/dimensions, we used the Pearson’s correlation coefficient. Association was defined as strong (r > 0.7), moderate (r > 0.5), or weak (r < 0.5) [42]. Our hypothesis was to expect r > 0.5 for the HSU scores and > 0.5 or r < -0.5, respectively, for the domains/dimensions [33]. For known-groups validity in terms of sex, age, and ODI severity, we performed a linear regression analyses with interaction terms defined as:

$$HSU=\mathrm{\alpha }+ {\upbeta }_{0}*\mathrm{instrument }+ {\upbeta }_{1}*\mathrm{ODI }+ {\upbeta }_{2}*\mathrm{age }+ {\upbeta }_{3}*\mathrm{sex }+ {\upbeta }_{21}*\mathrm{instrument}*\mathrm{ODI}+ {\upbeta }_{22}*\mathrm{instrument}*\mathrm{age }+ {\upbeta }_{23}*\mathrm{instrument}*\mathrm{sex}$$

Type of instrument (EQ-5D-3L = 0; PROPr = 1) and sex (male = 0; female = 1) were binary variables. Age in years was considered a continuous variable. ODI was measured on an ordinal scale (five severity levels) and dummy-coded. Also, we performed an analysis of variance (ANOVA). As post-hoc test we used the pairwise t-test and adjusted the p-value with the Bonferroni method to further differentiate the differences between ODI severity groups. While we expected significant main effects for instrument and predictor variables, our hypothesis stated that no significant interaction between instrument and age or sex occur, indicating that differences between instruments were not affected by the respective predictors. However, we expected significant interactions between instrument and ODI group.

Fourth, to test discriminatory power between ODI severity groups of both HSU scores and relative efficiency (RE), we used several methods. First, we investigated the effect size (ES) between ODI severity groups of each score using Cohen’s d, which was defined as mean differences divided by pooled standard deviation. ES was considered small (0.2–0.5), medium (0.5–0.8), or large (> 0.8) [43]. Second, we added the ratio of the area under the receiver-operating characteristics curve (AUROC-ratio) as a non-parametric method, using the ODI severity group as outcome and the respective HSU score as exposure for which AUROC-ratio = AUROCPROPr/AUROCEQ-5D-3L > 1 indicated higher discriminatory power for the PROPr; AUROC-ratio < 1 for the EQ-5D-3L [44]. As general hypothesis, we expected the PROPr to show a significantly better discriminatory power (p < 0.05) between the less severe ODI groups and EQ-5D-3L between the more severe ODI groups in the parametric method comparisons. For the non-parametric method comparisons, we did not expect significant differences. Third, we compared the RE of both instruments to detect differences between ODI groups which was defined as the ratio of F-values: RE = FPROPr/FEQ-5D-3L. RE > 1 indicates higher efficiency of the PROPr; RE < 1 for the EQ-5D-3L [45, 46]. Since the PROPr domains have more items, we expected that RE would be greater than 1. To calculate the 95% confidence-intervals (CI) for the RE and AUROC-ratio, we used 10,000 bootstrap samples.

Results

Sample characteristics

Of 218 patients, 50.0% were female. The mean age was 61.8 ± 17.2 years and ranged from 27 to 92 years. The most frequent ODI severity level was severe. The EQ-5D-3L dimensions of pain/discomfort, mobility, and usual activities were reported to be the most frequently impaired. Accordingly, the PROMIS domains of pain interference, physical function, and ability to participate in social roles and activities were the most impaired. Notably, those domains that are part of the PROPr but not of the EQ-5D-3L (sleep disturbance, fatigue) also showed impairment. The mean PROPr (0.20, 95%-CI: 0.18–0.22) and the mean EQ-5D-3L (0.55, 95%-CI: 0.51–0.58) differed significantly (Table 1).

Table 1 Sample characteristics
Full size table

Scale agreement

The ICC between EQ-5D-3L and PROPr was 0.27 (95%-CI: − 0.09–0.59), which is considered low agreement. The Bland–Altman plot (Fig. 1) demonstrates a systematic difference of d = 0.35 (p < 0.001). Agreement was higher for lower and higher values, which is probably an artifact of the bound scales. 95% of HSU differences between PROPr and EQ-5D-3L were between − 0.02 and 0.74, indicating that measurements can differ widely. 

Fig. 1
figure 1

Bland–Altman plot comparing agreement of European Quality of Life 5 Dimensions 3 Levels (EQ-5D-3L) and Patient-Reported Outcome Measurement Information System (PROMIS) Preference Score (PROPr). Upper dashed line: upper 95% limits of agreement (LoA), middle dashed line: mean bias of 0.35, and lower dashed line: lower 95% LoA. The line shows a loess smoother with a 95% confidence interval

Full size image

Distribution and ceiling and floor effects

The PROPr showed a larger positive skew (Pearson’s coefficient for skewness: γ = 1.33) than the EQ-5D-3L’s negative skew (γ =  − 0.55), indicating the former deviates significantly from the normal distribution (Fig. 2).

Fig. 2
figure 2

Correlation and distribution of EQ-5D-3L and the PROPr. The line shows a loess smoother with its 95% confidence interval

Full size image

Table 1 demonstrates that all EQ-5D-3L dimensions, except pain/discomfort, showed ceiling effects. Additionally, pain/discomfort and usual activities showed floor effects. None of the PROMIS scales showed a floor or ceiling effect; in fact, the maxima or minima were never achieved. Neither HSU score showed a ceiling or floor effect.

Construct validity

For convergent validity, the association measured by Pearson’s correlation coefficient between the EQ-5D-3L and the PROPr was moderate (r = 0.66, 95%-CI: 0.58–0.73; Table 2). Likewise, domain/dimension correlations were moderate. Those PROMIS domains showed higher correlation with those EQ-5D-3L dimensions that are conceptually equivalent. PROMIS cognition and EQ-5D-3L anxiety/depression correlated with − 0.59, which is plausible as depression may impair cognition [47].

Table 2 Correlation matrix of domains and HSU scores expressed in Pearson’s correlation coefficients r
Full size table

For known-groups validity, a linear regression analyses did not an interaction with age nor with sex but with ODI, suggesting that the observed difference is not influenced by age or sex but with ODI group (Table 3). The ANOVA yielded significant differences in both HSU scores depending on ODI severity. For further differentiation, a pairwise t-test with Bonferroni p-value adjustment found that for the PROPr, all differences except the one between the worst ODI groups “bedridden” and “crippling” were significant (p < 0.05). For the EQ-5D-3L, all differences except the one between the best ODI groups “minimal” and “moderate” were significant (p < 0.05).

Table 3 Coefficients of linear regression analyses with interaction terms predicting EQ-5D-3L
Full size table

Discriminatory power and relative efficiency

For PROPr, the ES was large in all comparisons except the one between the two worst ODI groups (Table 4). For the EQ-5D-3L, the ES was large only between the two worst ODI groups. However, ES of both scores presented a large CI, so differences were not statistically significant. Neither was the AUROC-ratio in any of the groups. RE favoured the PROPr statistically significant between “minimal”/ “moderate” and between “moderate”/ “severe”, but the EQ-5D-3L, though not statistically significant, between “severe”/ “crippling” and “crippling”/ “bedridden”. Generally, in all subgroups except ODI group “minimal”, the PROPr had smaller standard deviations (SD) than the EQ-5D-3L.

Table 4 Known-groups validity of PROPr and EQ-5D-3L between ODI severity groups in terms of effect size, relative efficiency, and area under the receiver-operating characteristics curve ratio (AUROC-ratio)
Full size table

Discussion

The present study showed that PROPr and EQ-5D-3L measure HSU differently in a sample of LBP patients. Scale agreement is low as neither HSU score shows floor or ceiling effects, but all EQ-5D-3L dimensions and none of the PROPr domains do. The PROPr’s distribution presented a positive skew, while the EQ-5D-3L’s showed a negative skew. Association of both scores was moderate, and differences were invariant to sex and age; however, the EQ-5D-3L could better account for differences in higher ODI severity levels, whereas the PROPr did so in lower ODI severity levels.

The sample size allowed for a relatively high statistical power and generalizability in this patient group for the first part of the analysis. However, for the known-groups validity, when the sample is divided into ODI severity groups, ES, AUROC-ratio, and some RE comparisons were not statistically significant as a result of not having an adequate sample size; thus, our results need to be confirmed in larger samples. Also, unfortunately, our sample lacked enough sociodemographic data and clinical data such as condition and comorbidities. Furthermore, we used the PROMIS-29, so the cognition domain had to be predicted using the linear regression function [36]. A direct measurement is expected to be more precise. Additionally, even though we used US value sets for both scores, the EQ-5D-3L’s was from 2002 and the PROPr’s was from 2016 which may be a source of systematic bias. This cross-sectional psychometric analyses has per se limited validity on how cost-effectiveness analyses differ depending on the HSU scores used in QALY measurements.

The mean difference between EQ-5D-3L and PROPr was 0.41 in a previous study, which is larger than in this present study [30]. Scale agreement comparisons are available only in comparison to the EQ-5D-5L. In terms of ICC, our study’s ICC result was larger (0.48) and mean difference was smaller (0.18) [33]. Three factors cause lower PROPr values compared to the EQ-5D-3L: (1) Generally, the PROPr has more (impaired) domains; (2) The EQ-5D-3L has only three measurement levels, which differs more from PROMIS than the EQ-5D-5L with its five levels; and (3) The PROPr has a multiplicative utility model and relatively large coefficients, which causes interactions between predictor variables. As a result, the PROPr’s HSU scale is in fact narrower than one of the EQ-5D-3L, which has a linear-additive model without interactions. Paradoxically, the PROPr can nevertheless define a higher number of health states which is a product of the levels of the descriptive system and the number health domains [32, 34]. As a consequence, both scores differ to the extent that they cannot be used interchangeably.

Ceiling/floor effects for the EQ-5D-3L dimensions are known and can be explained by its short ordinal scale of only three levels [17, 18, 46]. The EQ-5D-5L therefore has smaller ceiling effects [17, 18]. PROMIS dimensions are measured on a continuous scale and are known to have smaller or no ceiling/floor effects at all even when a different definition is applied [32, 33, 48]. PROMIS domains are explicitly designed to cover a wide range of measurements [35]. This was achieved by using four instead of one item per domain and using items of different severity or difficulty. For example, the PROMIS physical function item “Are you able to run 100 yards?” allows to measure a higher physical function than the correspondent EQ-5D mobility item “Do you have problems walking about?” [19, 20, 30].

The PROPr’s distribution was positively skewed in previous clinical samples as well and approximately normally distributed in general population samples [30, 32, 33]. The EQ-5D-5L and the EQ-5D-3L tend to be rather negatively skewed in any kind of samples [13, 28, 30, 32,33,34, 40, 41, 44, 46].

Differences in skewness naturally cause a decrease in correlation. The correlation between PROPr and EQ-5D-3L was lower than between the PROPr and the EQ-5D-5L, again because of the lower number of measurement levels [19, 33, 49]. In the one exisiting EQ-5D-3L-comparison, correlations were high (> 0.8) but measured by Spearman’s coefficient [30]. Invariance of the systematic difference between PROPr and other HSU scores with regard to socioeconomic factors, such as age and sex, have been previously reported [32, 33]. Our study is the first to investigate the relationship of these differences to clinical severity in LBP patients. We found that SDs as a measure of precision were smaller for the PROPr than for the EQ-5D-3L scores in the total sample and in all but the “minimal” ODI severity subgroups. This finding is in line with earlier findings in similarly small samples [33]. In larger samples, SD did not differ [32]. The lack of a difference occurred because the PROPr uses four items per domain instead of only one, a process that brings down measurement errors in smaller samples [50, 51]. As the variance has direct impact on F-values, we found that the PROPr’s RE was significantly stronger in the lower ODI group comparisons. The statistical insignificance of comparisons in discriminatory power in terms of ES and AUROC-ratio can be attributed to the small sample size; however, the ES indicated better discriminatory power for the PROPr at lower severity levels and for the EQ-5D-3L at higher severity levels. This finding is in line with recent reports about the differentiation of severity levels in stroke patients [30].

Another study suggested using two rather than just one HSU score in cost-effectiveness analyses to more comprehensively inform decision making [52]. Our results indicate that the PROPr and the EQ-5D-3L could complement one another very well as they have their strengths and limitations at different severity levels, which are at opposite ends of the HSU scale. As PROMIS is increasingly often used as a descriptive measurement of health domains, the necessary data to calculate the PROPr are often available [35]. Further research should be done to investigate this approach.

Conclusion

All PROPr and EQ-5D-3L dimensions of the biopsychosocial model of health showed impairment in LBP patients. The EQ-5D-3L and the PROPr differ considerably in their measurement and conceptualization of HSU so they cannot be used interchangeably. The PROPr was more efficient and more discriminatory for the lower ODI severity groups, while the EQ-5D-3L was more efficient and more discriminatory for the higher ODI severity groups. Joint application of both tools may provide additional information in cost-effectiveness analyses.

Availability of data and materials

Upon reasonable request.

References

  1. James SL, Abate D, Abate KH, Abay SM, Abbafati C, Abbasi N, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 354 Diseases and Injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1789–858.

    Article  Google Scholar 

  2. Knezevic NN, Candido KD, Vlaeyen JWS, Van Zundert J, Cohen SP. Low back pain. Lancet. 2021;398(10294):78–92. https://doi.org/10.1016/S0140-6736(21)00733-9.

    Article  PubMed  Google Scholar 

  3. Bang H, Zhao H. Median-based incremental cost-effectiveness ratio (ICER). J Stat Theory Pract. 2012;6(3):428–42.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Heintz E, Gerber-Grote A, Ghabri S, Hamers FF, Rupel VP, Slabe-Erker R, et al. Is there a european view on health economic evaluations? results from a synopsis of methodological guidelines used in the EUnetHTA partner countries. Pharmacoeconomics. 2016;34(1):59–76.

    Article  PubMed  Google Scholar 

  5. Weinstein MC, Torrance G, McGuire A. QALYs: The basics. Value Heal. 2009;12(SUPPL. 1):S5-9. https://doi.org/10.1111/j.1524-4733.2009.00515.x.

    Article  Google Scholar 

  6. Klarman HE, Francis JO, Rosenthal GD. Cost effectiveness analysis applied to the treatment of chronic renal disease. Med Care. 1968;6(1):48–54.

    Article  Google Scholar 

  7. Shaw JW, Johnson JA, Coons SJ. US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care. 2005;43(3):203–20.

    Article  PubMed  Google Scholar 

  8. Van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Heal. 2012;15(5):708–15. https://doi.org/10.1016/j.jval.2012.02.008.

    Article  Google Scholar 

  9. Brazier J, Ara R, Rowen D, Chevrou-Severac H. A review of generic preference-based measures for use in cost-effectiveness models. Pharmacoeconomics. 2017;35(s1):21–31.

    Article  PubMed  Google Scholar 

  10. Whynes DK, McCahon RA, Ravenscroft A, Hodgkinson V, Evley R, Hardman JG. Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain. Value Heal. 2013;16(1):124–32. https://doi.org/10.1016/j.jval.2012.09.003.

    Article  CAS  Google Scholar 

  11. Hanmer J, Feeny D, Fischhoff B, Hays RD, Hess R, Pilkonis PA, et al. The PROMIS of QALYs. Health Qual Life Outcomes. 2015;15–7. https://doi.org/10.1186/s12955-015-0321-6

  12. Hanmer J, Dewitt B. The Development of a Preference-based Scoring System for PROMIS® (PROPr): A Technical Report Version 1.4. 2017.

  13. Pan T, Mulhern B, Viney R, Norman R, Tran-Duy A, Hanmer J, et al. Evidence on the relationship between PROMIS-29 and EQ-5D: a literature review. Qual Life Res. 2021. https://doi.org/10.1007/s11136-021-02911-4

  14. Manning K, Kauffman BY, Rogers AH, Garey L, Zvolensky MJ. Fatigue severity and fatigue sensitivity: relations to anxiety, depression, pain catastrophizing, and pain severity among adults with severe fatigue and chronic low back pain. Behav Med. 2022;48(3):181–9.

    Article  PubMed  Google Scholar 

  15. Kelly GA, Blake C, Power CK, Okeeffe D, Fullen BM. The association between chronic low back pain and sleep: a systematic review. Clin J Pain. 2011;27(2):169–81.

    Article  PubMed  Google Scholar 

  16. Corti EJ, Gasson N, Loftus AM. Cognitive profile and mild cognitive impairment in people with chronic lower back pain. Brain Cogn. 2021;151:105737.

    Article  PubMed  Google Scholar 

  17. Martí-Pastor M, Pont A, Ávila M, Garin O, Vilagut G, Forero CG, et al. Head-to-head comparison between the EQ-5D-5L and the EQ-5D-3L in general population health surveys. Popul Health Metr. 2018;16(1):1–11.

    Article  Google Scholar 

  18. Greene ME, Rader KA, Garellick G, Malchau H, Freiberg AA, Rolfson O. The EQ-5D-5L improves on the EQ-5D-3L for health-related quality-of-life assessment in patients undergoing total hip arthroplasty. Clin Orthop Relat Res. 2015;473(11):3383–90.

    Article  PubMed  Google Scholar 

  19. Dewitt B, Feeny D, Fischhoff B, Cella D, Hays RD, Hess R, et al. Estimation of a preference-based summary score for the patient-reported outcomes measurement information system: The PROMIS®-Preference (PROPr) scoring system. Med Decis Mak. 2018;38(6):683–98.

    Article  Google Scholar 

  20. Hanmer J, Dewitt B, Yu L, Tsevat J, Roberts M, Revicki D, et al. Cross-sectional validation of the PROMIS- preference scoring system. PLoS ONE. 2018;13(7):1–13.

    Article  Google Scholar 

  21. Embretson SE, Reise SP. Item Response Theory For Psychologists. Psychology Press; 2013.

  22. Rupp AA, Zumbo BD. Understanding parameter invariance in unidimensional IRT models. Educ Psychol Meas. 2006;66(1):63–84.

    Article  Google Scholar 

  23. PROMIS Cooperative Group. PROMIS ® Instrument Maturity Model. 2012. p. 1–4. Available from: http://www.healthmeasures.net/images/PROMIS/PROMISStandards_Vers_2_0_MaturityModelOnly_508.pdf

  24. Fries JF, Witter J, Rose M, Cella D, Khanna D, Morgan-DeWitt E. Item response theory, computerized adaptive testing, and promis: assessment of physical function. J Rheumatol. 2014;41(1):153–8.

    Article  PubMed  Google Scholar 

  25. Choi SW, Schalet B, Cook KF, Cella D. Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression. Psychol Assess. 2014;26(2):513–27.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Hanmer J, Cella D, Feeny D, Fischhoff B, Hays RD, Hess R, et al. Selection of key health domains from PROMIS® for a generic preference-based scoring system. Qual Life Res. 2017;26(12):1–9.

    Article  Google Scholar 

  27. NICE. NICE Guidelines. 2013. Guide to the Methods of Technology Appraisal. Available from: nice.org.uk/process/pmg9

  28. Rencz F, Gulácsi L, Drummond M, Golicki D, Prevolnik Rupel V, Simon J, et al. EQ-5D in central and Eastern Europe: 2000–2015. Qual Life Res. 2016;25(11):2693–710.

    Article  PubMed  Google Scholar 

  29. Kennedy-Martin M, Slaap B, Herdman M, van Reenen M, Kennedy-Martin T, Greiner W, et al. Which multi-attribute utility instruments are recommended for use in cost-utility analysis? A review of national health technology assessment (HTA) guidelines. Eur J Heal Econ. 2020;21(8):1245–57. https://doi.org/10.1007/s10198-020-01195-8.

    Article  Google Scholar 

  30. Thompson NR, Lapin BR, Katzan IL. Utilities Estimated from PROMIS Scales for Cost-Effectiveness Analyses in Stroke. 2023;1–15.

  31. Rencz F, Brodszky V, Janssen MF. A direct comparison of the measurement properties of EQ-5D-5L, PROMIS-29+2 and PROMIS global health instruments and eq-5d-5l and propr utilities in a general population sample. Value Heal. 2023;26(7):1045–56. https://doi.org/10.1016/j.jval.2023.02.002.

    Article  Google Scholar 

  32. Klapproth CP, Sidey-Gibbons CJ, Valderas JM, Rose M, Fischer F. Comparison of the PROMIS Preference Score (PROPr) and EQ-5D-5L index value in general population samples in the United Kingdom, France, and Germany. Value Heal. 2022;25(5):824–34. https://doi.org/10.1016/j.jval.2021.10.012.

    Article  Google Scholar 

  33. Klapproth CP, Fischer F, Merbach M, Rose M, Obbarius A. Psychometric properties of the PROMIS Preference score (PROPr) in patients with rheumatological and psychosomatic conditions. BMC Rheumatol. 2022;6(1):1–12. https://doi.org/10.1186/s41927-022-00245-3.

    Article  Google Scholar 

  34. Pan T, Mulhern B, Viney R, Norman R, Hanmer J, Devlin N. A comparison of PROPr and EQ-5D-5L value sets. Pharmacoeconomics. 2021;40(0123456789):297–307. https://doi.org/10.1007/s40273-021-01109-3.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Cella D, Choi SW, Condon DM, Schalet B, Hays RD, Rothrock NE, et al. PROMIS® adult health profiles: efficient short-form measures of seven health domains. Value Heal. 2019;22(5):537–44.

    Article  Google Scholar 

  36. Dewitt B, Jalal H, Hanmer J. Computing PROPr Utility Scores for PROMIS® profile instruments. Value Heal. 2019;23(3):370–8. https://doi.org/10.1016/j.jval.2019.09.2752.

    Article  Google Scholar 

  37. Fairbank JCT, Pynsent PB. The oswestry disability index. Spine (Phila Pa 1976). 2000;25(22):2940–53.

    Article  CAS  PubMed  Google Scholar 

  38. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.

    Article  Google Scholar 

  39. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.

    Article  CAS  PubMed  Google Scholar 

  40. Zeng X, Sui M, Liu B, Yang H, Liu R, Tan RLY, et al. Measurement properties of the EQ-5D-5L and EQ-5D-3L in Six Commonly diagnosed cancers. Patient. 2021;14(2):209–22. https://doi.org/10.1007/s40271-020-00466-z.

    Article  PubMed  Google Scholar 

  41. Zhu J, Yan XX, Liu CC, Wang H, Wang L, Cao SM, et al. Comparing EQ-5D-3L and EQ-5D-5L performance in common cancers: suggestions for instrument choosing. Qual Life Res. 2021;30(3):841–54. https://doi.org/10.1007/s11136-020-02636-w.

    Article  PubMed  Google Scholar 

  42. Hinkle D, Wiersma W, Jurs S. Applied Statistics for the Behavioral Sciences. In: 5th ed. Boston, Massachusetts, USA, Massachusetts, USA: Houghton Mifflin; 2003.

  43. Cohen J (1988). Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Lawrence Erlbaum Associates P, editor. Hillsdale, NJ; 1988.

  44. Janssen MF, Bonsel GJ, Luo N. Is EQ-5D-5L better than EQ-5D-3L? a head-to-head comparison of descriptive systems and value sets from seven countries. Pharmacoeconomics. 2018;36(6):675–97. https://doi.org/10.1007/s40273-018-0623-8.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Liang MH, Larson MG, Cullen KE, Schwartz JA. Comparative measurement efficiency and sensitivity of five health status instruments for arthritis research. Arthritis Rheum. 1985;28(5):542–7.

    Article  CAS  PubMed  Google Scholar 

  46. Gamper EM, Cottone F, Sommer K, Norman R, King M, Breccia M, et al. The EORTC QLU-C10D was more efficient in detecting clinical known group differences in myelodysplastic syndromes than the EQ-5D-3L. J Clin Epidemiol. 2021;68–70.

  47. Kutchins H, Kirk SA. Diagnostic and Statistical Manual of Mental Disorders 4th ed. Washington, D.C.: American Psychiatric Association; 1994. https://doi.org/10.1093/sw/40.2.286

  48. Klapproth CP, Fischer F, Rose M, Karsten MM. Health state utility differed systematically in breast cancer patients between the EORTC QLU-C10D and the PROMIS Preference Score (PROPr). J Clin Epidemiol. 2022;152:101–9.

    Article  PubMed  Google Scholar 

  49. Zhang J, Dewitt B, Tang E, Breitner D, Saqib M, Li D, et al. Evaluation of PROMIS Preference Scoring System (PROPr) in patients undergoing hemodialysis or kidney transplant. Clin J Am Soc Nephrol. 2021;16(9):1328–36.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Fries J, Rose M, Krishnan E. The PROMIS of better outcome assessment: responsiveness, floor and ceiling effects, and internet administration. J Rheumatol. 2011;38(8):1759–64.

    Article  PubMed  Google Scholar 

  51. Fries JF, Krishnan E, Rose M, Lingala B, Bruce B. Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther. 2011;13(5):R147.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Feeny D, Furlong W, Torrance GW. Commentary. In praise of studies that use more than one generic preference-based measure. Int J Technol Assess Health Care. 2019;35(4):257–62.

    Article  PubMed  Google Scholar 

Download references

Funding

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

  1. Center for Patient-Centered Outcomes Research (CPCOR), Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Berlin, Germany

    Christoph Paul Klapproth, Felix Fischer & Matthias Rose

  2. Department of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, USA

    Matthias Rose

Authors
  1. Christoph Paul Klapproth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Felix Fischer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthias Rose
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Concept and design: CPK; Acquisition of data: MR; Analysis and interpretation of data: CPK, FF; Drafting of the manuscript: CPK; Critical revision of the paper: CPK, FF; Statistical analysis: CPK, FF; Provision of study materials: MR; Administrative and technical support: MR, Supervision: FF, MR.

Corresponding author

Correspondence to Christoph Paul Klapproth.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in this study were approved by Charité’s Ethics Committee (EA4/127/16), in accordance with the ethical standards of the institutional and/or national research committee and the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent: Informed consent was obtained from all individual participants included in the study.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Klapproth, C.P., Fischer, F. & Rose, M. Scale agreement, ceiling and floor effects, construct validity, and relative efficiency of the PROPr and EQ-5D-3L in low back pain patients. Health Qual Life Outcomes 21, 107 (2023). https://doi.org/10.1186/s12955-023-02188-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-023-02188-w

Keywords

Health and Quality of Life Outcomes

ISSN: 1477-7525

Contact us