Skip to main content

The use of EQ-5D-5L as a patient-reported outcome measure in evaluating community rehabilitation services in Alberta, Canada

Abstract

Background

The purpose of this study was to describe the characteristics and health-related quality of life (HRQL) of patients accessing community rehabilitation services in Alberta, Canada, using routinely collected EQ-5D-5L data, and explore factors associated with the impact of these services.

Methods

A retrospective, longitudinal, observational design was used. Patients completed the EQ-5D-5L and demographic questions at intake and end of rehabilitation care. Change in EQ-5D-5L dimensions from intake until end of rehabilitation was examined using the Pareto Classification of Health Change. Change scores were calculated for the EQ-5D-5L index, VAS, and total sum scores. Change groups in the EQ-5D-5L index and VAS scores, were defined by minimally important differences of 0.04 and 7.0, respectively. One level change was considered important for the total sum score. Effect size of the change in index, VAS, and total sum scores was also examined. Chi-squared tests were conducted to examine whether change in EQ-5D-5L varied by age, gender, region, and having anxiety/depression at intake.

Results

Three service programs were examined; pulmonary rehabilitation (n = 542), group-based community exercise (n = 463), and physiotherapy for bone and joint care (n = 391). At intake, HRQL in all programs was lower than that of the general Alberta population norms and improved by end of rehabilitation. The mean (SD) change in index, VAS, and total sum scores were 0.02 (0.13), 6.0 (18.3), and − 0.5 (2.4) in pulmonary rehabilitation, 0.06 (0.13), 6.6 (18.7), − 1.2 (2.4) in community exercise, and 0.13 (0.16), 1.2 (0.9), and − 2.8 (2.8) in physiotherapy, respectively. Based on change of the index score, 24% deteriorated, 38% improved, and 38% had no change in pulmonary rehabilitation; 17% deteriorated, 51% improved, and 32% had no change in community exercise; 5% deteriorated, 72% improved, and 23% had no change in physiotherapy. Similar trends were seen in the VAS and total sum scores. Older age, urban region, and having anxiety/depression at intake were associated with positive change in EQ-5D-5L.

Conclusions

The results of this study are intended to inform program/service level decisions by describing the characteristics and HRQL of patients accessing community rehabilitation, as well as the predictors of change in health status, which will help direct future program growth and service changes.

Background

Community rehabilitation is a person-centred approach that aims to maintain or improve patient functional abilities, prevent and deter illness and disability, and enhance health-related quality of life (HRQL) in an outpatient setting [1, 2]. Recently, there has been growing recognition of the importance of involving the patient perspective in evaluating clinical services in order to improve experience in rehabilitation care and other clinical settings [3, 4]. One method that health systems have adopted to achieve this is through the use of patient-reported outcome measures (PROMs). PROMs are tools used to measure patients’ direct perceptions regarding their health without others’ interpretations [5]. The use of PROMs have various roles in community rehabilitation services such as informing clinical practice, enhancing patient-centred care, supporting health services programming, directing performance measurement, and contributing to quality improvement [6,7,8]. However, routine, standardized use of PROMs has not been extensively adopted or reported in rehabilitation care [9], especially at the program or service level [7].

In the western Canadian province of Alberta, Alberta Health Services (AHS), responsible for province-wide provision of tertiary and community care, implemented a Rehabilitation Model of Care (R-MoC) to promote patient-centred care, provincial standardization, and data-driven service model [10, 11]. As part of the R-MoC, the EQ-5D-5L was adopted as a generic PROM and gradually implemented across community and outpatient rehabilitation services beginning in 2017. The process for selecting the EQ-5D-5L included stakeholder consultations, literature review, population needs assessment, current and future state reports, and a gap analysis [6]. Additionally, AHS had endorsed the EQ-5D-5L as the generic PROM for use in the healthcare system in 2015, and further embedding the ability to capture the EQ-5D-5L and other PROMs in Connect Care, the province-wide electronic patient medical information system [12]. Therefore, the EQ-5D-5L was chosen for use in the R-MoC as it could be embedded within workflows to facilitate patient-centred conversations; act as a quality indicator for programs and services; and inform health system planning and decision making [6]. An early adopter group of 18 sites with diverse service models and locations was identified to pilot the implementation of standardized routine outcome measurement from 2017 to 2018 [6]. In 2018, learnings from the pilot were used to spread and scale the R-MoC to an additional 152 adult community, outpatient rehabilitation sites across Alberta.

Very few studies have examined routinely collected PROMs in the care of rehabilitation patients and there is a significant gap in the literature on how such data can be used to inform local decision-makers on the performance of various programs or services and quality improvement initiatives. The aim of this study was to use routinely collected PROMs data (namely the EQ-5D-5L) to describe the characteristics and HRQL of patients accessing community rehabilitation services in Alberta, Canada, and explore factors associated with the impact of these services.

Methods

Data source

All patients participating in sites that were part of R-MoC implementation and data collection (n = 152 rehabilitation sites) were invited to complete a survey at intake (pre) and at the end (post) of receiving a rehabilitation service as part of routine outcome measurement. Survey content included the EQ-5D-5L, age, gender, and region where rehabilitation services were accessed (urban vs. rural). Included patients were 18 years or older and willing and able to complete the survey. Patients with cognitive impairment were excluded. Depending on the site, surveys were collected by iPad, laptop computer, or paper. All survey responses were stored in a secure electronic platform within the AHS firewall. A total of 2285 rehabilitation patients had data drawn from electronic medical records between December 1, 2018 and April 30, 2021. Only individuals with a complete pre and post EQ-5D-5L were included in the analysis. Records were excluded if they completed a pre and post EQ-5D-5L survey on the same day (n = 107). Of a total of 14 rehabilitation service types, we focused on three that had sufficient samples for analysis: pulmonary rehabilitation, group-based community exercise, and physiotherapy for bone and joint care.

Pulmonary rehabilitation programs provide rehabilitation assessment and treatment services to adults who have a chronic lung condition. The program consists of both group education and supervised exercise sessions to help people manage their lung diseases and improve their health and quality of life. The most common patient diagnosis in this group was chronic obstructive pulmonary disease and clinicians providing the service include respiratory therapists and physiotherapists.

Group-based community exercise programs consisted of a series of group education and supervised exercise sessions led by health professionals for persons with health conditions that impact their mobility and their ability to participate in home, work, or leisure activities. The program includes a variety of group exercise programs offered in a community setting with the aim of assisting participants with health conditions develop skills and confidence in self-directed physical activity in their home or community. The sessions occur over several weeks and include both exercise participation and education on the benefits of exercise. The clinicians involved in this program may include physiotherapists, kinesiologists, and occupational therapists.

Physiotherapy programs for bone and joint care provided treatment for individuals with specific physical concerns to help improve their function, their understanding of their condition, and what they can do to be healthy and independent, including services for general joint or muscle conditions or injuries, recent fractures or orthopedic surgeries, and recent hip or knee replacements. The clinical services were primarily provided by physiotherapists for lower extremity orthopaedic concerns (e.g., rehabilitation after hip or knee surgery or fracture). The goal of physical therapy services was to improve functional status and HRQL with exercise as a common treatment modality.

Measures

The EQ-5D-5L is a generic preference-based measure of HRQL that includes five dimensions (mobility, self-care, usual activities, pain/discomfort, anxiety/depression), each with five levels of problems (1 = none, 2 = mild, 3 = moderate, 4 = severe, 5 = extreme), describing 3125 distinct health states [13, 14]. A preference-based summary score (i.e., an index score) is generated for each health state using a country-specific value set [15]. The Canadian EQ-5D-5L value set was applied to calculate the index score in this study [16]. The EQ-5D-5L also includes a visual analogue scale (VAS), which records the respondent’s self-rated health ‘today’ on a vertical, visual analogue scale, ranging from 0 “worst imaginable health state” to 100 “best imaginable health state” [14]. A total sum score, ranging from 5 to 25, can also be calculated from the EQ-5D-5L data by summing the levels on the five dimensions, whereby 5 represents the best health state (i.e., no problems in all five dimensions, 11111) and 25 represents the worst health state (i.e., severe problems in all five dimensions, 55555). The EQ-5D-5L also exhibits sound evidence of validity and reliability in similar patient populations [17,18,19,20,21,22,23,24]. Other variables collected included age group (18-24, 25-44, 45-64, 65-74, ≥75), gender, and urban vs. rural residence.

Statistical analysis

General characteristics of the sample and changes in EQ-5D-5L from intake until the end of a rehabilitation intervention were examined in the three selected service programs (i.e., community exercise, pulmonary rehabilitation, physiotherapy). Approximate program intervention durations were determined based on the dates of completed pre and post EQ-5D-5L surveys, which may vary slightly than the dates of care delivered. Rehabilitation duration varies by program and individual. Change in the dimensions from intake until the end of rehabilitation was examined using the Pareto Classification of Health Change (PCHC) [25] as follows:

  • Deteriorated: deterioration in the level of problems reported in one or more dimensions from intake to end of rehabilitation, with no improvement in other dimensions

  • No change: level of problems reported (2-5 only) was the same at intake and end of rehabilitation

  • Maintained perfect health: no problems reported (level 1) at intake and end of rehabilitation

  • Improved: improvement in the level of problems reported in one or more dimensions from intake to end of rehabilitation, with no deterioration in other dimensions

The EQ-5D-5L index and VAS change scores (post minus pre) were calculated and assessed using the minimally important difference (MID) [26,27,28] as follows:

EQ-5D-5L index score:

  • Deteriorated: change score ≤ − 0.04

  • No change: − 0.04 < change score < 0.04

  • Maintained perfect health: 0.95 (i.e., health state 11111) at intake and end of rehabilitation

  • Improved: change score ≥ 0.04

VAS Score:

  • Deteriorated: change score ≤ − 7.0

  • No change: − 7.0 < change score < 7.0

  • Maintained perfect health: 100 at intake and end of rehabilitation

  • Improved: change score ≥ 7.0

No MID thresholds are available for the total sum score, as such, a change of one point in the total score was considered important and used to define change groups. Additionally, to assist in the interpretation of change in the EQ-5D-5L index, VAS, and total sum scores from pre to post, the effect size of the change was calculated by dividing the average change score by the standard deviation of the score at baseline. Effect size estimates were considered small (< 0.2), moderate (0.5) or large (> 0.8) [29].

The distribution of EQ-5D-5L levels of each dimension as well as mean (SD) index, VAS, and total sum scores were compared across service programs, participant factors (i.e., age, gender, region), and compared to Alberta general population norms [30]. Bivariate analyses were also conducted to examine the distribution of change in EQ-5D-5L index, VAS, and total sum scores (“deteriorated”, “no change”, “improved”) by age, gender, region, and the EQ-5D-5L anxiety/depression dimension at intake, using chi-squared tests. Region was excluded from bivariate analyses in the physiotherapy program as most of the sample was in one region. Due to limited “maintained perfect health” sample sizes within the index, VAS, and total sum scores, they were included in the “no change” group. The EQ-5D-5L anxiety/depression dimension level data was categorized into absent problems (level 1) and present problems (levels 2-5). A p-value < 0.05 was considered statistically significant. All statistical analyses were conducted in STATA 14.2 (Stata Corp LLC, College Station, Texas, USA).

Results

EQ-5D-5L in Pulmonary Rehabilitation

Among the 542 patients that received pulmonary rehabilitation services, half of the patients (59.2%) were older adults and half (50.9%) were male (Table 1). The primary conditions for presenting to pulmonary rehabilitation were chronic obstructive pulmonary disease (65.5%) or other respiratory condition (28.0%). The approximate duration of intervention (based on EQ-5D-5L measurement) ranged from 28 to 184 days, with a mean (SD) duration of 47.0 days (23.5) and median duration of 31.0 days.

Table 1 Demographics by sample and service area

At intake, the proportion of patients reporting mild to extreme problems (levels 2-5) was 72.5% in mobility, 29.9% in self-care, 77.1% in usual activities, 70.5% in pain/discomfort, and 61.4% in anxiety/depression. The mean (SD) index score was 0.73 (0.17), the mean VAS score was 62.3 (19.4), and the mean total sum score was 10.2 (3.2) (Table 2).

Table 2 EQ-5D-5L dimensions, index, VAS, and total sum scores at intake and end of rehabilitation across the three programs compared to Alberta Norms

By the end of the rehabilitation intervention, there was an 1.3% decrease in the proportion of patients reporting no problems on all EQ-5D-5L dimensions, and the proportion of patients reporting problems in self-care and pain/discomfort increased slightly. Based on PCHC, 9.4% of patients had no change in their health status, 37.1% had an improvement, 23.4% had a deterioration, and 30.1% had a mixed change. By the end of the care intervention, there was an average increase of 0.02 (SD 0.12) in the index score (effect size = 0.1), an increase of 6.0 points (SD 18.3) in the VAS (effect size = 0.31), and a decrease of 0.45 (SD 2.35) in the total sum score (effect size = 0.13). All changes were of small magnitude, and those of the index and VAS scores did not reach MID thresholds.

The largest improvements were observed in usual activities followed by mobility. Less than half of patients improved based on the index (38.4%), VAS (45.8%), and total sum (47.4%) scores; health status either did not change or deteriorated in the other half (Fig. 1a).

Fig. 1
figure 1

Change (%) in EQ-5D-5L dimensions, index, VAS, and total sum scores from intake until end of rehabilitation by program. a Pulmonary Rehabilitation. b Group-based Community Exercise. c Physiotherapy

EQ-5D-5L in Group-based Community Exercise

Among the 463 patients that participated in group-based community exercise services, half of the patients (56.6%) were older adults, and the majority (71.1%) were female (Table 1). The top three primary conditions for presenting to community exercise were chronic pain (22.9%), osteoarthritis or inflammatory arthritis (19.2%), and falls/balance (8.9%). The duration of intervention ranged from 2 to 275 days, with a mean (SD) duration of 103.7 days (51.4) and median duration of 91 days.

At intake, the proportion of patients reporting mild to extreme problems (levels 2-5) was 79.1% in mobility, 33.5% in self-care, 79.3% in usual activities, 89.9% in pain/discomfort, and 59.2% in anxiety/depression. The mean (SD) index score was 0.70 (0.18), the mean VAS score was 65.3 (18.2), and the mean total sum score was 10.8 (3.1) (Table 2).

By the end of rehabilitation intervention, there was a 4.3% increase in the proportion of patients reporting no problems on all EQ-5D-5L dimensions, and the proportion of patients reporting problems on all dimensions decreased. Based on PCHC, 11.0% of patients had no change in their health status, 50.3% had an improvement, 16.9% had a deterioration, and 21.8% had a mixed change. By the end of the intervention, there was an average increase of 0.06 (SD 0.13) in the EQ-5D-5L index score (effect size = 0.3), and an increase of 6.6 points (SD 18.7) in the VAS score (effect size = 0.4), and a decrease of 1.22 (2.39) in the EQ-5D-5L total sum score (effect size =0.4). These changes were of small to moderate magnitude, with only the index score reaching the MID threshold.

The largest improvements were observed in mobility followed by usual activities, and then pain/discomfort. About half of the patients improved based on the index (51.2%), VAS (43.8%), and total sum (58.5%) scores; health status either did not change or deteriorated in the other half of patients (Fig. 1b).

EQ-5D-5L in Physiotherapy

Among the 391 patients that received physiotherapy services, more than half of the patients (64.7%) were middle aged (45-65 years) and over half (60.6%) were female (Table 1). The top three primary conditions for presenting to physiotherapy were orthopaedic surgery (40.2%), musculoskeletal conditions (30.2%), and fracture (17.4%). The duration of intervention ranged from 28 to 397 days, with a mean (SD) duration of 67.3 days (46.0) and median duration of 61 days.

At intake, the proportion of patients reporting mild to extreme problems (levels 2-5) was 67.3% in mobility, 39.9% in self-care, 83.4% in usual activities, 96.2% in pain/discomfort, and 41.4% in anxiety/depression. The mean (SD) index score was 0.71 (0.17), the mean VAS score was 68.3 (18.9), and the mean total sum score was 10.6 (2.9) (Table 2).

By end of rehabilitation, there was a 11.5% increase in the proportion of patients reporting no problems on all EQ-5D-5L dimensions and the proportion of patients reporting problems on all dimensions decreased. Based on PCHC, 5.1% of patients had no change in their health status, 73.2% had an improvement, 5.4% had a deterioration, and 16.4% had a mixed change. By the end of rehabilitation, there was an average increase of 0.13 (SD 0.16) in the EQ-5D-5L index score (effect size = 0.8), an increase of 12.2 points (SD 18.4) in the VAS score (effect size = 0.7) and a decrease of 2.81 (2.79) in the total sum score (effect size =1.0). All changes were of moderate to large magnitude, and those of the index and VAS scores reached MID thresholds.

The largest improvements were observed in usual activities, followed by pain/discomfort and then mobility. Most patients improved based on the index (72.4%), VAS (54.9%), and total sum scores (80.6%) (Fig. 1c).

Rehabilitation patients compared to Alberta general population

In pulmonary rehabilitation and group-based community exercise service programs, self-reported health based on the EQ-5D-5L was much worse than that of the general Alberta population at intake, regardless of the age group (Table 2). Patients receiving these services reported more problems on all EQ-5D-5L dimensions and has lower index and VAS scores. Despite slight improvements by the end of the rehabilitation service, self-reported health remained much lower than that of the general Alberta population (overall and in relevant age groups). Similarly, patients receiving physiotherapy reported more problems on all EQ-5D-5L dimensions at intake and had lower index and VAS scores compared to the general Alberta population. However, physiotherapy patients had larger improvements than pulmonary rehabilitation and community exercise patients in all EQ-5D-5L dimensions, especially in anxiety/depression. Moreover, the average index and VAS scores of physiotherapy patients surpassed the overall and relevant age groups of the general Alberta population norms (Table 2).

Distribution of self-reported health by service program

In the pulmonary rehabilitation program, the distribution across the health status change categories (i.e., “deteriorated”, “no change”, “improved”) based on the VAS was statistically significant with age (Table 3). Of the patients aged 25-44, 68% experienced no change and only 10% improved. A much greater proportion of improvement (42-50%) was seen in the older age groups (p = 0.014). The anxiety/depression dimension at intake was also statistically significant with the health status change categories based on the index (p < 0.001) and total sum scores (p < 0.001). Of the pulmonary rehabilitation patients that reported mild-extreme problems (levels 2-5) on the anxiety/depression dimension at intake, 46 and 55% improved on the index score and total sum score, respectively. Comparatively, patients that reported no problems (level 1) on the anxiety/depression dimension at intake, 48% experienced no change in index scores and 38% experienced a deterioration in total sum score.

Table 3 Change (%) in EQ-5D-5L index, VAS, and total sum scores by age, gender, region, anxiety/depression at intake across programs

In group-based community exercise, the distribution across the total sum score change categories was statistically significant with region and anxiety/depression at intake (Table 3). Of those who lived in urban areas, 65% experienced an improvement on the total sum score, compared to 52% who lived in rural areas (p = 0.009). The anxiety/depression dimension at intake was also statistically significant with change in index (p = 0.002) and total sum scores (p = 0.022). Of the community exercise participants that reported mild-extreme problems on the anxiety/depression dimension at intake, 58 and 64% improved on the index score and total sum scores, respectively. Comparatively, participants that reported no problems on the anxiety/depression dimension at intake, 41 and 51% improved on the index and total sum scores, respectively.

In the physiotherapy program, only the anxiety/depression at intake was statistically significant with change in index (p < 0.001), VAS (p = 0.004), and total sum (p = 0.005) scores (Table 3). Of the physiotherapy patients that reported mild-extreme problems on the anxiety/depression dimension at intake, 83, 63, and 88% improved on the index, VAS, and total sum scores, respectively. Comparatively, participants that reported no problems on the anxiety/depression dimension at intake, 65, 49, and 75% improved on the index, VAS, and total sum scores, respectively (Table 3).

Discussion

In this study, self-reported health based on the EQ-5D-5L was poor at intake, and despite important changes by the end of rehabilitation, health status remained generally lower than that of the general Alberta population [30]. Physiotherapy outcomes were positive with aggregate health status reaching general Alberta norms. Based on EQ-5D-5L index VAS, and total sum scores at end of care, physiotherapy had the highest proportions of patients improve (72, 55, and 81%, respectively) compared to the other service types, whereas pulmonary rehabilitation had the fewest patients improve (38, 46, and 47%, respectively). In each of the examined service types, a significant proportion of patients did not experience important changes in their health status based on the EQ-5D-5L, and some experienced a deterioration. However, for some, maintaining health status (i.e., no change) can be a successful outcome. Nonetheless, examining the reasons for lack of change or deterioration are important to identify those patients and better plan their care and follow-up. Further investigation in these areas could also be useful for decision making for other programs.

Few studies have examined routinely collected PROMs in the care of rehabilitation patients. However, the EQ-5D has been used to evaluate programs in similar clinical settings. Ernstsson et al. described how EQ-5D data is being used in 41 Swedish National Quality Registries of various patient populations (e.g., intervention assessment, health economics, quality indicators), including patients with conditions related to the musculoskeletal and nervous systems [31]. However, this report does not report any EQ-5D data and only provides a description of how EQ-5D results are presented and used at different levels of the Swedish health care system. Devlin et al. reported routinely collected pre- and post-operative PROMs data, including the EQ-5D-3L, from patients undergoing elective hip and cataract operations in the United Kingdom Department of Health, with the aim of demonstrating how EQ-5D data can be analysed and reported for the purposes of hospital performance evaluation [32]. Devlin et al. present the proportion of the sample reporting each of the levels ‘pre’ and ‘post’ on each of the dimensions, the PCHC and a health profile grid of patients’ index scores. A key finding was that many patients did not experience an improvement on EQ-5D scores following cataract surgery and the changes for many that did experience an improvement were small, prompting further investigation on the benefits of cataract surgery within the NHS. Both studies correspond to our study in that they demonstrate how EQ-5D data can be used to assess programs or interventions, and as quality indicators for following up on the quality of care.

Literature suggests that patients with pulmonary disease often experience impaired participation in activities of daily living in such a way that is out of proportion to lung function impairment [33, 34]. Targeted therapies to improve usual activities, mobility, and pain/discomfort may improve HRQL more than therapies that solely intend to improve patients’ lung function [33, 35, 36]. Moreover, based on results from this study, younger patients experienced “no change” in health status in greater proportion compared to older patients who experienced more “improvement”. Therefore, program interventions, based on age, could be explored. Likely, older patients have more severe or acute COPD and therefore have more “room” for improvement whereas younger patients may have higher unmet expectations of rehabilitation (e.g., being able to return to work). Additionally, community exercise program results highlight the need for further investigation as to why metropolitan region participants have better health status outcomes compared to rural regions, such as the differences in resources and services provided in each area.

In all programs, patients with problems with anxiety/depression at intake experienced more improvement in health status by end of care than those without problems. While this finding is the inverse of what we would expect, mental and physical health are highly correlated. Patients with problems in anxiety/depression may have more problems with their physical health and have more “room” for improvement compared to those without problems in anxiety/depression. The improvement of overall health status through rehabilitation intervention may also improve mental health. Several studies have found positive mental health outcomes through rehabilitation interventions [37,38,39]. Incorporating a mental health screen and referral, when appropriate, into the process of care could be considered in an effort to provide multidisciplinary comprehensive care for complex patient needs.

A multi-level framework for the various purposes of routinely collected PROMs in the health system is described by Al Sayah et al. [40] Micro-level use of PROMs data is to inform healthcare providers’ clinical practice and enhance patient engagement (e.g., screening/health monitoring, goal setting); meso-level use of PROMs data are aggregated from a group of patients within an organization and analyzed to monitor health outcomes or evaluate programs/services; macro-level use of PROMs data are aggregated to evaluate the performance of individual or organizational providers at the health system level by comparing health outcomes across jurisdictions/regions [40]. While the EQ-5D-5L can provide many uses for all levels described, all have different challenges. For instance, the EQ-5D-5L may not not provide significant programmatic value in comparison to condition specific PROMs, especially concerning therapeutic areas or aspects of health not captured by the EQ-5D-5L dimensions [6]. The EQ-5D-5L may not be sensitive enough to detect all the effects of rehabilitation services on HRQL. Another consideration is that the data represent just two ‘snapshots’ of patient-reported health status, at intake and end of rehabilitation. Therefore, the extent to which patient health may have deteriorated in the absence of rehabilitation services remains unknown [32]. Moreover, some of the deterioration in health observed between the two periods may be due to worsened general health due to aging or complications of co-morbidities [32]. Other challenges of successful PROMs implementation have been documented in the literature [9, 11, 41, 42]. However, the use of EQ-5D-5L or other PROMs data can illuminate issues for further investigation in improving rehabilitation services.

Our study has strengths, including robust sampling of real-world patients, however, it also has limitations. Foremost, we recognize this design does not provide a rigorous assessment of the effectiveness of community rehabilitation. There may have been a selection bias and non-response bias in the sample. Individuals with cognitive issues were not invited to complete routine PROMs. There could also be a differential loss to follow up of those who only completed an intake survey. The EQ-5D-5L has also not yet been implemented across all Alberta community rehabilitation sites, therefore the sample is not fully representative. Additionally, observed changes in health status may have been affected by reversion to the mean rather than natural progression of disease or condition. Conversely, the generic nature of the EQ-5D-5L may not have been able to capture specific aspects or changes of patients’ conditions. A limitation of our bivariate analyses was that compared to those who reported no problems on the EQ-5D-5L dimensions at intake, those who reported problems had more ‘room’ to change by the end of rehabilitation, therefore, overestimating the effect. And perhaps most importantly, it was not possible to link EQ-5D-5L data to any other patient data, which limited the analysis and interpretation of findings. PROMs are intended to be used alongside other outcome measures and not in isolation of other patient parameters. Similar PROMs explorations in evaluating healthcare services should be accompanied by examining other patient data. Despite these limitations, we hope the reporting of the use of EQ-5D-5L data can inform future developments in the routine use of PROMs in community rehabilitation settings.

Conclusions

Routine collection of PROMs in the AHS Community Rehabilitation Program is intended to inform decisions at various levels within the system. AHS rehabilitation healthcare teams are committed to becoming data informed as they make improvements and inform future program or service changes [6]. Commitment to development of analytical and reporting methods of PROMs is key in health system management, with far reaching implications at all levels of healthcare. The implementation of the EQ-5D-5L as part of routine data collection in community rehabilitation, can increase the quality improvement culture with the clinical teams collecting and analyzing data. The results of this study are meant to inform the meso (i.e., program/service) level by describing the characteristics and health status of patients accessing community rehabilitation, as well as the predictors of change in health status, which will help direct future program growth and service changes.

Availability of data and materials

The data that supports the findings of this study are available from the University of Alberta. Restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the corresponding author upon reasonable request and with permission of the corresponding author.

Abbreviations

AHS:

Alberta Health Services

VAS:

Visual Analogue Scale

HRQL:

health-related quality of life

MID:

minimally important difference

PCHC:

Pareto Classification of Health Change

PROMs:

patient-reported outcome measures

R-MoC:

Rehabilitation Model of Care

References

  1. Aprile I, Di Stasio E, Romitelli F, et al. Effects of rehabilitation on quality of life in patients with chronic stroke. Brain Inj. 2008;22(6):451–6.

    Article  PubMed  Google Scholar 

  2. World Health Organization. Rehabilitation: key for health in the 21st century. 2019; https://www.who.int/disabilities/care/KeyForHealth21stCentury.pdf. Accessed January 24, 2022.

    Google Scholar 

  3. Vahdat S, Hamzehgardeshi L, Hessam S, Hamzehgardeshi Z. Patient involvement in health care decision making: a review. Iran Red Crescent Med J. 2014;16(1):e12454.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bombard Y, Baker GR, Orlando E, et al. Engaging patients to improve quality of care: a systematic review. Implement Sci. 2018;13(1):98.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Weldring T, Smith SM. Article commentary: patient-reported outcomes (pros) and patient-reported outcome measures (PROMs). Health Services Insights. 2013;6 HSI. S11093

  6. Churchill K, Warner L, Keogh E, Al SF. Implementation of EQ-5D-5L as a routine outcome measure in community outpatient and specialized rehabilitation services. J Patient-Rep Outcomes. 2021;5(2):103.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Alberta PROMs and EQ-5D Research and Support Unit (APERSU). Enhancing the Use of Patient-reported Outcome Measures (PROMs) in the Healthcare System in Alberta. 2020; https://apersu.ca/wp-content/uploads/2020/09/APERSU-PROMs-White-Paper.pdf. Accessed January 24, 2022.

    Google Scholar 

  8. Duncan EA, Murray J. The barriers and facilitators to routine outcome measurement by allied health professionals in practice: a systematic review. BMC Health Serv Res. 2012;12(1):1–9.

    Article  Google Scholar 

  9. Briggs MS, Rethman KK, Crookes J, et al. Implementing patient-reported outcome measures in outpatient rehabilitation settings: a systematic review of facilitators and barriers using the consolidated framework for implementation research. Arch Phys Med Rehabil. 2020;101(10):1796–812.

    Article  PubMed  Google Scholar 

  10. Alberta Health Services. Rehabilitation model of care: a discussion guide for clinicians, practice leaders and operational leaders. Edmonton, AB; 2019.

  11. Manhas KP, Olson K, Churchill K, Vohra S, Wasylak T. Experiences of shared decision-making in community rehabilitation: a focused ethnography. BMC Health Serv Res. 2020;20(1):329.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Dean S, Al Sayah F, Johnson JA. Measuring value in healthcare from a patients’ perspective. J Patient-Rep Outcomes. 2021;5(2):88.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. EuroQol Research Foundation. EQ-5D-5L User Guide. 2019.

    Google Scholar 

  15. Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.

    Article  CAS  PubMed  Google Scholar 

  16. Xie F, Pullenayegum E, Gaebel K, et al. A time trade-off-derived value set of the EQ-5D-5L for Canada. Med Care. 2016;54(1):98–105.

    Article  PubMed  Google Scholar 

  17. Nolan CM, Longworth L, Lord J, et al. The EQ-5D-5L health status questionnaire in COPD: validity, responsiveness and minimum important difference. Thorax. 2016;71(6):493–500.

    Article  PubMed  Google Scholar 

  18. Garratt AM, Engen K, Kjeldberg IR, et al. Use of EQ-5D-5L for assessing patient-reported outcomes in a National Register for specialized rehabilitation. Arch Phys Med Rehabil. 2023;

  19. Schweikert B, Hahmann H, Leidl R. Validation of the EuroQol questionnaire in cardiac rehabilitation. Heart. 2006;92(1):62–7.

    Article  CAS  PubMed  Google Scholar 

  20. Tsang HHL, Cheung JPY, Wong CKH, Cheung PWH, Lau CS, Chung HY. Psychometric validation of the EuroQoL 5-dimension (EQ-5D) questionnaire in patients with spondyloarthritis. Arthritis Res Ther. 2019;21(1):41.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chen P, Lin K-C, Liing R-J, Wu C-Y, Chen C-L, Chang K-C. Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation. Qual Life Res. 2016;25(6):1585–96.

    Article  PubMed  Google Scholar 

  22. Lin DY, Cheok TS, Samson AJ, et al. A longitudinal validation of the EQ-5D-5L and EQ-VAS stand-alone component utilising the Oxford hip score in the Australian hip arthroplasty population. J. Patient-Rep Outcomes. 2022;6(1):71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Conner-Spady BL, Marshall DA, Bohm E, et al. Reliability and validity of the EQ-5D-5L compared to the EQ-5D-3L in patients with osteoarthritis referred for hip and knee replacement. Qual Life Res. 2015;24(7):1775–84.

    Article  PubMed  Google Scholar 

  24. Feng Y-S, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647–73.

    Article  PubMed  Google Scholar 

  25. Devlin N, Parkin D, Janssen B. Analysis of EQ-5D profiles. In: Devlin N, Parkin D, Janssen B, editors. Methods for Analysing and reporting EQ-5D data. Cham: Springer International Publishing; 2020. p. 23–49.

    Chapter  Google Scholar 

  26. McClure NS, Sayah FA, Xie F, Luo N, Johnson JA. Instrument-defined estimates of the minimally important difference for EQ-5D-5L index scores. Value Health. 2017;20(4):644–50.

    Article  PubMed  Google Scholar 

  27. Pickard AS, Neary MP, Cella D. Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health Qual Life Outcomes. 2007;5:70.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Conner-Spady BL, Marshall DA, Bohm E, Dunbar MJ, Noseworthy TW. Comparing the validity and responsiveness of the EQ-5D-5L to the Oxford hip and knee scores and SF-12 in osteoarthritis patients 1 year following total joint replacement. Qual Life Res. 2018;27(5):1311–22.

    Article  PubMed  Google Scholar 

  29. Sullivan GM, Feinn R. Using effect size-or why the P value is not enough. J Grad Med Educ. 2012;4(3):279–82.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Alberta PROMs and EQ-5D. Research and support unit (APERSU). Alberta Population Norms for EQ-5D-5L; 2018.

    Google Scholar 

  31. Ernstsson O, Janssen MF, Heintz E. Collection and use of EQ-5D for follow-up, decision-making, and quality improvement in health care - the case of the Swedish National Quality Registries. Journal of Patient-Rep Outcomes. 2020;4(1):78.

    Article  Google Scholar 

  32. Devlin NJ, Parkin D, Browne J. Patient-reported outcome measures in the NHS: new methods for analysing and reporting EQ-5D data. Health Econ. 2010;19(8):886–905.

    Article  PubMed  Google Scholar 

  33. Troosters T, Casaburi R, Gosselink R, Decramer M. Pulmonary rehabilitation in chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 2005;172(1):19–38.

    Article  PubMed  Google Scholar 

  34. Hamilton AL, Killian KJ, Summers E, Jones NL. Symptom intensity and subjective limitation to exercise in patients with cardiorespiratory disorders. Chest. 1996;110(5):1255–63.

    Article  CAS  PubMed  Google Scholar 

  35. Vincken W, van Noord JA, Greefhorst APM, et al. Improved health outcomes in patients with COPD during 1 yr's treatment with tiotropium. Eur Respir J. 2002;19(2):209–16.

    Article  CAS  PubMed  Google Scholar 

  36. Ikeda A, Nishimura K, Koyama H, Tsukino M, Mishima M, Izumi T. Dose response study of ipratropium bromide aerosol on maximum exercise performance in stable patients with chronic obstructive pulmonary disease. Thorax. 1996;51(1):48–53.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Hashemi F, Sadeghi M, Vafaei S, et al. Effect of home-based pulmonary rehabilitation program on anxiety and depression in COVID-19 patients. Med-Surg Nursing J. 2022;11(2):1–8.

    Google Scholar 

  38. Liu K, Zhang W, Yang Y, Zhang J, Li Y, Chen Y. Respiratory rehabilitation in elderly patients with COVID-19: a randomized controlled study. Complement Ther Clin Pract. 2020;39:101166.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Cuesta-Vargas AI, González-Sánchez M. Changes in disability, physical/mental health states and quality of life during an 8-week multimodal physiotherapy programme in patients with chronic non-specific neck pain: a prospective cohort study. PLoS One. 2015;10(2):e0118395.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Al Sayah F, Lahtinen M, Bonsel GJ, Ohinmaa A, Johnson JA. A multi-level approach for the use of routinely collected patient-reported outcome measures (PROMs) data in healthcare systems. J Patient-Rep Outcomes. 2021;5(2):98.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Fleischmann M, Vaughan B. The challenges and opportunities of using patient reported outcome measures (PROMs) in clinical practice. Int J Osteop Med. 2018;28:56–61.

    Article  Google Scholar 

  42. Meerhoff GA, van Dulmen SA, Maas MJM, Heijblom K, Nijhuis-van der Sanden MWG, Van der Wees PJ. Development and evaluation of an implementation strategy for collecting data in a National Registry and the use of patient-reported outcome measures in physical therapist practices: quality improvement study. Phys Ther. 2017;97(8):837–51.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was funded by the EuroQol Research Foundation (Project 20190690).

Author information

Authors and Affiliations

Authors

Contributions

H.S. made substantial contributions to analysis and interpretation of data and wrote the main manuscript text. F.A.S made substantial contributions to conception of study, provided statistical and quantitative methods support, and was involved in revising the manuscript critically for important intellectual content. E.K., K.C., and L.W. made contributions to the conception of the study, provided clinical setting context, and revised the manuscript for intellectual content. A.O. made contributions to the conception of the study and revised the manuscript for intellectual content. J.A.J. was involved in the conception of the study; revised the manuscript critically for important intellectual content; gave final approval of the version to be published; agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Jeffrey A. Johnson.

Ethics declarations

Ethics approval and consent to participate

Ethics approvals for the study were granted from the University of Alberta (Health Research Ethics Board Pro00105374). Consent to participate was not required as this study was a secondary analysis using routinely collected medical care data.

Consent for publication

Not required.

Competing interests

Fatima Al Sayah, Arto Ohinmaa, and Jeffrey Johnson are members of the EuroQol Group. Jeffrey Johnson is also a member of the Board of Directors for the EuroQol Research Foundation. All authors have no other conflicts of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Short, H., Al Sayah, F., Churchill, K. et al. The use of EQ-5D-5L as a patient-reported outcome measure in evaluating community rehabilitation services in Alberta, Canada. Health Qual Life Outcomes 21, 125 (2023). https://doi.org/10.1186/s12955-023-02207-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-023-02207-w

Keywords