Skip to main content

Response rates in clinical quality registries and databases that collect patient reported outcome measures: a scoping review

Abstract

Background

Patient Reported Outcome Measures (PROMs) are being increasingly introduced in clinical registries, providing a personal perspective on the expectations and impact of treatment. The aim of this study was to describe response rates (RR) to PROMs in clinical registries and databases and to examine the trends over time, and how they change with the registry type, region and disease or condition captured.

Methods

We conducted a scoping literature review of MEDLINE and EMBASE databases, in addition to Google Scholar and grey literature. All English studies on clinical registries capturing PROMs at one or more time points were included. Follow up time points were defined as follows: baseline (if available), < 1 year, 1 to < 2 years, 2 to < 5 years, 5 to < 10 years and 10 + years. Registries were grouped according to regions of the world and health conditions. Subgroup analyses were conducted to identify trends in RRs over time. These included calculating average RRs, standard deviation and change in RRs according to total follow up time.

Results

The search strategy yielded 1,767 publications. Combined with 20 reports and four websites, a total of 141 sources were used in the data extraction and analysis process. Following the data extraction, 121 registries capturing PROMs were identified. The overall average RR at baseline started at 71% and decreased to 56% at 10 + year at follow up. The highest average baseline RR of 99% was observed in Asian registries and in registries capturing data on chronic conditions (85%). Overall, the average RR declined as follow up time increased.

Conclusion

A large variation and downward trend in PROMs RRs was observed in most of the registries identified in our review. Formal recommendations are required for consistent collection, follow up and reporting of PROMs data in a registry setting to improve patient care and clinical practice. Further research studies are needed to determine acceptable RRs for PROMs captured in clinical registries.

Introduction

Clinical quality registries systematically monitor quality of healthcare within specific clinical domains by routinely collecting, analysing and reporting health-related information [1,2,3,4]. They use predefined set of indicators designed to assess variation across structural, process and outcome measures to benchmark quality of care. Registries have received increasing attention as a means of improving quality and reducing the cost of health and medical care, through identifying variations in clinical practice and assessing the uptake of effective treatment [4].

Patient reported outcome measures (PROMs) are standardized, validated questionnaires designed to assess patients’ perceptions of their own physical and mental status and wellbeing [5]. PROMs are increasingly being introduced in clinical registries, providing a personal perspective on the expectations and impact of treatment [6]. These instruments can complement the existing roles of registries and databases as platforms for quality assessment and benchmarking, as well as for large-scale research projects [6, 7]. PROMs are seen as useful information to reflect and improve on the clinical work undertaken by clinicians .

Including PROMs in clinical registries offers many advantages [6]. First, incorporating the patient voice ensures that measurement of healthcare outcomes is patient-centred. Second, symptom burden, health related quality of life (HRQoL) and satisfaction with care are essentially lost if not captured in “real time”. Third, capturing of comprehensive PROMs data in a registry setting can inform health service planning, research and evaluation, and facilitate benchmarking of participating health services.

PROMs offer an efficient and feasible way of incorporating the patient voice into healthcare outcome assessments and clinical decision-making. PROMs reporting and use for quality improvement is different for registries with regular patient contact and data collection over many years, compared to those registries capturing PROMs from few interactions. For the optimal utilisation, good quality data and high response rates (RRs) to PROMs are necessary [8]. In contrast to clinical outcomes, patient reported outcomes are self-reported, which inherently leads to concerns about RRs. RRs that reach 100% are hardly ever achieved, especially in routine chronic and advanced care [9, 10]. Although higher RRs have been considered desirable, the representativeness of PROMs samples in clinical registries has been rarely reported [11]. This has important practical implications with efforts required to succeed in implementing new routines and systematic collection of PROMs [12].

A recently conducted review of registry-based and cohort studies revealed a large variation in RRs to PROMs [13]. Although this review identified a large number of registries capturing PROMs, the registries examined were mainly from Scandinavia with the inclusion of only a few other registries from the UK and New Zealand. Further studies are needed to systematically evaluate trends in RRs across Europe, USA and other countries. The aim of the present study was to expand on this previous research and to identify from the existing literature as many as possible available clinical registries and databases with PROMs to describe their RRs and trends over time across various health conditions and world regions.

Methods

Protocol

The Arksey and O’Malley method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA-ScR) procedures guided this review [14, 15]. The protocol was registered on PROSPERO (CRD42022344678).

Information sources

To identify potential studies, a medical librarian searched two main electronic databases MEDLINE and EMBASE in collaboration with the primary author. Grey literature to identify registry websites and annual reports with the information on PROMs data collection and most recent RRs was also included. In addition, a list of Australian registries collecting PROMs was compiled via the website of the Australian Register of Clinical Registries (https://www.safetyandquality.gov.au/publications-and-resources/australian-register-clinical-registries).

Eligibility criteria

Journal articles, annual reports and websites discussing registries or databases that collect PROMs data at one or more follow up time points and reporting PROMs RRs were included. Non-English articles, studies that did not use registry or database data and articles not reporting PROMs were excluded. Publications such as tutorials, letters, editorials, conference materials, periodical indices, personal narratives, practice guidelines or media were also excluded.

Search strategy

The search strategy was adopted from Wang et al. [13] and modified to fit the scope of this study. We used Medical Subject Heading (MeSH) keywords and free text search terms. The database records and details of how the literature search was undertaken was maintained at each stage of the review process. The terms were combined by means of Boolean operators and are listed in Additional file 1. A manual search of grey literature was performed. All searches were performed in August 2022.

Study selection

For each article selected for inclusion, abstracts and full texts were obtained. Reference lists of the included studies and systematic reviews were examined during the initial review.

The titles and abstracts of journal articles were screened by two researchers (CM and MC). Both authors then read the full texts of these articles to assess eligibility for final inclusion. Disagreement between the authors regarding eligibility was resolved by consensus amongst the three authors (CM, MC and RR). The inclusion and exclusion criteria were applied once again, and articles meeting the inclusion criteria progressed to the next stage of the review for data extraction. All screening processes were conducted through Endnote X9.

In the third phase, two independent researchers (CM and MC) extracted data from the eligible studies into a standardized excel spreadsheet. All discrepancies during the review process were resolved and verified by the lead researcher RR [15].

Data management

Relevant data from the included articles were extracted by CM, MC and RR. Data from grey literature such as registry annual reports and registry websites were also extracted by the same researchers during the data extraction phase. Data extracted from the journal articles, reports and websites included: country, registry name, source of information, condition, year registry was established, year registry started collecting PROMs data, number of patients in the registry, PROMs captured, number of reminders sent, RRs at various follow up time points, and any other relevant information. Methods used to calculate RRs were not explicitly stated in most articles, reports and websites, therefore this information was not included. If relevant information could not be located, an email to the registry contact was sent with a request for the missing information.

The extracted data was synthesized according to three steps: (1) analysing the data, (2) reporting the findings, (3) discussing the implications [15].

Data analysis and statistics

PROMs RRs from each registry and database were grouped according to the follow up time points of data collection. Follow up time points were defined as follows - t0: baseline (where available), t1: 0 to 1 year, t2 : 1 to < 2 years, t3 : 2 to < 5 years, t4 : 5 to < 10 years, and t5 : 10 + years. Registries were further grouped into the regions of the world: North and South American, European (excluding Scandinavia), Scandinavian, Oceania (including Australia and New Zealand), Asian and Global (those covering all continents). They were also categorised according to health conditions they captured: Arthroplasty/Reconstruction/joint related procedures, Chronic disease, Cancer, Trauma/Burns/Pain, Spine, Cardiac, Rare disease, Gynaecological, General surgery and device, and Miscellaneous conditions.

Change in RRs was calculated by subtracting the final reported RR from baseline or first reported RR and dividing the difference by the total length of follow up time. Registries that reported RR at a single follow up time were excluded from these calculations.

Results

General description of the literature

The search strategy yielded 1,767 publications (Fig. 1). A further 58 citations including grey literature and websites were identified. After removing duplicates, 1,497 sources remained. Twenty-four internet materials were excluded from the initial article screening process. Titles and abstracts of 1,473 journal articles were screened according to the inclusion criteria. Of those, 306 full text articles were assed for eligibility. The screening of full texts resulted in 117 journal articles. Combined with the 20 reports and 4 websites, a total of 141 sources were used in the data extraction and analysis process.

Fig. 1
figure 1

PRISMA chart

Articles in this review were published between 2008 and 2022. Twelve (8.5%) publications were published in 2022, 31 (21.9%) articles were published in 2021, 28 (19.9%) in 2020, 22 (15.6%) in 2019 and the remaining articles were published between the years 2008 and 2018 (Table 1).

Table 1 Registry characteristics. Follow up point t0 is the reported baseline time point or time of intervention as specified in the article or report. Follow up point t1 is from 0 to 1 year, follow up point t2 is from 1 to < 2 years, follow up point t3 is from 2 to < 5 years, follow up point t4 is from 5 to < 10 years and follow up point t5 is from 10 + years

Following the data extraction, 121 registries were identified and included for evaluation of RRs. Of the 121 registries, 33 (27%) were located in North and South America. Thirty-one (26%) registries originated from Scandinavia and 20 (17%) were based elsewhere in Europe. Twenty-three (19%) registries were located in Australia and New Zealand. The remaining eight (7%) registries were classified as global.

Arthroplasty/Reconstruction/Joint related procedure registries (27%) were most frequently reported in the literature. Cancer registries accounted for 21%, followed by 16%for chronic disease registries.

Twenty-five (21%) registries exclusively collected PROMs electronically (Table 1). Twenty-eight (23%) registries captured PROMs on paper. Forty-seven (39%) registries used a combination method for collecting PROMs, and only three (4%) exclusively phoned their patients to capture PROMs.

Information on PROMs reminders was available for 63 (52%) registries. Twenty-four (20%) registries did not send any reminders, 22 (18%) sent one reminder while 17 (14%) registries sent more than one reminder.

Registries collecting PROMs at various follow up time points

The vast majority (76%) of registries captured PROMs data at baseline (Table 2). In North and South America, baseline PROMs were captured by 27 (82%) registries, followed by 24 (77%) in Scandinavia, 18 (90%) in other European countries and 14 (61%) registries in Oceania. PROMs at < 1 year follow up were captured by 14 (42%) North and South American registries, 13 (42%) Scandinavian and 13 (65%) for both European and Oceania registries. Similarly, 21 (68%) Scandinavian registries, 17 (54%) North and South American registries, 17 (74%) Oceania and 6 (30%) European registries captured PROMs at 1 to < 2 years follow up. These numbers decreased with follow up years.

Table 2 Number and proportion of registries collecting PROMs at various follow up time points stratified by region and condition. Follow up point t0 is the reported baseline time point or time of intervention as specified in the article or report. Follow up point t1 is from 0 to 1 year, follow up point t2 is from 1 to < 2 years, follow up point t3 is from 2 to < 5 years, follow up point t4 is from 5 to < 10 years and follow up point t5 is from 10 + years

When grouping the registries by health conditions, 29 (88%) Arthroplasty/Reconstruction/Joint related procedure registries captured PROMs at baseline followed by 18 (72%) Cancer registries. Eighteen (55%) Arthroplasty/Reconstruction/Joint related procedure registries collected PROMs at < 1 year follow up, followed by 9 (90%) Trauma/Burns/Pain, 8 (32%) Cancer and 8 (42%) Chronic disease registries.

Average PROMs RRs

The overall mean and standard deviation (SD) RR of registries capturing PROMs started at 71% (24.0) at baseline and decreased to 56% (13.2) at 10 + years follow up period (Table 3).

Table 3 Average response rates (in %) with SD for time periods stratified by region, condition, modes and methods of administration and number of reminders sent. Follow up point t0 is the reported baseline time point or time of intervention as specified in the article or report. Follow up point t1 is from 0 to 1 year, follow up point t2 is from 1 to < 2 years, follow up point t3 is from 2 to < 5 years, follow up point t4 is from 5 to < 10 years and follow up point t5 is from 10 + years

Disaggregating this data according to the regions of the world, the average PROMs RR decreased as follow up time period increased in most regions of the world except for the registries based in the North and South Americas, European (non-Scandinavian) registries and global registries. For North and South American registries, the average PROMs RR decreased until the 1 to < 2 years follow up mark, then increased in the subsequent years. The RRs for European and global registries increased and decreased alternatively at each time point. This trend is further illustrated in Fig. 2.

Fig. 2
figure 2

Average PROMs response rates over time according to regions

The highest average baseline RR of 99% was observed in Asian registries. In contrast, the lowest baseline RR of 54% was observed in global registries (Table 3).

When the data were disaggregated according to health conditions, all registries displayed varying trends as follow up years increased. The lowest baseline RR of 35% was reported by General surgery and device registries. Arthroplasty/Reconstruction/Joint related, Cancer and Cardiac registries exhibited a downward trend in RRs after baseline data collection, then increased in RRs at 1 to < 2 years follow up. In contrast, Trauma/Burns/Pain related, Spine and Miscellaneous registries displayed an increasing trend in RRs after baseline, and a decrease in RRs at 1 to < 2 years follow up period. Rare disease and Gynaecological registries exhibited an upward trend in RRs post baseline data collection. These trends are further illustrated in Fig. 3 displaying the average RRs categorized into health conditions.

Fig. 3
figure 3

Average PROMs response rates over time according to health condition

PROMs data were collected for the longest follow up period of 10 + years by the Arthroplasty/Reconstruction/Joint related and Chronic disease registries. Cancer and General surgery and device registries reported PROMs data until the 5 to < 10 years follow up. Rare disease registries captured PROMs for the least amount of time [16,17,18,19,20], with the data being captured for less than a year.

At baseline, registries collecting PROMs on the phone reported the highest RR of 100%. This was followed by paper-based mode of administration (73%) and mixed method administration (71%). Some example include the American Registry for Migraine Research [21], the Expanded Haemodialysis Registry Protocol in Colombia [22] and the Prostate Strategic Urologic Research Endeavor Prostate Cancer Registry [23] which recorded nearly 100% RR at baseline. Registries using combined methods with nearly 100% baseline RR included the New Zealand Anterior Cruciate Ligament (ACL) Registry [24], the Keio inter-hospital Cardiovascular Studies-atrial fibrillation Registry [25] and Swedish Quality Registry for Pain Rehabilitation [26].

Electronic PROMs collection method was the least effective with an average baseline RR of 63% (25.7). Only the Austrian Myeloid Registry [27] and the Outcomes Registry for Better Informed Treatment of Atrial Fibrillation [28] recorded the highest RR at baseline (99% and 94% respectively).

Registries that sent more than one reminder led to a higher RR at baseline of 79% compared to those sending no reminders (63%) or only one reminder (72%) (Table 3). Those with more than one reminder recorded PROMs RR over 98%. Examples include Prostate Cancer Outcomes Registry-Victoria [29] and the New Zealand ACL Registry [13] both obtaining baseline RR over 98%. There was no identifiable trend in RRs in registries that sent more than one, one or no reminders for PROMs as follow up years increased.

Change in RR over time

Figure 4 portrays the change in RR over time according to the total follow up years of PROMs data capture. Of the 121 registries identified in our search, 54 registries captured PROMs only once. Change in RR over time could not be calculated for these registries. Change in RR approached to zero as the total follow up time increased indicating smaller change in RRs for 67 registries as follow up time increased.

Fig. 4
figure 4

Change in PROMs response rates over total follow up time. In this figure the change in response rates and total follow up time point for the Netherlands Cancer Registry was not plotted. This was due to the registry collecting follow up data seven days post treatment, hence once the change in response rates was calculated, the number is a large outlier that goes beyond the scale of the figure

Discussion

This is an up to date scoping review which aimed to describe RRs of PROMs captured in clinical registries and databases at various follow up timepoints. This review has identified 121 registries and databases capturing PROMs over at least one time point. Most of these registries were based in North and South Americas and Scandinavia, and captured PROMs at five different time points for ten or more years.

The overall average baseline RR for the registries included in this study was 71%, similar to that of 75% reported by Wang et al. [13]. As expected, the RR trended down over time, but with a slight increase of RR after ten years of follow up.

The highest baseline RR was observed in Chronic (85%) and Cancer (75%) disease registries. This could possibly occur due to symptom burden and reduced HRQoL in patients suffering from cancer and/or chronic illnesses. In general, chronic diseases are slow in progression, long in duration and also require regular medical monitoring and treatment [30]. Such conditions include stroke, diabetes, bowel disease, renal disease and diseases of the central nervous system and are associated with poor HRQoL. Since the attention is turning to patients with chronic conditions, PROMs can be used to provide patients’ perspective about impacts on their health status based on the choice of drug therapy and care provider. Care for such patients and their HRQoL might be improved if registries monitor PROMs routinely over a longer period of time [31].

Of 121 registries identified in this review, Arthroplasty/Reconstruction/Joint related registries were most common. This is not surprising, as the older population is growing in number and older adults are living longer. With fragility fractures and other fall-related injuries negatively impacting their HRQoL, limiting autonomy and increasing disability, they often require various joint and hip reconstruction procedures [30]. Such registries monitor patients for a long time and therefore, it seems reasonable that they capture PROMs at various follow up time points for more than ten years, with the RR varying from 68% at baseline to mid-50% at ten years post-surgery.

With regard to the number of PROMs reminders, our results reflect conclusions from previous studies confirming that more than one reminder is required to improve RRs [13, 32]. A similar study by Lucas et al. [33] was designed to capture electronic PROMs in prostate cancer patients. A systematic method that included automated email reminders, by which repeat contact was structured within the survey process, resulted in relatively high PROMs RRs at baseline and follow up.

PROMs delivery method and mode of administration need not to be ignored either. Studies have already shown that focusing on digital mechanisms, such as email and SMS, can achieve up to 97% RRs [34]. It also appears that postal mode of PROMs administration seems to perform better than electronic means but it can be more time-consuming and resource-intensive as the data needs to be digitized afterwards [35].

The benefits of PROMs are widely accepted; however, achieving high RRs remains a significant barrier and can be influenced by many different factors. To achieve goals of evaluating treatments and improving patient care, a certain RR to PROMs is necessary [24]. The International Society of Arthroplasty Registries PROMs Working Group proposed a RR of at least 60% [25]. This number is based on what is considered a sufficient RR in survey research [26]. Unfortunately, there is no clear consensus of what RR is acceptable for other registries so far.

Achieving high RRs at multiple follow up data collection points is challenging [24]. A recently published study by Ho et al. [36] assessed predictors of successful PROMs RRs in an orthopaedic outpatient setting at a public tertiary hospital. Being younger, being a new patient, having a longer wait time, being an English-speaker and being a pre- or post-operative patient were all associated with an increased RR of PROMs in this study. A similar study of 205 medical and surgical hospitals evaluated both patient and clinician factors in regards to RR to PROMs [37]. The factors included clinician training for PROMs data collection, administrative oversight, previous experience, presence of a clinician champion and payer incentives. Most of these factors were tied to a better RR. Just about half of all clinics studied yielded a 50% PROMs collection rate or better. Overwhelmingly, a high PROMs RR was linked to having at least 50% of clinicians trained in collecting patient responses and having administrative leaders oversee the whole process. Having prior experience with paper-based PROMs collection was also important [37].

Actions to improve RRs in clinical registries are needed. These may include capturing shorter forms of questionnaires or offering proxy versions for those who are ill or unable to complete the forms themselves [38, 39]. Translated in different languages and culturally-adapted versions of PROMs for non-native speakers should be also considered. PROMs data should be regularly discussed with patients and at consumer forums to encourage more adherence, which can possibly lead to improved RRs and better-quality of the data [40].

Strengths and limitations

In this study, we comprehensively reviewed a large number of clinical registries and databases from all over the world, with comparisons made across different regions and health conditions. To appreciate the findings in this review, the following limitations should be considered. First, we have likely missed several registries and databases despite our comprehensive search strategy, including an internet search in addition to a literature search of main large electronic databases. Second, a few publications and grey literature sources did not provide detailed information on the RRs or follow up time points. This has been noted in the text and tables. Third, some of the RRs in this review were extracted from registry cohort studies and may not reflect the actual RR at particular follow up points.

Conclusions

This review demonstrated large variation and downward trends of RRs to PROMs captured in clinical registries and databases across world regions and various health conditions. We have demonstrated that RRs to PROMs in a registry setting are constantly changing as they can be influenced by many amendable factors. Guidelines and recommendations for PROMs inclusion and capture in clinical registries should be considered prior to determining timing, frequency, mode and method for PROMs administration [6]. To date, there is no clear evidence for acceptable RR to PROMs in clinical registries. Consequently, further studies are warranted to determine reasonable RRs to PROMs while maintaining collection of high-quality clinical and patient outcome data.

Data Availability

Full data extraction table available upon request. Summary of results in Table 1.

Abbreviations

HRQoL:

Health Related Quality of Life

MeSH:

Medical Subject Heading

PRISMA-ScR:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews

PROMs:

Patient Reported Outcome Measures

RR:

Response Rates

SD:

Standard Deviation

References

  1. Ahern S, Evans SM, Hopper I, Earnest A. Clinical quality registries for clinician-level reporting: strengths and limitations. Med J Aust. 2018;208:323.

    Article  PubMed  Google Scholar 

  2. Ahern S, Ruseckaite R, Ackerman IN. Collecting patient-reported outcome measures. Intern Med J. 2017;47:1454–7.

    Article  PubMed  Google Scholar 

  3. Wilcox N, McNeil JJ. Clinical quality registries have the potential to drive improvements in the appropriateness of care. Med J Aust. 2016;205:27–S29.

    Article  Google Scholar 

  4. Gliklich RE, Dreyer NA. M L: Registries for Evaluating Patient Outcomes: A User’s Guide. 3rd edition. Agency for Healthcare Research and Quality 2014, 13.

  5. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    Article  PubMed  Google Scholar 

  6. Ruseckaite R, Maharaj AD, Dean J, Krysinska K, Ackerman IN, Brennan AL, Busija L, Carter H, Earnest A, Forrest CB, et al. Preliminary development of recommendations for the inclusion of patient-reported outcome measures in clinical quality registries. BMC Health Serv Res. 2022;22:276.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Blood Z, Tran A, Caleo L, Saw R, Dieng M, Shackleton M, Soyer HP, Arnold C, Mann GJ, Morton RL. Implementation of patient-reported outcome measures and patient-reported experience measures in melanoma clinical quality registries: a systematic review. BMJ Open. 2021;11:e040751.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Pronk Y, van der Weegen W, Vos R, Brinkman JM, van Heerwaarden RJ, Pilot P. What is the minimum response rate on patient-reported outcome measures needed to adequately evaluate total hip arthroplasties? Health Qual Life Outcomes. 2020;18:379.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Nimmo A, Bell S, Brunton C, Campbell J, Doyle A, MacKinnon B, Peel RK, Robertson S, Shilliday I, Spalding E, et al. Collection and determinants of patient reported outcome measures in haemodialysis patients in Scotland. QJM. 2018;111:15–21.

    Article  CAS  PubMed  Google Scholar 

  10. Pagels AA, Stendahl M, Evans M. Patient-reported outcome measures as a new application in the Swedish Renal Registry: health-related quality of life through RAND-36. Clin Kidney J. 2020;13:442–9.

    PubMed  Google Scholar 

  11. Harris IA, Cashman K, Lorimer M, Peng Y, Ackerman I, Heath E, Graves SE. Are responders to patient health surveys representative of those invited to participate? An analysis of the patient-reported outcome measures pilot from the australian Orthopaedic Association National Joint replacement Registry. PLoS ONE. 2021;16:e0254196.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Gjelsvik YM, Johannesen TB, Ursin G, Myklebust T. A nationwide, prospective collection of patient reported outcomes in the Cancer Registry of Norway. Norsk Epidemiologi 2022, 30(1–2).

  13. Wang K, Eftang CN, Jakobsen RB, Aroen A. Review of response rates over time in registry-based studies using patient-reported outcome measures. BMJ Open. 2020;10:e030808.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L, et al. PRISMA Extension for scoping reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169:467–73.

    Article  PubMed  Google Scholar 

  15. Arksey H, L OM. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.

    Article  Google Scholar 

  16. Tosi LL, Floor MK, Dollar CM, Gillies AP, Lee B, Nagamani SCS, Rauch F, Glorieux F, Retrouvey JM, Esposito P et al. Assessing disease experience across the life span for individuals with osteogenesis imperfecta: Challenges and opportunities for patient-reported outcomes (PROs) measurement: a pilot study. Orphanet J Rare Dis 2019, 14(1) (no pagination).

  17. Johnson NE, Heatwole C, Creigh P, McDermott MP, Dilek N, Hung M, Bounsanga J, Tang W, Shy ME, Herrmann DN. The Charcot-Marie-Tooth Health Index: evaluation of a patient-reported outcome. Ann Neurol. 2018;84:225–33.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Eng VA, Solis DC, Gorell ES, Choi S, Nazaroff J, Li S, de Souza MP, Murrell DF, Marinkovich MP, Tang JY. Patient-reported outcomes and quality of life in recessive dystrophic epidermolysis bullosa: a global cross-sectional survey. J Am Acad Dermatol. 2021;85:1161–7.

    Article  PubMed  Google Scholar 

  19. Moris G, Wood L, FernaNdez-Torron R, Gonzalez Coraspe JA, Turner C, Hilton-Jones D, Norwood F, Willis T, Parton M, Rogers M, et al. Chronic pain has a strong impact on quality of life in facioscapulohumeral muscular dystrophy. Muscle Nerve. 2018;57(3):380–7.

    Article  PubMed  Google Scholar 

  20. Seefried L, Dahir K, Petryk A, Hogler W, Linglart A, Martos-Moreno GA, Ozono K, Fang S, Rockman-Greenberg C, Kishnani PS. Burden of illness in adults with hypophosphatasia: data from the Global Hypophosphatasia Patient Registry. J Bone Miner Res. 2020;35(11):2171–8.

    Article  CAS  PubMed  Google Scholar 

  21. Pearl TA, Dumkrieger G, Chong CD, Dodick DW, Schwedt TJ. Impact of depression and anxiety symptoms on patient-reported outcomes in patients with migraine: results from the American Registry for Migraine Research (ARMR). Headache. 2020;60:1910–9.

    Article  PubMed  Google Scholar 

  22. Alarcon JC, Bunch A, Ardila F, Zuniga E, Vesga JI, Rivera A, Sanchez R, Sanabria RM. Colombian Registry of expanded hemodialysis I: impact of medium cut-off dialyzers on patient-reported outcomes: COREXH Registry. Blood Purif. 2021;50:110–8.

    Article  PubMed  Google Scholar 

  23. Hoffman KE, Penson DF, Zhao Z, Huang LC, Conwill R, Laviana AA, Joyce DD, Luckenbaugh AN, Goodman M, Hamilton AS, et al. Patient-reported outcomes through 5 years for active surveillance, surgery, Brachytherapy, or External Beam Radiation with or without androgen deprivation therapy for localized prostate Cancer. JAMA. 2020;323:149–63.

    Article  PubMed  PubMed Central  Google Scholar 

  24. New Zealand ACL Registry. Annual Report. https://www.aclregistry.nz/reports/. 2021.

  25. Ikemura N, Spertus JA, Kimura T, Mahaffey K, Piccini JP, Inohara T, Ueda I, Tanimoto K, Suzuki M, Nakamura I, et al. Cohort profile: patient characteristics and quality-of-life measurements for newly-referred patients with atrial fibrillation-Keio interhospital Cardiovascular Studies-atrial fibrillation (KiCS-AF). BMJ Open. 2019;9:e032746.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Kallman TF, Backryd E. Prevalence of analgesic use in patients with chronic pain referred to a multidisciplinary pain centre and its correlation with patient-reported outcome measures: a cross-sectional, registry-based study. J Rehabil Med. 2020;52:jrm00126.

    Article  PubMed  Google Scholar 

  27. Sztankay M, Neppl L, Wintner LM, Loth FL, Willenbacher W, Weger R, Weyrer W, Steurer M, Rumpold G, Holzner B. Complementing clinical cancer registry data with patient reported outcomes: a feasibility study on routine electronic patient-reported outcome assessment for the Austrian Myelome Registry. Eur J Cancer Care. 2019;28:e13154.

    Article  Google Scholar 

  28. Piccini JP, Fraulo ES, Ansell JE, Fonarow GC, Gersh BJ, Go AS, Hylek EM, Kowey PR, Mahaffey KW, Thomas LE, et al. Outcomes registry for better informed treatment of atrial fibrillation: rationale and design of ORBIT-AF. Am Heart J. 2011;162:606–612e601.

    Article  PubMed  Google Scholar 

  29. Rechtman M, Forbes A, Millar JL, Evans M, Dodds L, Murphy DG, Evans SM. Comparison of urinary and sexual patient-reported outcomes between open radical prostatectomy and robot-assisted radical prostatectomy: a propensity score matched, population-based study in Victoria. BMC Urol. 2022;22:18.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Megari K. Quality of life in Chronic Disease Patients. Health Psychol Res. 2013;1:e27.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Rodrigues D, Street A, Santos MJ, Rodrigues AM, Marques-Gomes J, Canhão H. Using Patient-Reported Outcome Measures to Evaluate Care for Patients With Inflammatory Chronic Rheumatic Disease. Value Health 2022.

  32. Sebrow D, Lavery HJ, Brajtbord JS, Hobbs A, Levinson AW, Samadi DB. Monitoring validated quality of life outcomes after prostatectomy: initial description of novel online questionnaire. Urology. 2012;79:314–9.

    Article  PubMed  Google Scholar 

  33. Lucas SM, Kim TK, Ghani KR, Miller DC, Linsell S, Starr J, Peabody JO, Hurley P, Montie J, Cher ML. Establishment of a web-based System for Collection of patient-reported Outcomes after Radical Prostatectomy in a Statewide Quality Improvement Collaborative. Urology. 2017;107:96–102.

    Article  PubMed  Google Scholar 

  34. Nielsen LK, King M, Möller S, Jarden M, Andersen CL, Frederiksen H, Gregersen H, Klostergaard A, Steffensen MS, Pedersen PT, et al. Strategies to improve patient-reported outcome completion rates in longitudinal studies. Qual Life Res. 2020;29:335–46.

    Article  PubMed  Google Scholar 

  35. Neve OM, van Benthem PPG, Stiggelbout AM, Hensen EF. Response rate of patient reported outcomes: the delivery method matters. BMC Med Res Methodol. 2021;21:220.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Ho A, Purdie C, Tirosh O, Tran P. Improving the response rate of patient-reported outcome measures in an australian tertiary metropolitan hospital. Patient Relat Outcome Meas. 2019;10:217–26.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Clinician Engagement Key for Collecting Patient-Reported Outcomes., https://patientengagementhit.com/news/clinician-engagement-key-for-collecting-patient-reported-outcomes

  38. Nguyen H, Butow P, Dhillon H, Sundaresan P. A review of the barriers to using patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs) in routine cancer care. J Med Radiat Sci. 2021;68:186–95.

    Article  PubMed  Google Scholar 

  39. Coste J, Quinquis L, Audureau E, Pouchot J. Non response, incomplete and inconsistent responses to self-administered health-related quality of life measures in the general population: patterns, determinants and impact on the validity of estimates - a population-based study in France using the MOS SF-36. Health Qual Life Outcomes. 2013;11:44.

    Article  PubMed  PubMed Central  Google Scholar 

  40. KÖhn S, Schlumbohm A, Marquardt M, Scheel-Sailer A, Tobler S, Vontobel J, Menzi L. Predicting non-response in patient-reported outcome measures: results from the swiss quality assurance programme in cardiac inpatient rehabilitation. Int J Qual Health Care 2022, 34.

  41. Australian Orthopaedic Association National Joint Replacement Registry (AOANJRR). Hip, Knee & Shoulder Arthroplasty: 2021 Annual Report, Adelaide; AOA., 2021: 1-432. https://aoanjrr.sahmri.com/annual-reports-221. 2021.

  42. Heo SM, Naylor JM, Harris IA, Churches TR. Reliability of patient-reported complications following hip or knee arthroplasty procedures. BMC Med Res Methodol. 2019;19:15.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Churches TNJ, Harris IA. Arthroplasty Clinical Outcomes Registry National (ACORN). Annual Final Report (2013–2018). Sydney: Whitlam Orthopaedic Research Centre; 2019. https://acornregistry.org/images/ACORN%20Final%20Report.pdf. 2018.

  44. Rolfson O, Rothwell A, Sedrakyan A, Chenok KE, Bohm E, Bozic KJ, Garellick G. Use of patient-reported outcomes in the context of different levels of data. J Bone Joint Surg - Am Volume. 2011;93(Suppl 3):66–71.

    Article  Google Scholar 

  45. Victorian Orthopaedic Trauma Outcomes Registry (VOTOR). 2020–2021. Annual Report. https://www.monash.edu/__data/assets/pdf_file/0005/3122087/VOTOR-annual-report_WEB2020-21.pdf. 2020–2021.

  46. Australian and New Zealand Hip Fracture Registry (ANZFHR). 2022 Annual Report. https://anzhfr.org/registry-reports/#:~:text=ANZHFR%20Annual%20Report%202022,on%2015%2C331%20patient%20care%20episodes.; 2022.

  47. Scholes C, Eng K, Harrison-Brown M, Ebrahimi M, Brown G, Gill S, Page R. Patient Registry of Upper Limb Outcomes (PRULO) a protocol for an orthopaedic clinical quality registry to monitor treatment outcomes. medRxiv 2023:2023.2002.2001.23284494.

  48. Galea VP, Ingelsrud LH, Florissi I, Shin D, Bragdon CR, Malchau H, Gromov K, Troelsen A. Patient-acceptable symptom state for the Oxford hip score and forgotten joint score at 3 months, 1 year, and 2 years following total hip arthroplasty: a registry-based study of 597 cases. Acta Orthop. 2020;91:372–7.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Mechlenburg I, Rasmussen S, Unbehaun D, Amundsen A, Rasmussen JV. Patients undergoing shoulder arthroplasty for failed nonoperative treatment of proximal humerus fracture have low implant survival and low patient-reported outcomes: 837 cases from the danish shoulder Arthroplasty Registry. Acta Orthop. 2020;91:319–25.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Rolfson O, Eresian Chenok K, Bohm E, Lubbeke A, Denissen G, Dunn J, Lyman S, Franklin P, Dunbar M, Overgaard S, et al. Patient-reported outcome measures in arthroplasty registries: report of the patient-reported outcome measures Working Group of the International Society of Arthroplasty Registries: Part I. overview and rationale for patient-reported outcome measures. Acta Orthop. 2016;87(Supplement 1):3–8.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Most J, Hoelen TCA, Spekenbrink-Spooren A, Schotanus MGM, Boonen B. Defining clinically meaningful thresholds for patient-reported outcomes in knee arthroplasty. J Arthroplasty 2022.

  52. The New Zealand Joint Registry., 22 Year Annual Report 1999–2020. https://www.nzoa.org.nz/sites/default/files/NZJR_22_Year_Report_Final.pdf. 2021.

  53. Norwegian Arthroplasty Register. Annual Report. 2022. https://helse-bergen.no/nasjonal-kompetansetjeneste-for-leddproteser-og-hoftebrudd/norwegian-national-advisory-unit-on-arthroplasty-and-hip-fractures

  54. Bartels S, Gjertsen JE, Frihagen F, Rogmark C, Utvag SE. High failure rate after internal fixation and beneficial outcome after arthroplasty in treatment of displaced femoral neck fractures in patients between 55 and 70 years: an observational study of 2,713 patients reported to the norwegian hip fracture Register. Acta Orthop. 2018;89(1):53–8.

    Article  PubMed  Google Scholar 

  55. Kristensen TB, Vinje T, Havelin LI, Engesaeter LB, Gjertsen JE. Posterior approach compared to direct lateral approach resulted in better patient-reported outcome after hemiarthroplasty for femoral neck fracture. Acta Orthop. 2017;88:29–34.

    Article  PubMed  Google Scholar 

  56. Gjertsen JE, Engesaeter LB, Furnes O, Havelin LI, Steindal K, Vinje T, Fevang JM. The norwegian hip fracture Register: experiences after the first 2 years and 15,576 reported operations. Acta Orthop. 2008;79:583–93.

    Article  PubMed  Google Scholar 

  57. Helse Bergen HF, DoOS. Haukeland University Hospital: Norwegian Arthroplasty Register, Norwegian Cruciate Ligament Register, Norwegian Hip Fracture Register, Norwegian Paediatric Hip Register. 2021.

  58. Ulstein S, Aroen A, Engebretsen L, Forssblad M, Lygre SHL, Rotterud JH. Effect of concomitant cartilage lesions on patient-reported Outcomes after Anterior Cruciate Ligament Reconstruction: a Nationwide Cohort Study from Norway and Sweden of 8470 patients with 5-Year follow-up. Orthop J Sports Med 2018, 6.

  59. Goh GS, Khow YZ, Tay DK, Lo NN, Yeo SJ, Liow MHL. Preoperative Mental Health Influences patient-reported outcome measures and satisfaction after revision total knee arthroplasty. J Arthroplasty. 2021;36:2878–86.

    Article  PubMed  Google Scholar 

  60. The Swedish Arthroplasty Register., Annual Report 2021. https://registercentrum.blob.core.windows.net/slr/r/SAR-Annual-Report-2021-SJlAFmlRl5.pdf

  61. The Swedish Knee Ligament Registry. : Annual Report 2019. https://www.aclregister.nu/media/uploads/Annual%20reports/a%CC%8Arsrapport_korsband_2019_eng_040720.pdf

  62. Coster ME, Montgomery F, Coster MC. Patient-reported outcomes of joint-preserving surgery for moderate hallux rigidus: a 1-year follow-up of 296 patients from Swefoot. Acta Orthop. 2020;92(1):109–13.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Joelson A, Nerelius F, Holy M, Sigmundsson FG. Reoperations after decompression with or without fusion for L4–5 spinal stenosis with or without degenerative spondylolisthesis: a study of 6,532 patients in Swespine, the national swedish spine register. Acta Orthop. 2021;92:264–8.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Kamrad I, Carlsson A, Henricson A, Magnusson H, Karlsson MK, Rosengren BE. Good outcome scores and high satisfaction rate after primary total ankle replacement. Acta Orthop. 2017;88:675–80.

    Article  PubMed  PubMed Central  Google Scholar 

  65. The Geneva Hip Arthroplasty Registry Annual Report. 2009. http://www.rpa.spot.pt/getdoc/0071e52c-7cdf-4d4e-86f7-5266c8b15bfb/The-Geneva-Hip-Arthroplasty-Registry_E-BOOK_Table-.aspx#:~:text=The%20Geneva%20hip%20arthroplasty%20registry%20has%20prospectively%20enrolled%20all%20primary,visit%20at%205%2Dyear%20intervals.

  66. Maempel JF, Ting JZ, Gaston P. Assessing the outcome of Hip Arthroscopy for Labral tears in Femoroacetabular Impingement using the Minimum dataset of the british non-arthroplasty hip Register: a single-surgeon experience. Arthroscopy. 2018;34:2131–9.

    Article  PubMed  Google Scholar 

  67. Non-Arthroplasty. Hip Register 7th Annual Report. 2022. https://www.nahr.co.uk/

  68. National Joint Registry UK. 2022. https://www.njrcentre.org.uk/

  69. National Ligament Registry UK. 2022. https://www.uknlr.co.uk

  70. Patel J, Lee JH, Li Z, SooHoo NF, Bozic K, Huddleston JI. 3rd: predictors of low patient-reported Outcomes Response Rates in the California Joint replacement Registry. J Arthroplasty. 2015;30:2071–5.

    Article  PubMed  Google Scholar 

  71. Randsborg PH, Cepeda N, Adamec D, Rodeo SA, Ranawat A, Pearle AD. Patient-reported outcome, return to Sport, and Revision Rates 7–9 years after Anterior Cruciate Ligament Reconstruction: results from a cohort of 2042 patients. Am J Sports Med. 2022;50:423–32.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Lyman S, Lee YY, McLawhorn AS, Islam W, MacLean CH. What are the minimal and substantial improvements in the HOOS and KOOS and JR Versions after total joint replacement? Clin Orthop Relat Res. 2018;476:2432–41.

    Article  PubMed  PubMed Central  Google Scholar 

  73. American Joint Replacement Registry Annual Report. 2021. https://connect.registryapps.net/hubfs/PDFs%20and%20PPTs/AJRR%202021%20Annual%20Report.pdf?hsCtaTracking=5d4716a7-fade-455e-a961-c13f715c1a72%7Cdc53c91e-d26e-49a0-ab86-0f3a6d4ec561.

  74. Prostate Cancer Outcomes Registry Australia and New Zealand. Annual Report 2020. PCOR-ANZ 2015–2018: Patterns of care, patient reported outcome and selected treatment analyses. https://prostatecancerregistry-org.s3.amazonaws.com/pcor_cms/media/filer_public/ce/9c/ce9cd8eb-2cb0-4be9-8473-4087b277fb1e/pcor-anz_2020_annual_report_final.pdf

  75. Ettridge K, Wright K, Smith D, Chambers S, Corsini N, Evans S, Moretti K, Roder D, Scuffham P, Miller C. Measuring psychosocial outcomes of men living with prostate cancer: feasibility of regular assessment of patient-reported outcomes. Eur J Cancer Care. 2021;30:e13393.

    Article  Google Scholar 

  76. Skandarajah AR, Lisy K, Ward A, Bishop J, Lacey K, Mann B, Jefford M. Patient-reported outcomes in survivors of breast cancer one, three, and five years post-diagnosis: a cancer registry-based feasibility study. Qual Life Res. 2021;30(2):385–94.

    Article  PubMed  Google Scholar 

  77. Vasquez C, Kolinsky M, Djebah R, Uhlich M, Donnelly B, Fairey AS, Hyndman E, Usmani N, Wu J, Venner P, et al. Cohort profile: the Alberta prostate Cancer Research Initiative (APCaRI) Registry and Biorepository facilitates technology translation to the clinic through the use of linked, longitudinal clinical and patient-reported data and biospecimens from men in Alberta, Canada. BMJ Open. 2020;10:e037222.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Joachim C, Veronique-Baudin J, Almont T, Ulric-Gervaise S, Macni J, Pierre-Louis O, Godaert L, Drame M, Novella JL, Farid K, et al. Cohort profile: the Martinique Cancer Registry and the quality of life prostate cancer cohort (QoL Prostate-MQ): challenges and prospects for reducing disparities in the Caribbean. BMJ Open. 2018;8:e021540.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Rose M, Svensson H, Handler J, Hoyer U, Ringberg A, Manjer J. Patient-reported outcome after oncoplastic breast surgery compared with conventional breast-conserving surgery in breast cancer. Breast Cancer Research & Treatment. 2020;180:247–56.

    Article  Google Scholar 

  80. Bronserud MM, Iachina M, Green A, Groenvold M, Dorflinger L, Jakobsen E. Patient-reported outcomes (PROs) in lung cancer: experiences from a nationwide feasibility study. Lung Cancer. 2019;128:67–73.

    Article  PubMed  Google Scholar 

  81. Nguyen-Nielsen M, Høyer S, Friis S, Hansen S, Brasso K, Jakobsen EB, Moe M, Larsson H, Søgaard M, Nakano A, Borre M. The danish prostate Cancer Database. Clin Epidemiol. 2016;6:649–53.

    Article  Google Scholar 

  82. Wallwiener M, Heindl F, Brucker SY, Taran FA, Hartkopf A, Overkamp F, Kolberg HC, Hadji P, Tesch H, Ettl J, et al. Implementation and feasibility of electronic patient-reported outcome (ePRO) data entry in the PRAEGNANT Real-Time Advanced and metastatic breast Cancer Registry. Geburtshilfe Frauenheilkd. 2017;77(8):870–8.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Lovegrove CE, Peters M, Guillaumier S, Arya M, Afzal N, Dudderidge T, Hosking-Jervis F, Hindley RG, Lewi H, McCartan N, et al. Evaluation of functional outcomes after a second focal high-intensity focused ultrasonography (HIFU) procedure in men with primary localized, non-metastatic prostate cancer: results from the HIFU evaluation and Assessment of Treatment (HEAT) registry. BJU Int. 2020;125:853–60.

    Article  CAS  PubMed  Google Scholar 

  84. Gupta A, Khalid O, Moravek C, Lamkin A, Matrisian LM, Doss S, Denlinger CS, Coveler AL, Weekes CD, Roeland EJ, et al. Leveraging patient-reported outcomes (PROs) in patients with pancreatic cancer: the pancreatic Cancer Action Network (PanCAN) online patient registry experience. Cancer Med. 2021;10:7152–61.

    Article  PubMed  PubMed Central  Google Scholar 

  85. van Kleef JJ, Dijksterhuis WPM, van den Boorn HG, Prins M, Verhoeven RHA, Gisbertz SS, Slingerland M, Mohammad NH, Creemers GJ, Neelis KJ, et al. Prognostic value of patient-reported quality of life for survival in oesophagogastric cancer: analysis from the population-based POCOP study. Gastric Cancer. 2021;24:1203–12.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Ramsey I, de Rooij BH, Mols F, Corsini N, Horevoorts NJE, Eckert M, van de Poll-Franse LV. Cancer survivors who fully participate in the PROFILES registry have better health-related quality of life than those who drop out. J Cancer Surviv. 2019;13:829–39.

    Article  PubMed  PubMed Central  Google Scholar 

  87. Christiansen O, Bratt O, Haug ES, Vaktskjold A, Selnes A, Jordhoy M. TECLA-an innovative technical approach for prostate cancer registries. Scandinavian J Urol. 2019;53:229–34.

    Article  Google Scholar 

  88. Amit M, Hutcheson K, Zaveri J, Lewin J, Kupferman ME, Hessel AC, Goepfert RP, Brandon Gunn G, Garden AS, Ferraratto R, et al. Patient-reported outcomes of symptom burden in patients receiving surgical or nonsurgical treatment for low-intermediate risk oropharyngeal squamous cell carcinoma: a comparative analysis of a prospective registry. Oral Oncol. 2019;91:13–20.

    Article  PubMed  Google Scholar 

  89. Barker AL, Peeters G, Morello RT, Norman R, Ayton D, Lefkovits J, Brennan A, Evans SM, Zalcberg J, Reid C, et al. Symptoms and feelings valued by patients after a percutaneous coronary intervention: a discrete-choice experiment to inform development of a new patient-reported outcome. BMJ Open. 2018;8:e023141.

    Article  PubMed  PubMed Central  Google Scholar 

  90. A/Prof Jeffrey Lefkovits MAB. Dr Diem Dinh, Ms Harriet Carruthers, Mrs Janine Doyle, Mrs, Philippa Scanlon MMLaPCMRobotV: The Victorian Cardiac Outcomes Registry Annual Report 2020. Monash University, SPHPM August 2021, Report No 8, pages 88.; 2020.

  91. Steinberg BA, Holmes DN, Pieper K, Allen LA, Chan PS, Ezekowitz MD, Freeman JV, Fonarow GC, Gersh BJ, Hylek EM et al. Factors Associated with Large Improvements in Health-Related Quality of Life in Patients with Atrial Fibrillation: Results from ORBIT-AF. Circulation: Arrhythmia and Electrophysiology 2020, 13.

  92. Bradley CK, Wang TY, Li S, Robinson JG, Roger VL, Goldberg AC, Virani SS, Louie MJ, Lee LV, Peterson ED, Navar AM. Patient-reported reasons for declining or discontinuing statin therapy: insights from the PALM Registry. J Am Heart Association. 2019;8:e011765.

    Article  Google Scholar 

  93. Arnold SV, Manandhar P, Vemulapalli S, Vekstein AM, Kosinski AS, Spertus JA, Cohen DJ. Patient-reported vs. physician-estimated symptoms before and after transcatheter aortic valve replacement. Eur Heart J Qual Care Clin Outcomes. 2022;8:161–8.

    Article  PubMed  Google Scholar 

  94. Victorian Ambulance Cardiac Arrest Registry (VACAR). Annual Report. 2020–2021. https://www.ambulance.vic.gov.au/wp-content/uploads/2022/10/VACAR-Annual-Report-2020-21.pdf. 2020–2021.

  95. Apfelbacher CJ, Ofenloch RF, Weisshaar E, Molin S, Bauer A, Mahler V, Heinrich A, von Kiedrowski R, Schmitt J, Elsner P, Diepgen TL. Chronic hand eczema in Germany: 5-year follow-up data from the CARPE registry. Contact Dermat. 2019;80(1):45–53.

    Article  Google Scholar 

  96. Kreuter M, Swigris J, Pittrow D, Geier S, Klotsche J, Prasse A, Wirtz H, Koschel D, Andreas S, Claussen M, et al. Health related quality of life in patients with idiopathic pulmonary fibrosis in clinical practice: insights-IPF registry. Respir Res. 2017;18:139.

    Article  PubMed  PubMed Central  Google Scholar 

  97. Younossi ZM, Yilmaz Y, Yu ML, Wai-Sun Wong V, Fernandez MC, Isakov VA, Duseja AK, Mendez-Sanchez N, Eguchi Y, Bugianesi E, et al. Clinical and patient-reported outcomes from patients with nonalcoholic fatty liver Disease across the World: Data from the global non-alcoholic steatohepatitis (NASH)/ non-alcoholic fatty liver Disease (NAFLD) Registry. Clinical Gastroenterology and Hepatology; 2021.

  98. Hardy T, Wonders K, Younes R, Aithal GP, Aller R, Allison M, Bedossa P, Betsou F, Boursier J, Brosnan MJ, et al. The european NAFLD Registry: a real-world longitudinal cohort study of nonalcoholic fatty liver disease. Contemp Clin Trials. 2020;98:106175.

    Article  PubMed  Google Scholar 

  99. Ahmed Ali U, Issa Y, van Goor H, van Eijck CH, Nieuwenhuijs VB, Keulemans Y, Fockens P, Busch OR, Drenth JP, Dejong CH, et al. Dutch Chronic Pancreatitis Registry (CARE): design and rationale of a nationwide prospective evaluation and follow-up. Pancreatology. 2015;15:46–52.

    Article  CAS  PubMed  Google Scholar 

  100. Verket NJ, Uhlig T, Sandvik L, Andersen MH, Tanbo TG, Qvigstad E. Health-related quality of life in women with endometriosis, compared with the general population and women with rheumatoid arthritis. Acta Obstet Gynecol Scand. 2018;97(11):1339–48.

    Article  PubMed  Google Scholar 

  101. Mellgren A, Eriksson LE, Reinius M, Marrone G, Svedhem V. Longitudinal trends and determinants of patient-reported side effects on ART-a swedish national registry study. PLoS ONE [Electronic Resource]. 2020;15:e0242710.

    Article  CAS  PubMed  Google Scholar 

  102. Svedbo Engstrom M, Leksell J, Johansson UB, Eeg-Olofsson K, Borg S, Palaszewski B, Gudbjornsdottir S. A disease-specific questionnaire for measuring patient-reported outcomes and experiences in the Swedish National Diabetes Register: development and evaluation of content validity, face validity, and test-retest reliability. Patient Educ Couns. 2018;101:139–46.

    Article  PubMed  Google Scholar 

  103. Heijke R, Bjork M, Frodlund M, McDonald L, Alemao E, Sjowall C. Relationship between remission, disease activity and patient-reported outcome measures in patients with recent-onset systemic lupus erythematosus. Lupus. 2020;29(6):625–30.

    Article  PubMed  PubMed Central  Google Scholar 

  104. Heijke R, Bjork M, Thyberg I, Kastbom A, McDonald L, Sjowall C. Comparing longitudinal patient-reported outcome measures between swedish patients with recent-onset systemic lupus erythematosus and early rheumatoid arthritis. Clin Rheumatol 2021.

  105. Hofstedt O, Di Giuseppe D, Alenius GM, Stattin N, Forsblad-D’Elia H, Ljung L. Comparison of agreement between internet-based registration of patient-reported outcomes and clinic-based paper forms within the Swedish Rheumatology Quality Register. Scand J Rheumatol. 2019;48:326–30.

    Article  CAS  PubMed  Google Scholar 

  106. Twigg S, Hensor EMA, Emery P, Tennant A, Morgan AW. Yorkshire Early Arthritis Register C: patient-reported outcomes as predictors of change in Disease Activity and disability in early rheumatoid arthritis: results from the Yorkshire Early Arthritis Register. J Rheumatol. 2017;44:1331–40.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  107. Callis Duffin K, Mason MA, Gordon K, Harrison RW, Crabtree MM, Guana A, Germino R, Lebwohl M. Characterization of patients with psoriasis in challenging-to-treat body areas in the Corrona Psoriasis Registry. Dermatology. 2021;237:46–55.

    Article  PubMed  Google Scholar 

  108. Mease PJ, Karki C, Palmer JB, Etzel CJ, Kavanaugh A, Ritchlin CT, Malley W, Herrera V, Tran M, Greenberg JD. Clinical and patient-reported outcomes in patients with psoriatic arthritis (PsA) by body surface area affected by Psoriasis: results from the Corrona PsA/Spondyloarthritis Registry. J Rheumatol. 2017;44:1151–8.

    Article  PubMed  Google Scholar 

  109. Strober B, Greenberg JD, Karki C, Mason M, Guo N, Hur P, Zhao Y, Herrera V, Lin F, Lebwohl M. Impact of psoriasis severity on patient-reported clinical symptoms, health-related quality of life and work productivity among US patients: real-world data from the Corrona Psoriasis Registry. BMJ Open. 2019;9:e027535.

    Article  PubMed  PubMed Central  Google Scholar 

  110. Yun H, Nowell WB, Curtis D, Yang JHW, Auriemma S, Chen M, Filby L, Curtis C. Assessing Rheumatoid Arthritis Disease Activity with patient-reported outcomes Measurement Information System Measures using Digital Technology. Arthritis Care Res. 2020;72:553–60.

    Article  Google Scholar 

  111. Case AH, Hellkamp AS, Neely ML, Bender S, Dilling DF, Gulati M, Hotchkin DL, Huie TJ, Snyder LD, Conoscenti CS, et al. Associations between patient-reported outcomes and death or lung transplant in idiopathic pulmonary fibrosis data from the idiopathic pulmonary fibrosis prospective outcomes registry. Annals of the American Thoracic Society. 2020;17(6):699–705.

    Article  PubMed  PubMed Central  Google Scholar 

  112. Braaten TJ, Zhang C, Presson AP, Breviu B, Clegg D, Walsh JA. Gender differences in psoriatic arthritis with fatigue, Pain, function, and work disability. J Psoriasis Psoriatic Arthritis. 2019;4(4):192–7.

    Article  Google Scholar 

  113. Feldon M, Farhadi PN, Brunner HI, Itert L, Goldberg B, Faiq A, Wilkerson J, Rose KM, Rider LG, Miller FW, Giannini EH. Predictors of reduced health-related quality of life in adult patients with idiopathic inflammatory myopathies. Arthritis Care and Research. 2017;69(11):1743–50.

    Article  PubMed  Google Scholar 

  114. Zimmerman M, Eeg-Olofsson KMDP, Svensson Am Rn P, Astrom M, Arner M, Dahlin L. Open carpal tunnel release and diabetes: a retrospective study using PROMs and national quality registries. BMJ Open. 2019;9:e030179.

    Article  PubMed  PubMed Central  Google Scholar 

  115. Hallenstal N, Sunnergren O, Ericsson E, Hemlin C, Hessen Soderman AC, Nerfeldt P, Odhagen E, Ryding M, Stalfors J. Tonsil surgery in Sweden 2013–2015. Indications, surgical methods and patient-reported outcomes from the National Tonsil surgery Register. Acta Otolaryngol. 2017;137:1096–103.

    Article  PubMed  Google Scholar 

  116. Alvarez R, Stricklen A, Buda CM, Ross R, Bonham AJ, Carlin AM, Varban OA, Ghaferi AA, Finks JF. Factors associated with completion of patient surveys 1 year after bariatric surgery. Surg Obes Relat Dis. 2021;17(3):538–47.

    Article  PubMed  Google Scholar 

  117. Waljee JF, Ghaferi A, Finks JF, Cassidy R, Varban O, Carlin A, Carlozzi N, Dimick J. Variation in patient-reported Outcomes across Hospitals following surgery. Med Care. 2015;53:960–6.

    Article  PubMed  PubMed Central  Google Scholar 

  118. Helsten DL, Ben Abdallah A, Avidan MS, Wildes TS, Winter A, McKinnon S, Bollini M, Candelario P, Burnside BA, Sharma A. Methodologic considerations for collecting patient-reported outcomes from unselected Surgical patients. Anesthesiology. 2016;125:495–504.

    Article  PubMed  Google Scholar 

  119. Australian Breast Device Registry (ABDR). Annual Report. 2021. https://www.abdr.org.au/content/uploads/2022/12/ABDR_2021_Annual-Report_DD_221212_Screen.pdf

  120. Melkemichel M, Bringman S, Nilsson H, Widhe B. Patient-reported chronic pain after open inguinal hernia repair with lightweight or heavyweight mesh: a prospective, patient-reported outcomes study. Br J Surg. 2020;107:1659–66.

    Article  CAS  PubMed  Google Scholar 

  121. Lundstrom KJ, Holmberg H, Montgomery A, Nordin P. Patient-reported rates of chronic pain and recurrence after groin hernia repair. Br J Surg. 2018;105:106–12.

    Article  PubMed  Google Scholar 

  122. Jakobsson E, Lundstrom KJ, Holmberg H, de la Croix H, Nordin P. Chronic Pain after Groin Hernia surgery in women: a patient-reported Outcome Study based on data from the Swedish Hernia Register. Ann Surg. 2022;275:213–9.

    Article  PubMed  Google Scholar 

  123. Madsen LD, Nussler E, Kesmodel US, Greisen S, Bek KM, Glavind-Kristensen M. Native-tissue repair of isolated primary rectocele compared with nonabsorbable mesh: patient-reported outcomes. Int Urogynecol J. 2017;28:49–57.

    Article  PubMed  Google Scholar 

  124. Nussler E, Granasen G, Bixo M, Lofgren M. Long-term outcome after routine surgery for pelvic organ prolapse-A national register-based cohort study. Int Urogynecol J 2022.

  125. Bradley CS, Brown HW, Shippey SS, Gutman RE, Andy UU, Yurteri-Kaplan LA, Kudish B, Mehr A, O’Boyle A, Foster RT, et al. Generic health-related quality of life in patients seeking care for pelvic organ prolapse. Female Pelvic Medicine and Reconstructive Surgery. 2021;27(6):337–43.

    Article  PubMed  Google Scholar 

  126. Poulsen NR, Mechlenburg I, Soballe K, Lange J. Patient-reported quality of life and hip function after 2-stage revision of chronic periprosthetic hip joint infection: a cross-sectional study. Hip Int. 2018;28:407–14.

    Article  PubMed  Google Scholar 

  127. Wall LB, Vuillerman C, Miller PE, Bae DS, Goldfarb CA, Co ULDSG. Patient-reported outcomes in arthrogryposis. J Pediatr Orthop. 2020;40:357–60.

    Article  PubMed  Google Scholar 

  128. Vuillermin C, Canizares MF, Bauer AS, Miller PE, Goldfarb CA. Congenital Upper Limb differences Registry (CoULD): Registry inclusion Effect. J Hand Surg Am. 2021;46:515e511–1.

    Article  Google Scholar 

  129. Ruiter AM, Strijbos E, de Meel RHP, Lipka AF, Raadsheer WF, Tannemaat MR, Verschuuren J. Accuracy of patient-reported data for an online patient registry of autoimmune myasthenia gravis and Lambert-Eaton myasthenic syndrome. Neuromuscul Disord. 2021;31:622–32.

    Article  PubMed  Google Scholar 

  130. Möller M, Wolf O, Bergdahl C, Mukka S, Rydberg EM, Hailer NP, Ekelund J, Wennergren D. The swedish fracture Register - ten years of experience and 600,000 fractures collected in a National Quality Register. BMC Musculoskelet Disord. 2022;23:141.

    Article  PubMed  PubMed Central  Google Scholar 

  131. Lagergren J, Moller M, Rogmark C. Displaced femoral neck fractures in patients 60–69 years old - treatment and patient reported outcomes in a register cohort. Injury. 2020;51(11):2652–7.

    Article  PubMed  Google Scholar 

  132. Juto H, Gartner Nilsson M, Moller M, Wennergren D, Morberg P. Evaluating non-responders of a survey in the swedish fracture register: no indication of different functional result. BMC Musculoskelet Disord. 2017;18:278.

    Article  PubMed  PubMed Central  Google Scholar 

  133. Lutz AD, Brooks JM, Chapman CG, Shanley E, Stout CE, Thigpen CA. Risk Adjustment of the modified low back Pain Disability Questionnaire and Neck Disability Index to Benchmark Physical Therapist performance: analysis from an Outcomes Registry. Phys Ther. 2020;100:609–20.

    Article  PubMed  Google Scholar 

  134. Australian Dementia Network Registry. Annual Report 2020–2021. https://www.australiandementianetwork.org.au/wp-content/uploads/2022/07/ADNeT-Registry-Annual-Report-2020-2021.pdf

  135. Australian Spine Registry (ASR). Annual Report. 2021. https://www.spineregistry.org.au/wp-content/uploads/2022/06/ASR_AR2021_web.pdf

  136. Andresen AK, Paulsen RT, Busch F, Isenberg-Jorgensen A, Carreon LY, Andersen MO. Patient-reported outcomes and patient-reported satisfaction after Surgical Treatment for Cervical Radiculopathy. Global Spine Journal. 2018;8(7):703–8.

    Article  PubMed  PubMed Central  Google Scholar 

  137. Matsumoto H, Mueller J, Konigsberg M, Ball J, St Hilaire T, Pawelek J, Roye DP, Cahill P, Sturm P, Smith J, et al. Improvement of pulmonary function measured by patient-reported outcomes in patients with spinal muscular atrophy after growth-friendly instrumentation. J Pediatr Orthop. 2021;41:1–5.

    Article  PubMed  Google Scholar 

  138. Mannion AF, Impellizzeri FM, Leunig M, Jeszenszy D, Becker HJ, Haschtmann D, Preiss S, Fekete TF. EUROSPINE 2017 FULL PAPER AWARD: time to remove our rose-tinted spectacles: a candid appraisal of the relative success of surgery in over 4500 patients with degenerative disorders of the lumbar spine, hip or knee. Eur Spine J. 2018;27:778–88.

    Article  PubMed  Google Scholar 

  139. Sunderland G, Foster M, Dheerendra S, Pillay R. Patient-reported outcomes following lumbar decompression surgery: a review of 2699 cases. Global Spine Journal. 2021;11(2):172–9.

    Article  PubMed  Google Scholar 

  140. Austevoll IM, Gjestad R, Grotle M, Solberg T, Brox JI, Hermansen E, Rekeland F, Indrekvam K, Storheim K, Hellum C. Follow-up score, change score or percentage change score for determining clinical important outcome following surgery? An observational study from the norwegian registry for spine surgery evaluating patient reported outcome measures in lumbar spinal stenosis and lumbar degenerative spondylolisthesis. BMC Musculoskelet Disord 2019, 20(1) (no pagination).

  141. Zakaria HM, Mansour T, Telemi E, Xiao S, Bazydlo M, Schultz L, Nerenz D, Perez-Cruet M, Seyfried D, Aleem IS, et al. Patient Demographic and Surgical factors that affect completion of patient-reported outcomes 90 days and 1 year after spine surgery: analysis from the Michigan spine surgery improvement collaborative (MSSIC). World Neurosurg. 2019;130:e259–71.

    Article  PubMed  Google Scholar 

  142. Theisen KM, Mann R, Roth JD, Pariser JJ, Stoffel JT, Lenherr SM, Myers JB, Welk B, Elliott SP. Frequency of patient-reported UTIs is associated with poor quality of life after spinal cord injury: a prospective observational study. Spinal Cord. 2020;58:1274–81.

    Article  PubMed  Google Scholar 

  143. Wilkerson CG, Sherrod BA, Alvi MA, Asher AL, Coric D, Virk MS, Fu KM, Foley KT, Park P, Upadhyaya CD, et al. Differences in patient-reported outcomes between anterior and posterior approaches for treatment of cervical spondylotic myelopathy: a Quality Outcomes Database Analysis. World Neurosurg. 2022;160:e436–41.

    Article  PubMed  Google Scholar 

  144. Cadilhac DADL, Morrison J, Lester M, Paice K, Moss K, Carter H, Campbell B, Cloud G, Anderson CSKM, Faux S, Dewey H, Hill K, Donnan G, Grimley R, Middleton S. Lannin NA on behalf of the, Consortium. A: The Australian Stroke Clinical Registry Annual Report 2020. The Florey Institute of Neuroscience and Mental Health; December 2021, Report No. 13. 2021.

  145. Palmcrantz S, Sommerfeld DK. Development and validation of the swedish national stroke register Riksstroke’s questionnaires in patients at 3 and 12 months after stroke: a qualitative study. BMJ Open. 2018;8:e018702.

    Article  PubMed  PubMed Central  Google Scholar 

  146. Turner GM, Slade A, Retzer A, McMullan C, Kyte D, Belli A, Calvert M. An introduction to patient-reported outcome measures (PROMs) in trauma. J Trauma Acute Care Surg. 2019;86:314–20.

    Article  PubMed  Google Scholar 

  147. Burns Registry of Australia and New Zealand. Annual Report 2020/21. https://anzba.org.au/assets/BRANZ-12th-Annual-Report-July-20-June-21.pdf. Department of Epidemiology and Preventive Medicine, Monash University. Melbourne, Australia; 2022.

  148. Stamer UM, Bernhart K, Lehmann T, Setzer M, Stuber F, Komann M, Meissner W. Desire for more analgesic treatment’: pain and patient-reported outcome after paediatric tonsillectomy and appendectomy. Br J Anaesth. 2021;126(6):1182–91.

    Article  PubMed  Google Scholar 

  149. Zaslansky R, Chapman CR, Meissner W, Collaboration PO. Implementing clinical practice guidelines and assessing pain-related patient reported outcomes. Preliminary data from PAIN OUT, an international acute pain registry 2014.

  150. van der Vliet QMJ, Bhashyam AR, Hietbrink F, Houwert RM, Oner FC, Leenen LPH. Routine incorporation of longer-term patient-reported outcomes into a dutch trauma registry. Qual Life Res. 2019;28:2731–9.

    Article  PubMed  PubMed Central  Google Scholar 

  151. Wihlke G, Strommer L, Troeng T, Brattstrom O. Long-term follow-up of patients treated for traumatic injury regarding physical and psychological function and health-related quality of life. Eur J Trauma Emerg Surg. 2021;47:129–35.

    Article  PubMed  Google Scholar 

  152. Rios-Diaz AJ, Herrera-Escobar JP, Lilley EJ, Appelson JR, Gabbe B, Brasel K, deRoon-Cassini T, Schneider EB, Kasotakis G, Kaafarani H, et al. Routine inclusion of long-term functional and patient-reported outcomes into trauma registries: the FORTE project. J Trauma Acute Care Surg. 2017;83:97–104.

    Article  PubMed  Google Scholar 

  153. Amtmann D, McMullen K, Bamer A, Fauerbach JA, Gibran NS, Herndon D, Schneider JC, Kowalske K, Holavanahalli R, Miller AC. National Institute on Disability, Independent Living, and Rehabilitation Research burn Model System: review of Program and Database. Arch Phys Med Rehabil. 2020;101:5–s15.

    Article  Google Scholar 

Download references

Acknowledgements

We thank medical librarian Lorena Romero for assisting with the database searches.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

RR developed the research question and designed the project. RR, MC and CM developed the search strategy. They were the reviewers for the data selection, performed the data extraction and analysis, and drafted the manuscript. SA revised the manuscript and contributed to the discussion points. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Rasa Ruseckaite.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Additional file 1

. Provides the search strategy used in EMBASE and MEDLINE.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ruseckaite, R., Mudunna, C., Caruso, M. et al. Response rates in clinical quality registries and databases that collect patient reported outcome measures: a scoping review. Health Qual Life Outcomes 21, 71 (2023). https://doi.org/10.1186/s12955-023-02155-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-023-02155-5

Keywords