Overcoming barriers to the implementation of patient-reported outcomes in cancer clinical trials: the PROMOTION Registry
© Efficace et al.; licensee BioMed Central Ltd. 2014
Received: 25 March 2014
Accepted: 31 May 2014
Published: 6 June 2014
Every cancer treatment, irrespective of its clinical effectiveness, has an impact on patients’ quality of life (QoL). Even recently developed targeted therapies might have side effects and significantly impact patients’ QoL. Thus, understanding the advantages and disadvantages of different treatments from the patient’s standpoint has become a must in clinical research and is highly valued by major stakeholders. Thousands of cancer patients are enrolled into randomized controlled trials (RCTs) each year and many complete patient-reported outcome (PRO) instruments to obtain patient-centered information as part of the assessment of the overall effectiveness of the new therapy. Some of these RCTs have generated high quality PRO evidence forming the basis for approval (or support to approval) of drugs by the US Food and Drug Administration. However, a consistent strategy to determine the quality of patient centered evidence presented in RCTs has until recently been lacking. One of the fundamental questions when including PROs in clinical research revolves around methodological robustness and consistency of outcome reporting. Cancer patients, physicians and healthcare system stakeholders need to rely on solid information to make the best possible choice regarding treatment. Therefore generating high-quality findings from PRO assessment in cancer trials is of paramount importance. In an effort to improve quality of PRO assessment and reporting in the near future, the Patient-Reported Outcome Measurements Over Time In ONcology (PROMOTION) Registry was developed. The scope of this Registry is to identify, track, analyse, and store information on all cancer RCTs that have included PROs, and assess the quality of their PRO assessments.
Cancer is now an increasingly common diagnosis worldwide as population longevity increases. Recent data from the International Agency for Cancer research (IARC) indicate approximately 14.1 million new cancer cases in 2012, a rise of more than 10% compared to 2008 (12.7 million cases), and further projections suggest an increase to 19.3 million new cancer cases per year by 2025 . Therefore, understanding how cancer and its treatment impact on each aspect of a patient’s life is critical and remains a major challenge.
Every cancer treatment, irrespective of its clinical effectiveness, has an impact on patients’ quality of life (QoL). Standard treatments have traditionally included chemotherapy, radiotherapy and surgery or a combination of these. In recent years, anticancer-targeted therapies have been developed for some cancers, and very often these greatly contribute to improving both survival and QoL [2, 3]. Nonetheless, even targeted therapies might have side effects and significantly impact patients’ QoL . Thus, understanding the advantages and disadvantages (pro and cons) of different treatments from the patient’s standpoint has become a must in clinical research and is highly valued by major stakeholders .
Rationale and objective
Randomized controlled trials (RCTs), play a key role in cancer research as they provide the best methodology to evaluate treatments and inform health policy and practice. Within RCTs in oncology, it is now commonplace to make assessment of patient-reported outcomes (PROs). Thousands of cancer patients are enrolled into RCTs each year and many complete relevant PRO instruments to obtain patient-centered information as part of the assessment of the overall effectiveness of the new therapy. A number of these RCTs have generated high quality PRO evidence and some of these have also formed the basis for approval (or support to approval) of drugs by the US Food and Drug Administration (FDA) by showing better PROs with a given treatment. Examples of this include mitoxantrone for prostate cancer patients and imatinib for patients with chronic myeloid leukemia [3, 6]. However, it should be noted that methodological drawbacks in the design and reporting of PROs have often limited the use of PRO data in approval of drugs .
However, a consistent strategy to determine the quality of patient centered evidence presented in RCTs has until recently been lacking, but is vital to clinicians as PRO data from RCTs may directly inform patients and practitioners regarding the effects of a treatment, or may indirectly influence clinical practice by incorporation into relevant guidelines . One of the fundamental questions when including PROs in clinical research revolves around methodological robustness and consistency of outcome reporting. There are a number of well known challenges, for example, to PRO data collection, appropriate timing of assessment, adequate statistical analysis and outcome interpretation [9, 10]. In addition, the choice of the PRO questionnaire is also a fundamental aspect to be considered; the questionnaire should be relevant for the specific research question, and with solid psychometric characteristics (e.g., valid, reliable and responsive to health changes). Cancer patients, physicians and healthcare system stakeholders need to rely on solid information to make the best possible choice regarding treatment. Therefore generating high-quality findings from PRO assessment in cancer trials is of paramount importance. Poorly designed or reported PROs assessment is likely to hamper the critical appraisal of results and limit the knowledge transfer from research settings to clinical practice.
The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group (QLG) has pioneered the field of methodological research in this area by developing and validating an international portfolio of measures to be used in RCTs in oncology . The EORTC has led on several published reviews of PRO in RCTs, showing that the application of PROs in many trials was plagued by important methodological drawbacks, limiting the generalizability of the results [12–15]. In response to these findings the EORTC raised the need to establish international standards for QoL assessment in cancer clinical trials  and made significant efforts to define basic minimum criteria to guide investigators when reporting HRQOL from cancer RCTs . Further international initiatives have subsequently been launched to increase the quality of PRO assessment in clinical trials, including guidance from the International Society for Quality of Life Research (ISOQOL) . The ISOQoL guidance is of particular value as it formed the basis for the development of the recently issued CONSORT PRO recommendations .
In an effort to improve quality of PRO assessment and reporting in the near future, the EORTC QLG recently contributed to devise the Patient-Reported Outcome Measurements Over Time In ONcology (PROMOTION) Registry (http://promotion.gimema.it). This is also co-financed by the Italian Group for Adult Hematologic Diseases (GIMEMA). The broad scope of this Registry is to identify, track, analyse, and store information on all cancer RCTs that have included PROs, and assess the quality of their PRO assessments. This work is being performed using a common set of criteria across all cancer disease sites, thus allowing comparisons across all cancer areas.
Overview on registry content and type of information included
The database stores information stemming from published RCTs that enrolled at least 50 patients overall, that report PROs, and that have been published since 2004. To date, nearly 600 studies in a wide range of cancer populations have been identified, analyzed and electronically archived. Data on more than 50 different items have been extracted from each eligible study.
Descriptive summary of some key data contained in the PROMOTION Registry ( http://promotion.gimema.it )
Basic Study Characteristics
Name of Cooperative Group/s leading the study (if any)
Difference between treatment arms in the primary endpoint (if any)
Age of patients
Gender of patients
Overall trial sample size
PRO sample size
PRO instrument/s used
Summary of PRO results
If statistically significant PRO difference exists, details of the domain/s of interest should be reported (e.g. symptoms only, functional aspects, global quality of life)
Summary of main clinical (other than PRO) results
PRO Methodology and Analysis
PRO identification in the abstract
Statement of PRO hypothesis and its PRO domain
Description of the mode of administration of the PRO tool and the methods of collecting data
Electronic mode of PRO administration
Description of the rationale for choice of the PRO instrument
Citation of evidence of PRO instrument validity and reliability
Description of the intended PRO data collection
Statement of the status of PRO as either a primary or secondary outcome
Statement of the magnitude of the effect size (for statistically significant PRO results)
Description of statistical approaches for dealing with missing data
Statement of the extent of missing data
Flow diagram or description of the allocation of participants and those lost to follow-up for PROs specifically
Statement of the reasons for missing data
Description of the study patients’ characteristics including baseline PRO scores
Reporting of PRO outcomes in a graphical format
Discussion of the limitations of the PRO components of the trial
Discussion of the limitations of the clinical significance of the PRO findings
Methodology used to assess clinical significance
Discussion of the PRO results in the context of the other clinical trial outcomes
Overview on working methodology
All published RCTs meeting the inclusion criteria are identified by electronic searching of PubMed/Medline, the Cochrane library, PsycINFO and PsycARTICLES. Hand searching of the bibliographies of eligible articles are also performed.
After eligibility of articles for inclusion is confirmed, a minimum of two trained reviewers (who are also study collaborators) independently examine each trial and extract pre-specified information. Every reviewer has a personal password to access the online system to complete the electronic-data extraction form (eDEF), details of which have been reported previously . This approach allows a double blind data entry procedure to ensure accuracy and validity of data entry into the Registry. Discrepancies in the independent evaluations are recorded and a discrepancy form automatically generated by the system. Discrepancies are discussed by the two reviewers and resolved by them with a third reviewer reconciling any continuing discrepancies. After the review team reach consensus for all items the final eDEF for the RCT is locked, validated and imported in the Registry for research use.
Future work and value to the international community
The methodological challenge of incorporating PROs into cancer RCTs is frequently cited as a major limiting factor for their use. However, through the PROMOTION Registry data we have begun to show that PRO methodological quality has improved over time in RCTs in prostate disease, suggesting that the methodological challenges related to PRO logistics, design and analyses are no longer insurmountable .
Work continues within the PROMOTION Registry team to determine if this is also the case for other cancer sites, and to identify key areas where PRO methodology remains poor in cancer RCTs and needs to be addressed to facilitate the translation of PRO findings from research to clinical practice.
The PROMOTION Registry (http://promotion.gimema.it) is now an extensive source of information for all investigators involved in PROs related cancer research and will continue to be regularly updated. Data and information contained in the registry can be used to address specific clinical or more methodological research questions. We welcome research proposals from other investigators and research groups (not only from GIMEMA and the EORTC QLG) to collaborate with the international PROMOTION team in the effort to drive PROs into clinical practice and better inform healthcare decisions.
We acknowledge the essential contribution of all collaborators of the PROMOTION Registry. This project is funded by a research grant from the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group. Also, additional support for the conduct of the study was provided by the Italian Group for Adult Hematologic Diseases ( GIMEMA). JMB is supported by the MRC ConDuCT Hub for Trials Methodology Research. We also acknowledge Alessandro Perreca for his invaluable contribution in the data management.
- Ferlay J, Soerjomataram I, Ervik M, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F, GLOBOCAN 2012 v1.0: Cancer Incidence and Mortality Worldwide: IARC CancerBase No. 11. Lyon, France: International Agency for Research on Cancer; 2013.Google Scholar
- Keefe DM, Bateman EH: Tumor control versus adverse events with targeted anticancer therapies. Nat Rev Clin Oncol 2012, 9: 98–109.View ArticleGoogle Scholar
- Hahn EA, Glendenning GA, Sorensen MV, Hudgens SA, Druker BJ, Guilhot F, Larson RA, O'Brien SG, Dobrez DG, Hensley ML, Cella D: Quality of life in patients with newly diagnosed chronic phase chronic myeloid leukemia on imatinib versus interferon alfa plus low-dose cytarabine: results from the IRIS Study. J Clin Oncol 2003, 21: 2138–2146. 10.1200/JCO.2003.12.154View ArticlePubMedGoogle Scholar
- Efficace F, Baccarani M, Breccia M, Alimena G, Rosti G, Cottone F, Deliliers GL, Barate C, Rossi AR, Fioritoni G, Luciano L, Turri D, Martino B, Di Raimondo F, Dabusti M, Bergamaschi M, Leoni P, Simula MP, Levato L, Ulisciani S, Veneri D, Sica S, Rambaldi A, Vignetti M, Mandelli F, GIMEMA: Health-related quality of life in chronic myeloid leukemia patients receiving long-term therapy with imatinib compared with the general population. Blood 2011, 118: 4554–4560. 10.1182/blood-2011-04-347575View ArticlePubMedGoogle Scholar
- Basch E, Abernethy AP, Mullins CD, Reeve BB, Smith ML, Coons SJ, Sloan J, Wenzel K, Chauhan C, Eppard W, Frank ES, Lipscomb J, Raymond SA, Spencer M, Tunis S: Recommendations for incorporating patient-reported outcomes into clinical comparative effectiveness research in adult oncology. J Clin Oncol 2012, 30: 4249–4255. 10.1200/JCO.2012.42.5967View ArticlePubMedGoogle Scholar
- Osoba D, Tannock IF, Ernst DS, Neville AJ: Health-related quality of life in men with metastatic prostate cancer treated with prednisone alone or mitoxantrone and prednisone. J Clin Oncol 1999, 17: 1654–1663.PubMedGoogle Scholar
- Johnson JR, Williams G, Pazdur R: End points and united states food and drug administration approval of oncology drugs. J Clin Oncol 2003, 21: 1404–1411. 10.1200/JCO.2003.08.072View ArticlePubMedGoogle Scholar
- Calvert M, Brundage M, Jacobsen PB, Schunemann HJ, Efficace F: The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes 2013, 11: 184. 10.1186/1477-7525-11-184PubMed CentralView ArticlePubMedGoogle Scholar
- Fayers PM, Hopwood P, Harvey A, Girling DJ, Machin D, Stephens R: Quality of life assessment in clinical trials–guidelines and a checklist for protocol writers: the U.K. Medical Research Council experience. MRC Cancer Trials Office. Eur J Cancer 1997, 33: 20–28. 10.1016/S0959-8049(96)00412-1View ArticlePubMedGoogle Scholar
- Chassany O, Sagnier P, Marquis P, Fullerton S, Aaronson N: Patient-reported outcomes: the example of health-related quality of life – a European guidance document for the improved integration of health-related quality of life assessment in the drug regulatory process. Drug Inf J 2002, 36: 209–238. 10.1177/009286150203600127View ArticleGoogle Scholar
- Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC, Kaasa S, Klee M, Osoba D, Razavi D, Rofe P, Schraub S, Sneeuw K, Sullivan M, Takeda F: The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993, 85: 365–376. 10.1093/jnci/85.5.365View ArticlePubMedGoogle Scholar
- Bottomley A, Therasse P: Quality of life in patients undergoing systemic therapy for advanced breast cancer. Lancet Oncol 2002, 3: 620–628. 10.1016/S1470-2045(02)00876-8View ArticlePubMedGoogle Scholar
- Bottomley A, Efficace F, Thomas R, Vanvoorden V, Ahmedzai SH: Health-related quality of life in non-small-cell lung cancer: methodologic issues in randomized controlled trials. J Clin Oncol 2003, 21: 2982–2992. 10.1200/JCO.2003.01.203View ArticlePubMedGoogle Scholar
- Efficace F, Bottomley A, Vanvoorden V, Blazeby JM: Methodological issues in assessing health-related quality of life of colorectal cancer patients in randomised controlled trials. Eur J Cancer 2004, 40: 187–197. 10.1016/j.ejca.2003.10.012View ArticlePubMedGoogle Scholar
- Efficace F, Bottomley A, van Andel G: Health related quality of life in prostate carcinoma patients: a systematic review of randomized controlled trials. Cancer 2003, 97: 377–388. 10.1002/cncr.11065View ArticlePubMedGoogle Scholar
- Bottomley A, Efficace F, Fayers PM: Standards are needed for quality of life clinical trials. BMJ 2002, 324: 1156. 10.1136/bmj.324.7346.1156PubMed CentralView ArticlePubMedGoogle Scholar
- Efficace F, Bottomley A, Osoba D, Gotay C, Flechtner H, D'Haese S, Zurlo A: Beyond the development of health-related quality-of-life (HRQOL) measures: a checklist for evaluating HRQOL outcomes in cancer clinical trials–does HRQOL evaluation in prostate cancer research inform clinical decision making? J Clin Oncol 2003, 21: 3502–3511. 10.1200/JCO.2003.12.121View ArticlePubMedGoogle Scholar
- Brundage M, Blazeby J, Revicki D, Bass B, de Vet H, Duffy H, Efficace F, King M, Lam CL, Moher D, Scott J, Sloan J, Snyder C, Yount S, Calvert M: Patient-reported outcomes in randomized clinical trials: development of ISOQOL reporting standards. Qual Life Res 2013, 22: 1161–1175. 10.1007/s11136-012-0252-1PubMed CentralView ArticlePubMedGoogle Scholar
- Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD: Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA 2013, 309: 814–822. 10.1001/jama.2013.879View ArticlePubMedGoogle Scholar
- Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group; Cochrane Statistical Methods Group: The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011, 343: d5928. 10.1136/bmj.d5928PubMed CentralView ArticlePubMedGoogle Scholar
- Efficace F, Feuerstein M, Fayers P, Cafaro V, Eastham J, Pusic A, Blazeby J: Patient-reported outcomes in randomised controlled trials of prostate cancer: methodological quality and impact on clinical decision making. Eur Urol 2013. doi:10.1016/j.eururo.2013.10.017. [Epub ahead of print]Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.