Surrogate end points of quality of life assessment: have we really found what we are looking for?
© Tassinari; licensee BioMed Central Ltd. 2003
Received: 25 July 2003
Accepted: 24 November 2003
Published: 24 November 2003
Outcome research is a new interesting field in medical research. Some years ago, a document of the American Society of Clinical Oncology distinguished the outcomes of a treatment into patient-outcomes (overall survival and quality of life) and cancer-outcomes (response rate), giving higher priority to patient outcomes. This document is one of the best structured instruments to evaluate and classify the outcomes in clinical oncology. Nevertheless, although overall survival and quality of life represent the main patient outcomes in clinical oncology, in the last years many researchers tried to overcome these recommendations, creating new surrogate end points to assess overall survival and quality of life. Surrogate end points can be useful tools when they are used to achieve preliminary data that anticipate the evaluation of the final outcome, but the use of surrogate end points instead of the main outcomes is quite dangerous, as it can provide wrong answers to clinical questions. The use (or abuse) of surrogate end points of quality of life has recently favoured some questionable decisions of the main regulator organs, such as the approval by the Food and Drugs Administration of the use of gemcitabine in advanced chemotherapy-naive pancreatic cancer, or mitoxantrone in the palliative treatment of hormone-resistant pancreatic cancer, based on the improvement in clinical benefit (a non-validated instrument to evaluate the outcome of palliative chemotherapy) besides a minimal and questionable overall survival, or pain control (evaluated with a non-validated instrument). A correct use of surrogate end points of quality of life within and not instead of quality of life assessment should be the engagement of our further efforts in quality of life research.
In the last years, many authors highlighted the importance of outcome research in oncology, either in clinical research or in daily clinical practice [1, 2]. Outcome research has been defined as a discipline investigating the relationship between the results of clinical research and clinical practice, but a consensus about the real meaning of outcome is not yet fully reached, and many aspects are not well defined. In 1996, the American Society of Clinical Oncology (ASCO) published a special article to clarify the outcomes of a clinical approach to neoplastic disease . Based on the distinction between activity and effectiveness of a treatment, the outcomes were divided into cancer-outcomes (response rate) and patient-outcomes (mainly survival and quality of life). Moreover, the Outcomes Working Group of the ASCO highlighted the priority of patient-outcomes, giving a secondary relevance to cancer outcomes and pharmacoeconomic evaluations. The relevance of survival and quality of life as patient-outcomes entails two critical issues: a) how to correlate the different outcomes in the same clinical approach; and b) how to evaluate the outcomes in daily clinical practice or clinical research from a methodological point of view.
In daily clinical practice, response rate is the main criterion to evaluate the outcome of a treatment, as a relationship between response rate and overall survival is supposed. However, such an assumption can be acceptable for chemo-sensitive diseases (Hodgkin disease, testicular cancer), but it is at least questionable for the most part of chemo-resistant diseases (Non-Small-Cell Lung Cancer, gastric or pancreatic cancer). A similar questionable attitude is represented by the increasing use of symptoms control, toxicity or performance status as surrogate end points of quality of life, whereas the actual assessment of quality of life remains a neglected end point in clinical research. Despite the dangerous implications from a methodological point of view, the use of surrogate end points of effectiveness is a quite diffuse attitude, that is rapidly increasing in both clinical research and daily clinical practice. Although the Food and Drugs Administration (FDA) and EMEA give great relevance to quality of life as a patient-outcome [1, 4], they do not seem to consider quality of life as an essential outcome when they are approving new drugs [5, 6]. Such an idiosyncrasy of both clinicians and regulatory agencies for the assessment of quality of life has favoured the use of several surrogate end points, potentially misleading and methodologically questionable.
Surrogate end points of quality of life
In the last years, clinical research paid increasing attention to quality of life, and many papers investigated quality of life as an outcome of the treatment and improvement in the quality of the data [7–9]. However, the assessment of quality of life is difficult and often inaccurate. Frequent obstacles in quality of life assessment are represented by patients compliance, missing data, accuracy of the assessment, usefulness of the tools (validated and not-validated), complexity of the assessment, and scepticism of clinicians, researchers and regulators about the value of health-related quality of life assessment in clinical research or in clinical practice [10–16]. All these obstacles have favoured the use (and the abuse) of surrogate end points of quality of life, the role of which has invaded the main dimensions of quality of life research, jeopardizing the correct assessment of health-related quality of life as a patient-outcome. Surrogate end points are intermediate end points, that should be related with the main end point and could represent a preliminary index of the final outcome. Surrogate end points of survival can be the disease free interval in the adjuvant setting, or the number of complete regressions of the disease during chemotherapy for metastatic cancer . Both parameters, although different from overall survival, may represent a preliminary index of effectiveness, that can be useful in a preliminary analysis. Although a preliminary evaluation of effectiveness with a surrogate end point can be extremely useful if related with the final outcome, it could be deleterious if used instead of the evaluation of the final outcome. The risk of confounding a surrogate end point with a final end point is a real danger for researchers and regulators, and the misunderstanding between surrogate and final end points is not uncommon in oncology.
Surrogate end points of quality of life assessment: reasons for the recent misunderstanding
Clinical benefit has never been validated as an outcome of a palliative treatment in pancreatic cancer.
Although clinical benefit assessment derived from the assessment of two primary measures (pain and performance status) and one secondary measure (weight change), it was just pain (in particular the reduction in opiate consumption) that significantly differed between responders and non-responders; this could not be considered enough to justify an approach with chemotherapy.
The effectiveness of gemcitabine as palliative treatment had to be tested against an appropriate palliative treatment (in particular, considering the relevance of pain assessment in clinical benefit evaluation, against an adequate treatment with opiate), avoiding to use the reduction of opiate consumption as a partial index of activity.
The weight of costs and side effects was not adequately compared with the modest and questionable improvement in the primary end points.
However, these severe criticisms, raised by many authors, failed to restrict the use of clinical benefit as a surrogate end point of quality of life. On the contrary, it has become one of the main outcomes not only in the palliative treatment of advanced pancreatic cancer, but also of many other solid tumours [25, 26]. Moreover, on the basis of the improvement in overall survival and clinical benefit , in 1997 the FDA registered gemcitabine as the treatment of choice in advanced pancreatic cancer, assuming clinical benefit as a surrogate end point of quality of life, and paving the way for a new dangerous era in quality of life assessment.
Likewise, in 1996 Tannock et al. published the results of a trial investigating the use of mitoxantrone in advanced hormone-resistant prostate cancer . Also this trial had some limits, that were similar to those weakening the trials focused on clinical benefit in advanced pancreatic cancer: primary end point was pain control; pain was assessed using non-validated instruments; the reduction in opiate consumption was a secondary end point; the control arm received corticosteroids, that is a questionable treatment if pain control is the primary end point. Nevertheless, mitoxantrone was registered by the FDA for the treatment of advanced hormone-resistant prostate cancer, adopting pain control (assessed with a non-validated instrument) as a surrogate end point of quality of life, despite the criticisms and the doubts widely expressed in literature [28–30]. The group of Tannock successively reviewed the data of their first experience, analysing either the quality of life , or the pharmacoeconomic dimension, correctly using a cost-utility model of analysis . Both reports confirmed the superiority of the experimental arm, but some perplexities do remain, for either the choice of the control arm (low doses of prednisone are not universally accepted as the standard palliative treatment in hormone-resistant prostate cancer), or the rapid approval by regulators on the basis of the data of the first paper. Also for the use of mitoxantrone in hormone-resistant prostate cancer it is evident how dangerous could be an approach to quality of life based on surrogate end points.
Insufficient sensitivity of the instruments used for quality of life assessment (no validated instruments was used in the selected trials).
Duration of the treatment and follow up too short to evaluate the impact of the treatment in overall quality of life.
Secondary relevance of cancer cachexia in the status of terminal or pre-terminal patients.
Moreover, a further fundamental aspect is worthy to be underlined, as it is likely to concern not only cancer cachexia, but the most part of palliative care dimensions. Symptoms control probably represents an index of activity instead of effectiveness, and it can not be considered by itself a surrogate end point of quality of life without running the risk of drawing erroneous conclusions, as it is probably a relevant, but not fundamental dimension of quality of life assessment.
Quality of life assessment represents an independent outcome in clinical research and an index of effectiveness of a treatment.
Surrogate end points of quality of life can represent an useful instrument in clinical research or daily clinical practice, on condition that they are used with and within quality of life assessment.
The conclusions of trials using surrogate end points of quality of life instead of quality of life assessment as primary outcome should be evaluated with caution, and no definitive conclusion about quality of life should be drawn from such trials.
The habit of regulators (FDA or EMEA) of using surrogate end points of quality of life to register new drugs should be handled with great caution, and further confirmatory data should be warranted before reaching a definitive confirmation.
The use of surrogate end points of quality of life can be useful within a project of quality of life assessment. On the other hand, the evaluation of quality of life using solely surrogate end points is incorrect by a methodological point of view and can lead to incorrect conclusions, that are just surrogate responses to surrogate questions.
- Apolone G: Clinical and outcome research in oncology. The need for integration. Health and Quality of Life Outcomes 2003, 1: 3. 10.1186/1477-7525-1-3PubMed CentralPubMedView ArticleGoogle Scholar
- Lee SJ, Earle CC, Weeks JC: Outcomes research in oncology: history, conceptual framework and trends in the literature. J Natl Cancer Inst 2000, 92: 195–204. 10.1093/jnci/92.3.195PubMedView ArticleGoogle Scholar
- ASCO Special Article: Outcomes of cancer treatment for technology assessment and cancer treatment guidelines. J Clin Oncol 1996, 14: 671–9.Google Scholar
- Schilsky RL: End points in cancer clinical trials and the drugs approval process. Clin Cancer Res 2002, 8: 935–8.PubMedGoogle Scholar
- Johnson JR, Williams G, Pazdur R: End points and United States Food and Drug Administration approval of oncology drugs. J Clin Oncol 2003, 21: 1404–11. 10.1200/JCO.2003.08.072PubMedView ArticleGoogle Scholar
- Apolone G, De Carli G, Brunetti M, Garattini S: Health-related quality of life (HR-QOL) and regulatory issues. An assessment of the European Agency for the Evaluation of Medical Products (EMEA) recommendation on the use of HR-QOL measures in drug approval. Pharmacoeconomics 2001, 19: 187–95.PubMedView ArticleGoogle Scholar
- Sanders C, Egger M, Donovan J, Tallon D, Frankel S: Reporting on quality of life in randomised controlled trials: bibliographic study. BMJ 1998, 317: 1191–4.PubMed CentralPubMedView ArticleGoogle Scholar
- Panzini I, Tassinari D, Monticelli G, Sermasi A, Roudnas B, Arcangeli V, Papi M, Fochessati F, Poggi B, Ravaioli A: Quality of life (QoL) in randomized clinical trials (RCT): a critical review of literature. [abstract]. Proc Am Soc Clin Oncol J Clin Oncol 2003, 22: a2952.Google Scholar
- Levine MN, Ganz PA: Beyond the development of quality-of-life instruments: where do we go from here? J Clin Oncol 2002, 20: 2215–6. 10.1200/JCO.20.2.405PubMedView ArticleGoogle Scholar
- Garratt A, Schmidt L, Mackintosh A, Fitzpatrick R: Quality of life measurement: bibliographic study of patient assessed health outcome measures. BMJ 2002, 324: 1417–21. 10.1136/bmj.324.7351.1417PubMed CentralPubMedView ArticleGoogle Scholar
- Carr AJ, Higginson IJ: Are quality of life measures patient centred? BMJ 2001, 322: 1357–60. 10.1136/bmj.322.7298.1357PubMed CentralPubMedView ArticleGoogle Scholar
- Bland MJ, Altman DG: Validating scales and indexes. BMJ 2002, 324: 606–7. 10.1136/bmj.324.7337.606PubMed CentralPubMedView ArticleGoogle Scholar
- Bottomley A: The cancer patient and quality of life. The Oncologist 2002, 7: 120–5.PubMedView ArticleGoogle Scholar
- Carr AJ, Gibson B, Robinson PG: Is quality of life determined by expectations or experience? BMJ 2001, 322: 1240–3. 10.1136/bmj.322.7296.1240PubMed CentralPubMedView ArticleGoogle Scholar
- Higginson IJ, Carr AJ: Using quality of life measures in the clinical setting. BMJ 2001, 322: 1297–300. 10.1136/bmj.322.7297.1297PubMed CentralPubMedView ArticleGoogle Scholar
- Muldoon MF, Barger SD, Flory JD, Manuck SB: What are quality of life measurements measuring? BMJ 1998, 316: 542–5.PubMed CentralPubMedView ArticleGoogle Scholar
- Cella D, Chang CH, Lai JS, Webster K: Advances in quality of life measurements in oncology patients. Semin Oncol 2002,29(3 suppl 8):60–8. 10.1053/sonc.2002.33535PubMedView ArticleGoogle Scholar
- Rothemberg ML, Moore MJ, Cripps MC, Andersen JS, Portenoy RK, Burris HA III, Green MR, Tarassoff PG, Brown TD, Casper ES, Storniolo AM, Von Hoff DD: A phase II trial of gemcitabine in patients with 5-FU-refractory pancreas cancer. Ann Oncol 1996, 7: 347–53.View ArticleGoogle Scholar
- Burris HA III, Moore MJ, Andersen J, Green MR, Rothemberg ML, Modiano MR, Cripps MC, Portenoy RK, Starniolo AM, Tarassoff P, Nelson R, Dorr FA, Stephens CD, Van Hoff DD: Improvements in survival and clinical benefit with gemcitabine as first line therapy for patients with advanced pancreas cancer: a randomized trial. J Clin Oncol 1997, 15: 2403–13.PubMedGoogle Scholar
- Verweij J: The benefit of clinical benefit: a European perspective. Ann Oncol 1996, 7: 333–334.PubMedView ArticleGoogle Scholar
- Gelber RD: Gemcitabine for pancreatic cancer: how hard to look for clinical benefit? An American perspective. Ann Oncol 1996, 7: 335–7.PubMedView ArticleGoogle Scholar
- Caraceni A, De Conno F: Analgesic effect of chemotherapy? J Clin Oncol 1998, 16: 803.PubMedGoogle Scholar
- Ballatori E, Del Favero A, Roila F: Clinical benefit as a primary efficacy endpoint. J Clin Oncol 1998, 16: 803–4.PubMedGoogle Scholar
- Steer CB, Marx GM, Harper PG: Is there quality in clinical benefit? Ann Oncol 2001, 12: 1191–3. 10.1023/A:1012474308888PubMedView ArticleGoogle Scholar
- Hoffman K, Glimelius B: Evaluation of clinical benefit of chemotherapy in patients with upper gastrointestinal cancer. Acta Oncol 1998, 37: 651–9. 10.1080/028418698429991PubMedView ArticleGoogle Scholar
- Vansteenkiste JF, Vandebroek JE, Nackaerts KL, Weynants P, Valcke YJ, Verresen DA, Devogelaere RC, Marien SA, Humblet YP, Dams NL, The Leuven Lung Cancer Group: Clinical-benefit response in advanced non-small-cell lung cancer: a multicentre prospective randomised phase III study of single agent gemcitabine versus cisplatin-vindesine. Ann Oncol 2001, 12: 1221–30. 10.1023/A:1012208711013PubMedView ArticleGoogle Scholar
- Tannock IF, Osoba D, Stockler MR, Ernst DS, Neville AJ, Moore MJ, Armitage GR, Wilson JJ, Venner PM, Coppin CML, Murphy KC: Chemotherapy with mitoxantrone plus prednisone or prednisone alone for symptomatic hormone-resistant prostate cancer: a canadian randomized trial with palliative end points. J Clin Oncol 1996, 14: 1756–64.PubMedGoogle Scholar
- Vogelzang NJ: One hundred thirteen men with hormone-refractory prostate cancer died today. J Clin Oncol 1996, 14: 1753–5.PubMedGoogle Scholar
- Denes AE: Chemotherapy with mitoxantrone in hormone-refractory prostate cancer. J Clin Oncol 1997, 15: 410–1.PubMedGoogle Scholar
- Browman GP: Science, language, intuition, and many meanings of quality of life. J Clin Oncol 1999, 17: 1651–3.PubMedGoogle Scholar
- Osoba D, Tannock IF, Ernst DS, Neville A: Heath-related quality of life in men with metastatic prostate cancer treated with prednisone alone or mitoxantrone and prednisone. J Clin Oncol 1999, 17: 1654–63.PubMedGoogle Scholar
- Bloomfield DJ, Krahn MD, Neogi T, Panzarella T, Smith TJ, Warde P, Willan AR, Ernst S, Moore MJ, Neville A, Tannock IF: Economic evaluation of chemotherapy with mitoxantrone plus prednisone for symptomatic hormone-resistant prostate cancer: based on a canadian randomized trial with palliative end points. J Clin Oncol 1998, 16: 2272–9.PubMedGoogle Scholar
- Fukuoka M, Yano S, Giaccone G, Tamura T, Nakagawa K, Douillard JY, Nishiwaki Y, Vansteenkiste J, Kudo S, Averbuch S, Macleod A, Fayereislova A, Baselga J: Final results from a phase II trial of ZD1839 ('Iressa') for patients with advanced non-small-cell lung cancer (IDEAL 1). [abstract]. J Clin Oncol 2002, 21: 298a.Google Scholar
- Kris MG, Natale RB, Herbst RS, Lynch TJ, Prager D, Belani CP, Schiller JH, Kelly K, Spiridonidis C, Albain KS, Brahmer JR, Sandler A, Crawford J, Lutzker SG, Lilenbaum R, Helms L, Wolf M, Averbuch S, Ochs J, Kay A: A phase II trial of ZD1839 ('Iressa') in advanced non-small cell lung cancer (NSCLC) patients who had failed platinum- and docetaxel-based regimens (IDEAL 2). [abstract]. J Clin Oncol 2002, 21: 292a.Google Scholar
- Herbst RS: Dose-comparative monotherapy trials of ZD1839 in previously treated Non-Small Cell Lung Cancer patients. Semin Oncol 2003,30(1 supplement 1):30–38. 10.1053/sonc.2003.50030PubMedView ArticleGoogle Scholar
- Cella D: Impact of ZD1839 on Non-Small Cell Lung Cancer-related symptoms as measured by the Functional Assessment of Cancer Therapy-Lung Scale. Semin Oncol 2003,30(1 supplement 1):39–48. 10.1053/sonc.2003.50031PubMedView ArticleGoogle Scholar
- Kaasa S, Loge JH: Quality of life in palliative care: principles and practice. Palliat Med 2003, 17: 11–20. 10.1191/0269216303pm662raPubMedView ArticleGoogle Scholar
- Kaasa S, Loge JH: Quality of life assessment in palliative care. The Lancet Oncology 2002, 3: 175–82. 10.1016/S1470-2045(02)00682-4PubMedView ArticleGoogle Scholar
- ASCO Special Article: Cancer care during the last phase of life. J Clin Oncol 1998, 16: 1986–96.Google Scholar
- Maltoni M, Nanni O, Scarpi E, Rossi D, Serra P, Amadori D: High-dose progestins for the treatment of cancer anorexia-cachexia syndrome: a systematic review of randomised clinical trials. Ann Oncol 2001, 12: 289–300. 10.1023/A:1011156811739PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.