- Open Access
Surrogate end points of quality of life assessment: have we really found what we are looking for?
Health and Quality of Life Outcomesvolume 1, Article number: 71 (2003)
Outcome research is a new interesting field in medical research. Some years ago, a document of the American Society of Clinical Oncology distinguished the outcomes of a treatment into patient-outcomes (overall survival and quality of life) and cancer-outcomes (response rate), giving higher priority to patient outcomes. This document is one of the best structured instruments to evaluate and classify the outcomes in clinical oncology. Nevertheless, although overall survival and quality of life represent the main patient outcomes in clinical oncology, in the last years many researchers tried to overcome these recommendations, creating new surrogate end points to assess overall survival and quality of life. Surrogate end points can be useful tools when they are used to achieve preliminary data that anticipate the evaluation of the final outcome, but the use of surrogate end points instead of the main outcomes is quite dangerous, as it can provide wrong answers to clinical questions. The use (or abuse) of surrogate end points of quality of life has recently favoured some questionable decisions of the main regulator organs, such as the approval by the Food and Drugs Administration of the use of gemcitabine in advanced chemotherapy-naive pancreatic cancer, or mitoxantrone in the palliative treatment of hormone-resistant pancreatic cancer, based on the improvement in clinical benefit (a non-validated instrument to evaluate the outcome of palliative chemotherapy) besides a minimal and questionable overall survival, or pain control (evaluated with a non-validated instrument). A correct use of surrogate end points of quality of life within and not instead of quality of life assessment should be the engagement of our further efforts in quality of life research.
In the last years, many authors highlighted the importance of outcome research in oncology, either in clinical research or in daily clinical practice [1, 2]. Outcome research has been defined as a discipline investigating the relationship between the results of clinical research and clinical practice, but a consensus about the real meaning of outcome is not yet fully reached, and many aspects are not well defined. In 1996, the American Society of Clinical Oncology (ASCO) published a special article to clarify the outcomes of a clinical approach to neoplastic disease . Based on the distinction between activity and effectiveness of a treatment, the outcomes were divided into cancer-outcomes (response rate) and patient-outcomes (mainly survival and quality of life). Moreover, the Outcomes Working Group of the ASCO highlighted the priority of patient-outcomes, giving a secondary relevance to cancer outcomes and pharmacoeconomic evaluations. The relevance of survival and quality of life as patient-outcomes entails two critical issues: a) how to correlate the different outcomes in the same clinical approach; and b) how to evaluate the outcomes in daily clinical practice or clinical research from a methodological point of view.
In daily clinical practice, response rate is the main criterion to evaluate the outcome of a treatment, as a relationship between response rate and overall survival is supposed. However, such an assumption can be acceptable for chemo-sensitive diseases (Hodgkin disease, testicular cancer), but it is at least questionable for the most part of chemo-resistant diseases (Non-Small-Cell Lung Cancer, gastric or pancreatic cancer). A similar questionable attitude is represented by the increasing use of symptoms control, toxicity or performance status as surrogate end points of quality of life, whereas the actual assessment of quality of life remains a neglected end point in clinical research. Despite the dangerous implications from a methodological point of view, the use of surrogate end points of effectiveness is a quite diffuse attitude, that is rapidly increasing in both clinical research and daily clinical practice. Although the Food and Drugs Administration (FDA) and EMEA give great relevance to quality of life as a patient-outcome [1, 4], they do not seem to consider quality of life as an essential outcome when they are approving new drugs [5, 6]. Such an idiosyncrasy of both clinicians and regulatory agencies for the assessment of quality of life has favoured the use of several surrogate end points, potentially misleading and methodologically questionable.
Surrogate end points of quality of life
In the last years, clinical research paid increasing attention to quality of life, and many papers investigated quality of life as an outcome of the treatment and improvement in the quality of the data [7–9]. However, the assessment of quality of life is difficult and often inaccurate. Frequent obstacles in quality of life assessment are represented by patients compliance, missing data, accuracy of the assessment, usefulness of the tools (validated and not-validated), complexity of the assessment, and scepticism of clinicians, researchers and regulators about the value of health-related quality of life assessment in clinical research or in clinical practice [10–16]. All these obstacles have favoured the use (and the abuse) of surrogate end points of quality of life, the role of which has invaded the main dimensions of quality of life research, jeopardizing the correct assessment of health-related quality of life as a patient-outcome. Surrogate end points are intermediate end points, that should be related with the main end point and could represent a preliminary index of the final outcome. Surrogate end points of survival can be the disease free interval in the adjuvant setting, or the number of complete regressions of the disease during chemotherapy for metastatic cancer . Both parameters, although different from overall survival, may represent a preliminary index of effectiveness, that can be useful in a preliminary analysis. Although a preliminary evaluation of effectiveness with a surrogate end point can be extremely useful if related with the final outcome, it could be deleterious if used instead of the evaluation of the final outcome. The risk of confounding a surrogate end point with a final end point is a real danger for researchers and regulators, and the misunderstanding between surrogate and final end points is not uncommon in oncology.
Surrogate end points of quality of life assessment: reasons for the recent misunderstanding
In the last years, the "clinical benefit assessment" has widely been used to evaluate the outcome of palliative chemotherapy . It was introduced in 1996 by Rothemberg et al. as a primary end point in a phase II trial investigating the activity of gemcitabine in metastatic pancreatic cancer pre-treated with 5FU , and consisted of the measurement of three debilitating signs or symptoms, frequent in advanced pancreatic cancer: pain, functional impairment and weight loss. The trial showed an activity of this palliative treatment, and was followed by a phase III trial, that reported an improvement in clinical benefit and survival for patients with chemotherapy-naive pancreatic cancer treated with gemcitabine, in comparison with patients treated with 5FU . Both these trials, introducing clinical benefit as an outcome of palliative chemotherapy, were severely questioned [20–24] for the following methodological reasons:
Clinical benefit has never been validated as an outcome of a palliative treatment in pancreatic cancer.
Although clinical benefit assessment derived from the assessment of two primary measures (pain and performance status) and one secondary measure (weight change), it was just pain (in particular the reduction in opiate consumption) that significantly differed between responders and non-responders; this could not be considered enough to justify an approach with chemotherapy.
The effectiveness of gemcitabine as palliative treatment had to be tested against an appropriate palliative treatment (in particular, considering the relevance of pain assessment in clinical benefit evaluation, against an adequate treatment with opiate), avoiding to use the reduction of opiate consumption as a partial index of activity.
The weight of costs and side effects was not adequately compared with the modest and questionable improvement in the primary end points.
However, these severe criticisms, raised by many authors, failed to restrict the use of clinical benefit as a surrogate end point of quality of life. On the contrary, it has become one of the main outcomes not only in the palliative treatment of advanced pancreatic cancer, but also of many other solid tumours [25, 26]. Moreover, on the basis of the improvement in overall survival and clinical benefit , in 1997 the FDA registered gemcitabine as the treatment of choice in advanced pancreatic cancer, assuming clinical benefit as a surrogate end point of quality of life, and paving the way for a new dangerous era in quality of life assessment.
Likewise, in 1996 Tannock et al. published the results of a trial investigating the use of mitoxantrone in advanced hormone-resistant prostate cancer . Also this trial had some limits, that were similar to those weakening the trials focused on clinical benefit in advanced pancreatic cancer: primary end point was pain control; pain was assessed using non-validated instruments; the reduction in opiate consumption was a secondary end point; the control arm received corticosteroids, that is a questionable treatment if pain control is the primary end point. Nevertheless, mitoxantrone was registered by the FDA for the treatment of advanced hormone-resistant prostate cancer, adopting pain control (assessed with a non-validated instrument) as a surrogate end point of quality of life, despite the criticisms and the doubts widely expressed in literature [28–30]. The group of Tannock successively reviewed the data of their first experience, analysing either the quality of life , or the pharmacoeconomic dimension, correctly using a cost-utility model of analysis . Both reports confirmed the superiority of the experimental arm, but some perplexities do remain, for either the choice of the control arm (low doses of prednisone are not universally accepted as the standard palliative treatment in hormone-resistant prostate cancer), or the rapid approval by regulators on the basis of the data of the first paper. Also for the use of mitoxantrone in hormone-resistant prostate cancer it is evident how dangerous could be an approach to quality of life based on surrogate end points.
A different, but in one way similar question may be represented by the recent FDA rapid approval of gefitinib in the treatment of advanced pre-treated Non-Small-Cell Lung Cancer. Although in the IDEAL-1 and the IDEAL-2 trials (the registrative trials) were used validated tools in quality of life assessment, both of them were planned as phase II trials, in which the activity, and not the effectiveness of the treatment were investigated [33–36]. It follows that a correct tool on one hand, but also an inappropriate design of the trial on the other hand, were used to register a molecule in the treatment of cancer, underlining once again how the topic may be still confounding (although the rules of FDA rapid approval of a drug are obviously beyond the arguments of this paper). A further dimension in which the use of surrogate end points of quality of life could be misleading is palliative care. The quality of the residual life at the end of life is a very important issue, and the dimension of quality of life has been widely investigated in the last years [37–39]. Quality of life assessment at the end of life is a very complex field of quality of life research, and the use of surrogate end points of quality of life is just one of the undefined aspects of this field. Progestins or corticosteroids are the drugs of choice in the palliative treatment of the cancer cachexia syndrome, and megestrol acetate or medroxyprogesterone acetate likely represent the gold standard to this aim. However, a recent systematic review highlighted that no significant improvement in quality of life besides weight gain or appetite improvement can be inferred from the trials investigating the role of megestrol acetate or medroxyprogesterone acetate in quality of life . The reasons explaining the lack of improvement in quality of life assessment can be summarized as follows:
Insufficient sensitivity of the instruments used for quality of life assessment (no validated instruments was used in the selected trials).
Duration of the treatment and follow up too short to evaluate the impact of the treatment in overall quality of life.
Secondary relevance of cancer cachexia in the status of terminal or pre-terminal patients.
Moreover, a further fundamental aspect is worthy to be underlined, as it is likely to concern not only cancer cachexia, but the most part of palliative care dimensions. Symptoms control probably represents an index of activity instead of effectiveness, and it can not be considered by itself a surrogate end point of quality of life without running the risk of drawing erroneous conclusions, as it is probably a relevant, but not fundamental dimension of quality of life assessment.
Surrogate end points are largely used in clinical research, and their use can not be considered wrong by a conceptual point of view. A surrogate end point is an useful index to evaluate a final outcome, as it is usually easier to be evaluated and is evaluable in a shorter time. Conversely, the use of a surrogate end point instead of a final outcome is wrong by a methodological point of view and can lead to draw misleading conclusions. Unfortunately, the use of surrogate end points in clinical research has gained ground in the last years, favouring a lot of conclusions that appear at least questionable when applied to daily clinical practice. Moreover, the use of surrogate end points as outcomes of effectiveness has been extended to survival and even to the assessment of quality of life. The use in clinical research or clinical practice of surrogate end points such as clinical benefit or pain control is not a problem by itself. On the contrary, it should be worthy of renewed attention as concerns cancer-related symptoms and symptoms control. The actual problem is that the assessment of clinical benefit or pain is not used with quality of life assessment, but instead of quality of life assessment, and such an attitude inevitably reduces the quality of life dimension to mere symptoms control. Finally, reviewing the papers reporting data about quality of life assessment in oncology, some points can be highlighted:
Quality of life assessment represents an independent outcome in clinical research and an index of effectiveness of a treatment.
Surrogate end points of quality of life can represent an useful instrument in clinical research or daily clinical practice, on condition that they are used with and within quality of life assessment.
The conclusions of trials using surrogate end points of quality of life instead of quality of life assessment as primary outcome should be evaluated with caution, and no definitive conclusion about quality of life should be drawn from such trials.
The habit of regulators (FDA or EMEA) of using surrogate end points of quality of life to register new drugs should be handled with great caution, and further confirmatory data should be warranted before reaching a definitive confirmation.
The use of surrogate end points of quality of life can be useful within a project of quality of life assessment. On the other hand, the evaluation of quality of life using solely surrogate end points is incorrect by a methodological point of view and can lead to incorrect conclusions, that are just surrogate responses to surrogate questions.
Apolone G: Clinical and outcome research in oncology. The need for integration. Health and Quality of Life Outcomes 2003, 1: 3. 10.1186/1477-7525-1-3
Lee SJ, Earle CC, Weeks JC: Outcomes research in oncology: history, conceptual framework and trends in the literature. J Natl Cancer Inst 2000, 92: 195–204. 10.1093/jnci/92.3.195
ASCO Special Article: Outcomes of cancer treatment for technology assessment and cancer treatment guidelines. J Clin Oncol 1996, 14: 671–9.
Schilsky RL: End points in cancer clinical trials and the drugs approval process. Clin Cancer Res 2002, 8: 935–8.
Johnson JR, Williams G, Pazdur R: End points and United States Food and Drug Administration approval of oncology drugs. J Clin Oncol 2003, 21: 1404–11. 10.1200/JCO.2003.08.072
Apolone G, De Carli G, Brunetti M, Garattini S: Health-related quality of life (HR-QOL) and regulatory issues. An assessment of the European Agency for the Evaluation of Medical Products (EMEA) recommendation on the use of HR-QOL measures in drug approval. Pharmacoeconomics 2001, 19: 187–95.
Sanders C, Egger M, Donovan J, Tallon D, Frankel S: Reporting on quality of life in randomised controlled trials: bibliographic study. BMJ 1998, 317: 1191–4.
Panzini I, Tassinari D, Monticelli G, Sermasi A, Roudnas B, Arcangeli V, Papi M, Fochessati F, Poggi B, Ravaioli A: Quality of life (QoL) in randomized clinical trials (RCT): a critical review of literature. [abstract]. Proc Am Soc Clin Oncol J Clin Oncol 2003, 22: a2952.
Levine MN, Ganz PA: Beyond the development of quality-of-life instruments: where do we go from here? J Clin Oncol 2002, 20: 2215–6. 10.1200/JCO.20.2.405
Garratt A, Schmidt L, Mackintosh A, Fitzpatrick R: Quality of life measurement: bibliographic study of patient assessed health outcome measures. BMJ 2002, 324: 1417–21. 10.1136/bmj.324.7351.1417
Carr AJ, Higginson IJ: Are quality of life measures patient centred? BMJ 2001, 322: 1357–60. 10.1136/bmj.322.7298.1357
Bland MJ, Altman DG: Validating scales and indexes. BMJ 2002, 324: 606–7. 10.1136/bmj.324.7337.606
Bottomley A: The cancer patient and quality of life. The Oncologist 2002, 7: 120–5.
Carr AJ, Gibson B, Robinson PG: Is quality of life determined by expectations or experience? BMJ 2001, 322: 1240–3. 10.1136/bmj.322.7296.1240
Higginson IJ, Carr AJ: Using quality of life measures in the clinical setting. BMJ 2001, 322: 1297–300. 10.1136/bmj.322.7297.1297
Muldoon MF, Barger SD, Flory JD, Manuck SB: What are quality of life measurements measuring? BMJ 1998, 316: 542–5.
Cella D, Chang CH, Lai JS, Webster K: Advances in quality of life measurements in oncology patients. Semin Oncol 2002,29(3 suppl 8):60–8. 10.1053/sonc.2002.33535
Rothemberg ML, Moore MJ, Cripps MC, Andersen JS, Portenoy RK, Burris HA III, Green MR, Tarassoff PG, Brown TD, Casper ES, Storniolo AM, Von Hoff DD: A phase II trial of gemcitabine in patients with 5-FU-refractory pancreas cancer. Ann Oncol 1996, 7: 347–53.
Burris HA III, Moore MJ, Andersen J, Green MR, Rothemberg ML, Modiano MR, Cripps MC, Portenoy RK, Starniolo AM, Tarassoff P, Nelson R, Dorr FA, Stephens CD, Van Hoff DD: Improvements in survival and clinical benefit with gemcitabine as first line therapy for patients with advanced pancreas cancer: a randomized trial. J Clin Oncol 1997, 15: 2403–13.
Verweij J: The benefit of clinical benefit: a European perspective. Ann Oncol 1996, 7: 333–334.
Gelber RD: Gemcitabine for pancreatic cancer: how hard to look for clinical benefit? An American perspective. Ann Oncol 1996, 7: 335–7.
Caraceni A, De Conno F: Analgesic effect of chemotherapy? J Clin Oncol 1998, 16: 803.
Ballatori E, Del Favero A, Roila F: Clinical benefit as a primary efficacy endpoint. J Clin Oncol 1998, 16: 803–4.
Steer CB, Marx GM, Harper PG: Is there quality in clinical benefit? Ann Oncol 2001, 12: 1191–3. 10.1023/A:1012474308888
Hoffman K, Glimelius B: Evaluation of clinical benefit of chemotherapy in patients with upper gastrointestinal cancer. Acta Oncol 1998, 37: 651–9. 10.1080/028418698429991
Vansteenkiste JF, Vandebroek JE, Nackaerts KL, Weynants P, Valcke YJ, Verresen DA, Devogelaere RC, Marien SA, Humblet YP, Dams NL, The Leuven Lung Cancer Group: Clinical-benefit response in advanced non-small-cell lung cancer: a multicentre prospective randomised phase III study of single agent gemcitabine versus cisplatin-vindesine. Ann Oncol 2001, 12: 1221–30. 10.1023/A:1012208711013
Tannock IF, Osoba D, Stockler MR, Ernst DS, Neville AJ, Moore MJ, Armitage GR, Wilson JJ, Venner PM, Coppin CML, Murphy KC: Chemotherapy with mitoxantrone plus prednisone or prednisone alone for symptomatic hormone-resistant prostate cancer: a canadian randomized trial with palliative end points. J Clin Oncol 1996, 14: 1756–64.
Vogelzang NJ: One hundred thirteen men with hormone-refractory prostate cancer died today. J Clin Oncol 1996, 14: 1753–5.
Denes AE: Chemotherapy with mitoxantrone in hormone-refractory prostate cancer. J Clin Oncol 1997, 15: 410–1.
Browman GP: Science, language, intuition, and many meanings of quality of life. J Clin Oncol 1999, 17: 1651–3.
Osoba D, Tannock IF, Ernst DS, Neville A: Heath-related quality of life in men with metastatic prostate cancer treated with prednisone alone or mitoxantrone and prednisone. J Clin Oncol 1999, 17: 1654–63.
Bloomfield DJ, Krahn MD, Neogi T, Panzarella T, Smith TJ, Warde P, Willan AR, Ernst S, Moore MJ, Neville A, Tannock IF: Economic evaluation of chemotherapy with mitoxantrone plus prednisone for symptomatic hormone-resistant prostate cancer: based on a canadian randomized trial with palliative end points. J Clin Oncol 1998, 16: 2272–9.
Fukuoka M, Yano S, Giaccone G, Tamura T, Nakagawa K, Douillard JY, Nishiwaki Y, Vansteenkiste J, Kudo S, Averbuch S, Macleod A, Fayereislova A, Baselga J: Final results from a phase II trial of ZD1839 ('Iressa') for patients with advanced non-small-cell lung cancer (IDEAL 1). [abstract]. J Clin Oncol 2002, 21: 298a.
Kris MG, Natale RB, Herbst RS, Lynch TJ, Prager D, Belani CP, Schiller JH, Kelly K, Spiridonidis C, Albain KS, Brahmer JR, Sandler A, Crawford J, Lutzker SG, Lilenbaum R, Helms L, Wolf M, Averbuch S, Ochs J, Kay A: A phase II trial of ZD1839 ('Iressa') in advanced non-small cell lung cancer (NSCLC) patients who had failed platinum- and docetaxel-based regimens (IDEAL 2). [abstract]. J Clin Oncol 2002, 21: 292a.
Herbst RS: Dose-comparative monotherapy trials of ZD1839 in previously treated Non-Small Cell Lung Cancer patients. Semin Oncol 2003,30(1 supplement 1):30–38. 10.1053/sonc.2003.50030
Cella D: Impact of ZD1839 on Non-Small Cell Lung Cancer-related symptoms as measured by the Functional Assessment of Cancer Therapy-Lung Scale. Semin Oncol 2003,30(1 supplement 1):39–48. 10.1053/sonc.2003.50031
Kaasa S, Loge JH: Quality of life in palliative care: principles and practice. Palliat Med 2003, 17: 11–20. 10.1191/0269216303pm662ra
Kaasa S, Loge JH: Quality of life assessment in palliative care. The Lancet Oncology 2002, 3: 175–82. 10.1016/S1470-2045(02)00682-4
ASCO Special Article: Cancer care during the last phase of life. J Clin Oncol 1998, 16: 1986–96.
Maltoni M, Nanni O, Scarpi E, Rossi D, Serra P, Amadori D: High-dose progestins for the treatment of cancer anorexia-cachexia syndrome: a systematic review of randomised clinical trials. Ann Oncol 2001, 12: 289–300. 10.1023/A:1011156811739