The predictive accuracy of PREDICT: a personalized decision-making tool for Southeast Asian women with breast cancer
Hoong-Seam Wong, Shridevi Subramaniam, Zarifah Alias, Nur Aishah Taib, Gwo-Fuang Ho, Char-Hong Ng, Cheng-Har Yip, Helena M Verkooijen, Mikael Hartman, Nirmala Bhoo-Pathy, Hoong-Seam Wong, Shridevi Subramaniam, Zarifah Alias, Nur Aishah Taib, Gwo-Fuang Ho, Char-Hong Ng, Cheng-Har Yip, Helena M Verkooijen, Mikael Hartman, Nirmala Bhoo-Pathy
Abstract
Web-based prognostication tools may provide a simple and economically feasible option to aid prognostication and selection of chemotherapy in early breast cancers. We validated PREDICT, a free online breast cancer prognostication and treatment benefit tool, in a resource-limited setting. All 1480 patients who underwent complete surgical treatment for stages I to III breast cancer from 1998 to 2006 were identified from the prospective breast cancer registry of University Malaya Medical Centre, Kuala Lumpur, Malaysia. Calibration was evaluated by comparing the model-predicted overall survival (OS) with patients' actual OS. Model discrimination was tested using receiver-operating characteristic (ROC) analysis. Median age at diagnosis was 50 years. The median tumor size at presentation was 3 cm and 54% of patients had lymph node-negative disease. About 55% of women had estrogen receptor-positive breast cancer. Overall, the model-predicted 5 and 10-year OS was 86.3% and 77.5%, respectively, whereas the observed 5 and 10-year OS was 87.6% (difference: -1.3%) and 74.2% (difference: 3.3%), respectively; P values for goodness-of-fit test were 0.18 and 0.12, respectively. The program was accurate in most subgroups of patients, but significantly overestimated survival in patients aged <40 years, and in those receiving neoadjuvant chemotherapy. PREDICT performed well in terms of discrimination; areas under ROC curve were 0.78 (95% confidence interval [CI]: 0.74-0.81) and 0.73 (95% CI: 0.68-0.78) for 5 and 10-year OS, respectively. Based on its accurate performance in this study, PREDICT may be clinically useful in prognosticating women with breast cancer and personalizing breast cancer treatment in resource-limited settings.
Conflict of interest statement
The authors have no conflicts of interest to disclose.
Figures
References
- Engelhardt EG, Garvelink MM, de Haes JH, et al. Predicting and communicating the risk of recurrence and death in women with early-stage breast cancer: a systematic review of risk prediction models. J Clin Oncol 2014; 32:238–250.
- Paik S, Shak S, Tang G, et al. Multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. New Engl J Med 2004; 351:2817–2826.
- Van de Vijver MJ, He YD, van’t Veer LJ, et al. A gene-expression signature as a predictor of survival in breast cancer. New Engl J Med 2002; 347:1999–2009.
- Paik S. Is gene array testing to be considered routine now? Breast 2011; 20:S87–S91.
- Kim C, Paik S. Gene-expression-based prognostic assays for breast cancer. Nat Rev Clin Oncol 2010; 7:340–347.
- Bonastre J, Marguet S, Lueza B, et al. Cost effectiveness of molecular profiling for adjuvant decision making in patients with node-negative breast cancer. J Clin Oncol 2014; 32:3513–3519.
- Bhoo Pathy N, Yip CH, Taib NA, et al. Breast cancer in a multi-ethnic Asian setting: results from the Singapore-Malaysia hospital-based breast cancer registry. Breast 2011; 20:S75–S80.
- Kwong A, Mang OW, Wong CH, et al. Breast cancer in Hong Kong, Southern China: the first population-based analysis of epidemiological characteristics, stage-specific, cancer-specific, and disease-free survival in breast cancer patients: 1997–2001. Ann Surg Oncol 2011; 18:3072–3078.
- Raina V, Bhutani M, Bedi R, et al. Clinical features and prognostic factors of early breast cancer at a major cancer center in North India. Indian J Cancer 2005; 42:40–45.
- de Glas NA, van de Water WA, Engelhardt EG, et al. Validity of Adjuvant! Online program in older patients with breast cancer: a population-based study. Lancet Oncol 2014; 15:722–729.
- Love N. Management of breast cancer in the adjuvant and metastatic settings. Patt Care Med Oncol 2005; 2: . Accessed November 10, 2014.
- Engelhardt EG, Pieterse AH, van Duijn-Bakker N, et al. Breast cancer specialists’ views on and use of risk prediction models in clinical practice: a mixed methods approach. Acta Oncol 2014; 13:1–7.
- Ravdin PM, Siminoff LA, Davis GJ, et al. Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol 2001; 19:980–991.
- Wishart GC, Azzato EM, Greenberg DC, et al. PREDICT: a new UK prognostic model that predicts survival following surgery for invasive breast cancer. Breast Cancer Res 2010; 12:R1.
- Michaelson JS, Chen L, Bush D, et al. Improved web-based calculators for predicting breast carcinoma outcomes. Breast Cancer Res Treat 2011; 128:827–835.
- Mook S, Schmidt MK, Rutgers EJ, et al. Calibration and discriminatory accuracy of prognosis calculation for breast cancer with the online Adjuvant! program: a hospital-based retrospective cohort study. Lancet Oncol 2009; 10:1070–1076.
- Olivotto IA, Bajdik CD, Ravdin PM, et al. Population-based validation of the prognostic model ADJUVANT! For early breast cancer. J Clin Oncol 2005; 20:2716–2725.
- Wishart GC, Bajdik CD, Azzato EM, et al. A population-based validation of the prognostic model PREDICT for early breast cancer. Eur J Surg Oncol 2011; 37:411–417.
- Wishart GC, Bajdik CD, Dicks E, et al. PREDICT plus: development and validation of a prognostic model for early breast cancer that includes HER2. Br J Cancer 2012; 107:800–807.
- Bush D, Michaelson JS. Technical report for the paper: improved web-based calculators for predicting breast carcinoma outcomes. Laboratory for Quantitative Medicine, Technical Report #12. . Published June 17, 2010 Accessed October 23, 2014.
- Hajage D, de Rycke Y, Bollet M, et al. External validation of Adjuvant! Online breast cancer prognosis tool. Prioritizing recommendations for improvement. PLoS One 2011; 6:e27446.
- Campbell HE, Taylor MA, Harris AL, et al. An investigation into the performance of the Adjuvant! Online prognostic programme in early breast cancer for a cohort of patients in the United Kingdom. Br J Cancer 2009; 101:1074–1084.
- Bhoo-Pathy N, Yip CH, Hartman M, et al. Adjuvant! Online is overoptimistic in predicting survival of Asian breast cancer patients. Eur J Cancer 2012; 48:982–989.
- Kuo YL, Chen DR, Chang TW. Accuracy validation of Adjuvant! Online in Taiwanese breast cancer patients—a 10-year analysis. BMC Med Inform Decision Making 2012; 12:108.
- Jung M, Choi EH, Nam CM, et al. Application of the Adjuvant! Online model to Korean breast cancer patients: an assessment of prognostic accuracy and development of an alternative prognostic tool. Ann Surg Oncol 2013; 20:2615–2624.
- Lim GCC, Yahaya H. Second Report of the National Cancer Registry. Cancer Incidence in Malaysia 2003. 2004; Kuala Lumpur: National Cancer Registry,
- Bamber D. The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. J Math Psy 1975; 12:387–415.
- Hanley JA, McNeil BJ. The meaning of the use of the area under the receiver operating characteristic (ROC) curve. Radiology 1982; 143:29–36.
- Eifel P, Axelson JA, Costa J, et al. National Institutes of Health Consensus Development Conference Statement: adjuvant therapy for breast cancer, November 1-3, 2000. J Natl Cancer Inst 2001; 93:979–989.
- Adami HO, Malker B, Holmberg L, et al. The relation between survival and age at diagnosis in breast cancer. N Eng J Med 1986; 315:559–563.
- Nixon AJ, Neuberg D, Hayes DF, et al. Relationship of patient age to pathologic features of the tumor and prognosis for patients with stage I or stage II breast cancer. J Clin Oncol 1994; 12:888–894.
- Fredholm H, Eaker S, Frisell J, et al. Breast cancer in young women: poor survival despite intensive treatment. PloS One 2009; 4:e7695.
- McKenzie F, Jeffreys M. Do lifestyle or social factors explain ethnic/racial inequalities in breast cancer survival? Epidemiol Rev 2009; 31:52–66.
- Bhoo-Pathy N, Hartman M, Yip CH, et al. Ethnic differences in survival after breast cancer in South East Asia. PLoS One 2012; 7:e30995.
- Bhoo Pathy N, Uiterwaal CS, Taib NA, et al. Gradually implemented new biomarkers for prognostication of breast cancer: complete case analysis may introduce bias. J Clin Epid 2011; 65:568–571.
- Cheang MC, Chia SK, Voduc D, et al. Ki67 index, HER2 status, and prognosis of patients with luminal B breast cancer. J Natl Cancer Inst 2009; 101:736–750.
- McKeigue PM, Shah B, Marmot MG. Relation of central obesity and insulin resistance with high diabetes prevalence and cardiovascular risk in South Asians. Lancet 1991; 337:382–386.
- Jones LW, Haykowsky MJ, Swartz JJ, et al. Early breast cancer therapy and cardiovascular injury. J Am Coll Cardiol 2007; 50:1435–1441.
- Burke HB, Goodman PH, Rosen DB, et al. Artificial neural networks improve the accuracy of cancer survival prediction. Cancer 1997; 79:857–862.
- Lundin M, Lundin J, Burke HB, et al. Artificial neural networks applied to survival prediction in breast cancer. Oncology 1999; 57:281–286.
- Gupta S, Tran T, Luo W, et al. Machine-learning prediction of cancer survival: a retrospective study using electronic administrative records and a cancer registry. BMJ Open 2014; 4:e004007.
Source: PubMed