Decentral gene expression analysis: analytical validation of the Endopredict genomic multianalyte breast cancer prognosis test

Ralf Kronenwett, Kerstin Bohmann, Judith Prinzler, Bruno V Sinn, Franziska Haufe, Claudia Roth, Manuela Averdick, Tanja Ropers, Claudia Windbergs, Jan C Brase, Karsten E Weber, Karin Fisch, Berit M Müller, Marcus Schmidt, Martin Filipits, Peter Dubsky, Christoph Petry, Manfred Dietel, Carsten Denkert, Ralf Kronenwett, Kerstin Bohmann, Judith Prinzler, Bruno V Sinn, Franziska Haufe, Claudia Roth, Manuela Averdick, Tanja Ropers, Claudia Windbergs, Jan C Brase, Karsten E Weber, Karin Fisch, Berit M Müller, Marcus Schmidt, Martin Filipits, Peter Dubsky, Christoph Petry, Manfred Dietel, Carsten Denkert

Abstract

Background: EndoPredict (EP) is a clinically validated multianalyte gene expression test to predict distant metastasis in ER-positive, HER2-negative breast cancer treated with endocrine therapy alone. The test is based on the combined analysis of 12 genes in formalin-fixed, paraffin-embedded (FFPE) tissue by reverse transcription-quantitative real-time PCR (RT-qPCR). Recently, it was shown that EP is feasible for reliable decentralized assessment of gene expression. The aim of this study was the analytical validation of the performance characteristics of the assay and its verification in a molecular-pathological routine laboratory.

Methods: Gene expression values to calculate the EP score were assayed by one-step RT-qPCR using RNA from FFPE tumor tissue. Limit of blank, limit of detection, linear range, and PCR efficiency were assessed for each of the 12 PCR assays using serial samples dilutions. Different breast cancer samples were used to evaluate RNA input range, precision and inter-laboratory variability.

Results: PCR assays were linear up to Cq values between 35.1 and 37.2. Amplification efficiencies ranged from 75% to 101%. The RNA input range without considerable change of the EP score was between 0.16 and 18.5 ng/μl. Analysis of precision (variation of day, day time, instrument, operator, reagent lots) resulted in a total noise (standard deviation) of 0.16 EP score units on a scale from 0 to 15. The major part of the total noise (SD 0.14) was caused by the replicate-to-replicate noise of the PCR assays (repeatability) and was not associated with different operating conditions (reproducibility). Performance characteristics established in the manufacturer's laboratory were verified in a routine molecular pathology laboratory. Comparison of 10 tumor samples analyzed in two different laboratories showed a Pearson coefficient of 0.995 and a mean deviation of 0.15 score units.

Conclusions: The EP test showed reproducible performance characteristics with good precision and negligible laboratory-to-laboratory variation. This study provides further evidence that the EP test is suitable for decentralized testing in specialized molecular pathological laboratories instead of a reference laboratory. This is a unique feature and a technical advance in comparison with existing RNA-based prognostic multigene expression tests.

Figures

Figure 1
Figure 1
Translation of the EndoPredict multigene expression test from research laboratory to clinical practice. Workflow of sequential discovery and clinical as well as analytical validation is shown.
Figure 2
Figure 2
RNA input range and reproducibility of EndoPredict. (A) EP scores depending on amount of input RNA. RNAs from 6 different FFPE samples were diluted and EP scores were assessed dependent on RNA input (Cq-ARG as surrogate marker). 95% confidence intervals (CI) of EP scores calculated from the noise model are indicated. (B) Correlation between Cq-ARG and total RNA concentration assessed by RIBOGREEN assay. Lower RNA input limit is indicated by dotted lines. (C) Reproducibility of 160 EP scores assessed in three different RNA samples (low risk, close to the decision point, high risk) over time (11 different working days distributed over 21 calendar days). Individual EP measurement results are indicated by dots.
Figure 3
Figure 3
Verification of performance data at Charité. (A) EP scores depending on amount of input RNA assessed as Cq-ARG. Pre-specified input limit is indicated by a dotted line. 95% CI are given. (B) Correlation of EP scores of 10 different breast cancer FFPE samples assessed at the molecular-pathological laboratory at the Charité compared to reference values assessed at Sividon. The cutoff value between low and high risk for distant metastasis is indicated by dotted lines.

References

    1. Filipits M, Rudas M, Jakesz R, Dubsky P, Fitzal F, Singer CF, Dietze O, Greil R, Jelen A, Sevelda P. et al.A new molecular predictor of distant recurrence in ER-positive, HER2-negative breast cancer adds independent information to conventional clinical risk factors. Clin Cancer Res. 2011;17(18):6012–6020. doi: 10.1158/1078-0432.CCR-11-0926.
    1. Denkert C, Kronenwett R, Schlake W, Bohmann K, Penzel R, Weber KE, Hofler H, Lehmann U, Schirmacher P, Specht K. et al.Decentral gene expression analysis for ER+/Her2- breast cancer: results of a proficiency testing program for the EndoPredict assay. Virchows Arch. 2012;460(3):251–259. doi: 10.1007/s00428-012-1204-4.
    1. Muller BM, Brase JC, Haufe F, Weber KE, Budzies J, Petry C, Prinzler J, Kronenwett R, Dietel M, Denkert C. Comparison of the RNA-based EndoPredict multigene test between core biopsies and corresponding surgical breast cancer sections. J Clin Pathol. 2012;65(7):660–662. doi: 10.1136/jclinpath-2012-200716.
    1. Bohmann K, Hennig G, Rogel U, Poremba C, Mueller BM, Fritz P, Stoerkel S, Schaefer KL. RNA extraction from archival formalin-fixed paraffin-embedded tissue: a comparison of manual, semiautomated, and fully automated purification methods. Clin Chem. 2009;55(9):1719–1727. doi: 10.1373/clinchem.2008.122572.
    1. Muller BM, Kronenwett R, Hennig G, Euting H, Weber K, Bohmann K, Weichert W, Altmann G, Roth C, Winzer KJ. et al.Quantitative determination of estrogen receptor, progesterone receptor, and HER2 mRNA in formalin-fixed paraffin-embedded tissue–a new option for predictive biomarker assessment in breast cancer. Diagn Mol Pathol. 2011;20(1):1–10. doi: 10.1097/PDM.0b013e3181e3630c.
    1. Hennig G, Gehrmann M, Stropp U, Brauch H, Fritz P, Eichelbaum M, Schwab M, Schroth W. Automated extraction of DNA and RNA from a single formalin-fixed paraffin-embedded tissue section for analysis of both single-nucleotide polymorphisms and mRNA expression. Clin Chem. 2010;56(12):1845–1853. doi: 10.1373/clinchem.2010.151233.
    1. Denkert C, Loibl S, Noske A, Roller M, Muller BM, Komor M, Budczies J, Darb-Esfahani S, Kronenwett R, Hanusch C. et al.Tumor-associated lymphocytes as an independent predictor of response to neoadjuvant chemotherapy in breast cancer. J Clin Oncol. 2010;28(1):105–113. doi: 10.1200/JCO.2009.23.7370.
    1. Veer LJ v 't, Dai H, van de Vijver MJ, He YD, Hart AA, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT. et al.Gene expression profiling predicts clinical outcome of breast cancer. Nature. 2002;415(6871):530–536. doi: 10.1038/415530a.
    1. Paik S, Shak S, Tang G, Kim C, Baker J, Cronin M, Baehner FL, Walker MG, Watson D, Park T. et al.A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. N Engl J Med. 2004;351(27):2817–2826. doi: 10.1056/NEJMoa041588.
    1. Gray RG, Quirke P, Handley K, Lopatin M, Magill L, Baehner FL, Beaumont C, Clark-Langone KM, Yoshizawa CN, Lee M. et al.Validation study of a quantitative multigene reverse transcriptase-polymerase chain reaction assay for assessment of recurrence risk in patients with stage II colon cancer. J Clin Oncol. 2011;29(35):4611–4619. doi: 10.1200/JCO.2010.32.8732.
    1. Parker JS, Mullins M, Cheang MC, Leung S, Voduc D, Vickery T, Davies S, Fauron C, He X, Hu Z. et al.Supervised risk predictor of breast cancer based on intrinsic subtypes. J Clin Oncol. 2009;27(8):1160–1167. doi: 10.1200/JCO.2008.18.1370.
    1. Nielsen TO, Parker JS, Leung S, Voduc D, Ebbert M, Vickery T, Davies SR, Snider J, Stijleman IJ, Reed J. et al.A comparison of PAM50 intrinsic subtyping with immunohistochemistry and clinical prognostic factors in tamoxifen-treated estrogen receptor-positive breast cancer. Clin Cancer Res. 2010;16(21):5222–5232. doi: 10.1158/1078-0432.CCR-10-1282.
    1. CLSI. Verification and validation of multiplex nucleic acid assays; approved guideline. CLSI document MM17-A. Wayne, PA: Clinical and Laboratory Standards Institute; 2008.
    1. Paska C, Bogi K, Szilak L, Tokes A, Szabo E, Sziller I, Rigo J Jr, Sobel G, Szabo I, Kaposi-Novak P. et al.Effect of formalin, acetone, and RNAlater fixatives on tissue preservation and different size amplicons by real-time PCR from paraffin-embedded tissue. Diagn Mol Pathol. 2004;13(4):234–240. doi: 10.1097/01.pdm.0000134778.37729.9f.
    1. CLSI. Use of external RNA controls in gene expression assays; approved guideline. CLSI document MM16-A. Wayne, PA: Clinical and Laboratory Standards Institute; 2006.
    1. NCCLS. Protocols for determination of limits of detection and limits of quantitation; approved guideline. NCCLS document EP17-A. Wayne, PA: NCCLS; 2004.
    1. NCCLS. Evaluation of the linearity of quantitative measurement procedures: a statistical approach; approved guideline. NCCLS document EP6-A. Wayne, PA: NCCLS; 2003.
    1. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, Kubista M, Mueller R, Nolan T, Pfaffl MW, Shipley GL. et al.The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009;55(4):611–622. doi: 10.1373/clinchem.2008.112797.
    1. International Organisation of Standardization. ISO 5725-2. Accuracy (trueness and precision) of measurement methods and results – Part 2: basic method for the determination of repeatability and reproducibility of a standard measurement method. British Standards Institution BS ISO 5725-2. Geneva: International Organization of Standardization; 1994.
    1. NCCLS. Evaluation of precision performance of quantitative measurement methods; approved guideline-second edition. NCCLS document EP5-A2. Wayne, PA: NCCLS; 2004.
    1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–310.
    1. Simon RM, Paik S, Hayes DF. Use of archived specimens in evaluation of prognostic and predictive biomarkers. J Natl Cancer Inst. 2009;101(21):1446–1452. doi: 10.1093/jnci/djp335.
    1. National Research Council. Evolution of Translational Omics: Lessons Learned and the Path Forward. Washington, DC: The National Academies Press; 2012.
    1. Glas AM, Floore A, Delahaye LJ, Witteveen AT, Pover RC, Bakx N, Lahti-Domenici JS, Bruinsma TJ, Warmoes MO, Bernards R. et al.Converting a breast cancer microarray signature into a high-throughput diagnostic test. BMC Genomics. 2006;7:278. doi: 10.1186/1471-2164-7-278.
    1. Cronin M, Sangli C, Liu ML, Pho M, Dutta D, Nguyen A, Jeong J, Wu J, Langone KC, Watson D. Analytical validation of the Oncotype DX genomic diagnostic test for recurrence prognosis and therapeutic response prediction in node-negative, estrogen receptor-positive breast cancer. Clin Chem. 2007;53(6):1084–1091. doi: 10.1373/clinchem.2006.076497.
    1. Clark-Langone KM, Sangli C, Krishnakumar J, Watson D. Translating tumor biology into personalized treatment planning: analytical performance characteristics of the Oncotype DX Colon Cancer Assay. BMC Cancer. 2010;10:691. doi: 10.1186/1471-2407-10-691.
    1. Varga Z, Diebold J, Dommann-Scherrer C, Frick H, Kaup D, Noske A, Obermann E, Ohlschlegel C, Padberg B, Rakozy C. et al.How reliable is Ki-67 immunohistochemistry in grade 2 breast carcinomas? A QA study of the Swiss Working Group of Breast- and Gynecopathologists. PloS one. 2012;7(5):e37379. doi: 10.1371/journal.pone.0037379.

Source: PubMed

3
Abonnere