Reliability of an e-PRO Tool of EORTC QLQ-C30 for Measurement of Health-Related Quality of Life in Patients With Breast Cancer: Prospective Randomized Trial

Markus Wallwiener, Lina Matthies, Elisabeth Simoes, Lucia Keilmann, Andreas D Hartkopf, Alexander N Sokolov, Christina B Walter, Nina Sickenberger, Stephanie Wallwiener, Manuel Feisst, Paul Gass, Peter A Fasching, Michael P Lux, Diethelm Wallwiener, Florin-Andrei Taran, Joachim Rom, Andreas Schneeweiss, Joachim Graf, Sara Y Brucker, Markus Wallwiener, Lina Matthies, Elisabeth Simoes, Lucia Keilmann, Andreas D Hartkopf, Alexander N Sokolov, Christina B Walter, Nina Sickenberger, Stephanie Wallwiener, Manuel Feisst, Paul Gass, Peter A Fasching, Michael P Lux, Diethelm Wallwiener, Florin-Andrei Taran, Joachim Rom, Andreas Schneeweiss, Joachim Graf, Sara Y Brucker

Abstract

Background: Breast cancer represents the most common malignant disease in women worldwide. As currently systematic palliative treatment only has a limited effect on survival rates, the concept of health-related quality of life (HRQoL) is gaining more and more importance in the therapy setting of metastatic breast cancer. One of the major patient-reported outcomes (PROs) for measuring HRQoL in patients with breast cancer is provided by the European Organization for Research and Treatment of Cancer (EORTC). Currently, paper-based surveys still predominate, as only a few reliable and validated electronic-based questionnaires are available. Facing the possibilities associated with evolving digitalization in medicine, validation of electronic versions of well-established PRO is essential in order to contribute to comprehensive and holistic oncological care and to ensure high quality in cancer research.

Objective: The aim of this study was to analyze the reliability of a tablet-based measuring application for EORTC QLQ-C30 in German language in patients with adjuvant and (curative) metastatic breast cancer.

Methods: Paper- and tablet-based questionnaires were completed by a total of 106 female patients with adjuvant and metastatic breast cancer recruited as part of the e-PROCOM study. All patients were required to complete the electronic- (e-PRO) and paper-based versions of the HRQoL EORTC QLQ-C30 questionnaire. A frequency analysis was performed to determine descriptive sociodemographic characteristics. Both dimensions of reliability (parallel forms reliability [Wilcoxon test] and test of internal consistency [Spearman rho and agreement rates for single items, Pearson correlation and Kendall tau for each scale]) were analyzed.

Results: High correlations were shown for both dimensions of reliability (parallel forms reliability and internal consistency) in the patient's response behavior between paper- and electronic-based questionnaires. Regarding the test of parallel forms reliability, no significant differences were found in 27 of 30 single items and in 14 of 15 scales, whereas a statistically significant correlation in the test of consistency was found in all 30 single items and all 15 scales.

Conclusions: The evaluated e-PRO version of the EORTC QLQ-C30 is reliable for patients with both adjuvant and metastatic breast cancer, showing a high correlation in almost all questions (and in many scales). Thus, we conclude that the validated paper-based PRO assessment and the e-PRO tool are equally valid. However, the reliability should also be analyzed in other prospective trials to ensure that usability is reliable in all patient groups.

Trial registration: ClinicalTrials.gov NCT03132506; https://ichgcp.net/clinical-trials-registry/NCT03132506 (Archived by WebCite at http://www.webcitation.org/6tRcgQuou).

Keywords: EORTC QLQ-C30; HRQoL; breast cancer; patient-reported outcomes; reliability.

Conflict of interest statement

Conflicts of Interest: PG has received honoraria from Novartis and financial support for symposia from Novartis, Roche, and PharmaMar. The other authors declare that they have no conflict of interest.

©Markus Wallwiener, Lina Matthies, Elisabeth Simoes, Lucia Keilmann, Andreas D Hartkopf, Alexander N Sokolov, Christina B Walter, Nina Sickenberger, Stephanie Wallwiener, Manuel Feisst, Paul Gass, Peter A Fasching, Michael P Lux, Diethelm Wallwiener, Florin-Andrei Taran, Joachim Rom, Andreas Schneeweiss, Joachim Graf, Sara Y Brucker. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.09.2017.

Figures

Figure 1
Figure 1
Screenshot of PiiA application of the EORTC QLQ-C30 questionnaire for 4-point-scale questions (German).
Figure 2
Figure 2
Screenshot of PiiA application of the EORTC QLQ-C30 questionnaire for 7-point-scalekaled questions (German).
Figure 3
Figure 3
Bland-Altman plot for overall state of health.
Figure 4
Figure 4
The CONSORT flow diagram.

References

    1. Krebsdaten. 2016. [2017-08-28]. Bericht zum krebsgeschehen in Deutschland 2016 .
    1. Verma S, Miles D, Gianni L, Krop IE, Welslau M, Baselga J, Pegram M, Oh D, Diéras V, Guardino E, Fang L, Lu MW, Olsen S, Blackwell K. Trastuzumab emtansine for HER2-positive advanced breast cancer. N Engl J Med. 2012 Nov 08;367(19):1783–91. doi: 10.1056/NEJMoa1209124.
    1. Baselga J, Cortés J, Kim S, Im S, Hegg R, Im Y, Roman L, Pedrini JL, Pienkowski T, Knott A, Clark E, Benyunes MC, Ross G, Swain SM. Pertuzumab plus trastuzumab plus docetaxel for metastatic breast cancer. N Engl J Med. 2012 Jan 12;366(2):109–19. doi: 10.1056/NEJMoa1113216.
    1. Baselga J, Campone M, Piccart M, Burris HA, Rugo HS, Sahmoud T, Noguchi S, Gnant M, Pritchard KI, Lebrun F, Beck JT, Ito Y, Yardley D, Deleu I, Perez A, Bachelot T, Vittori L, Xu Z, Mukhopadhyay P, Lebwohl D, Hortobagyi GN. Everolimus in postmenopausal hormone-receptor-positive advanced breast cancer. N Engl J Med. 2012 Feb 09;366(6):520–9. doi: 10.1056/NEJMoa1109653.
    1. Hortobagyi GN, Stemmer SM, Burris HA, Yap Y, Sonke GS, Paluch-Shimon S, Campone M, Blackwell KL, André F, Winer EP, Janni W, Verma S, Conte P, Arteaga CL, Cameron DA, Petrakova K, Hart LL, Villanueva C, Chan A, Jakobsen E, Nusch A, Burdaeva O, Grischke E, Alba E, Wist E, Marschner N, Favret AM, Yardley D, Bachelot T, Tseng L, Blau S, Xuan F, Souami F, Miller M, Germa C, Hirawat S, O'Shaughnessy J. Ribociclib as first-line therapy for HR-positive, advanced breast cancer. N Engl J Med. 2016 Dec 03;375(18):1738–48. doi: 10.1056/NEJMoa1609709.
    1. Finn RS, Crown JP, Lang I, Boer K, Bondarenko IM, Kulyk SO, Ettl J, Patel R, Pinter T, Schmidt M, Shparyk Y, Thummala AR, Voytko NL, Fowst C, Huang X, Kim ST, Randolph S, Slamon DJ. The cyclin-dependent kinase 4/6 inhibitor palbociclib in combination with letrozole versus letrozole alone as first-line treatment of oestrogen receptor-positive, HER2-negative, advanced breast cancer (PALOMA-1/TRIO-18): a randomised phase 2 study. Lancet Oncol. 2015 Jan;16(1):25–35. doi: 10.1016/S1470-2045(14)71159-3.
    1. Finn RS, Martin M, Rugo HS, Jones S, Im S, Gelmon K, Harbeck N, Lipatov ON, Walshe JM, Moulder S, Gauthier E, Lu DR, Randolph S, Diéras V, Slamon DJ. Palbociclib and letrozole in advanced breast cancer. N Engl J Med. 2016 Dec 17;375(20):1925–36. doi: 10.1056/NEJMoa1607303.
    1. Dufresne A, Pivot X, Tournigand C, Facchini T, Altweegg T, Chaigneau L, De GA. Impact of chemotherapy beyond the first line in patients with metastatic breast cancer. Breast Cancer Res Treat. 2008 Jan;107(2):275–9. doi: 10.1007/s10549-007-9550-7.
    1. Kucharczyk MJ, Parpia S, Walker-Dilks C, Banfield L, Swaminath A. Ablative therapies in metastatic breast cancer: a systematic review. Breast Cancer Res Treat. 2017 Jul;164(1):13–25. doi: 10.1007/s10549-017-4228-2.
    1. Kassam F, Enright K, Dent R, Dranitsaris G, Myers J, Flynn C, Fralick M, Kumar R, Clemons M. Survival outcomes for patients with metastatic triple-negative breast cancer: implications for clinical practice and trial design. Clin Breast Cancer. 2009 Feb;9(1):29–33. doi: 10.3816/CBC.2009.n.005.
    1. Savci-Heijink CD, Halfwerk H, Hooijer GK, Horlings HM, Wesseling J, van de Vijver MJ. Retrospective analysis of metastatic behaviour of breast cancer subtypes. Breast Cancer Res Treat. 2015 Apr;150(3):547–57. doi: 10.1007/s10549-015-3352-0.
    1. Wintner LM, Giesinger JM, Zabernigg A, Sztankay M, Meraner V, Pall G, Hilbe W, Holzner B. Quality of life during chemotherapy in lung cancer patients: results across different treatment lines. Br J Cancer. 2013 Oct 29;109(9):2301–8. doi: 10.1038/bjc.2013.585. doi: 10.1038/bjc.2013.585.
    1. Trautmann F, Hentschel L, Hornemann B, Rentsch A, Baumann M, Ehninger G, Schmitt J, Schuler M. Electronic real-time assessment of patient-reported outcomes in routine care-first findings and experiences from the implementation in a comprehensive cancer center. Support Care Cancer. 2016 Jul;24(7):3047–56. doi: 10.1007/s00520-016-3127-0.
    1. Goodwin PJ, Ennis M, Bordeleau LJ, Pritchard KI, Trudeau ME, Koo J, Hood N. Health-related quality of life and psychosocial status in breast cancer prognosis: analysis of multiple variables. J Clin Oncol. 2004 Oct 15;22(20):4184–92. doi: 10.1200/JCO.2004.12.091.
    1. Awmf. 2012. [2017-08-28]. Interdisziplinaere S3-leitlinie fuer die diagnostik, therapie und nachsorge des mammakarzinoms .
    1. WHO. [2017-08-28]. WHOQOL: measuring quality of life
    1. Ritsner M, Modai I, Endicott J, Rivkin O, Nechamkin Y, Barak P, Goldin V, Ponizovsky A. Differences in quality of life domains and psychopathologic and psychosocial factors in psychiatric patients. J Clin Psychiatry. 2000 Nov;61(11):880–9; quiz 890.
    1. Cortés J, Baselga J, Im Y, Im S, Pivot X, Ross G, Clark E, Knott A, Swain SM. Health-related quality-of-life assessment in CLEOPATRA, a phase III study combining pertuzumab with trastuzumab and docetaxel in metastatic breast cancer. Ann Oncol. 2013 Oct;24(10):2630–5. doi: 10.1093/annonc/mdt274.
    1. Korpela J, Mali P, Kaljonen A, Salminen E. Quality of life of patients with metastatic breast cancer treated with epirubicin and docetaxel. IJCM. 2011;02(03):346–51. doi: 10.4236/ijcm.2011.23060.
    1. Karamouzis MV, Ioannidis G, Rigatos G. Quality of life in metastatic breast cancer patients under chemotherapy or supportive care: a single-institution comparative study. Eur J Cancer Care (Engl) 2007 Sep;16(5):433–8. doi: 10.1111/j.1365-2354.2006.00771.x.
    1. Raphael J, Verma S. Overall survival (OS) endpoint: an incomplete evaluation of metastatic breast cancer (MBC) treatment outcome. Breast Cancer Res Treat. 2015 Apr;150(3):473–8. doi: 10.1007/s10549-015-3342-2.
    1. Stefanovic S, Wallwiener M, Karic U, Domschke C, Katic L, Taran F, Pesic A, Hartkopf A, Hadji P, Teufel M, Schuetz F, Sohn C, Fasching P, Schneeweiss A, Brucker S. Patient-reported outcomes (PRO) focused on adverse events (PRO-AEs) in adjuvant and metastatic breast cancer: clinical and translational implications. Support Care Cancer. 2017 Feb;25(2):549–58. doi: 10.1007/s00520-016-3437-2.
    1. Abernethy AP, Herndon JE, Wheeler JL, Day JM, Hood L, Patwardhan M, Shaw H, Lyerly HK. Feasibility and acceptability to patients of a longitudinal system for evaluating cancer-related symptoms and quality of life: pilot study of an e/Tablet data-collection system in academic oncology. J Pain Symptom Manage. 2009 Jun;37(6):1027–38. doi: 10.1016/j.jpainsymman.2008.07.011.
    1. Pakhomov SV, Jacobsen SJ, Chute CG, Roger VL. Agreement between patient-reported symptoms and their documentation in the medical record. Am J Manag Care. 2008 Aug;14(8):530–9.
    1. Wuerstlein R, Kirkovits T, Drewes C, Schiltz D, Bauerfeind I, Haidinger R, Paradies K, Goldmann-Posch U, Schinkoethe T, Harbeck N. Abstract P2-10-05: eHealth in modern breast cancer treatment: new possibilities in communication between patients, doctors and nursing staff: Cancer Res. 2015 Apr 30;75(9 Supplement):Abstract nr P2-10-05. doi: 10.1158/1538-7445.SABCS14-P2-10-05.
    1. FDA (Food and Drug Administration) FDA. 2009. [2017-08-28]. Guidance for industry: patient-reported outcome measures; use in medical product development to support labeling claims, Stand .
    1. Snyder CF, Jensen RE, Segal JB, Wu AW. Patient-reported outcomes (PROs): putting the patient perspective in patient-centered outcomes research. Med Care. 2013 Aug;51(8 Suppl 3):S73–9. doi: 10.1097/MLR.0b013e31829b1d84.
    1. Bitton A, Onega T, Tosteson AN, Haas JS. Toward a better understanding of patient-reported outcomes in clinical practice. Am J Manag Care. 2014 Apr;20(4):281–3.
    1. Valderas JM, Alonso J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res. 2008 Nov;17(9):1125–35. doi: 10.1007/s11136-008-9396-4.
    1. Szende A, Leidy NK, Revicki D. Health-related quality of life and other patient-reported outcomes in the European centralized drug regulatory process: a review of guidance documents and performed authorizations of medicinal products 1995 to 2003. Value Health. 2005;8(5):534–48. doi: 10.1111/j.1524-4733.2005.00051.x.
    1. Basch E. Patient-reported outcomes in drug safety evaluation. Ann Oncol. 2009 Dec;20(12):1905–6. doi: 10.1093/annonc/mdp542.
    1. Basch E, Jia X, Heller G, Barz A, Sit L, Fruscione M, Appawu M, Iasonos A, Atkinson T, Goldfarb S, Culkin A, Kris MG, Schrag D. Adverse symptom event reporting by patients vs clinicians: relationships with clinical outcomes. J Natl Cancer Inst. 2009 Dec 2;101(23):1624–32. doi: 10.1093/jnci/djp386.
    1. Basch E, Goldfarb S. Electronic patient-reported outcomes for collecting sensitive information from patients. J Support Oncol. 2009;7(3):98–9.
    1. Basch E. New frontiers in patient-reported outcomes: adverse event reporting, comparative effectiveness, and quality assessment. Annu Rev Med. 2014;65:307–17.
    1. Willke RJ, Burke LB, Erickson P. Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. Control Clin Trials. 2004 Dec;25(6):535–52. doi: 10.1016/j.cct.2004.09.003.
    1. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, Selby PJ. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004 Feb 15;22(4):714–24. doi: 10.1200/JCO.2004.06.078.
    1. Wallwiener M, Simoes E, Sokolov AN, Brucker SY, Fasching PA, Graf J. Health-related quality of life in metastatic and adjuvant breast cancer patients. Geburtshilfe Frauenheilkd. 2016 Oct;76(10):1065–73. doi: 10.1055/s-0042-113188.
    1. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de HJC. The European organization for research and treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993 Mar 3;85(5):365–76.
    1. Basch E, Iasonos A, Barz A, Culkin A, Kris MG, Artz D, Fearn P, Speakman J, Farquhar R, Scher HI, McCabe M, Schrag D. Long-term toxicity monitoring via electronic patient-reported outcomes in patients receiving chemotherapy. J Clin Oncol. 2007 Dec 01;25(34):5374–80. doi: 10.1200/JCO.2007.11.2243.
    1. Judson TJ, Bennett AV, Rogak LJ, Sit L, Barz A, Kris MG, Hudis CA, Scher HI, Sabattini P, Schrag D, Basch E. Feasibility of long-term patient self-reporting of toxicities from home via the internet during routine chemotherapy. J Clin Oncol. 2013 Jul 10;31(20):2580–5. doi: 10.1200/JCO.2012.47.6804.
    1. Graf J, Simoes E, Wißlicen K, Rava L, Walter CB, Hartkopf A, Keilmann L, Taran A, Wallwiener S, Fasching P, Brucker SY, Wallwiener M. Willingness of patients with breast cancer in the adjuvant and metastatic setting to use electronic surveys (ePRO) depends on sociodemographic factors, health-related quality of life, disease status and computer skills. Geburtshilfe Frauenheilkd. 2016 May;76(5):535–41. doi: 10.1055/s-0042-105872.
    1. Hartkopf AD, Graf J, Simoes E, Keilmann L, Sickenberger N, Gass P, Wallwiener D, Matthies L, Taran F, Lux MP, Wallwiener S, Belleville E, Sohn C, Fasching PA, Schneeweiss A, Brucker SY, Wallwiener M. Electronic-based patient-reported outcomes: willingness, needs, and barriers in adjuvant and metastatic breast cancer patients. JMIR Cancer. 2017 Aug 07;3(2):e11. doi: 10.2196/cancer.6996.
    1. Barentsz MW, Wessels H, van Diest PJ, Pijnappel RM, Haaring C, van der Pol CC, Witkamp AJ, van DB, Verkooijen HM. Tablet, web-based, or paper questionnaires for measuring anxiety in patients suspected of breast cancer: patients' preferences and quality of collected data. J Med Internet Res. 2014;16(10):e239. doi: 10.2196/jmir.3578.
    1. Steele GC, Gill A, Khan AI, Hans PK, Kuluski K, Cott C. The electronic patient reported outcome tool: testing usability and feasibility of a mobile app and portal to support care for patients with complex chronic disease and disability in primary care settings. JMIR Mhealth Uhealth. 2016 Jun 02;4(2):e58. doi: 10.2196/mhealth.5331.
    1. Ayana BA, Negash S, Yusuf L, Tigeneh W, Haile D. Reliability and validity of amharic version of EORTC QLQ-C 30 questionnaire among gynecological cancer patients in Ethiopia. PLoS One. 2016;11(6):e0157359. doi: 10.1371/journal.pone.0157359.
    1. Schwartzberg L. Electronic patient-reported outcomes: the time is ripe for integration into patient care and clinical research. Am Soc Clin Oncol Educ Book. 2016;35:e89–96. doi: 10.14694/EDBK_158749.
    1. Lachin JM. Statistical properties of randomization in clinical trials. Control Clin Trials. 1988 Dec;9(4):289–311.
    1. Schulz KF. Randomized controlled trials. Clin Obstet Gynecol. 1998 Jun;41(2):245–56.
    1. EORTC. 2001. [2017-09-06]. EORTC QLQ C-30 scoring manual .
    1. Brady MJ, Cella DF, Mo F, Bonomi AE, Tulsky DS, Lloyd SR, Deasy S, Cobleigh M, Shiomoto G. Reliability and validity of the functional assessment of cancer therapy-breast quality-of-life instrument. J Clin Oncol. 1997 Mar;15(3):974–86.
    1. Kemmler G, Holzner B, Kopp M, Dünser M, Margreiter R, Greil R, Sperner-Unterweger B. Comparison of two quality-of-life instruments for cancer patients: the functional assessment of cancer therapy-general and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-C30. J Clin Oncol. 1999 Sep;17(9):2932–40. doi: 10.1200/JCO.1999.17.9.2932.
    1. Schaeffeler N, Pfeiffer K, Ringwald J, Brucker SY, Wallwiener M, Zipfel S, Teufel M. Assessing the need for psychooncological support: screening instruments in combination with patients' subjective evaluation may define psychooncological pathways. Psychooncology. 2015 Dec;24(12):1784–91. doi: 10.1002/pon.3855.

Source: PubMed

3
Tilaa