The Computer-based Health Evaluation Software (CHES): a software for electronic patient-reported outcome monitoring

Bernhard Holzner, Johannes M Giesinger, Jakob Pinggera, Stefan Zugal, Felix Schöpf, Anne S Oberguggenberger, Eva M Gamper, August Zabernigg, Barbara Weber, Gerhard Rumpold, Bernhard Holzner, Johannes M Giesinger, Jakob Pinggera, Stefan Zugal, Felix Schöpf, Anne S Oberguggenberger, Eva M Gamper, August Zabernigg, Barbara Weber, Gerhard Rumpold

Abstract

Background: Patient-reported Outcomes (PROs) capturing e.g., quality of life, fatigue, depression, medication side-effects or disease symptoms, have become important outcome parameters in medical research and daily clinical practice. Electronic PRO data capture (ePRO) with software packages to administer questionnaires, storing data, and presenting results has facilitated PRO assessment in hospital settings. Compared to conventional paper-pencil versions of PRO instruments, ePRO is more economical with regard to staff resources and time, and allows immediate presentation of results to the medical staff.The objective of our project was to develop software (CHES - Computer-based Health Evaluation System) for ePRO in hospital settings and at home with a special focus on the presentation of individual patient's results.

Methods: Following the Extreme Programming development approach architecture was not fixed up-front, but was done in close, continuous collaboration with software end users (medical staff, researchers and patients) to meet their specific demands. Developed features include sophisticated, longitudinal charts linking patients' PRO data to clinical characteristics and to PRO scores from reference populations, a web-interface for questionnaire administration, and a tool for convenient creating and editing of questionnaires.

Results: By 2012 CHES has been implemented at various institutions in Austria, Germany, Switzerland, and the UK and about 5000 patients participated in ePRO (with around 15000 assessments in total). Data entry is done by the patients themselves via tablet PCs with a study nurse or an intern approaching patients and supervising questionnaire completion.

Discussion: During the last decade several software packages for ePRO have emerged for different purposes. Whereas commercial products are available primarily for ePRO in clinical trials, academic projects have focused on data collection and presentation in daily clinical practice and on extending cancer registries with PRO data. CHES includes several features facilitating the use of PRO data for individualized medical decision making. With its web-interface it allows ePRO also when patients are home. Thus, it provides complete monitoring of patients'physical and psychosocial symptom burden.

Figures

Figure 1
Figure 1
Questionnaire (EORTC QLQ-C30) as presented to patients in CHES.
Figure 2
Figure 2
Clinical PRO report in CHES.
Figure 3
Figure 3
CHES Architecture.

References

    1. Bottomley A, Jones D, Claassens L. Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European Medicines Agency. Eur J Cancer. 2009;45(3):347–53. doi: 10.1016/j.ejca.2008.09.032.
    1. U.S. Food and Drug Administration. Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. . U.S. FDA, Clinical/Medical; 2009. Accessed 8th November 2012.
    1. Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362(10):865–9. doi: 10.1056/NEJMp0911494.
    1. Ware JE Jr. Conceptualization and measurement of health-related quality of life: comments on an evolving field. Arch Phys Med Rehabil. 2003;84(4 Suppl 2):S43–51.
    1. Gutteling JJ, Busschbach JJ, de Man RA, Darlington AS. Logistic feasibility of health related quality of life measurement in clinical practice: results of a prospective study in a large population of chronic liver patients. Health Qual Life Outcomes. 2008;6:97. doi: 10.1186/1477-7525-6-97.
    1. Taenzer P, Bultz BD, Carlson LE, Speca M, DeGagne T, Olson K, Doll R, Rosberger Z. Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psychooncology. 2000;9(3):203–13. doi: 10.1002/1099-1611(200005/06)9:3<203::AID-PON453>;2-Y.
    1. Wright EP, Selby PJ, Crawford M, Gillibrand A, Johnston C, Perren TJ, Rush R, Smith A, Velikova G, Watson K, Gould A, Cull A. Feasibility and compliance of automated measurement of quality of life in oncology practice. J Clin Oncol. 2003;21(2):374–82. doi: 10.1200/JCO.2003.11.044.
    1. Erharter A, Giesinger J, Kemmler G, Schauer-Maurer G, Stockhammer G, Muigg A, Hutterer M, Rumpold G, Sperner-Unterweger B, Holzner B. Implementation of computer-based quality-of-life monitoring in brain tumor outpatients in routine clinical practice. J Pain Symptom Manage. 2010;39(2):219–29. doi: 10.1016/j.jpainsymman.2009.06.015.
    1. Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health. 2008;11(2):322–33. doi: 10.1111/j.1524-4733.2007.00231.x.
    1. Coons S, Gwaltney C, Hays R, Lundy J, Sloan J, Revicki D, Lenderking W, Cella D. Basch E, and Force IeT, Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force report. Value Health. 2009;12(4):419–429. doi: 10.1111/j.1524-4733.2008.00470.x.
    1. Robling MR, Ingledew DK, Greene G, Sayers A, Shaw C, Sander L, Russell IT, Williams JG, Hood K. Applying an extended theoretical framework for data collection mode to health services research. BMC Health Serv Res. 2010;10:180. doi: 10.1186/1472-6963-10-180.
    1. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, Selby PJ. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22(4):714–24. doi: 10.1200/JCO.2004.06.078.
    1. Luckett T, Butow PN, King MT. Improving patient outcomes through the routine use of patient-reported data in cancer clinics: future directions. Psychooncology. 2009;18(11):1129–38. doi: 10.1002/pon.1545.
    1. Basch E, Artz D, Dulko D, Scher K, Sabbatini P, Hensley M, Mitra N, Speakman J, McCabe M, Schrag D. Patient online self-reporting of toxicity symptoms during chemotherapy. J Clin Oncol. 2005;23(15):3552–61. doi: 10.1200/JCO.2005.04.275.
    1. Bush N, Donaldson G, Moinpour C, Haberman M, Milliken D, Markle V, Lauson J. Development, feasibility and compliance of a web-based system for very frequent QOL and symptom home self-assessment after hematopoietic stem cell transplantation. Qual Life Res. 2005;14(7):77–93.
    1. Vickers AJ, Savage CJ, Shouery M, Eastham JA, Scardino PT, Basch EM. Validation study of a web-based assessment of functional recovery after radical prostatectomy. Health Qual Life Outcomes. 2010;8:82.
    1. Snyder CF, Jensen R, Courtin SO, Wu AW. PatientViewpoint: a website for patient-reported outcomes assessment. Qual Life Res. 2009;18(7):793–800. doi: 10.1007/s11136-009-9497-8.
    1. Aaronson N, Choucair A, Elliott T, Greenhalgh J, Halyard M, Hess R, Miller D, Reeve B, Santana M, Snyder CF. User’s Guide to Implementing Patient-Reported Outcomes Assessment in Clinical Practice. 2011. Available from: .
    1. Greenhalgh J. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res. 2009;18(1):115–23. doi: 10.1007/s11136-008-9430-6.
    1. Crane HM, Lober W, Webster E, Harrington RD, Crane PK, Davis TE, Kitahata MM. Routine collection of patient-reported outcomes in an HIV clinic setting: the first 100 patients. Curr HIV Res. 2007;5(1):109–18. doi: 10.2174/157016207779316369.
    1. Kinnaman J, Farrell A, Bisconer S. Evaluation of the Computerized Assessment System for Psychotherapy Evaluation and Research (CASPER) as a measure of treatment effectiveness with psychiatric inpatients. Assessment. 2006;13(2):154–67. doi: 10.1177/1073191105285952.
    1. Stern RG, Fudge R, Sison CE, Allan ER, Crichton J, Losonczy M. Computerized self-assessment of psychosis severity questionnaire [COSAPSQ] in schizophrenia: preliminary results. Psychopharmacol Bull. 1998;34(1):9–12.
    1. McLachlan SA, Allenby A, Matthews J, Wirth A, Kissane D, Bishop M, Beresford J, Zalcberg J. Randomized trial of coordinated psychosocial interventions based on patient self-assessments versus standard care to improve the psychosocial functioning of patients with cancer. J Clin Oncol. 2001;19(21):4117–25.
    1. Detmar SB, Muller MJ, Schornagel JH, Wever LDV, Aaronson NK. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. Jama. 2002;288(23):3027–34. doi: 10.1001/jama.288.23.3027.
    1. Greenhalgh J, Long AF, Flynn R. The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory? Soc Sci Med. 2005;60(4):833–43. doi: 10.1016/j.socscimed.2004.06.022.
    1. Beck K, Andres C. Extreme Programming Explained: Embrace Change. 2. Boston: Addison-Wesley; 2005.
    1. The PROMIS network. Patient-Reported Outcomes Measurement Information System (PROMIS) 2011. Available from: .
    1. Petersen MA, Groenvold M, Aaronson NK, Chie WC, Conroy T, Costantini A, Fayers P, Helbostad J, Holzner B, Kaasa S, Singer S, Velikova G, Young T. Development of computerised adaptive testing (CAT) for the EORTC QLQ-C30 dimensions - general approach and initial results for physical functioning. Eur J Cancer. 2010;46(8):1352–8. doi: 10.1016/j.ejca.2010.02.011.
    1. Green B, Bock R, Humphreys L. Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement. 1984;21:347–360. doi: 10.1111/j.1745-3984.1984.tb01039.x.
    1. Chang CH. Patient-reported outcomes measurement and management with innovative methodologies and technologies. Qual Life Res. 2007;16(Suppl 1):157–66.
    1. Daemen J, Rijmen V. The Design of RijndaeL: AES - The Advanced Encryption Standard (Information Security and Cryptography) Berlin: Springer; 2002.
    1. EORTC Quality of Life Group. EORTC Quality of Life. 2012. Available from:
    1. Sokoloff MH, Joyce GF, Wise M. Testis cancer. J Urol. 2007;177(6):2030–41. doi: 10.1016/j.juro.2007.01.127.
    1. PHT Corporation. PHT Firsthand Knowledge. 2011. 2011. Available from:
    1. Invivo Data Inc. 2011. [cited 2011 30 Nov 2011]; Available from:
    1. AssisTek Inc. 2011. [cited 2011 30 Nov 2011]; Available from:
    1. The PROMIS network. Assessment Cente. 2011. cited 2010 30 Nov 2011]; Available from: .
    1. Ashley L, Jones H, Thomas J, Forman D, Newsham A, Morris E, Johnson O, Velikova G, Wright P. Integrating cancer survivors' experiences into UK cancer registries: design and development of the ePOCS system (electronic Patient-reported Outcomes from Cancer Survivors) Br J Cancer. 2011;105(Suppl 1):S74–81.
    1. Ashley L, Jones H, Forman D, Newsham A, Brown J, Downing A, Velikova G, Wright P. Feasibility test of a UK-scalable electronic system for regular collection of patient-reported outcome measures and linkage with clinical cancer registry data: The electronic Patient-reported Outcomes from Cancer Survivors (ePOCS) system. BMC Med Inform Decis Mak. 2011;11:66. doi: 10.1186/1472-6947-11-66.
    1. van de Poll-Franse LV, Horevoorts N, van Eenbergen M, Denollet J, Roukema JA, Aaronson NK, Vingerhoets A, Coebergh JW, de Vries J, Essink-Bot ML, Mols F. The Patient Reported Outcomes Following Initial treatment and Long term Evaluation of Survivorship registry: scope, rationale and design of an infrastructure for the study of physical and psychosocial outcomes in cancer survivorship cohorts. Eur J Cancer. 2011;47(14):2188–94. doi: 10.1016/j.ejca.2011.04.034.
    1. de Bree R, Verdonck-de Leeuw IM, Keizer AL, Houffelaar A, Leemans CR. Touch screen computer-assisted health-related quality of life and distress data collection in head and neck cancer patients. Clin Otolaryngol. 2008;33(2):138–142. doi: 10.1111/j.1749-4486.2008.01676.x.
    1. VU medisch centrum and NDDO Institute for Prevention and Early Diagnostics (NIPED) OncoKompas. 2011. cited 2011 30 Nov 2011]; Available from:
    1. Engelen V, Haverman L, Koopman H, Schouten-van Meeteren N, Meijer-van D, Bergh E, Vrijmoet-Wiersma J, van Dijk EM, Last B, Detmar S, Grootenhuis M. Development and implementation of a patient reported outcome intervention (QLIC-ON PROfile) in clinical paediatric oncology practice. Patient Educ Couns. 2010;81(2):235–244. doi: 10.1016/j.pec.2010.02.003.
    1. Haverman L, Engelen V, van Rossum MA, Heymans HS, Grootenhuis MA. Monitoring health-related quality of life in paediatric practice: development of an innovative web-based application. BMC Pediatr. 2011;11:3. doi: 10.1186/1471-2431-11-3.
    1. Tsai J, Bond G. A comparison of electronic records to paper records in mental health centers. Int J Qual Health Care. 2008;20(2):136–43.
    1. Bleich HL, Beckley RF, Horowitz GL, Jackson JD, Moody ES, Franklin C, Goodman SR, McKay MW, Pope RA, Walden T. et al.Clinical computing in a teaching hospital. N Engl J Med. 1985;312(12):756–64. doi: 10.1056/NEJM198503213121205.
    1. Szajna B. Empirical Evaluation of the Revised Technology Acceptance Model. Management Science. 1996;42(1):82–85.
    1. Carlson LE, Speca M, Hagen N, Taenzer P. Computerized quality-of-life screening in a cancer pain clinic. J Palliat Care. 2001;17(1):46–52.
    1. Hollen PJ, Gralla RJ, Stewart JA, Meharchand JM, Wierzbicki R, Leighl N. Can a computerized format replace a paper form in PRO and HRQL evaluation? Psychometric testing of the computer-assisted LCSS instrument (eLCSS-QL) Support Care Cance. 2012. Jun 10. [Epub ahead of print]
    1. Rogausch A, Sigle J, Seibert A, Thuring S, Kochen MM, Himmel W. Feasibility and acceptance of electronic quality of life assessment in general practice: an implementation study. Health Qual Life Outcomes. 2009;7:51. doi: 10.1186/1477-7525-7-51.
    1. Bossola M, Murri R, Onder G, Turriziani A, Fantoni M, Padua L. Physicians' knowledge of health-related quality of life and perception of its importance in daily clinical practice. Health Qual Life Outcomes. 2010;8:43. doi: 10.1186/1477-7525-8-43.
    1. Jacobs JE, van de Lisdonk EH, Smeele I, van Weel C, Grol RP. Management of patients with asthma and COPD: monitoring quality of life and the relationship to subsequent GP interventions. Fam Pract. 2001;18(6):574–80. doi: 10.1093/fampra/18.6.574.
    1. Basch E, Iasonos A, Barz A, Culkin A, Kris MG, Artz D, Fearn P, Speakman J, Farquhar R, Scher HI, McCabe M, Schrag D. Long-term toxicity monitoring via electronic patient-reported outcomes in patients receiving chemotherapy. J Clin Oncol. 2007;25(34):5374–80. doi: 10.1200/JCO.2007.11.2243.
    1. Giesinger J, Kuster M, Holzner B, Giesinger K. Development of a computer-adaptive version of the Forgotten Joint Score. J Arthroplasty. in press.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren