A Mobile Technology for Collecting Patient-Reported Physical Activity and Distress Outcomes: Cross-Sectional Cohort Study

Miyeon Jung, SaeByul Lee, Jisun Kim, HeeJeong Kim, BeomSeok Ko, Byung Ho Son, Sei-Hyun Ahn, Yu Rang Park, Daegon Cho, Haekwon Chung, Hye Jin Park, Minsun Lee, Jong Won Lee, Seockhoon Chung, Il Yong Chung, Miyeon Jung, SaeByul Lee, Jisun Kim, HeeJeong Kim, BeomSeok Ko, Byung Ho Son, Sei-Hyun Ahn, Yu Rang Park, Daegon Cho, Haekwon Chung, Hye Jin Park, Minsun Lee, Jong Won Lee, Seockhoon Chung, Il Yong Chung

Abstract

Background: Electronic patient-reported outcome (PROs) provides a fast and reliable assessment of a patient's health-related quality of life. Nevertheless, using PRO in the traditional paper format is not practical for clinical practice due to the limitations associated with data analysis and management. A questionnaire app was developed to address the need for a practical way to group and use distress and physical activity assessment tools.

Objective: The purpose of this study was to assess the level of agreement between electronic (mobile) and paper-and-pencil questionnaire responses.

Methods: We validated the app version of the distress thermometer (DT), International Physical Activity Questionnaire (IPAQ), and Patient Health Questionnaire-9 (PHQ-9). A total of 102 participants answered the paper and app versions of the DT and IPAQ, and 96 people completed the PHQ-9. The study outcomes were the correlation of the data between the paper-and-pencil and app versions.

Results: A total of 106 consecutive breast cancer patients were enrolled and analyzed for validation of paper and electronic (app) versions. The Spearman correlation values of paper and app surveys for patients who responded to the DT questionnaire within 7 days, within 3 days, and on the same day were .415 (P<.001), .437 (P<.001), and .603 (P<.001), respectively. Similarly, the paper and app survey correlation values of the IPAQ total physical activity metabolic equivalent of task (MET; Q2-6) were .291 (P=.003), .324 (P=.005), and .427 (P=.01), respectively. The correlation of the sum of the Patient Health Questionnaire-9 (Q1-9) according to the time interval between the paper-based questionnaire and the app-based questionnaire was .469 for 14 days (P<.001), .574 for 7 days (P<.001), .593 for 3 days (P<.001), and .512 for the same day (P=.03). These were all statistically significant. Similarly, the correlation of the PHQ (Q10) value according to the time interval between the paper-based questionnaire and the app-based questionnaire was .283 for 14 days (P=.005), .409 for 7 days (P=.001), .415 for 3 days (P=.009), and .736 for the same day (P=.001). These were all statistically significant. In the overall trend, the shorter the interval between the paper-and-pencil questionnaire and the app-based questionnaire, the higher the correlation value.

Conclusions: The app version of the distress and physical activity questionnaires has shown validity and a high level of association with the paper-based DT, IPAQ (Q2-6), and PHQ-9. The app-based questionnaires were not inferior to their respective paper versions and confirm the feasibility for their use in clinical practice. The high correlation between paper and mobile app data allows the use of new mobile apps to benefit the overall health care system.

Trial registration: ClinicalTrials.gov NCT03072966; https://ichgcp.net/clinical-trials-registry/NCT03072966.

Keywords: breast neoplasms; mobile apps; patient-reported outcome measures (PROMs); quality of life; questionnaire; telemedicine; validation.

Conflict of interest statement

Conflicts of Interest: HC is CEO of Swallaby Co Ltd, Seoul, Korea.

©Miyeon Jung, SaeByul Lee, Jisun Kim, HeeJeong Kim, BeomSeok Ko, Byung Ho Son, Sei-Hyun Ahn, Yu Rang Park, Daegon Cho, Haekwon Chung, Hye Jin Park, Minsun Lee, Jong Won Lee, Seockhoon Chung, Il Yong Chung. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 04.05.2020.

Figures

Figure 1
Figure 1
Participant enrollment.
Figure 2
Figure 2
App screenshots of the (A) Distress Thermometer, (B) International Physical Activity Questionnaire, and (C) Patient Health Questionnaire–9.
Figure 3
Figure 3
Paper-based versions of the (A) Distress Thermometer, (B) International Physical Activity Questionnaire, and (C) Patient Health Questionnaire–9.
Figure 4
Figure 4
Examples of app data for (A) Distress Thermometer, (B) International Physical Activity Questionnaire Q2-6, and (C) International Physical Activity Questionnaire Q7.

References

    1. Kim J, Lim S, Min YH, Shin Y, Lee B, Sohn G, Jung KH, Lee J, Son BH, Ahn SH, Shin S, Lee JW. Depression screening using daily mental-health ratings from a smartphone application for breast cancer patients. J Med Internet Res. 2016 Aug 04;18(8):e216. doi: 10.2196/jmir.5598.
    1. Mitchell AJ, Ferguson DW, Gill J, Paul J, Symonds P. Depression and anxiety in long-term cancer survivors compared with spouses and healthy controls: a systematic review and meta-analysis. Lancet Oncol. 2013 Jul;14(8):721–732. doi: 10.1016/S1470-2045(13)70244-4.
    1. FDA Center for Drug Evaluation and Research. FDA Center for Biologics Evaluation and Research. FDA Center for Devices and Radiological Health Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79. doi: 10.1186/1477-7525-4-79.
    1. Jette DU, Halbert J, Iverson C, Miceli E, Shah P. Use of standardized outcome measures in physical therapist practice: perceptions and applications. Phys Ther. 2009 Feb;89(2):125–135. doi: 10.2522/ptj.20080234.
    1. Hatfield DR, Ogles BM. Why some clinicians use outcome measures and others do not. Adm Policy Ment Health. 2007 May;34(3):283–291. doi: 10.1007/s10488-006-0110-y.
    1. Schick-Makaroff K, Molzahn A. Strategies to use tablet computers for collection of electronic patient-reported outcomes. Health Qual Life Outcomes. 2015;13:2. doi: 10.1186/s12955-014-0205-1.
    1. Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of Internet versus paper-and-pencil versions. J Med Internet Res. 2007;9(3):e25. doi: 10.2196/jmir.9.3.e25.
    1. Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health. 2008;11(2):322–333. doi: 10.1111/j.1524-4733.2007.00231.x.
    1. Meystre S. The current state of telemonitoring: a comment on the literature. Telemed J E Health. 2005 Feb;11(1):63–69. doi: 10.1089/tmj.2005.11.63.
    1. Duregger K, Hayn D, Nitzlnader M, Kropf M, Falgenhauer M, Ladenstein R, Schreier G. Electronic patient reported outcomes in paediatric oncology: applying mobile and near field communication technology. Stud Health Technol Inform. 2016;223:281–288.
    1. Burdette SD, Herchline TE, Oehler R. Surfing the web: practicing medicine in a technological age: using smartphones in clinical practice. Clin Infect Dis. 2008 Jul 01;47(1):117–122. doi: 10.1086/588788.
    1. Juniper EF, Langlands JM, Juniper BA. Patients may respond differently to paper and electronic versions of the same questionnaires. Respir Med. 2009 Jun;103(6):932–934. doi: 10.1016/j.rmed.2008.10.019.
    1. Zbrozek A, Hebert J, Gogates G, Thorell R, Dell C, Molsen E, Craig G, Grice K, Kern S, Hines S. Validation of electronic systems to collect patient-reported outcome (PRO) data—recommendations for clinical trial teams: report of the ISPOR ePRO systems validation good research practices task force. Value Health. 2013 Jun;16(4):480–489. doi: 10.1016/j.jval.2013.04.002.
    1. Swallaby Inc. [2020-04-20].
    1. Lin LI. Assay validation using the concordance correlation coefficient. Biometrics. 1992 Jun;48(2):599–604. doi: 10.2307/2532314.
    1. Zainal NZ, Nik-Jaafar NR, Baharudin A, Sabki ZA, Ng CG. Prevalence of depression in breast cancer survivors: a systematic review of observational studies. Asian Pac J Cancer Prev. 2013;14(4):2649–2656.
    1. Glenn T, Monteith S. New measures of mental state and behavior based on data collected from sensors, smartphones, and the Internet. Curr Psychiatry Rep. 2014 Dec;16(12):523. doi: 10.1007/s11920-014-0523-3.
    1. Epis OM, Casu C, Belloli L, Schito E, Filippini D, Muscarà M, Gentile MG, Perez CPC, Venerelli C, Sonnati M, Schiavetti I, Bruschi E. Pixel or paper? Validation of a mobile technology for collecting patient-reported outcomes in rheumatoid arthritis. JMIR Res Protoc. 2016 Nov 16;5(4):e219. doi: 10.2196/resprot.5631.
    1. Duracinsky M, Lalanne C, Goujard C, Herrmann S, Cheung-Lung C, Brosseau J, Schwartz Y, Chassany O. Electronic versus paper-based assessment of health-related quality of life specific to HIV disease: reliability study of the PROQOL-HIV questionnaire. J Med Internet Res. 2014;16(4):e115. doi: 10.2196/jmir.3330.
    1. Thorén ES, Andersson G, Lunner T. The use of research questionnaires with hearing impaired adults: online vs. paper-and-pencil administration. BMC Ear Nose Throat Disord. 2012;12:12. doi: 10.1186/1472-6815-12-12.
    1. Holländare F, Andersson G, Engström I. A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J Med Internet Res. 2010;12(5):e49. doi: 10.2196/jmir.1392.
    1. Bierbrier R, Lo V, Wu RC. Evaluation of the accuracy of smartphone medical calculation apps. J Med Internet Res. 2014;16(2):e32. doi: 10.2196/jmir.3062.
    1. Bush NE, Skopp N, Smolenski D, Crumpton R, Fairall J. Behavioral screening measures delivered with a smartphone app: psychometric properties and user preference. J Nerv Ment Dis. 2013 Nov;201(11):991–995. doi: 10.1097/NMD.0000000000000039.
    1. Garcia-Palacios A, Herrero R, Belmonte MA, Castilla D, Guixeres J, Molinari G, Baños RM. Ecological momentary assessment for chronic pain in fibromyalgia using a smartphone: a randomized crossover study. Eur J Pain. 2014 Jul;18(6):862–872.
    1. Kim JH, Kwon S, Shim SR, Sun HY, Ko YM, Chun D, Yang WJ, Song YS. Validation and reliability of a smartphone application for the International Prostate Symptom Score questionnaire: a randomized repeated measures crossover study. J Med Internet Res. 2014 Feb 10;16(2):e38. doi: 10.2196/jmir.3042.
    1. Salaffi F, Gasparini S, Ciapetti A, Gutierrez M, Grassi W. Usability of an innovative and interactive electronic system for collection of patient-reported data in axial spondyloarthritis: comparison with the traditional paper-administered format. Rheumatology (Oxford) 2013 Nov;52(11):2062–2070. doi: 10.1093/rheumatology/ket276.
    1. Chung IY, Jung M, Lee SB, Lee JW, Park YR, Cho D, Chung H, Youn S, Min YH, Park HJ, Lee M, Chung S, Son BH, Ahn S. An assessment of physical activity data collected via a smartphone app and a smart band in breast cancer survivors: observational study. J Med Internet Res. 2019 Sep 06;21(9):13463. doi: 10.2196/13463.

Source: PubMed

3
Suscribir