Engagement and attrition with eHealth tools for remote monitoring in chronic arthritis: a systematic review and meta-analysis

Michaël Doumen, Diederik De Cock, Caroline Van Lierde, Albrecht Betrains, Sofia Pazmino, Delphine Bertrand, René Westhovens, Patrick Verschueren, Michaël Doumen, Diederik De Cock, Caroline Van Lierde, Albrecht Betrains, Sofia Pazmino, Delphine Bertrand, René Westhovens, Patrick Verschueren

Abstract

Objectives: Although eHealth tools are potentially useful for remote disease monitoring, barriers include concerns of low engagement and high attrition. We aimed to summarise evidence on patients' engagement and attrition with eHealth tools for remotely monitoring disease activity/impact in chronic arthritis.

Methods: A systematic literature search was conducted for original articles and abstracts published before September 2022. Eligible studies reported quantitative measures of patients' engagement with eHealth instruments used for remote monitoring in chronic arthritis. Engagement rates were pooled using random effects meta-analysis.

Results: Of 8246 references, 45 studies were included: 23 using smartphone applications, 13 evaluating wearable activity trackers, 7 using personal digital assistants, 6 including web-based platforms and 2 using short message service. Wearable-based studies mostly reported engagement as the proportion of days the tracker was worn (70% pooled across 6 studies). For other eHealth tools, engagement was mostly reported as completion rates for remote patient-reported outcomes (PROs). The pooled completion rate was 80%, although between-study heterogeneity was high (I2 93%) with significant differences between eHealth tools and frequency of PRO-collection. Engagement significantly decreased with longer study duration, but attrition varied across studies (0%-89%). Several predictors of higher engagement were reported. Data on the influence of PRO-reporting frequency were conflicting.

Conclusion: Generally high patient engagement was reported with eHealth tools for remote monitoring in chronic arthritis. However, we found considerable between-study heterogeneity and a relative lack of real-world data. Future studies should use standardised measures of engagement, preferably assessed in a daily practice setting.

Trial registeration number: The protocol was registered on PROSPERO (CRD42021267936).

Keywords: arthritis; epidemiology; health services research; patient reported outcome measures.

Conflict of interest statement

Competing interests: None declared.

© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Figures

Figure 1
Figure 1
PRISMA flow chart of systematic review. ICTRP, International Clinical Trials Registry Platform.
Figure 2
Figure 2
Forest plot of pooled completion rates for patient-reported outcomes collected with eHealth tools.
Figure 3
Figure 3
Forest plot of pooled completion rates according to eHealth tool. PDA, personal digital assistant; SMS, short message service; WAT, wearable activity tracker.
Figure 4
Figure 4
Forest plot of pooled completion rates according to patient-reported outcome collection frequency.
Figure 5
Figure 5
Forest plot of pooled proportion of study days a wearable activity tracker was actively worn.

References

    1. Hoy DG, Smith E, Cross M, et al. . The global burden of musculoskeletal conditions for 2010: an overview of methods. Ann Rheum Dis 2014;73:982–9. 10.1136/annrheumdis-2013-204344
    1. March L, Smith EUR, Hoy DG, et al. . Burden of disability due to musculoskeletal (MSK) disorders. Best Pract Res Clin Rheumatol 2014;28:353–66. 10.1016/j.berh.2014.08.002
    1. Pazmino S, Lovik A, Boonen A, et al. . New indicator for discordance between patient-reported and traditional disease activity outcomes in patients with early rheumatoid arthritis. Rheumatology 2022. 10.1093/rheumatology/keac213. [Epub ahead of print: 13 Apr 2022].
    1. Walker UA, Mueller RB, Jaeger VK, et al. . Disease activity dynamics in rheumatoid arthritis: patients' self-assessment of disease activity via WebApp. Rheumatology 2017;56:1707–12. 10.1093/rheumatology/kex229
    1. Schoemaker CG, de Wit MPT. Treat-to-Target from the patient perspective is Bowling for a perfect strike. Arthritis Rheumatol 2021;73:9–11. 10.1002/art.41461
    1. Battafarano DF, Ditmyer M, Bolster MB, et al. . 2015 American College of rheumatology workforce study: supply and demand projections of adult rheumatology workforce, 2015-2030. Arthritis Care Res 2018;70:617–26. 10.1002/acr.23518
    1. World Health Organization . Global diffusion of eHealth: Making universal health coverage achievable. [Internet]. Report of the third global survey on eHealth; 2016: 156.
    1. Studenic P, Karlfeldt S, Alunno A. The past, present and future of e-health in rheumatology. Joint Bone Spine 2021;88:105163. 10.1016/j.jbspin.2021.105163
    1. Seppen BF, den Boer P, Wiegel J, et al. . Asynchronous mHealth interventions in rheumatoid arthritis: systematic scoping review. JMIR Mhealth Uhealth 2020;8:e19260. 10.2196/19260
    1. Beukenhorst AL, Druce KL, De Cock D. Smartphones for musculoskeletal research - hype or hope? Lessons from a decennium of mHealth studies. BMC Musculoskelet Disord 2022;23:487. 10.1186/s12891-022-05420-8
    1. Seppen B, Wiegel J, Ter Wee MM, et al. . Smartphone-Assisted patient-initiated care versus usual care in patients with rheumatoid arthritis and low disease activity: a randomized controlled trial. Arthritis Rheumatol 2022. 10.1002/art.42292. [Epub ahead of print: 11 Jul 2022].
    1. Müskens WD, Rongen-van Dartel SAA, Vogel C, et al. . Telemedicine in the management of rheumatoid arthritis: maintaining disease control with less health-care utilization. Rheumatol Adv Pract 2021;5:rkaa079. 10.1093/rap/rkaa079
    1. Knitza J, Tascilar K, Vuillerme N, et al. . Accuracy and tolerability of self-sampling of capillary blood for analysis of inflammation and autoantibodies in rheumatoid arthritis patients-results from a randomized controlled trial. Arthritis Res Ther 2022;24:125. 10.1186/s13075-022-02809-7
    1. Druce KL, Gibson DS, McEleney K, et al. . Remote sampling of biomarkers of inflammation with linked patient generated health data in patients with rheumatic and musculoskeletal diseases: an ecological Momentary assessment feasibility study. BMC Musculoskelet Disord 2022;23:770. 10.1186/s12891-022-05723-w
    1. Riches PL, Alexander D, Hauser B, et al. . Evaluation of supported self-management in gout (GoutSMART): a randomised controlled feasibility trial. Lancet Rheumatol 2022;4:e320–8. 10.1016/S2665-9913(22)00062-5
    1. Doumen M, Westhovens R, Pazmino S, et al. . The ideal mHealth-application for rheumatoid arthritis: qualitative findings from stakeholder focus groups. BMC Musculoskelet Disord 2021;22:746. 10.1186/s12891-021-04624-8
    1. Druce KL, Dixon WG, McBeth J. Maximizing engagement in mobile health studies: lessons learned and future directions. Rheum Dis Clin North Am 2019;45:159–72. 10.1016/j.rdc.2019.01.004
    1. Page MJ, McKenzie JE, Bossuyt PM, et al. . The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71. 10.1136/bmj.n71
    1. Wells GA, Shea B, O’Connell D. The Newcastle-Ottawa Scale (NOS) for assessing the quality if nonrandomized studies in meta-analyses. Available:
    1. Maher CG, Sherrington C, Herbert RD, et al. . Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther 2003;83:713–21. 10.1093/ptj/83.8.713
    1. Elmagboul N, Coburn BW, Foster J, et al. . Physical activity measured using wearable activity tracking devices associated with gout flares. Arthritis Res Ther 2020;22:181. 10.1186/s13075-020-02272-2
    1. Pouls BPH, Bekker CL, Gaffo AL, et al. . Tele-monitoring flares using a smartphone APP in patients with gout or suspected gout: a feasibility study. Rheumatol Adv Pract 2021;5:rkab100. 10.1093/rap/rkab100
    1. Bromberg MH, Connelly M, Anthony KK, et al. . Self-Reported pain and disease symptoms persist in juvenile idiopathic arthritis despite treatment advances: an electronic diary study. Arthritis Rheumatol 2014;66:462–9. 10.1002/art.38223
    1. Tyrrell JS, Redshaw CH, Schmidt W. Physical activity in ankylosing spondylitis: evaluation and analysis of an eHealth tool. J Innov Health Inform 2016;23:510–22. 10.14236/jhi.v23i2.169
    1. Kempin R, Richter JG, Schlegel A, et al. . Monitoring of disease activity with a smartphone APP in routine clinical care in patients with axial spondyloarthritis. J Rheumatol 2022;49:878–84.
    1. Yu SP, Ferreira ML, Duong V, et al. . Responsiveness of an activity tracker as a measurement tool in a knee osteoarthritis clinical trial (ACTIVe-OA study). Ann Phys Rehabil Med 2022;65:101619. 10.1016/j.rehab.2021.101619
    1. Crouthamel M, Quattrocchi E, Watts S, et al. . Using a researchkit smartphone app to collect rheumatoid arthritis symptoms from real-world participants: feasibility study. JMIR Mhealth Uhealth 2018;6:e177. 10.2196/mhealth.9656
    1. Nowell WB, Gavigan K, Kannowski CL, et al. . Which patient-reported outcomes do rheumatology patients find important to track digitally? A real-world longitudinal study in ArthritisPower. Arthritis Res Ther 2021;23:53. 10.1186/s13075-021-02430-0
    1. Christodoulou C, Schneider S, Junghaenel DU, et al. . Measuring daily fatigue using a brief scale adapted from the patient-reported outcomes measurement information system (PROMIS ®). Qual Life Res 2014;23:1245–53. 10.1007/s11136-013-0553-z
    1. Beukenhorst AL, Howells K, Cook L, et al. . Engagement and participant experiences with consumer smartwatches for health research: longitudinal, observational feasibility study. JMIR Mhealth Uhealth 2020;8:e14368. 10.2196/14368
    1. Druce KL, McBeth J, van der Veer SN, et al. . Recruitment and ongoing engagement in a UK smartphone study examining the association between weather and pain: cohort study. JMIR Mhealth Uhealth 2017;5:e168. 10.2196/mhealth.8162
    1. Nowell W, Curtis JR, Zhao H. Participant engagement and adherence in an ArthritisPower real-world study to capture Smartwatch and patient-reported outcome data among rheumatoid arthritis patients. Arthritis & Rheumatology 2020;72:3959–62.
    1. McBeth J, Dixon WG, Moore SM, et al. . Sleep disturbance and quality of life in rheumatoid arthritis: prospective mHealth study. J Med Internet Res 2022;24:e32825. 10.2196/32825
    1. Renskers L, Rongen-van Dartel SAA, Huis AMP, et al. . Patients’ experiences regarding self-monitoring of the disease course: an observational pilot study in patients with inflammatory rheumatic diseases at a rheumatology outpatient clinic in The Netherlands. BMJ Open 2020;10:e033321. 10.1136/bmjopen-2019-033321
    1. Harbottle V, Bennett J, Duong C, et al. . 303 feasibility of wearable technologies in children and young people with juvenile idiopathic arthritis. Rheumatology 2018;57:key075.527. 10.1093/rheumatology/key075.527
    1. Heale LD, Dover S, Goh YI, et al. . A wearable activity tracker intervention for promoting physical activity in adolescents with juvenile idiopathic arthritis: a pilot study. Pediatr Rheumatol Online J 2018;16:66. 10.1186/s12969-018-0282-5
    1. Jacquemin C, Servy H, Molto A, et al. . Physical activity assessment using an activity tracker in patients with rheumatoid arthritis and axial spondyloarthritis: prospective observational study. JMIR Mhealth Uhealth 2018;6:e1. 10.2196/mhealth.7948
    1. Östlind E, Sant'Anna A, Eek F, et al. . Physical activity patterns, adherence to using a wearable activity tracker during a 12-week period and correlation between self-reported function and physical activity in working age individuals with hip and/or knee osteoarthritis. BMC Musculoskelet Disord 2021;22:450. 10.1186/s12891-021-04338-x
    1. Bingham CO, Gaich CL, DeLozier AM, et al. . Use of daily electronic patient-reported outcome (PRO) diaries in randomized controlled trials for rheumatoid arthritis: rationale and implementation. Trials 2019;20:182. 10.1186/s13063-019-3272-0
    1. Colls J, Lee YC, Xu C, et al. . Patient adherence with a smartphone APP for patient-reported outcomes in rheumatoid arthritis. Rheumatology 2021;60:108–12. 10.1093/rheumatology/keaa202
    1. Seppen BF, Wiegel J, L'ami MJ, et al. . Feasibility of self-monitoring rheumatoid arthritis with a smartphone APP: results of two mixed-methods pilot studies. JMIR Form Res 2020;4:e20165. 10.2196/20165
    1. Lee SSS, Xin X, Lee WP, et al. . The feasibility of using SMS as a health survey tool: an exploratory study in patients with rheumatoid arthritis. Int J Med Inform 2013;82:427–34. 10.1016/j.ijmedinf.2012.12.003
    1. Lee RR, Shoop-Worrall S, Rashid A, et al. . "Asking Too Much?": Randomized N-of-1 trial exploring patient preferences and measurement reactivity to frequent use of remote multidimensional pain assessments in children and young people with juvenile idiopathic arthritis. J Med Internet Res 2020;22:e14503. 10.2196/14503
    1. Broderick JE, Schneider S, Junghaenel DU, et al. . Validity and reliability of patient-reported outcomes measurement information system instruments in osteoarthritis. Arthritis Care Res 2013;65:1625–33. 10.1002/acr.22025
    1. Rouzaud Laborde C, Cenko E, Mardini MT, et al. . Satisfaction, usability, and compliance with the use of smartwatches for ecological momentary assessment of knee osteoarthritis symptoms in older adults: usability study. JMIR Aging 2021;4:e24553. 10.2196/24553
    1. Skrepnik N, Spitzer A, Altman R, et al. . Assessing the impact of a novel smartphone application compared with standard follow-up on mobility of patients with knee osteoarthritis following treatment with Hylan G-F 20: a randomized controlled trial. JMIR Mhealth Uhealth 2017;5:e64. 10.2196/mhealth.7179
    1. Simblett S, Greer B, Matcham F, et al. . Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res 2018;20:e10480. 10.2196/10480
    1. Jackson LE, Edgil TA, Hill B, et al. . Telemedicine in rheumatology care: a systematic review. Semin Arthritis Rheum 2022;56:152045. 10.1016/j.semarthrit.2022.152045
    1. Davergne T, Pallot A, Dechartres A, et al. . Use of wearable activity Trackers to improve physical activity behavior in patients with rheumatic and musculoskeletal diseases: a systematic review and meta-analysis. Arthritis Care Res 2019;71:758–67. 10.1002/acr.23752
    1. Amagai S, Pila S, Kaat AJ, et al. . Challenges in participant engagement and retention using mobile health Apps: literature review. J Med Internet Res 2022;24:e35120. 10.2196/35120
    1. Shih PC, Han K, Poole ES. Use and adoption challenges of wearable activity trackers. iConference 2015 Proceedings, 2015.
    1. Pratap A, Neto EC, Snyder P, et al. . Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med 2020;3:21. 10.1038/s41746-020-0224-8
    1. Gossec L, Cantagrel A, Soubrier M, et al. . An e-health interactive self-assessment website (Sanoia®) in rheumatoid arthritis. A 12-month randomized controlled trial in 320 patients. Joint Bone Spine 2018;85:709–14. 10.1016/j.jbspin.2017.11.015
    1. Wildenbos GA, Peute L, Jaspers M. Aging barriers influencing mobile health usability for older adults: a literature based framework (MOLD-US). Int J Med Inform 2018;114:66–75. 10.1016/j.ijmedinf.2018.03.012
    1. Len CA, Miotto e Silva VB, Terreri MTRA. Importance of adherence in the outcome of juvenile idiopathic arthritis. Curr Rheumatol Rep 2014;16:410. 10.1007/s11926-014-0410-2
    1. Serlachius A, Schache K, Kieser A, et al. . Association between user engagement of a mobile health APP for gout and improvements in self-care behaviors: randomized controlled trial. JMIR Mhealth Uhealth 2019;7:e15021. 10.2196/15021
    1. Reade S, Spencer K, Sergeant JC, et al. . Cloudy with a chance of pain: engagement and subsequent attrition of daily data entry in a smartphone pilot study tracking weather, disease severity, and physical activity in patients with rheumatoid arthritis. JMIR Mhealth Uhealth 2017;5:e37. 10.2196/mhealth.6496
    1. Stinson JN, Petroz GC, Stevens BJ, et al. . Working out the kinks: testing the feasibility of an electronic pain diary for adolescents with arthritis. Pain Res Manag 2008;13:375–82. 10.1155/2008/326389
    1. Najm A, Gossec L, Weill C, et al. . Mobile health apps for self-management of rheumatic and musculoskeletal diseases: systematic literature review. JMIR Mhealth Uhealth 2019;7:e14730. 10.2196/14730
    1. Geuens J, Swinnen TW, Westhovens R, et al. . A review of persuasive principles in mobile apps for chronic arthritis patients: opportunities for improvement. JMIR Mhealth Uhealth 2016;4:e118. 10.2196/mhealth.6286
    1. Austin L, Sharp CA, van der Veer SN, et al. . Providing 'the bigger picture': benefits and feasibility of integrating remote monitoring from smartphones into the electronic health record. Rheumatology 2020;59:367–78. 10.1093/rheumatology/kez207
    1. Bellamy N, Patel B, Davis T, et al. . Electronic data capture using the Womac NRS 3.1 index (m-Womac): a pilot study of repeated independent remote data capture in oa. Inflammopharmacology 2010;18:107–11. 10.1007/s10787-010-0040-x
    1. Connelly M, Anthony KK, Sarniak R, et al. . Parent pain responses as predictors of daily activities and mood in children with juvenile idiopathic arthritis: the utility of electronic diaries. J Pain Symptom Manage 2010;39:579–90. 10.1016/j.jpainsymman.2009.07.013
    1. Connelly M, Bromberg MH, Anthony KK, et al. . Emotion regulation predicts pain and functioning in children with juvenile idiopathic arthritis: an electronic diary study. J Pediatr Psychol 2012;37:43–52. 10.1093/jpepsy/jsr088
    1. Connelly M, Bromberg MH, Anthony KK, et al. . Use of smartphones to prospectively evaluate predictors and outcomes of caregiver responses to pain in youth with chronic disease. Pain 2017;158:629–36. 10.1097/j.pain.0000000000000804
    1. Costantino F, Leboime A, Bessalah L, et al. . Correspondence between patient-reported flare and disease activity score variation in axial spondyloarthritis: a 12-months web-based study. Joint Bone Spine 2022;89:105422. 10.1016/j.jbspin.2022.105422
    1. Fu K, Makovey J, Metcalf B, et al. . Sleep quality and fatigue are associated with pain exacerbations of hip osteoarthritis: an Internet-based case-crossover study. J Rheumatol 2019;46:1524–30. 10.3899/jrheum.181406
    1. Gilbert AL, Lee J, Song J, et al. . Relationship between self-reported restless sleep and objectively measured physical activity in adults with knee osteoarthritis. Arthritis Care Res 2021;73:687–92. 10.1002/acr.23581
    1. Heiberg T, Kvien TK, Dale Øystein, et al. . Daily health status registration (patient diary) in patients with rheumatoid arthritis: a comparison between personal digital assistant and paper-pencil format. Arthritis Rheum 2007;57:454–60. 10.1002/art.22613
    1. Lalloo C, Harris LR, Hundert AS, et al. . The iCanCope pain self-management application for adolescents with juvenile idiopathic arthritis: a pilot randomized controlled trial. Rheumatology 2021;60:196–206. 10.1093/rheumatology/keaa178
    1. Lazaridou A, Martel MO, Cornelius M, et al. . The association between daily physical activity and pain among patients with knee osteoarthritis: the moderating role of pain catastrophizing. Pain Med 2019;20:916–24. 10.1093/pm/pny129
    1. Martin MJ, Ng N, Blackler L, et al. . P227 Remote monitoring of patients with RA: a user-centred design approach. Rheumatology 2020;59:keaa111–221. 10.1093/rheumatology/keaa111.221
    1. Murray MT, Penney SP, Landman A, et al. . User experience with a voice-enabled smartphone APP to collect patient-reported outcomes in rheumatoid arthritis. Clin Exp Rheumatol 2022;40:882–9. 10.55563/clinexprheumatol/xsdfl2
    1. Pers Y-M, Valsecchi V, Mura T, et al. . A randomized prospective open-label controlled trial comparing the performance of a connected monitoring interface versus physical routine monitoring in patients with rheumatoid arthritis. Rheumatology 2021;60:1659–68. 10.1093/rheumatology/keaa462
    1. Wilson SJ, Martire LM, Keefe FJ, et al. . Daily verbal and nonverbal expression of osteoarthritis pain and spouse responses. Pain 2013;154:2045–53. 10.1016/j.pain.2013.06.023
    1. Zaslavsky O, Thompson HJ, McCurry SM, et al. . Use of a wearable technology and motivational interviews to improve sleep in older adults with osteoarthritis and sleep disturbance: a pilot study. Res Gerontol Nurs 2019;12:167–73. 10.3928/19404921-20190319-02

Source: PubMed

3
Tilaa