Barriers encountered during enrollment in an internet-mediated randomized controlled trial
Lorraine R Buis, Adrienne W Janney, Michael L Hess, Silas A Culver, Caroline R Richardson, Lorraine R Buis, Adrienne W Janney, Michael L Hess, Silas A Culver, Caroline R Richardson
Abstract
Background: Online technology is a promising resource for conducting clinical research. While the internet may improve a study's reach, as well as the efficiency of data collection, it may also introduce a number of challenges for participants and investigators. The objective of this research was to determine the challenges that potential participants faced during the enrollment phase of a randomized controlled intervention trial of Stepping Up to Health, an internet-mediated walking program that utilized a multi-step online enrollment process.
Methods: We conducted a quantitative content analysis of 623 help tickets logged in a participant management database during the enrollment phase of a clinical trial investigating the effect of an automated internet-mediated walking intervention. Qualitative coding was performed by two trained coders, and 10% of the sample was coded by both coders to determine inter-coder reliability. Quantitative analyses included standard descriptive statistics on ticket characteristics and theme frequency, and a Poisson regression analysis identified characteristics of potential participants who reported more frequent problems during enrollment.
Results: In total, 880 potential participants visited the study website and 80% completed the enrollment screening. Of the potential participants who visited the study website, 38% had help tickets logged in the participant management database. The total number of help tickets associated with individual potential participants ranged from 0 to 7 (M = .71). Overall, 46% of help tickets were initiated by email and 54% were initiated by phone. The most common help ticket theme was issues related to the study process (48%). The next most prominent theme was discussion related to obtaining medical clearance (34%), followed by issues related to pedometers and uploading (31%). Older individuals, women, and those with lower self-rated internet ability were more likely to report problems during the enrollment process.
Conclusion: Prospective participants in an online clinical trial encountered a number of barriers to enrollment that led them to request help from study staff. Questions about the complex enrollment process itself were common. In a complex multi-step enrollment process, providing personalized feedback to potential participants indicating their status within the enrollment process may be beneficial.
Trial registration: ClinicalTrials.gov NCT00729040.
References
- Pew Internet & American Life Project Demographics of internet users
- Horrigan JB. Home broadband adoption in 2008
- Fox S. Online Health Search 2006: Most internet users start at a search engine when looking for health information online. Very few check the source and date of the information they find
- Ahern NR. Using the Internet to conduct research. Nurse Res. 2005;13:55–70.
- Murray E, Khadjesari Z, White IR, Kalaitzaki E, Godfrey C, McCambridge J, Thompson SG, Wallace P. Methodological challenges in online trials. J Med Internet Res. 2009;11:e9. doi: 10.2196/jmir.1052.
- Dorman K, Saade GR, Smith H, Moise KJ., Jr Use of the World Wide Web in research: randomization in a multicenter clinical trial of treatment for twin-twin transfusion syndrome. Obstet Gynecol. 2000;96:636–639. doi: 10.1016/S0029-7844(00)00978-9.
- Cioffi I, Martina R, Michelotti A, Chiodini P, Tagliaferri R, Farella M. Web-based randomised controlled trials in orthodontics. Evid Based Dent. 2008;9:118–120. doi: 10.1038/sj.ebd.6400618.
- Scholle SH, Peele PB, Kelleher KJ, Frank E, Jansen-McWilliams L, Kupfer D. Effect of different recruitment sources on the composition of a bipolar disorder case registry. Soc Psychiatry Psychiatr Epidemiol. 2000;35:220–227. doi: 10.1007/s001270050231.
- Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, Couper MP, Green B, Wildenhaus K. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res. 2007;9:e11. doi: 10.2196/jmir.9.2.e11.
- McKay HG, Danaher BG, Seeley JR, Lichtenstein E, Gau JM. Comparing two web-based smoking cessation programs: randomized controlled trial. J Med Internet Res. 2008;10:e40. doi: 10.2196/jmir.993.
- Rothert K, Strecher VJ, Doyle LA, Caplan WM, Joyce JS, Jimison HB, Karm LM, Mims AD, Roth MA. Web-based weight management programs in an integrated health care setting: a randomized, controlled trial. Obesity (Silver Spring) 2006;14:266–272. doi: 10.1038/oby.2006.34.
- Warmerdam L, van Straten A, Twisk J, Riper H, Cuijpers P. Internet-based treatment for adults with depressive symptoms: randomized controlled trial. J Med Internet Res. 2008;10:e44. doi: 10.2196/jmir.1094.
- Devineni T, Blanchard EB. A randomized controlled trial of an internet-based treatment for chronic headache. Behav Res Ther. 2005;43:277–292. doi: 10.1016/j.brat.2004.01.008.
- Riffe D, Lacy S, Fico F. Analyzing Media Messages: Using quantitative content analysis in research. 2. Mahwah: Lawrence Erlbaum Publishers; 2005.
- Richardson CR, Mehari KS, McIntyre LG, Janney AW, Fortlage LA, Sen A, Strecher VJ, Piette JD. A randomized trial comparing structured and lifestyle goals in an internet-mediated walking program for people with type 2 diabetes. Int J Behav Nutr Phys Act. 2007;4:59. doi: 10.1186/1479-5868-4-59.
Source: PubMed