The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial

Jennifer B McClure, Susan M Shortreed, Andy Bogart, Holly Derry, Karin Riggs, Jackie St John, Vijay Nair, Larry An, Jennifer B McClure, Susan M Shortreed, Andy Bogart, Holly Derry, Karin Riggs, Jackie St John, Vijay Nair, Larry An

Abstract

Background: Participant engagement influences treatment effectiveness, but it is unknown which intervention design features increase treatment engagement for online smoking cessation programs.

Objective: We explored the effects of 4 design features (ie, factors) on early engagement with an Internet-based, motivational smoking cessation program.

Methods: Smokers (N=1865) were recruited from a large health care organization to participate in an online intervention study, regardless of their interest in quitting smoking. The program was intended to answer smokers' questions about quitting in an effort to motivate and support cessation. Consistent with the screening phase in the multiphase optimization strategy (MOST), we used a 2-level, full-factorial design. Each person was randomized to 1 of 2 levels of each factor, including message tone (prescriptive vs motivational), navigation autonomy (dictated vs not), proactive email reminders (yes vs no), and inclusion of personally tailored testimonials (yes vs no). The effects of each factor level on program engagement during the first 2 months of enrollment were compared, including number of visits to the website resulting in intervention content views (as opposed to supplemental content views), number of intervention content areas viewed, number of intervention content pages viewed, and duration of time spent viewing this content, as applicable to each factor.

Results: Adjusting for baseline readiness to quit, persons who received content written in a prescriptive tone made the same number of visits to the website as persons receiving content in a motivational tone, but viewed 1.17 times as many content areas (95% CI 1.08-1.28; P<.001) and 1.15 times as many pages (95% CI 1.04-1.28; P=.009). Time spent viewing materials did not differ among groups (P=.06). Persons required to view content in a dictated order based on their initial readiness to quit made the same number of visits as people able to freely navigate the site, but viewed fewer content areas (ratio of means 0.80, 95% CI 0.74-0.87; P<.001), 1.17 times as many pages (95% CI 1.06-1.31; P=.003), and spent 1.37 times more minutes online (95% CI 1.17-1.59; P<.001). Persons receiving proactive email reminders made 1.20 times as many visits (95% CI 1.09-1.33; P<.001), viewed a similar number of content areas as persons receiving no reminders, viewed 1.58 times as many pages (95% CI 1.48-1.68; P<.001), and spent 1.51 times as many minutes online (95% CI 1.29-1.77; P<.001) as those who did not receive proactive emails. Tailored testimonials did not significantly affect engagement.

Conclusions: Using a prescriptive message tone, dictating content viewing order, and sending reminder emails each resulted in greater program engagement relative to the contrasting level of each experimental factor. The results require replication, but suggest that a more directive interaction style may be preferable for online cessation programs.

Trial registration: clinicaltrials.gov NCT00992264; https://ichgcp.net/clinical-trials-registry/NCT00992264 (Archived by WebCite at http://www.webcitation.org/6F7H7lr3P).

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Example screenshot of Questions about Quitting (Q2) layout.
Figure 2
Figure 2
Recruitment flow and allocation of participants.

References

    1. Centers for Disease Control and Prevention (CDC) Annual smoking-attributable mortality, years of potential life lost, and economic costs--United States, 1995-1999. MMWR Morb Mortal Wkly Rep. 2002 Apr 12;51(14):300–3.
    1. Levy DT, Graham AL, Mabry PL, Abrams DB, Orleans CT. Modeling the impact of smoking-cessation treatment policies on quit rates. Am J Prev Med. 2010 Mar;38(3 Suppl):S364–72. doi: 10.1016/j.amepre.2009.11.016.
    1. Hutton HE, Wilson LM, Apelberg BJ, Tang EA, Odelola O, Bass EB, Chander G. A systematic review of randomized controlled trials: Web-based interventions for smoking cessation among adolescents, college students, and adults. Nicotine Tob Res. 2011 Apr;13(4):227–38. doi: 10.1093/ntr/ntq252.
    1. Civljak M, Sheikh A, Stead LF, Car J. Internet-based interventions for smoking cessation. Cochrane Database Syst Rev. 2010;(9):CD007078. doi: 10.1002/14651858.CD007078.pub3.
    1. Strecher VJ, McClure J, Alexander G, Chakraborty B, Nair V, Konkel J, Greene S, Couper M, Carlier C, Wiese C, Little R, Pomerleau C, Pomerleau O. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res. 2008;10(5):e36. doi: 10.2196/jmir.1002.
    1. Danaher BG, Boles SM, Akers L, Gordon JS, Severson HH. Defining participant exposure measures in Web-based health behavior change programs. J Med Internet Res. 2006;8(3):e15. doi: 10.2196/jmir.8.3.e15.
    1. Couper MP, Alexander GL, Zhang N, Little RJ, Maddy N, Nowak MA, McClure JB, Calvi JJ, Rolnick SJ, Stopponi MA, Cole Johnson C. Engagement and retention: measuring breadth and depth of participant use of an online intervention. J Med Internet Res. 2010;12(4):e52. doi: 10.2196/jmir.1430.
    1. Fiore MC, Bailey WC, Cohen SJ, Dorfman SF, Goldstein MG, Gritz ER. Clinical practice guideline: Treating tobacco use and dependence. Rockville, MD: US Department of Health and Human Services. Public Health Service; 2000. Jun, [2012-12-18]. .
    1. Zbikowski SM, Jack LM, McClure JB, Deprey M, Javitz HS, McAfee TA, Catz SL, Richards J, Bush T, Swan GE. Utilization of services in a randomized trial testing phone- and web-based interventions for smoking cessation. Nicotine Tob Res. 2011 May;13(5):319–27. doi: 10.1093/ntr/ntq257.
    1. An LC, Schillo BA, Saul JE, Wendling AH, Klatt CM, Berg CJ, Ahulwalia JS, Kavanaugh AM, Christenson M, Luxenberg MG. Utilization of smoking cessation informational, interactive, and online community resources as predictors of abstinence: cohort study. J Med Internet Res. 2008;10(5):e55. doi: 10.2196/jmir.1018.
    1. Elfeddali I, Bolman C, Candel MJ, Wiers RW, de Vries H. Preventing smoking relapse via Web-based computer-tailored feedback: a randomized controlled trial. J Med Internet Res. 2012;14(4):e109. doi: 10.2196/jmir.2057.
    1. Richardson A, Graham AL, Cobb N, Xiao H, Mushro A, Abrams D, Vallone D. Engagement promotes abstinence in a Web-based cessation intervention: cohort study. J Med Internet Res. 2013;15(1):e14. doi: 10.2196/jmir.2277.
    1. Schwarzer R, Satow L. Online intervention engagement predicts smoking cessation. Prev Med. 2012 Sep;55(3):233–6. doi: 10.1016/j.ypmed.2012.07.006.
    1. Schneider F, van Osch L, Schulz DN, Kremers SP, de Vries H. The influence of user characteristics and a periodic email prompt on exposure to an internet-delivered computer-tailored lifestyle program. J Med Internet Res. 2012;14(2):e40. doi: 10.2196/jmir.1939.
    1. Greaney ML, Sprunck-Harrild K, Bennett GG, Puleo E, Haines J, Viswanath KV, Emmons KM. Use of email and telephone prompts to increase self-monitoring in a Web-based intervention: randomized controlled trial. J Med Internet Res. 2012;14(4):e96. doi: 10.2196/jmir.1981.
    1. Crutzen R, Cyr D, de Vries NK. The role of user control in adherence to and knowledge gained from a website: randomized comparison between a tunneled version and a freedom-of-choice version. J Med Internet Res. 2012;14(2):e45. doi: 10.2196/jmir.1922.
    1. Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005 Aug;30(1):65–73. doi: 10.1207/s15324796abm3001_8.
    1. Collins LM, Murphy SA, Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J Prev Med. 2007 May;32(5 Suppl):S112–8. doi: 10.1016/j.amepre.2007.01.022.
    1. Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003 Oct;71(5):843–61. doi: 10.1037/0022-006X.71.5.843.
    1. Heckman CJ, Egleston BL, Hofmann MT. Efficacy of motivational interviewing for smoking cessation: a systematic review and meta-analysis. Tob Control. 2010 Oct;19(5):410–6. doi: 10.1136/tc.2009.033175.
    1. Hettema JE, Hendricks PS. Motivational interviewing for smoking cessation: a meta-analytic review. J Consult Clin Psychol. 2010 Dec;78(6):868–84. doi: 10.1037/a0021498.
    1. Lundahl B, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Psychol. 2009 Nov;65(11):1232–45. doi: 10.1002/jclp.20638.
    1. Vasilaki EI, Hosier SG, Cox WM. The efficacy of motivational interviewing as a brief intervention for excessive drinking: a meta-analytic review. Alcohol Alcohol. 2006;41(3):328–35. doi: 10.1093/alcalc/agl016.
    1. Hettema J, Steele J, Miller WR. Motivational interviewing. Annu Rev Clin Psychol. 2005;1:91–111. doi: 10.1146/annurev.clinpsy.1.102803.143833.
    1. Green MC, Brock TC. The role of transportation in the persuasiveness of public narratives. J Pers Soc Psychol. 2000;79:701–21.
    1. Kreuter MW, Green MC, Cappella JN, Slater MD, Wise ME, Storey D, Clark EM, O'Keefe DJ, Erwin DO, Holmes K, Hinyard LJ, Houston T, Woolley S. Narrative communication in cancer prevention and control: a framework to guide research and application. Ann Behav Med. 2007 Jun;33(3):221–35. doi: 10.1080/08836610701357922.
    1. Strecher VJ, McClure JB, Alexander GL, Chakraborty B, Nair VN, Konkel JM, Greene SM, Collins LM, Carlier CC, Wiese CJ, Little RJ, Pomerleau CS, Pomerleau OF. Web-based smoking-cessation programs: results of a randomized trial. Am J Prev Med. 2008 May;34(5):373–81. doi: 10.1016/j.amepre.2007.12.024.
    1. McClure JB, Derry H, Riggs KR, Westbrook EW, St John J, Shortreed SM, Bogart A, An LC. Questions about quitting (Q2): design and methods of a Multiphase Optimization Strategy (MOST) randomized screening experiment for an online, motivational smoking cessation intervention. Contemp Clin Trials. 2012 Sep;33(5):1094–102. doi: 10.1016/j.cct.2012.06.009.
    1. Deci EL, Ryan RM. The "what" and "why" of goal pursuits: human needs and the self-determination of behavior. Psychol Inquiry. 2000;11:227–68.
    1. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000 Jan;55(1):68–78.
    1. Ryan RM, Deci EL. Self-regulation and the problem of human autonomy: does psychology need choice, self-determination, and will? J Pers. 2006 Dec;74(6):1557–85. doi: 10.1111/j.1467-6494.2006.00420.x.
    1. Collins LM, Baker TB, Mermelstein RJ, Piper ME, Jorenby DE, Smith SS, Christiansen BA, Schlam TR, Cook JW, Fiore MC. The multiphase optimization strategy for engineering effective tobacco use interventions. Ann Behav Med. 2011 Apr;41(2):208–26. doi: 10.1007/s12160-010-9253-x.
    1. Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol Methods. 2009 Sep;14(3):202–24. doi: 10.1037/a0015826.
    1. Miller WR, Rollnick S. Motivational Interviewing, Second Edition: Preparing People for Change. New York: The Guilford Press; 2002.
    1. Heatherton TF, Kozlowski LT, Frecker RC, Fagerström KO. The Fagerström Test for Nicotine Dependence: a revision of the Fagerström Tolerance Questionnaire. Br J Addict. 1991 Sep;86(9):1119–27.
    1. Böhning D, Dietz E, Schlattmann P, Mendonca L, Kirchner U. The zero-inflated Poisson model the decayed, missing filled teeth index in dental epidemiology. J R Statist Soc A. 1999;162:195–209.
    1. Preisser JS, Stamm JW, Long DL, Kincade ME. Review and recommendations for zero-inflated count regression modeling of dental caries indices in epidemiological studies. Caries Res. 2012;46(4):413–23. doi: 10.1159/000338992.
    1. Raghunathan TE, Lepkowski JM, Hoewyk JV, Solenberger PA. A multivariate technique for multiply imputing missing values using a sequence of regression models. Surv Methodol. 2001;27(1):85–95.
    1. Van Buuren S, Brand JPL, Groothuis-Oudshoorn CGM, Rubin DB. Fully conditional specification in multivariate imputation. J Stat Comput Simul. 2006;76(12):1049–64.
    1. Little RJA, Rubin DB. Statistical Analysis with Missing Data. Hoboken, NJ: Wiley; 2002.
    1. Raghunathan TE, Rubin DB. Large-sample significance levels from multiply imputed data using moment-based statistics and an F reference distribution. J Am Stat Assoc. 1991;86(416):1065–73.
    1. Rollnick S, Miller WR. What is motivational interviewing? Behav Cognit Psychother. 2009 Jun 2009;23(04):325. doi: 10.1017/S135246580001643X.
    1. Graham AL, Cobb NK, Papandonatos GD, Moreno JL, Kang H, Tinkelman DG, Bock BC, Niaura RS, Abrams DB. A randomized trial of Internet and telephone treatment for smoking cessation. Arch Intern Med. 2011 Jan 10;171(1):46–53. doi: 10.1001/archinternmed.2010.451.
    1. Swan GE, McClure JB, Jack LM, Zbikowski SM, Javitz HS, Catz SL, Deprey M, Richards J, McAfee TA. Behavioral counseling and varenicline treatment for smoking cessation. Am J Prev Med. 2010 May;38(5):482–90. doi: 10.1016/j.amepre.2010.01.024.
    1. Balmford J, Borland R, Li L, Ferretter I. Usage of an Internet smoking cessation resource: the Australian QuitCoach. Drug Alcohol Rev. 2009 Jan;28(1):66–72. doi: 10.1111/j.1465-3362.2008.00009.x.
    1. Eysenbach G, CONSORT-EHEALTH Group CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. doi: 10.2196/jmir.1923.

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren