Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content

Gratianne Vaisson, Holly O Witteman, Zachary Bouck, Caroline A Bravo, Laura Desveaux, Diego Llovet, Justin Presseau, Marianne Saragosa, Monica Taljaard, Shama Umar, Jeremy M Grimshaw, Jill Tinmouth, Noah M Ivers, Gratianne Vaisson, Holly O Witteman, Zachary Bouck, Caroline A Bravo, Laura Desveaux, Diego Llovet, Justin Presseau, Marianne Saragosa, Monica Taljaard, Shama Umar, Jeremy M Grimshaw, Jill Tinmouth, Noah M Ivers

Abstract

Background: Cancer Care Ontario's Screening Activity Report (SAR) is an online audit and feedback tool designed to help primary care physicians in Ontario, Canada, identify patients who are overdue for cancer screening or have abnormal results requiring follow-up. Use of the SAR is associated with increased screening rates. To encourage SAR use, Cancer Care Ontario sends monthly emails to registered primary care physicians announcing that updated data are available. However, analytics reveal that 50% of email recipients do not open the email and less than 7% click the embedded link to log in to their report.

Objective: The goal of the study is to determine whether rewritten emails result in increased log-ins. This manuscript describes how different user- and theory-informed messages intended to improve the impact of the monthly emails will be experimentally tested and how a process evaluation will explore why and how any effects observed were (or were not) achieved.

Methods: A user-centered approach was used to rewrite the content of the monthly email, including messages operationalizing 3 behavior change techniques: anticipated regret, material incentive (behavior), and problem solving. A pragmatic, 2x2x2 factorial experiment within a multiphase optimization strategy will test the redesigned emails with an embedded qualitative process evaluation to understand how and why the emails may or may not have worked. Trial outcomes will be ascertained using routinely collected administrative data. Physicians will be recruited for semistructured interviews using convenience and snowball sampling.

Results: As of April 2017, 5576 primary care physicians across the province of Ontario, Canada, had voluntarily registered for the SAR, and in so doing, signed up to receive the monthly email updates. From May to August 2017 participants received the redesigned monthly emails with content specific to their allocated experimental condition prompting use of the SAR. We have not yet begun analyses.

Conclusions: This study will inform how to communicate effectively with primary care providers by email and identify which behavior change techniques tested are most effective at encouraging engagement with an audit and feedback report.

Trial registration: ClinicalTrials.gov NCT03124316; https://ichgcp.net/clinical-trials-registry/NCT03124316 (Archived by WebCite at http://www.webcitation.org/6w2MqDWGu).

Keywords: behavior change techniques; clinical trials as topic; early detection of cancer; electronic mail; feedback; implementation science; persuasive communication; primary health care; process evaluation.

Conflict of interest statement

Conflicts of Interest: During the course of this project, authors CAB, DL, SU, and JT were employed at CCO.

©Gratianne Vaisson, Holly O Witteman, Zachary Bouck, Caroline A Bravo, Laura Desveaux, Diego Llovet, Justin Presseau, Marianne Saragosa, Monica Taljaard, Shama Umar, Jeremy M Grimshaw, Jill Tinmouth, Noah M Ivers. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 16.02.2018.

Figures

Figure 1
Figure 1
Logic model of the content and hypothesised mechanism of change.
Figure 2
Figure 2
Allocation flow diagram.

References

    1. Zapka JG, Lemon SC. Interventions for patients, providers, and health care organizations. Cancer. 2004 Sep 01;101(5 Suppl):1165–1187. doi: 10.1002/cncr.20504. doi: 10.1002/cncr.20504.
    1. Finney Rutten LJ, Nelson DE, Meissner HI. Examination of population-wide trends in barriers to cancer screening from a diffusion of innovation perspective (1987-2000) Prev Med. 2004 Mar;38(3):258–268. doi: 10.1016/j.ypmed.2003.10.011.
    1. Maxwell AE, Bastani R, Crespi CM, Danao LL, Cayetano RT. Behavioral mediators of colorectal cancer screening in a randomized controlled intervention trial. Prev Med. 2011 Feb;52(2):167–173. doi: 10.1016/j.ypmed.2010.11.007.
    1. Hanson K, Montgomery P, Bakker D, Conlon M. Factors influencing mammography participation in Canada: an integrative review of the literature. Curr Oncol. 2009 Sep;16(5):65–75.
    1. Hewitson P, Ward AM, Heneghan C, Halloran SP, Mant D. Primary care endorsement letter and a patient leaflet to improve participation in colorectal cancer screening: results of a factorial randomised trial. Br J Cancer. 2011 Aug 09;105(4):475–480. doi: 10.1038/bjc.2011.255. doi: 10.1038/bjc.2011.255.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012 Jun 13;(6):CD000259. doi: 10.1002/14651858.CD000259.pub3.
    1. Arditi C, Rège-Walther M, Wyatt JC, Durieux P, Burnand B. Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2012 Dec 12;(12):CD001175. doi: 10.1002/14651858.CD001175.pub3.
    1. Scott A, Sivey P, Ait Ouakrim D, Willenberg L, Naccarella L, Furler J, Young D. The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database Syst Rev. 2011 Sep 07;(9):CD008451. doi: 10.1002/14651858.CD008451.pub2.
    1. Taitz JM, Lee TH, Sequist TD. A framework for engaging physicians in quality and safety. BMJ Qual Saf. 2012 Sep;21(9):722–728. doi: 10.1136/bmjqs-2011-000167.
    1. Ivers N, Barnsley J, Upshur R, Tu K, Shah B, Grimshaw J, Zwarenstein M. “My approach to this job is...one person at a time”: Perceived discordance between population-level quality targets and patient-centred care. Can Fam Physician. 2014 Mar;60(3):258–266.
    1. van der Veer SN, de Keizer NF, Ravelli ACJ, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010 May;79(5):305–323. doi: 10.1016/j.ijmedinf.2010.01.011.
    1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2015 Mar 01;136(5):E359–E386. doi: 10.1002/ijc.29210. doi: 10.1002/ijc.29210.
    1. Global Burden of Disease Cancer Collaboration. Fitzmaurice C, Dicker D, Pain A, Hamavid H, Moradi-Lakeh M, MacIntyre MF, Allen C, Hansen G, Woodbrook R, Wolfe C, Hamadeh RR, Moore A, Werdecker A, Gessner BD, Te Ao B, McMahon B, Karimkhani C, Yu C, Cooke GS, Schwebel DC, Carpenter DO, Pereira DM, Nash D, Kazi DS, De Diego L, Plass D, Ukwaja KN, Thurston GD, Yun Jin K, Simard EP, Mills E, Park E-K, Catalá-López F, deVeber G, Gotay C, Khan G, Hosgood D, Santos IS, Leasher JL, Singh J, Leigh J, Jonas JB, Jonas J, Sanabria J, Beardsley J, Jacobsen KH, Takahashi K, Franklin RC, Ronfani L, Montico M, Naldi L, Tonelli M, Geleijnse J, Petzold M, Shrime MG, Younis M, Yonemoto N, Breitborde N, Yip P, Pourmalek F, Lotufo PA, Esteghamati A, Hankey GJ, Ali R, Lunevicius R, Malekzadeh R, Dellavalle R, Weintraub R, Lucas R, Hay R, Rojas-Rueda D, Westerman R, Sepanlou SG, Nolte S, Patten S, Weichenthal S, Abera Semaw Ferede, Fereshtehnejad S-M, Shiue I, Driscoll T, Vasankari T, Alsharif U, Rahimi-Movaghar V, Vlassov VV, Marcenes WS, Mekonnen W, Melaku YA, Yano Y, Artaman A, Campos I, MacLachlan J, Mueller U, Kim D, Trillini M, Eshrati B, Williams HC, Shibuya K, Dandona R, Murthy K, Cowie B, Amare AT, Antonio CA, Castañeda-Orjuela C, van Gool CH, Violante F, Oh I-H, Deribe K, Soreide K, Knibbs L, Kereselidze M, Green M, Cardenas R, Roy N, Tillmann T, Tillman T, Li Y, Krueger H, Monasta L, Dey S, Sheikhbahaei S, Hafezi-Nejad N, Kumar GA, Sreeramareddy CT, Dandona L, Wang H, Vollset SE, Mokdad A, Salomon JA, Lozano R, Vos T, Forouzanfar M, Lopez A, Murray C, Naghavi M. The Global Burden of Cancer 2013. JAMA Oncol. 2015 Jul;1(4):505–527. doi: 10.1001/jamaoncol.2015.0735.
    1. The guide to clinical preventive services: recommendation of the US Preventive Service Task Force. 2014. [2017-12-27]. .
    1. Curry S, Byers T, Hewitt M. Fulfilling the potential for cancer prevention and early detection. 2003. [2017-12-27]. .
    1. IARC Handbook of Cancer Prevention—Cervix Cancer Screening, Volume 10. Lyon: International Agency for Research on Cancer Press; 2005. [2017-12-27]. .
    1. Cancer Care Ontario. 2017. [2017-07-10]. Screening
    1. Cancer Quality Council of Ontario. [2017-05-24].
    1. Jonah L, Pefoyo AK, Lee A, Hader J, Strasberg S, Kupets R, Chiarelli AM, Tinmouth J. Evaluation of the effect of an audit and feedback reporting tool on screening participation: the Primary Care Screening Activity Report (PCSAR) Prev Med. 2017 Mar;96:135–143. doi: 10.1016/j.ypmed.2016.12.002.
    1. Collins LM, Kugler KC, Gwadz MV. Optimization of multicomponent behavioral and biobehavioral interventions for the prevention and treatment of HIV/AIDS. AIDS Behav. 2016 Jan;20 Suppl 1:S197–S214. doi: 10.1007/s10461-015-1145-4.
    1. Michie S, Atkins L, West R. The Behaviour Change Wheel: A Guide to Designing Interventions. London: Silverback; 2014.
    1. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The Behavior Change Technique Taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013 Aug;46(1):81–95. doi: 10.1007/s12160-013-9486-6.
    1. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005 Feb;14(1):26–33. doi: 10.1136/qshc.2004.011155.
    1. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–680. doi: 10.1111/j.1464-0597.2008.00341.x.
    1. Wyrick DL, Rulison KL, Fearnow-Kenney M, Milroy JJ, Collins LM. Moving beyond the treatment package approach to developing behavioral interventions: addressing questions that arose during an application of the Multiphase Optimization Strategy (MOST) Transl Behav Med. 2014 Sep;4(3):252–259. doi: 10.1007/s13142-013-0247-7.
    1. Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. Am J Prev Med. 2014 Oct;47(4):498–504. doi: 10.1016/j.amepre.2014.06.021.
    1. Nair V, Strecher V, Fagerlin A, Ubel P, Resnicow K, Murphy S, Little R, Chakraborty B, Zhang A. Screening experiments and the use of fractional factorial designs in behavioral intervention research. Am J Public Health. 2008 Aug;98(8):1354–1359. doi: 10.2105/AJPH.2007.127563.
    1. Korn EL, Freidlin B. Non-factorial analyses of two-by-two factorial trial designs. Clin Trials. 2016 Dec;13(6):651–659. doi: 10.1177/1740774516659472.
    1. McAlister FA, Straus SE, Sackett DL, Altman DG. Analysis and reporting of factorial trials: a systematic review. JAMA. 2003 May 21;289(19):2545–2553. doi: 10.1001/jama.289.19.2545.
    1. Statistics Canada. [2017-05-31]. Population with a regular medical doctor, by sex, provinces and territories (percent) .
    1. Hutchison B, Glazier R. Ontario's primary care reforms have transformed the local care landscape, but a plan is needed for ongoing improvement. Health Aff (Millwood) 2013 Apr;32(4):695–703. doi: 10.1377/hlthaff.2012.1087.
    1. Richardson A. Screening and the number needed to treat. J Med Screen. 2001;8(3):125–127. doi: 10.1136/jms.8.3.125.
    1. Richardson AK, Potter JD. Screening for colorectal cancer and prostate cancer: challenges for New Zealand. N Z Med J. 2014 Jun 06;127(1395):23–30.
    1. van Ravesteyn NT, Stout NK, Schechter CB, Heijnsdijk EAM, Alagoz O, Trentham-Dietz A, Mandelblatt JS, de Koning HJ. Benefits and harms of mammography screening after age 74 years: model estimates of overdiagnosis. J Natl Cancer Inst. 2015 Jul;107(7) doi: 10.1093/jnci/djv103.
    1. Bulliard J-L, Levi F. Mammography screening: time to reevaluate its impact? Eur J Cancer Prev. 2012 May;21(3):222–226. doi: 10.1097/CEJ.0b013e328350de6e.
    1. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O'Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
    1. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117. doi: 10.1186/1471-2288-13-117.
    1. O'Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.
    1. Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006 Mar;16(3):377–394. doi: 10.1177/1049732305285708.
    1. Lorencatto F, Gould NJ, McIntyre SA, During C, Bird J, Walwyn R, Cicero R, Glidewell L, Hartley S, Stanworth SJ, Foy R, Grimshaw JM, Michie S, Francis JJ, AFFINITIE programme A multidimensional approach to assessing intervention fidelity in a process evaluation of audit and feedback interventions to reduce unnecessary blood transfusions: a study protocol. Implement Sci. 2016 Dec 12;11(1):163. doi: 10.1186/s13012-016-0528-x.
    1. Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016 Aug 06;388(10044):547–548. doi: 10.1016/S0140-6736(16)31256-9.
    1. Wolfenden L, Yoong SL, Williams C, Grimshaw J, Durrheim DN, Gillham K, Wiggers J. Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example. J Clin Epidemiol. 2017 May;85:3–11. doi: 10.1016/j.jclinepi.2017.03.007.
    1. Cancer Care Ontario. 2015. [2017-05-30]. Who we are
    1. Sim J. Collecting and analysing qualitative data: issues raised by the focus group. J Adv Nurs. 1998 Aug;28(2):345–352.

Source: PubMed

3
S'abonner