Understanding the Canadian adult CT head rule trial: use of the theoretical domains framework for process evaluation

Janet A Curran, Jamie Brehaut, Andrea M Patey, Martin Osmond, Ian Stiell, Jeremy M Grimshaw, Janet A Curran, Jamie Brehaut, Andrea M Patey, Martin Osmond, Ian Stiell, Jeremy M Grimshaw

Abstract

Background: The Canadian CT Head Rule was prospectively derived and validated to assist clinicians with diagnostic decision-making regarding the use of computed tomography (CT) in adult patients with minor head injury. A recent intervention trial failed to demonstrate a decrease in the rate of head CTs following implementation of the rule in Canadian emergency departments. Yet, the same intervention, which included a one-hour educational session and reminders at the point of requisition, was successful in reducing cervical spine imaging rates in the same emergency departments. The reason for the varied effect of the intervention across these two behaviours is unclear. There is an increasing appreciation for the use of theory to conduct process evaluations to better understand how strategies are linked with outcomes in implementation trials. The Theoretical Domains Framework (TDF) has been used to explore health professional behaviour and to design behaviour change interventions but, to date, has not been used to guide a theory-based process evaluation. In this proof of concept study, we explored whether the TDF could be used to guide a retrospective process evaluation to better understand emergency physicians' responses to the interventions employed in the Canadian CT Head Rule trial.

Methods: A semi-structured interview guide, based on the 12 domains from the TDF, was used to conduct telephone interviews with project leads and physician participants from the intervention sites in the Canadian CT Head Rule trial. Two reviewers independently coded the anonymised interview transcripts using the TDF as a coding framework. Relevant domains were identified by: the presence of conflicting beliefs within a domain; the frequency of beliefs; and the likely strength of the impact of a belief on the behaviour.

Results: Eight physicians from four of the intervention sites in the Canadian CT Head Rule trial participated in the interviews. Barriers likely to assist with understanding physicians' responses to the intervention in the trial were identified in six of the theoretical domains: beliefs about consequences; beliefs about capabilities; behavioural regulation; memory, attention and decision processes; environmental context and resources; and social influences. Despite knowledge that the Canadian CT Head Rule was highly sensitive and reliable for identifying clinically important brain injuries and strong beliefs about the benefits for using the rule, a number of barriers were identified that may have prevented physicians from consistently applying the rule.

Conclusion: This proof of concept study demonstrates the use of the TDF as a guiding framework to design a retrospective theory-based process evaluation. There is a need for further development and testing of methods for using the TDF to guide theory-based process evaluations running alongside behaviour change intervention trials.

References

    1. Laupacis A, Sekar N, Stiell IG. Clinical prediction rules. A review and suggested modifications of methodological standards. JAMA. 1997;277(6):488–494. doi: 10.1001/jama.1997.03540300056034.
    1. Stiell IG, Wells GA. Methodologic standards for the development of clinical decision rules in emergency medicine. Ann Emerg Med. 1999;33(4):437–447. doi: 10.1016/S0196-0644(99)70309-4.
    1. McGinn TG, Guyatt GH, Wyer PC, Naylor CD, Stiell IG, Richardson WS. Users' Guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-based medicine working group. JAMA. 2000;284(1):79–84. doi: 10.1001/jama.284.1.79.
    1. Asplin BR, Magid DJ, Rhodes KV, Solberg LI, Lurie N, Camargo CA Jr. A conceptual model of emergency department crowding. Ann Emerg Med. 2003;42(2):173–180. doi: 10.1067/mem.2003.302.
    1. Stiell IG, Wells GA, Vandemheen K, Laupacis A, Brison R, Eisenhauer MA, Greenberg GH, MacPhail I, McKnight RD, Reardon M, Verbeek R, Worthington J, Lesiuk H. Variation in ED use of computed tomography for patients with minor head injury. Ann Emerg Med. 1997;30(1):14–22. doi: 10.1016/S0196-0644(97)70104-5.
    1. Stiell IG, Lesiuk H, Wells GA, McKnight RD, Brison R, Clement C, Eisenhauer MA, Greenberg GH, MacPhail I, Reardon M, Worthington J, Verbeek R, Rowe B, Cass D, Dreyer J, Holroyd B, Morrison L, Schull M, Laupacis A. Canadian CT head and C-spine study group: the Canadian CT head rule study for patients with minor head injury: rationale, objectives, and methodology for phase I (derivation) Ann Emerg Med. 2001;38(2):160–169. doi: 10.1067/mem.2001.116796.
    1. Stiell IG, Lesiuk H, Wells GA, Coyle D, McKnight RD, Brison R, Clement C, Eisenhauer MA, Greenberg GH, Macphail I, Reardon M, Worthington J, Verbeek R, Rowe B, Cass D, Dreyer J, Holroyd B, Morrison L, Schull M, Laupacis A. Canadian CT head and C-spine study group: Canadian CT head rule study for patients with minor head injury: methodology for phase II (validation and economic analysis) Ann Emerg Med. 2001;38(3):317–322. doi: 10.1067/mem.2001.116795.
    1. Stiell IG, Wells GA, Vandemheen K, Clement C, Lesiuk H, Laupacis A, McKnight RD, Verbeek R, Brison R, Cass D, Eisenhauer ME, Greenberg G, Worthington J. The Canadian CT head rule for patients with minor head injury. Lancet. 2001;357(9266):1391–1396. doi: 10.1016/S0140-6736(00)04561-X.
    1. Stiell IG, Clement CM, Rowe BH, Schull MJ, Brison R, Cass D, Eisenhauer MA, McKnight RD, Bandiera G, Holroyd B, Lee JS, Dreyer J, Worthington JR, Reardon M, Greenberg G, Lesiuk H, MacPhail I, Wells GA. Comparison of the Canadian CT head rule and the New Orleans criteria in patients with minor head injury. JAMA. 2005;294(12):1511–1518. doi: 10.1001/jama.294.12.1511.
    1. Stiell IG, Clement CM, Grimshaw JM, Brison RJ, Rowe BH, Lee JS, Shah A, Brehaut J, Holroyd BR, Schull MJ, McKnight RD, Eisenhauer MA, Dreyer J, Letovsky E, Rutledge T, Macphail I, Ross S, Perry JJ, Ip U, Lesiuk H, Bennett C, Wells GA. A prospective cluster-randomized trial to implement the Canadian CT head rule in emergency departments. CMAJ. 2010;182(14):1527–1532.
    1. Stiell IG, Clement CM, Grimshaw J, Brison RJ, Rowe BH, Schull MJ, Lee JS, Brehaut J, McKnight RD, Eisenhauer MA, Dreyer J, Letovsky E, Rutledge T, MacPhail I, Ross S, Shah A, Perry JJ, Holroyd BR, Ip U, Lesiuk H, Wells GA. Implementation of the Canadian C-spine rule: prospective 12 centre cluster randomised trial. BMJ. 2009;339:b4146. doi: 10.1136/bmj.b4146.
    1. Stiell IG, Grimshaw J, Wells GA, Coyle D, Lesiuk HJ, Rowe BH, Brison RJ, Schull MJ, Lee J, Clement CM. A matched-pair cluster design study protocol to evaluate implementation of the Canadian C-spine rule in hospital emergency departments: phase III. Implement Sci. 2007;2:4. doi: 10.1186/1748-5908-2-4.
    1. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):iii–iv. 1–72.
    1. Grimshaw JM, Zwarenstein M, Tetroe JM, Godin G, Graham ID, Lemyre L, Eccles MP, Johnston M, Francis JJ, Hux J, O'Rourke K, Legare F, Presseau J. Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada. Implement Sci. 2007;2:38. doi: 10.1186/1748-5908-2-38.
    1. Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205. doi: 10.1111/j.1468-0009.2011.00625.x.
    1. Francis JJ, Eccles MP, Johnston M, Whitty P, Grimshaw JM, Kaner EF, Smith L, Walker A. Explaining the effects of an intervention designed to promote evidence-based diabetes care: a theory-based process evaluation of a pragmatic cluster randomised controlled trial. Implement Sci. 2008;3:50. doi: 10.1186/1748-5908-3-50.
    1. Ramsay CR, Thomas RE, Croal BL, Grimshaw JM, Eccles MP. Using the theory of planned behaviour as a process evaluation tool in randomised trials of knowledge translation strategies: a case study from UK primary care. Implement Sci. 2010;5:71. doi: 10.1186/1748-5908-5-71.
    1. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. "Psychological theory" group: making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33. doi: 10.1136/qshc.2004.011155.
    1. Dyson J, Lawton R, Jackson C, Cheater F. Does the use of a theoretical approach tell us more about hand hygiene behaviour? THe barriers and levers to hand hygiene. J Infect Prev. 2011;12(1):17–24. doi: 10.1177/1757177410384300.
    1. Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ. Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians' blood transfusion behaviour. Br J Health Psychol. 2009;14(Pt 4):625–646.
    1. Michie S, Pilling S, Garety P, Whitty P, Eccles MP, Johnston M, Simmons J. Difficulties implementing a mental health guideline: an exploratory investigation using psychological theory. Implement Sci. 2007;2:8. doi: 10.1186/1748-5908-2-8.
    1. McKenzie JE, French SD, O'Connor DA, Grimshaw JM, Mortimer D, Michie S, Francis J, Spike N, Schattner P, Kent PM, Buchbinder R, Green SE. IMPLEmenting a clinical practice guideline for acute low back pain evidence-based manageMENT in general practice (IMPLEMENT): cluster randomised controlled trial study protocol. Implement Sci. 2008;3:11. doi: 10.1186/1748-5908-3-11.
    1. Amemori M, Korhonen T, Kinnunen T, Michie S, Murtomaa H. Enhancing implementation of tobacco use prevention and cessation counselling guideline among dental providers: a cluster randomised controlled trial. Implement Sci. 2011;6:13. doi: 10.1186/1748-5908-6-13.
    1. French SD, Green SE, O'Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012;7:38. doi: 10.1186/1748-5908-7-38.
    1. Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7:35. doi: 10.1186/1748-5908-7-35.
    1. Sturges JEHK. Comparing telephone and face-to-face qualitative interviewing: a research note. Qual Res. 2004;4:107–118. doi: 10.1177/1468794104041110.
    1. Holt A. Using the telephone for narrative interviewing: a research note. Qual Res. 2010;10(1):113–121. doi: 10.1177/1468794109348686.
    1. Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ. 2000;320(7227):114–116. doi: 10.1136/bmj.320.7227.114.
    1. QSR International. NVivo qualitative data analysis software. 2010. VERSION 9.
    1. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288. doi: 10.1177/1049732305276687.
    1. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37. doi: 10.1186/1748-5908-7-37.
    1. Brehaut JC, Stiell IG, Visentin L, Graham ID. Clinical decision rules "in the real world": how a widely disseminated rule is used in everyday practice. Acad Emerg Med. 2005;12(10):948–956. doi: 10.1111/j.1553-2712.2005.tb00805.x.
    1. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011;26(11):1479–1498. doi: 10.1080/08870446.2010.540664.
    1. Geary UKU. Clinical decision-making in emergency medicine. Emergencias. 2010;22:56–60.
    1. Croskerry P. Critical thinking and decisionmaking: avoiding the perils of thin-slicing. Ann Emerg Med. 2006;48(6):720–722. doi: 10.1016/j.annemergmed.2006.03.030.
    1. Croskerry P, Sinclair D. Emergency medicine: a practice prone to error? CJEM. 2001;3(4):271–276.
    1. Brehaut JC, Graham ID, Wood TJ, Taljaard M, Eagles D, Lott A, Clement C, Kelly AM, Mason S, Stiell IG. Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries. Med Decis Making. 2010;30(3):398–408. doi: 10.1177/0272989X09344747.
    1. Phillips B. Clinical decision rules: how to use them. Arch Dis Child Educ Pract Ed. 2010;95(3):88–92. doi: 10.1136/adc.2009.174458.
    1. Croskerry P. The cognitive imperative: thinking about how we think. Acad Emerg Med. 2000;7(11):1223–1231. doi: 10.1111/j.1553-2712.2000.tb00467.x.
    1. Friedman CP, Gatti GG, Franz TM, Murphy GC, Wolf FM, Heckerling PS, Fine PL, Miller TM, Elstein AS. Do physicians know when their diagnoses are correct? implications for decision support and error reduction. J Gen Intern Med. 2005;20(4):334–339. doi: 10.1111/j.1525-1497.2005.30145.x.
    1. Sandhu H, Carpenter C, Freeman K, Nabors SG, Olson A. Clinical decisionmaking: opening the black box of cognitive reasoning. Ann Emerg Med. 2006;48(6):713–719. doi: 10.1016/j.annemergmed.2006.03.011.
    1. Michie S, Johnson M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–680. doi: 10.1111/j.1464-0597.2008.00341.x.
    1. Wolfers ME, van den Hoek C, Brug J, de Zwart O. Using intervention mapping to develop a programme to prevent sexually transmittable infections, including HIV, among heterosexual migrant men. BMC Publ Health. 2007;7:141. doi: 10.1186/1471-2458-7-141.
    1. Francis JJ, Johnston M, Robertson C, Glidewell L, Entwistle V, Eccles MP, Grimshaw JM. What is an adequate sample size? operationalising data saturation for theory-based interview studies. Psychol Health. 2010;25(10):1229–1245. doi: 10.1080/08870440903194015.

Source: PubMed

3
Abonnere