Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit

Carl R May, Tracy Finch, Luciana Ballini, Anne MacFarlane, Frances Mair, Elizabeth Murray, Shaun Treweek, Tim Rapley, Carl R May, Tracy Finch, Luciana Ballini, Anne MacFarlane, Frances Mair, Elizabeth Murray, Shaun Treweek, Tim Rapley

Abstract

Background: Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.

Methods: Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.

Results: On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://www.normalizationprocess.org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.

Conclusion: Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.

Figures

Figure 1
Figure 1
NPT Toolkit - Web-interface - Sliding Toolbar.
Figure 2
Figure 2
NPT Toolkit - Reporting page - Individual Radar Plots for each Construct.

References

    1. Campbell M, Fitzpatrick R, Haines A, Kinmonth A, Sandercock P, Spiegelhalter D, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–696. doi: 10.1136/bmj.321.7262.694.
    1. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL. Designing and evaluating complex interventions to improve health care. Brit Med J. 2007;334(7591):455–459. doi: 10.1136/.
    1. Angus D, Brouwers M, Driedger M, Eccles M, Francis J, Godin G, Graham I, Grimshaw J, Hanna S, Harrison MB. et al.Designing theoretically-informed implementation interventions The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG) Implement Sci. 2006;1
    1. Grol RP, Bosch M, Hulscher M, Eccles M, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Quarterly. 2007;85(1):93–138. doi: 10.1111/j.1468-0009.2007.00478.x.
    1. Goldthorpe JH. On Sociology: Critique and Program. Stanford: Stanford University Press; 2006.
    1. Hechter M, Horne C. In: Theories of social order. Hechter M, Horne C, editor. Stanford CA, Stanford University Press; 2003. Theory is explanation.
    1. May C, Finch T. Implementation, embedding, and integration: an outline of Normalization Process Theory. Sociology. 2009;43(3):535–554.
    1. May C. 2006 A rational model for assessing and evaluating complex interventions in health care. BMC Health Services Research. 2006;6:86. doi: 10.1186/1472-6963-6-86.
    1. May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, Gask L, MacFarlane A, Murray E, Rapley T, Rogers A, Treweek S, Wallace P, Anderson G, Burns J, Heaven B. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Services Research. 2007;7:148. doi: 10.1186/1472-6963-7-148.
    1. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991;50:179–211. doi: 10.1016/0749-5978(91)90020-T.
    1. Rogers EM. The Diffusion of Innovations. 4. New York: Free Press; 1995.
    1. Latour B. Reassembling the Social: An Introduction to Actor Network Theory. Oxford: Oxford University Press; 2005.
    1. Bunge M. How does it work? The search for explanatory mechanisms. Philosophy of the Social Sciences. 2004;34(2):182–210. doi: 10.1177/0048393103262550.
    1. Gerring J. The mechanismic worldview: Thinking inside the box. British Journal of Political Science. 2008;38:161–179.
    1. Lieberson S, Lynn FB. Barking up the wrong branch: Scientific alternatives to the current model of sociological science. Annual Review of Sociology. 2002;28:1–19. doi: 10.1146/annurev.soc.28.110601.141122.
    1. Gask L, Lever-Green G, Hays R. Dissemination and implementation of suicide prevention training in one Scottish region. BMC Health Serv Res. 2008;8
    1. Gask L, Rogers A, Campbell S, Sheaff R. Beyond the limits of clinical governance? The case of mental health in English primary care. BMC Health Serv Res. 2008;8
    1. May CR, Montori VM, Mair F. Understanding patients' experiences of treatment burden in chronic heart failure using normalization process theory. Annals of Family Medicine. in press .
    1. Coburn NG, Guller U, Baxter NN, Kiss A, Ringash J, Swallow CJ, Law CHL. Adjuvant therapy for resected gastric cancer-rapid, yet incomplete adoption following results of intergroup 0116 trial. Int J Radiat Oncol Biol Phys. 2008;70(4):1073–1080. doi: 10.1016/j.ijrobp.2007.07.2378.
    1. Kirsh S, Lawrence R, Aron D. Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes. Implementation Science. 2008;3:article 34.
    1. May C, Mair F, Dowrick C, Finch T. Process evaluation for complex interventions in primary care: understanding trials using the normalization process model. BMC Family Practice. 2007;8:42. doi: 10.1186/1471-2296-8-42.
    1. Speed C, Heaven B, Adamson A, Bond J, Corbett S, Lake AA, May C, Vanoli A, McMeekin P, Moynihan P. et al.LIFELAX - diet and LIFEstyle versus LAXatives in the management of chronic constipation in older people: randomised controlled trial. Health Technol Assess. 2010;14(52):1-+.
    1. Gask L, Bower P, Lovell K, Escott D, Archer J, Gilbody S, Lankshear A, Simpson A, Richards D. What work has to be done to implement collaborative care for depression? Process evaluation of a trial utilizing the Normalization Process Model. Implement Sci. 2010;5(15)
    1. Gunn JM, Palmer VJ, Dowrick CF, Herrman HE, Griffiths FE, Kokanovic R, Blashki GA, Hegarty KL, Johnson CL, Potiriadis M. et al.Embedding effective depression care: using theory for primary care organisational and systems change. Implement Sci. 2010;5
    1. Kennedy A, Chew-Graham CA, Blakeman T, Bowen A, Gardner C, Protheroe J, Rogers A, Gask L. Delivering the WISE (Whole Systems Informing Self-Management Engagement) training package in primary care: learning from formative evaluation. Implement Sci. 2010;5(7)
    1. Pencille LJ, Campbell ME, Van Houten HK, Shah ND, Mullan RJ, Swiglo BA, Breslin M, Kesman RL, Tulledge-Scheitel SM, Jaeger TM. et al.Protocol for the Osteoporosis Choice trial. A pilot randomized trial of a decision aid in primary care practice. Trials. 2009;10
    1. Elwyn G, Légaré F, van der Weijden T, Edwards A, May C. Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice. Implement Science. 2008;3:57. doi: 10.1186/1748-5908-3-57.
    1. Mair FS, Hiscock J, Beaton SC. Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illness. 2008;4(2):110–7. doi: 10.1177/1742395308092482.
    1. King G, Richards H, Godden D. Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. Journal of Telemedicine and Telecare. 2007;13(8):382–6. doi: 10.1258/135763307783064430.
    1. Gagnon M-P, Legare F, Fortin J-P, Labrecque M, Lamothe L, Duplantie J. An integrated strategy of knowledge application for optimal e-health implementation: A multi method study protocol. BMC Medical Informatics and Decision Making. 2008;8:article 17.
    1. Obstfelder A, Engeseth KH, Wynn R. Characteristics of successfully implemented telemedical applications. Implementation Science. 2007;2:article 25.
    1. Boddy D, King G, Clark J, Heaney D, Mair F. The influence of context and process when implementing e-health. BMC Medical Informatics and Decision Making. 2009;9(1):9. doi: 10.1186/1472-6947-9-9.
    1. Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F. Why is it difficult to implement e-health initiatives? A qualitative study. Implementation Science. in press .
    1. Gagnon MP, Legare F, Fortin JP, Lamothe L, Labrecque M, Duplantie J. An integrated strategy of knowledge application for optimal e-health implementation: A multi-method study protocol. BMC Med Inform Decis Mak. 2008;8
    1. Halford S, Obstfelder A, Lotherington AT. Changing the record: the inter-professional, subjective and embodied effects of electronic patient records. New Technol Work Employ. 2010;25(3):210–222. doi: 10.1111/j.1468-005X.2010.00249.x.
    1. King G, Richards H, Godden D. Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. J Telemed Telecare. 2007;13(8):382–386. doi: 10.1258/135763307783064430.
    1. Boddy D, King G, Clark J, Heaney D, Mair F. The influence of context and process when implementing e-health. Bmc Med Inform Decis. 2009;9(1):9. doi: 10.1186/1472-6947-9-9.
    1. Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F. Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci. 2011;6
    1. Stinchcombe A. Constructing social theories. New York: Harcourt, Brace and World; 1968.
    1. May C, Mair FS, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A. et al.Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009;4(29)
    1. Mair F, May C, Murray E, Finch T, Anderson G, O'Donnell C, Wallace P, Sullivan F. Understanding the Implementation and Integration of E-Health Services London: National Co-ordinating. Centre for the National Institute for Health Research Service Delivery and Organisation Programme (NCCSDO); 2009.
    1. May C, Finch T, Cornford J, Exley C, Gately C, Kirk S, Jenkings KN, Mair FS, Osbourne J, Robinson AL, Integrating Telecare for Chronic Disease Management in the Community: What Needs to be Done? London: NIHR; 2009.
    1. Ritchie J, Spencer L. In: Analysing Qualitative Data. Bryman A, Burgess R, editor. London: Routledge; 1994. Qualitative data analysis for applied policy research; pp. 173–194.
    1. Banister P, Burman E, Parker I, Taylor M, Tindall C. Qualitative methods in psychology. Buckingham: Open University Press; 1994.
    1. Murray E, May C, Mair F. Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT) BMC Medical Informatics and Decision Making. 2010;10(61)
    1. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C. et al.Normalisation Process Theory: a framework for developing, evaluating and implementing complex interventions. BMC Medicine. 2010;8(63)

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren