A Contextual Analysis and Logic Model for Integrated Care for Frail Older Adults Living at Home: The INSPIRE Project

Olivia Yip, Evelyn Huber, Samuel Stenz, Leah L Zullig, Andreas Zeller, Sabina M De Geest, Mieke Deschodt, INSPIRE consortium, Olivia Yip, Evelyn Huber, Samuel Stenz, Leah L Zullig, Andreas Zeller, Sabina M De Geest, Mieke Deschodt, INSPIRE consortium

Abstract

Introduction: Implementation science methods and a theory-driven approach can enhance the understanding of whether, how, and why integrated care for frail older adults is successful in practice. In this study, we aimed to perform a contextual analysis, develop a logic model, and select preliminary implementation strategies for an integrated care model in newly created information and advice centers for older adults in Canton Basel-Landschaft, Switzerland.

Methods: We conducted a contextual analysis to determine factors which may influence the integrated care model and implementation strategies needed. A logic model depicting the overall program theory, including inputs, core components, outputs and outcomes, was designed using a deductive approach, and included stakeholders' feedback and preliminary implementation strategies.

Results: Contextual factors were identified (e.g., lack of integrated care regulations, existing community services, and a care pathway needed). Core components of the care model include screening, referral, assessment, care plan creation and coordination, and follow-up. Outcomes included person-centred coordinated care experiences, hospitalization rate and symptom burden, among others. Implementation strategies (e.g., nurse training and co-developing educational materials) were proposed to facilitate care model adoption.

Conclusion: Contextual understanding and a clear logic model should enhance the potential for successful implementation of the integrated care model.

Keywords: Frail elderly; Implementation science; Integrated care; Logic model; Program development; Program theory.

Conflict of interest statement

The authors have no competing interests to declare.

Copyright: © 2021 The Author(s).

Figures

Figure 1
Figure 1
INSPIRE project overview mapped according to the Framework of the Medical Research Council.
Figure 2
Figure 2
The INSPIRE project approach to care model development.
Figure 3
Figure 3
The logic model for the INSPIRE care model. BL = Basel-Landschaft; CGA = Comprehensive Geriatric Assessment; ED = Emergency Department; HC = Health care; HCP = Health care providers; HR-QoL = Health-related Quality of Life; IAC = Information and Advice Center; SSP = Social service providers.

References

    1. Vetrano DL, Palmer K, Marengoni A, Marzetti E, Lattanzio F, Roller-Wirnsberger R, et al. Frailty and multimorbidity: a systematic review and meta-analysis. Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 2019; 74(5): 659–66. DOI: 10.1093/gerona/gly110
    1. Vermeiren S, Vella-Azzopardi R, Beckwee D, Habbig AK, Scafoglieri A, Jansen B, et al. Frailty and the prediction of negative health outcomes: a meta-analysis. Journal of the American Medical Directors Association, 2016; 17(12): 1163. e1-e17. DOI: 10.1016/j.jamda.2016.09.010
    1. Kojima G. Frailty as a predictor of nursing home placement among community-dwelling older adults: a systematic review and meta-analysis. Journal of Geriatric Physical Therapy, 2018; 41(1): 42–8. DOI: 10.1519/JPT.0000000000000097
    1. Parry C, Coleman EA, Smith JD, Frank J, Kramer AM. The care transitions intervention: a patient-centered approach to ensuring effective transfers between sites of geriatric care. Home Health Care Services Quarterly, 2003; 22(3): 1–17. DOI: 10.1300/J027v22n03_01
    1. Humphries R. Integrated health and social care in England – Progress and prospects. Health Policy, 2015; 119(7): 856–9. DOI: 10.1016/j.healthpol.2015.04.010
    1. Thistlethwaite P. Integrating health and social care in Torbay: Improving care for Mrs Smith. London: The King’s Fund; 2011. [cited 20 Nov 2018]. Available from: .
    1. Shaw S, Rosen R, Rumbold, B. What is integrated care? Research report. Nuffield Trust, 2011. [cited 3 Nov 2018]. Available from: .
    1. World Health Organization. WHO global strategy on people-centred and integrated health services: interim report. World Health Organization; 2015. [cited 1 Feb 2019]. Available from: .
    1. Hopman P, de Bruin SR, Forjaz MJ, Rodriguez-Blazquez C, Tonnara G, Lemmens LC, et al. Effectiveness of comprehensive care programs for patients with multiple chronic conditions or frailty: A systematic literature review. Health Policy, 2016; 120(7): 818–32. DOI: 10.1016/j.healthpol.2016.04.002
    1. Looman WM, Huijsman R, Fabbricotti IN. The (cost-)effectiveness of preventive, integrated care for community-dwelling frail older people: A systematic review. Health and Social Care in the Community, 2019; 27(1): 1–30. DOI: 10.1111/hsc.12571
    1. Deschodt M, Laurent G, Cornelissen L, Yip O, Zuniga F, Denhaerynck K, et al. Core components and impact of nurse-led integrated care models for home-dwelling older people: A systematic review and meta-analysis. International Journal of Nursing Studies, 2020; 105: 103552. DOI: 10.1016/j.ijnurstu.2020.103552
    1. Hoogendijk EO. How effective is integrated care for community-dwelling frail older people? The case of the Netherlands. Age and Ageing, 2016; 45(5): 585–8. DOI: 10.1093/ageing/afw081
    1. Briggs AM, Valentijn PP, Thiyagarajan JA, de Carvalho IA. Elements of integrated care approaches for older people: a review of reviews. BMJ Open, 2018; 8(4): e021194. DOI: 10.1136/bmjopen-2017-021194
    1. Threapleton DE, Chung RY, Wong SYS, Wong E, Chau P, Woo J, et al. Integrated care for older populations and its implementation facilitators and barriers: A rapid scoping review. International Journal for Quality in Health Care, 2017; 29(3): 327–34. DOI: 10.1093/intqhc/mzx041
    1. World Health Organization. Integrated care for older people: guidelines on community-level interventions to manage declines in intrinsic capacity. World Health Organization; 2017. [cited 10 Nov 2018]. Available from: .
    1. Bardsley M, Steventon A, Smith J, Dixon J. Evaluating integrated and community-based care: how do we know what works? Research report. Nuffield Trust, 2013. [cited: 2 Nov 2018]. Available from: .
    1. Goddard M, Mason AR. Integrated care: A pill for all ills? International Journal of Health Policy and Management, 2017; 6(1): 1–3. DOI: 10.15171/ijhpm.2016.111
    1. Smit LC, Schuurmans MJ, Blom JW, Fabbricotti IN, Jansen APD, Kempen G, et al. Unravelling complex primary-care programs to maintain independent living in older people: a systematic overview. Journal of Clinical Epidemiology, 2018; 96: 110–9. DOI: 10.1016/j.jclinepi.2017.12.013
    1. Beland F, Hollander MJ. Integrated models of care delivery for the frail elderly: international perspectives. Gaceta Sanitaria, 2011; 25 Suppl 2: 138–46. DOI: 10.1016/j.gaceta.2011.09.003
    1. de Bruin SR, Stoop A, Billings J, Leichsenring K, Ruppe G, Tram N, et al. The SUSTAIN project: A European study on improving integrated care for older people living at home. International Journal of Integrated Care, 2018; 18(1): 6. DOI: 10.5334/ijic.3090
    1. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ, 2013; 347. DOI: 10.1136/bmj.f6753
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ, 2008; 337: a1655. DOI: 10.1136/bmj.a1655
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 2011; 38(2): 65–76. DOI: 10.1007/s10488-010-0319-7
    1. Breitenstein SM, Gross D, Garvey CA, Hill C, Fogg L, Resnick B. Implementation fidelity in community-based interventions. Research in Nursing and Health, 2010; 33(2): 164–73. DOI: 10.1002/nur.20373
    1. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ, 2015; 350: h1258. DOI: 10.1136/bmj.h1258
    1. Metzelthin SF, Daniels R, van Rossum E, Cox K, Habets H, de Witte LP, et al. A nurse-led interdisciplinary primary care approach to prevent disability among community-dwelling frail older people: a large-scale process evaluation. International Journal of Nursing Studies, 2013; 50(9): 1184–96. DOI: 10.1016/j.ijnurstu.2012.12.016
    1. Bleijenberg N, ten Dam VH, Drubbel I, Numans ME, de Wit NJ, Schuurmans MJ. Treatment fidelity of an evidence-based nurse-led intervention in a proactive primary care program for older people. Worldviews on Evidence-Based Nursing, 2016; 13(1): 75–84. DOI: 10.1111/wvn.12151
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation Science, 2013; 8: 139–50. DOI: 10.1186/1748-5908-8-139
    1. Sadler E. The contribution of implementation science to improving the design and evaluation of integrated care programmes for older people with frailty. Journal of Integrated Care, 2019; 27(3): 232–40. DOI: 10.1108/JICA-07-2018-0048
    1. Centers for Disease Control and Prevention. Evaluation guide. Developing and using a logic model. CDC Division for Heart Disease and Stroke Prevention. [cited 20 Feb 2019]. Available from: .
    1. Funnell S, Rogers P. Purposeful program theory. Effective use of theories of change and logic models. San Francisco: Jossey-Bass; 2011.
    1. W.K. Kellogg Foundation. Logic Model Development Guide. W.K. Kellogg Foundation; 2004. [cited 2 Nov 2019]. Available from: .
    1. Knowlton L, Philips C. The logic model guidebook better strategies for greater results. SAGE Publishing; 2012. [cited 19 Nov 2019]. Available from: .
    1. Davidoff F. Understanding contexts: how explanatory theories can help. Implementation Science, 2019; 14(1): 23. DOI: 10.1186/s13012-019-0872-8
    1. Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Services Research, 2019; 19(1): 189. DOI: 10.1186/s12913-019-4015-3
    1. Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implementation Science, 2017; 12(1): 21. DOI: 10.1186/s13012-017-0552-5
    1. Nilsen P. Making sense of implementation theories, models and frameworks. Implementation Science, 2015; 10: 53. DOI: 10.1186/s13012-015-0242-0
    1. Stange K, Glasgow R. Considering and reporting important contextual factors in research on the patient-centered medical home. Rockville, MD; Agency for Healthcare Research and Quality; 2013. [cited 10 May 2020]. Available from: .
    1. King’s Improvement Science. Implementation science research development (ImpRes) tool: a practical guide to using the ImpRes tool. King’s College London; 2018. [cited 4 Sept 2019]. Available from: .
    1. Bauer MS, Kirchner J. Implementation science: What is it and why should I care? Psychiatry Research, 2019. DOI: 10.1016/j.psychres.2019.04.025
    1. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implementation Science, 2012; 7: 50. DOI: 10.1186/1748-5908-7-50
    1. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. Journal of Behavioral Health Services and Research, 2017; 44(2): 177–94. DOI: 10.1007/s11414-015-9475-6
    1. Altersbetreuungs- und Pflegegesetz (APG), in SGS 941. [Elderly Care and Nursing Law]. 2018. Available from: . [in German].
    1. Deschodt M, Siqeca F, Yip O, Stenz S, Blozik E, Briel M, et al. Bevölkerungsbefragung Basel-Landschaft Kantonaler Bericht. [Basel-Landschaft Population Survey: Cantonal Report]. Departement Public Health, Universität Basel. 2020. [cited 20 Jul 2020]. Available from: .
    1. Cummings H. Logic Models: An Intermediate Level Workshop [powerpoint slides]. Canadian Evaluation Society; 2014. [cited 2018 Dec 1].
    1. Ebenso B, Manzano A, Uzochukwu B, Etiaba E, Huss R, Ensor T, et al. Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria. Evaluation and Program Planning, 2019; 73: 97–110. DOI: 10.1016/j.evalprogplan.2018.12.002
    1. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 2015; 10: 21. DOI: 10.1186/s13012-015-0209-1
    1. Department of Public Health, University of Basel: INSPIRE. [webpage on the internet]. [cited 1 Dec 2018]. 2018. Available from: .
    1. Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 2015; 10: 109. DOI: 10.1186/s13012-015-0295-0
    1. O’Cathain A, Croot L, Duncan E, Rousseau N, Sworn K, Turner KM, et al. Guidance on how to develop complex interventions to improve health and healthcare. BMJ open, 2019; 9(8): e029954–e. DOI: 10.1136/bmjopen-2019-029954
    1. Social Care Institute for Excellence. Logic model for integrated care. Social Care Institute for Excellence; 2017. [cited 12 Jun 2019]. Available from: .
    1. Petersen D, Taylor EF, Peikes D. Logic Models: The foundation to implement, study, and refine patient-centered medical home models. Rockville, MD: Agency for Healthcare Research and Quality, 2013. [cited 5 Dec 2019]. Available from: .
    1. NHS Islington Clinical Commissioning Group. Islington Integrated Care Evaluation Framework. NHS Islington Clinical Commissioning Group; 2015. [cited 2 Nov 2019]. Available from: .
    1. Rowbotham S. Berkshire West 10 Frail and Older People Pathway Redesign Programme. South Reading Patient Voice Group. [cited 7 Nov 2019]. Available from: .
    1. Stadnick NA, Sadler E, Sandall J, Turienzo CF, Bennett IM, Borkan J, et al. Comparative case studies in integrated care implementation from across the globe: a quest for action. BMC Health Services Research, 2019; 19(1): 899. DOI: 10.1186/s12913-019-4661-5
    1. National Academy of Sciences. Integrating social care into the delivery of health care: moving upstream to improve the nation’s health. National Academy of Sciences; 2019. [cited 12 Dec 2019]. Available from: .
    1. World Health Organization. Framework on integrated, people-centred health services. World Health Organization; 2016. [cited 14 Jan 2019]. Available from: .
    1. Leutz WN. Five laws for integrating medical and social services: lessons from the United States and the United Kingdom. Milbank Quarterly, 1999; 77(1): 77–110, iv–v. DOI: 10.1111/1468-0009.00125
    1. Araujo de Carvalho I, Epping-Jordan J, Pot AM, Kelley E, Toro N, Thiyagarajan JA, et al. Organizing integrated health-care services to meet older people’s needs. Bulletin of the World Health Organization, 2017; 95(11): 756–63. DOI: 10.2471/BLT.16.187617
    1. World Health Organization. World report on ageing and health. World Health Organization; 2015. [cited 15 Dec 2018]. Available from: .
    1. Briggs AM, Araujo de Carvalho I. Actions required to implement integrated care for older people in the community using the World Health Organization‘s ICOPE approach: A global Delphi consensus study. PloS One, 2018; 13(10): e0205533-e. DOI: 10.1371/journal.pone.0205533
    1. Oliver D, Foot C, Humphries R. Making our health and care systems fit for an ageing population. The King‘s Fund; 2014. [cited 1 Dec 2018]. Available from: .
    1. Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet, 2013; 381(9868): 752–62. DOI: 10.1016/S0140-6736(12)62167-9
    1. Maly RC, Hirsch SH, Reuben DB. The performance of simple instruments in detecting geriatric conditions and selecting community-dwelling older people for geriatric assessment. Age and Ageing, 1997; 26(3): 223–31. DOI: 10.1093/ageing/26.3.223
    1. Santos-Eggimann B, Sirven N. Screening for frailty: older populations and older individuals. Public Health Reviews, 2016; 37(1): 7. DOI: 10.1186/s40985-016-0021-8
    1. Cesari M, Prince M, Thiyagarajan JA, De Carvalho IA, Bernabei R, Chan P, et al. Frailty: an emerging public health priority. Journal of the American Medical Directors Association, 2016; 17(3): 188–92. DOI: 10.1016/j.jamda.2015.12.016
    1. Turner G, Clegg A. Best practice guidelines for the management of frailty: a British Geriatrics Society, Age UK and Royal College of General Practitioners report. Age and Ageing, 2014; 43(6): 744–7. DOI: 10.1093/ageing/afu138
    1. Morley JE, Vellas B, van Kan GA, Anker SD, Bauer JM, Bernabei R, et al. Frailty consensus: a call to action. Journal of the American Medical Directors Association, 2013; 14(6): 392–7. DOI: 10.1016/j.jamda.2013.03.022
    1. Ambagtsheer RC, Beilby JJ, Visvanathan R, Dent E, Yu S, Braunack-Mayer AJ. Should we screen for frailty in primary care settings? A fresh perspective on the frailty evidence base: A narrative review. Preventive Medicine, 2019; 119: 63–9. DOI: 10.1016/j.ypmed.2018.12.020
    1. Hendry A, Vanhecke E, Carriazo AM, Lopez-Samaniego L, Espinosa JM, Sezgin D, et al. Integrated care models for managing and preventing frailty: A systematic review for the European Joint Action on Frailty Prevention (ADVANTAGE JA). Translational Medicine at UniSa, 2019; 19: 5–10.
    1. Palmer K, Marengoni A, Forjaz MJ, Jureviciene E, Laatikainen T, Mammarella F, et al. Multimorbidity care model: Recommendations from the consensus meeting of the Joint Action on Chronic Diseases and Promoting Healthy Ageing across the Life Cycle (JA-CHRODIS). Health Policy, 2018; 122(1): 4–11. DOI: 10.1016/j.healthpol.2017.09.006
    1. Leijten FRM, Struckmann V, van Ginneken E, Czypionka T, Kraus M, Reiss M, et al. The SELFIE framework for integrated care for multi-morbidity: Development and description. Health Policy, 2018; 122(1): 12–22. DOI: 10.1016/j.healthpol.2017.06.002
    1. Fabbricotti IN, Janse B, Looman WM, de Kuijper R, van Wijngaarden JDH, Reiffers A. Integrated care for frail elderly compared to usual care: a study protocol of a quasi-experiment on the effects on the frail elderly, their caregivers, health professionals and health care costs. BMC Geriatrics, 2013; 13(1): 31. DOI: 10.1186/1471-2318-13-31
    1. Bleijenberg N, ten Dam VH, Drubbel I, Numans ME, de Wit NJ, Schuurmans MJ. Development of a proactive care program (U-CARE) to preserve physical functioning of frail older people in primary care. Journal of Nursing Scholarship, 2013; 45(3): 230–7. DOI: 10.1111/jnu.12023
    1. Daniels R, van Rossum E, Metzelthin S, Sipers W, Habets H, Hobma S, et al. A disability prevention programme for community-dwelling frail older persons. Clinical Rehabilitation, 2011; 25(11): 963–74. DOI: 10.1177/0269215511410728
    1. Metzelthin SF, van Rossum E, de Witte LP, Ambergen AW, Hobma SO, Sipers W, et al. Effectiveness of interdisciplinary primary care approach to reduce disability in community dwelling frail older people: cluster randomised controlled trial. BMJ, 2013; 347: f5264. DOI: 10.1136/bmj.f5264
    1. Ellis G, Whitehead MA, Robinson D, O’Neill D, Langhorne P. Comprehensive geriatric assessment for older adults admitted to hospital: meta-analysis of randomised controlled trials. BMJ, 2011; 343: d6553. DOI: 10.1136/bmj.d6553
    1. Pilotto A, Cella A, Pilotto A, Daragjati J, Veronese N, Musacchio C, et al. Three decades of comprehensive geriatric assessment: evidence coming from different healthcare settings and specific clinical conditions. Journal of the American Medical Directors Association, 2017; 18(2): 192. e1–.e11. DOI: 10.1016/j.jamda.2016.11.004
    1. Stuck AE, Egger M, Hammer A, Minder CE, Beck JC. Home visits to prevent nursing home admission and functional decline in elderly people: systematic review and meta-regression analysis. The Journal of the American Medical Association, 2002; 287(8): 1022–8. DOI: 10.1001/jama.287.8.1022
    1. Stoop A, Lette M, van Gils PF, Nijpels G, Baan CA, de Bruin SR. Comprehensive geriatric assessments in integrated care programs for older people living at home: A scoping review. Health and Social Care Community, 2019; 27(5): e549–e66. DOI: 10.1002/14651858.CD012705
    1. Briggs R, McDonough A, Ellis G, Bennett K, O’Neill D, Robinson D. Comprehensive Geriatric Assessment for community-dwelling, high-risk, frail, older people. Cochrane Database of Systematic Reviews, 2017(6). DOI: 10.1111/jgs.14325
    1. Bleijenberg N, Drubbel I, Schuurmans MJ, Dam HT, Zuithoff NP, Numans ME, et al. Effectiveness of a proactive primary care program on preserving daily functioning of older people: a cluster randomized controlled trial. Journal of the American Geriatrics Society, 2016; 64(9): 1779–88. DOI: 10.1111/jgs.14325
    1. Spoorenberg SLW, Uittenbroek RJ, Middel B, Kremer BPH, Reijneveld SA, Wynia K. Embrace, a model for integrated elderly care: study protocol of a randomized controlled trial on the effectiveness regarding patient outcomes, service use, costs, and quality of care. BMC Geriatrics, 2013; 13(1): 62. DOI: 10.1186/1471-2318-13-62
    1. Baxter S, Johnson M, Chambers D, Sutton A, Goyder E, Booth A. The effects of integrated care: a systematic review of UK and international evidence. BMC Health Services Research, 2018; 18(1): 350. DOI: 10.1186/s12913-018-3161-3
    1. Sadler E, Potterton V, Anderson R, Khadjesari Z, Sheehan K, Butt F, et al. Service user, carer and provider perspectives on integrated care for older people with frailty, and factors perceived to facilitate and hinder implementation: A systematic review and narrative synthesis. PloS One, 2019; 14(5): e0216488. DOI: 10.1371/journal.pone.0216488
    1. Curry N, Ham C. Clinical and Service Integration: The route to improved outcomes. The King’s Fund; 2010. [cited 1 Mar 2019]. Available from: .
    1. Lette M, Boorsma M, Lemmens L, Stoop A, Nijpels G, Baan C, et al. Unknown makes unloved—A case study on improving integrated health and social care in the Netherlands using a participatory approach. Health and Social Care in the Community, 2020; 28(2): 670–80. DOI: 10.1111/hsc.12901
    1. Kirst M, Im J, Burns T, Baker GR, Goldhar J, O’Campo P, et al. What works in implementation of integrated care programs for older adults with complex needs? A realist review. International Journal for Quality in Health Care, 2017; 29(5): 612–24. DOI: 10.1093/intqhc/mzx095
    1. Rijken M, Lette M, Baan CA, de Bruin SR. Assigning a prominent role to “The Patient Experience” in assessing the quality of integrated care for populations with multiple chronic conditions. International Journal of Integrated Care, 2019; 19(3): 19. DOI: 10.5334/ijic.4656
    1. Mielke J, Leppla L, Valenta S, Teynor A, Zullig L, De Geest S, et al. The Basel Approach for coNtextual ANAlysis (BANANA) in Implementation Science Using the SMILe Project as an Example. Presentation at: ESPACOMP; 2019; Porto.
    1. Clark H, Andersen A. Theories of change and logic models: telling them apart. Presentation at: the American Evaluation Association Conference; 2004; Atlanta, Georgia. Available from: .
    1. Mills T, Lawton R, Sheard L. Advancing complexity science in healthcare research: the logic of logic models. BMC Medical Research Methodology, 2019; 19(1): 55. DOI: 10.1186/s12874-019-0701-4
    1. Renger R, Foltysova J, Becker KL, Souvannasacd E. The power of the context map: Designing realistic outcome evaluation strategies and other unanticipated benefits. Evaluation and Program Planning, 2015; 52: 118–25. DOI: 10.1016/j.evalprogplan.2015.04.003
    1. Smith JD, Li DH, Rafferty MR. The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. Implementation Science, 2020; 15(1): 84. DOI: 10.1186/s13012-020-01041-8
    1. De Savigny D, Adam T. Systems thinking for health systems strengthening. Alliance for Health Policy and Systems Research, World Health Organization; 2009. [cited 1 Feb 2020]. Available from: .

Source: PubMed

3
订阅