Study protocol for "Study of Practices Enabling Implementation and Adaptation in the Safety Net (SPREAD-NET)": a pragmatic trial comparing implementation strategies

Rachel Gold, Celine Hollombe, Arwen Bunce, Christine Nelson, James V Davis, Stuart Cowburn, Nancy Perrin, Jennifer DeVoe, Ned Mossman, Bruce Boles, Michael Horberg, James W Dearing, Victoria Jaworski, Deborah Cohen, David Smith, Rachel Gold, Celine Hollombe, Arwen Bunce, Christine Nelson, James V Davis, Stuart Cowburn, Nancy Perrin, Jennifer DeVoe, Ned Mossman, Bruce Boles, Michael Horberg, James W Dearing, Victoria Jaworski, Deborah Cohen, David Smith

Abstract

Background: Little research has directly compared the effectiveness of implementation strategies in any setting, and we know of no prior trials directly comparing how effectively different combinations of strategies support implementation in community health centers. This paper outlines the protocol of the Study of Practices Enabling Implementation and Adaptation in the Safety Net (SPREAD-NET), a trial designed to compare the effectiveness of several common strategies for supporting implementation of an intervention and explore contextual factors that impact the strategies' effectiveness in the community health center setting.

Methods/design: This cluster-randomized trial compares how three increasingly hands-on implementation strategies support adoption of an evidence-based diabetes quality improvement intervention in 29 community health centers, managed by 12 healthcare organizations. The strategies are as follows: (arm 1) a toolkit, presented in paper and electronic form, which includes a training webinar; (arm 2) toolkit plus in-person training with a focus on practice change and change management strategies; and (arm 3) toolkit, in-person training, plus practice facilitation with on-site visits. We use a mixed methods approach to data collection and analysis: (i) baseline surveys on study clinic characteristics, to explore how these characteristics impact the clinics' ability to implement the tools and the effectiveness of each implementation strategy; (ii) quantitative data on change in rates of guideline-concordant prescribing; and (iii) qualitative data on the "how" and "why" underlying the quantitative results. The outcomes of interest are clinic-level results, categorized using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework, within an interrupted time-series design with segmented regression models. This pragmatic trial will compare how well each implementation strategy works in "real-world" practices.

Discussion: Having a better understanding of how different strategies support implementation efforts could positively impact the field of implementation science, by comparing practical, generalizable methods for implementing clinical innovations in community health centers. Bridging this gap in the literature is a critical step towards the national long-term goal of effectively disseminating and implementing effective interventions into community health centers.

Trial registration: ClinicalTrials.gov, NCT02325531.

Figures

Fig. 1
Fig. 1
The SPREAD-NET study in the context of a larger line of research on improving cardiovascular outcomes in socioeconomically vulnerable patients with diabetes
Fig. 2
Fig. 2
Alert noting that the patient’s statin dose is too low
Fig. 3
Fig. 3
Alert noting that the patient’s statin order is outdated
Fig. 4
Fig. 4
The roster/panel management tool
Fig. 5
Fig. 5
The roster tool’s list for “scrubbing” incoming patients

References

    1. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–50. doi: 10.1016/j.amepre.2012.05.024.
    1. Katz DL, Murimi M, Gonzalez A, Njike V, Green LW. From controlled trial to community adoption: the multisite translational community trial. Am J Public Health. 2011;101:e17–27. doi: 10.2105/AJPH.2010.300104.
    1. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am J Public Health. 2012;102:1274–81. doi: 10.2105/AJPH.2012.300755.
    1. Nolan K, Schall MW, Erb F, Nolan T. Using a framework for spread: the case of patient access in the Veterans Health Administration. Jt Comm J Qual Patient Saf. 2005;31:339–47.
    1. Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2012;4.
    1. Harris JR, Cheadle A, Hannon PA, Forehand M, Lichiello P, Mahoney E, et al. A framework for disseminating evidence-based health promotion practices. Prev Chronic Dis. 2012;9:E22. doi: 10.5888/pcd9.120126.
    1. Cilenti D, Brownson RC, Umble K, Erwin PC, Summers R. Information-seeking behaviors and other factors contributing to successful implementation of evidence-based practices in local health departments. J Public Health Manag Pract. 2012;18:571–6. doi: 10.1097/PHH.0b013e31825ce8e2.
    1. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57. doi: 10.1177/1077558711430690.
    1. US Department of Health & Human Services. U.S. Department of Health and Human Services strategic plan fiscal years 2010–2015. 2010. . Accessed 24 Jan 2013.
    1. Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Public Health. 2009;30:151–74. doi: 10.1146/annurev.publhealth.031308.100049.
    1. Flaspohler P, Lesesne CA, Puddy RW, Smith E, Wandersman A. Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. Am J Community Psychol. 2012;9.
    1. Brownson RC, Colditz GA, Proctor EK. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2012.
    1. McCormack L, Sheridan S, Lewis M, Boudewyns V, Melvin CL, Kistler C, et al. Communication and dissemination strategies to facilitate the use of health-related evidence, (evidence reports/technology assessments, No. 213.) Rockville (MD): Agency for Healthcare Research and Quality (US); 2013.
    1. Ryan RW, Harris KK, Mattox L, Singh O, Camp M, Shirey MR. Nursing leader collaboration to drive quality improvement and implementation science. Nurs Adm Q. 2015;39:229–38. doi: 10.1097/NAQ.0000000000000111.
    1. Newhouse R, Bobay K, Dykes PC, Stevens KR, Titler M. Methodology issues in implementation science. Med Care. 2013;51:S32–40. doi: 10.1097/MLR.0b013e31827feeca.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38:65–76. doi: 10.1007/s10488-010-0319-7.
    1. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139.
    1. Heil SKR, Castillo G, Stephens J, Jacobson Vann JC. Evidence-based implementation strategies: a review of systematic reviews. (prepared by the American Institutes for Research under contract no. HHSN2268201100098U.). Edited by National Heart LaBINIoH. 2013. Bethesda, MD.
    1. Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, et al. Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001;39:II2–45. doi: 10.1097/00005650-200108002-00002.
    1. Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009; CD003030. Doi: 10.1002/14651858.CD003030.pub2.
    1. Gilbody S, Whitty P, Grimshaw J, Thomas R. Educational and organizational interventions to improve the management of depression in primary care: a systematic review. JAMA. 2003;289:3145–51. doi: 10.1001/jama.289.23.3145.
    1. Wensing M, Fluit C, Grol R. Educational strategies. In: Grol R, Wensing M, Eccles M, Davis D, editors. Improving patient care: the implementation of change in health care. 2. Hoboken, NJ: Wiley-Blackwell; 2013. pp. 197–209.
    1. Davis D, Davis N, Johnson N. Knowledge translation in health care. USA: Wiley; 2013. Formal educational interventions; pp. 163–75.
    1. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30. doi: 10.1016/S0140-6736(03)14546-1.
    1. Shapiro MJ, Morey JC, Small SD, Langford V, Kaylor CJ, Jagminas L, et al. Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? Qual Saf Health Care. 2004;13:417–21. doi: 10.1136/qshc.2003.005447.
    1. Herbert CP, Wright JM, Maclure M, Wakefield J, Dormuth C, Brett-MacLean P, et al. Better prescribing project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care. Fam Pract. 2004;21:575–81. doi: 10.1093/fampra/cmh515.
    1. Yamada J, Shorkey A, Barwick M, Widger K, Stevens BJ. The effectiveness of toolkits as knowledge translation strategies for integrating evidence into clinical care: a systematic review. BMJ Open. 2015;5 doi: 10.1136/bmjopen-2014-006808.
    1. Chaillet N, Dumont A. Evidence-based strategies for reducing cesarean section rates: a meta-analysis. Birth. 2007;34:53–64. doi: 10.1111/j.1523-536X.2006.00146.x.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6
    1. Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003;CD000259.
    1. Khunpradit S, Tavender E, Lumbiganon P, Laopaiboon M, Wasiak J, Gruen RL. Non-clinical interventions for reducing unnecessary caesarean section. Cochrane Database Syst Rev. 2011;CD005528. doi: 10.1002/14651858.CD005528.pub2.
    1. Walsh J, McDonald KM, Shojania KG, Sundaram V, Nayak S, Davies S, et al. Closing the quality gap: a critical analysis of quality improvement strategies (vol. 3: hypertension care). Report No.: 04-0051-3. 2005.
    1. Bravata DM, Sundaram V, Lewis R, Gienger A, Gould MK, McDonald KM, et al. Closing the quality gap: a critical analysis of quality improvement strategies (vol. 5: asthma care) Rockville (MD): Agency for Healthcare Research and Quality; 2007.
    1. Mansell G, Shapley M, Jordan JL, Jordan K. Interventions to reduce primary care delay in cancer referral: a systematic review. Br J Gen Pract. 2011;61:e821–35. doi: 10.3399/bjgp11X613160.
    1. Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009;47:356–63. doi: 10.1097/MLR.0b013e3181893f6b.
    1. Powell AA, White KM, Partin MR, Halek K, Christianson JB, Neil B, et al. Unintended consequences of implementing a national performance measurement system into local practice. J Gen Intern Med. 2012;27:405–12. doi: 10.1007/s11606-011-1906-3.
    1. Dixon-Woods M, Redwood S, Leslie M, Minion J, Martin GP, Coleman JJ. Improving quality and safety of care using “technovigilance”: an ethnographic case study of secondary use of data from an electronic prescribing and decision support system. Milbank Q. 2013;91:424–54. doi: 10.1111/1468-0009.12021.
    1. Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O'Brien MA, French SD, et al. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29:1534–41. doi: 10.1007/s11606-014-2913-y.
    1. Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74. doi: 10.1370/afm.1312.
    1. Parchman ML, Noel PH, Culler SD, Lanham HJ, Leykum LK, Romero RL, et al. A randomized trial of practice facilitation to improve the delivery of chronic illness care in primary care: initial and sustained effects. Implement Sci. 2013;8:93. doi: 10.1186/1748-5908-8-93.
    1. Taylor EF, Machta RM, Meyers DS, Genevro J, Peikes DN. Enhancing the primary care team to provide redesigned care: the roles of practice facilitators and care managers. Ann Fam Med. 2013;11:80–3. doi: 10.1370/afm.1462.
    1. Gold R, Nelson C, Cowburn S, Bunce A, Hollombe C, Davis J, et al. Feasibility and impact of implementing a private care system’s diabetes quality improvement intervention in the safety net: a cluster-randomized trial. Implement Sci. 2015;10:83. doi: 10.1186/s13012-015-0259-4.
    1. Dickinson WP, Dickinson LM, Nutting PA, Emsermann CB, Tutt B, Crabtree BF, et al. Practice facilitation to improve diabetes care in primary care: a report from the EPIC randomized clinical trial. Ann Fam Med. 2014;12:8–16. doi: 10.1370/afm.1591.
    1. National Association of Community Health Centers. A Sketch Book of Community Health Centers: Chartbook 2014. . 2014. 9-28-2015.
    1. NACHC. The Safety Net on the Edge. 2008. . 2010. 5-21-2008.
    1. Kaiser Family Foundation. Patients Served by Federally-Funded Federally Qualified Health Centers. . 2015. 10-6-2015.
    1. .
    1. Powell BJ, Proctor EK, Glisson CA, Kohl PL, Raghavan R, Brownson RC, et al. A mixed methods multiple case study of implementation as usual in children’s social service organizations: study protocol. Implement Sci. 2013;8:92. doi: 10.1186/1748-5908-8-92.
    1. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50. doi: 10.1186/1748-5908-7-50.
    1. Wong W, Jaffe M, Wong M, Dudl RJ. Implementation study—Vohs National Quality Award. Community implementation and translation of Kaiser Permanente’s cardiovascular disease risk-reduction strategy. The Permanente Journal. 2011;15:36–41. doi: 10.7812/TPP/10-115.
    1. Gold R, Muench J, Hill C, Turner A, Mital M, Milano C, et al. Collaborative development of a randomized study to adapt a diabetes quality improvement initiative for federally qualified health centers. J Health Care Poor Underserved. 2012;23:236–46. doi: 10.1353/hpu.2012.0132.
    1. Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clin Psychol (New York) 2011;18:67–83.
    1. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50. doi: 10.1007/s10464-008-9165-0.
    1. Rohrbach LA, Gunning M, Sun P, Sussman S. The project towards no drug abuse (TND) dissemination trial: implementation fidelity and immediate outcomes. Prev Sci. 2010;11:77–88. doi: 10.1007/s11121-009-0151-z.
    1. van de Steeg-van Gompel CH, Wensing M, De Smet PA. Implementation of adherence support for patients with hypertension despite antihypertensive therapy in general practice: a cluster randomized trial. Am J Hypertens. 2010;23:1038–45. doi: 10.1038/ajh.2010.63.
    1. Teddlie C, Tashakkori A. Mixed methods research: contemporary issues in an emerging field. In: Denzin N, Lincoln Y, editors. The SAGE handbook of qualitative research. 4. 2011. pp. 285–99.
    1. DeVoe JE, Likumahuwa S, Eiff MP, Nelson CA, Carroll JE, Hill CN, et al. Lessons learned and challenges ahead: report from the OCHIN safety net West practice-based research network (PBRN) J Am Board Fam Med. 2012;25:560–4. doi: 10.3122/jabfm.2012.05.120141.
    1. DeVoe JE, Gold R, Spofford M, Chauvie S, Muench J, Turner A, et al. Developing a network of community health centers with a common electronic health record: description of the safety net west practice-based research network (SNW-PBRN) J Am Board Fam Med. 2011;24:597–604. doi: 10.3122/jabfm.2011.05.110052.
    1. DeVoe JE, Sears A. The OCHIN community information network: bringing together community health centers, information technology, and data to support a patient-centered medical village. J Am Board Fam Med. 2013;26:271–8. doi: 10.3122/jabfm.2013.03.120234.
    1. Gold R. The guide to conducting research in the OCHIN practice management data. . 2007. Portland OR. Accessed 25 Feb 2013.
    1. DeVoe JE, Gold R, McIntire P, Puro J, Chauvie S, Gallia CA. Electronic health records vs medicaid claims: completeness of diabetes preventive care data in community health centers. Ann Fam Med. 2011;9:351–8. doi: 10.1370/afm.1279.
    1. James PA, Oparil S, Carter BL, Cushman WC, Dennison-Himmelfarb C, Handler J, et al. 2014 evidence-based guideline for the management of high blood pressure in adults: report from the panel members appointed to the eighth joint national committee (JNC 8) JAMA. 2014;311:507–20. doi: 10.1001/jama.2013.284427.
    1. Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, Jr, et al. The seventh report of the joint national committee on prevention, detection, evaluation, and treatment of high blood pressure: the JNC 7 report. JAMA. 2003;289:2560–72. doi: 10.1001/jama.289.19.2560.
    1. U.S. Preventive Services Task Force Screening for high blood pressure: U.S. preventive services task force reaffirmation recommendation statement. Ann Intern Med. 2007;147:783–6. doi: 10.7326/0003-4819-147-11-200712040-00009.
    1. Moyer VA. Screening for primary hypertension in children and adolescents: U.S. preventive services task force recommendation statement. Ann Intern Med. 2013;159:613–9. doi: 10.7326/0003-4819-159-9-201311050-00725.
    1. Centers for disease control and prevention. Million hearts—the initiative. . 2015. Accessed 30 Apr 2015.
    1. American Diabetes Association Standards of medical care in diabetes—2015. Diabetes Care. 2015;38:S1–93.
    1. Stone NJ, Robinson JG, Lichtenstein AH, Bairey Merz CN, Blum CB, Eckel RH, et al. 2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: a report of the American College of Cardiology/American Heart Association Task Force on practice guidelines. Circulation. 2014;129:S1–45. doi: 10.1161/01.cir.0000437738.63853.7a.
    1. Grabenstein C. Scrubbing and huddling. . 2014. Patient Centered Primary Car Institute. Accessed 12 June 2015.
    1. Barac R, Stein S, Bruce B, Barwick M. Scoping review of toolkits as a knowledge translation strategy in health. BMC Med Inform Decis Mak. 2014;14:121. doi: 10.1186/s12911-014-0121-7.
    1. Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157:29–43. doi: 10.7326/0003-4819-157-1-201207030-00450.
    1. Damiani G, Pinnarelli L, Colosimo SC, Almiento R, Sicuro L, Galasso R, et al. The effectiveness of computerized clinical guidelines in the process of care: a systematic review. BMC Health Serv Res. 2010;10:2. doi: 10.1186/1472-6963-10-2.
    1. Heselmans A, Van de Velde S, Donceel P, Aertgeerts B, Ramaekers D. Effectiveness of electronic guideline-based implementation systems in ambulatory care settings—a systematic review. Implement Sci. 2009;4:82. doi: 10.1186/1748-5908-4-82.
    1. Nieuwlaat R, Connolly SJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, et al. Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:90. doi: 10.1186/1748-5908-6-90.
    1. Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, et al. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:92. doi: 10.1186/1748-5908-6-92.
    1. Gaglio B, Glasgow R. Evaluation approaches for dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health. New York: Oxford University Press; 2012.
    1. Glasgow RE, Marcus AC, Bull SS, Wilson KM. Disseminating effective cancer screening interventions. Cancer. 2004;101:1239–50. doi: 10.1002/cncr.20509.
    1. Glasgow RE, Goldstein MG, Ockene JK, Pronk NP. Translating what we have learned into practice. Principles and hypotheses for interventions addressing multiple behaviors in primary care. Am J Prev Med. 2004;27:88–101. doi: 10.1016/j.amepre.2004.04.019.
    1. Rubenstein LV, Pugh J. Strategies for promoting organizational and practice change by advancing implementation research. J Gen Intern Med. 2006;Suppl 2:S58–64. doi: 10.1007/s11606-006-0276-8.
    1. Cohen D, McDaniel RR, Jr, Crabtree BF, Ruhe MC, Weyer SM, Tallia A, et al. A practice change model for quality improvement in primary care practice. J Healthc Manag. 2004;49:155–68.
    1. Chang ET, Rose DE, Yano EM, et al. Determinants of readiness for primary care-mental health integration (PC-MHI) in the VA health care system. J Gen Intern Med. 2012;5.
    1. Stamatakis KA, McQueen A, Filler C, Boland E, Dreisinger M, Brownson RC, et al. Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings. Implement Sci. 2012;7:65. doi: 10.1186/1748-5908-7-65.
    1. Solberg LI, Asche SE, Margolis KL, Whitebird RR. Measuring an organization’s ability to manage change: the change process capability questionnaire and its use for improving depression care. Am J Med Qual. 2008;23:193–200. doi: 10.1177/1062860608314942.
    1. Emmons KM, Weiner B, Fernandez ME, Tu SP. Systems antecedents for dissemination and implementation: a review and analysis of measures. Health Educ Behav. 2012;39:87–105. doi: 10.1177/1090198111409748.
    1. Glisson C, Schoenwald SK, Hemmelgarn A, Green P, Dukes D, Armstrong KS, et al. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol. 2010;78:537–50. doi: 10.1037/a0019160.
    1. Stevenson K, Baker R. Investigating organisational culture in primary care. Quality in Primary Care. 2005;13:191–200.
    1. Finley EP, Pugh JA, Lanham HJ, Leykum LK, Cornell J, Veerapaneni P, et al. Relationship quality and patient-assessed quality of care in VA primary care clinics: development and validation of the work relationships scale. Ann Fam Med. 2013;11:543–9. doi: 10.1370/afm.1554.
    1. Shea B, Santesso N, Qualman A, Heiberg T, Leong A, Judd M, et al. Consumer-driven health care: building partnerships in research. Health Expect. 2005;8:352–9. doi: 10.1111/j.1369-7625.2005.00347.x.
    1. Simon JS, Rundall TG, Shortell SM. Adoption of order entry with decision support for chronic care by physician organizations. J Am Med Inform Assoc. 2007;14:432–9. doi: 10.1197/jamia.M2271.
    1. Solberg LI, Crain AL, Jaeckels N, Ohnsorg KA, Margolis KL, Beck A, et al. The DIAMOND initiative: implementing collaborative care for depression in 75 primary care clinics. Implement Sci. 2013;8:135. doi: 10.1186/1748-5908-8-135.
    1. Ohman-Strickland PA, John OA, Nutting PA, et al. Measuring organizational attributes of primary care practices: development of a new instrument. Health Serv Res. 2007;42:1257–73. doi: 10.1111/j.1475-6773.2006.00644.x.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9:45. doi: 10.1186/1748-5908-9-45.
    1. Leykum LK, Palmer R, Lanham H, et al. Reciprocal learning and chronic care model implementation in primary care: results from a new scale of learning in primary care. BMC Health Serv Res. 2011;11:44. doi: 10.1186/1472-6963-11-44.
    1. Jaen CR, Crabtree BF, Palmer RF, et al. Methods for evaluating practice change toward a patient-centered medical home. Ann Fam Med. 2010;8(Suppl 1):S9–20. doi: 10.1370/afm.1108.
    1. Nutting PA, Crabtree BF, Stewart EE, et al. Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann Fam Med. 2010;8(Suppl 1):S33–44. doi: 10.1370/afm.1119.
    1. Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework. Implement Sci. 2009;4:38. doi: 10.1186/1748-5908-4-38.
    1. Feldstein AC, Smith DH, Perrin N, et al. Reducing warfarin medication interactions: an interrupted time series evaluation. Arch Intern Med. 2006;166:1009–15. doi: 10.1001/archinte.166.9.1009.
    1. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27:299–309. doi: 10.1046/j.1365-2710.2002.00430.x.
    1. Gillings D, Makuc D, Siegel E. Analysis of interrupted time series mortality trends: an example to evaluate regionalized perinatal care. Am J Public Health. 1981;71:38–46. doi: 10.2105/AJPH.71.1.38.
    1. Cohen DJ, Leviton LC, Isaacson NF, Tallia AF, Crabtree BF. Online diaries for qualitative evaluation: gaining real-time insights. Am J Evaluation. 2006;163–184.
    1. Patton M. Qualitative evaluation and research methods. Thousand Oaks, CA: Sage; 2002.
    1. Argyris C, Schon D. Theory in practice. San Francisco: Jossey-Bass; 1974.
    1. Denzin N, Lincoln Y. The sage handbook of qualitative research (4th ed) Thousand Oaks, CA: Sage; 2011.
    1. Beebe J. Rapid assessment process: an introduction. Walnut Creek, CA: AltaMira Press; 2001.
    1. Bernard HR. Research methods in anthropology: qualitative and quantitative approaches. Thousand Oaks, CA: Sage; 1994.
    1. Crabtree BF, Miller WL. Doing qualitative research, 2nd ed. Thousand Oaks, CA: Sage Publications, Inc.; 1999.
    1. Lincoln Y, Guba EG. Naturalistic inquiry. Newberry Park, CA: Sage; 1985.
    1. Berg BL. Qualitative research methods for the social sciences. 7. Boston: Allyn and Bacon; 2009.
    1. Spradley JP. The ethnographic interview. New York: Rinehart and Winston; 1979.
    1. Kotter JP. Leading change. Boston: Harvard Business School Press; 1996.
    1. Rogers EM. Diffusion of innovations. New York: Free Press; 2003.
    1. Langley GJ, Moen R, Nolan KM, Nolan TW, Norman CL, Provost LP. The improvement guide: a practical approach to enhancing organizational performance. San Francisco: Jossey-Bass; 2009.
    1. Pink DH. Drive: the surprising truth about what motivates us. New York, NY: Riverhead Books; 2009.
    1. Maccoby M. The leaders we need: and what makes us follow. Boston, Mass: Harvard Business School Press; 2007.
    1. Maccoby M, Norman CL, Norman CJ, Margolies R. Transforming health care leadership a systems guide to improve patient care, decrease costs, and improve population health. Hoboken: Jossey-Bass; 2013.
    1. Patterson K. Influencer: the power to change anything. New York: McGraw-Hill; 2008.
    1. Heath C, Heath D. Switch: how to change things when change is hard. New York: Broadway Books; 2010.
    1. Quinn RE. Deep change: discovering the leader within. San Francisco, California: Jossey-Bass Publishers; 1996.

Source: PubMed

Sponsorzy i współpracownicy

Warunki medyczne

Interwencje lekowe

3
Subskrybuj