The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research

Shannon Wiltsey Stirman, John Kimberly, Natasha Cook, Amber Calloway, Frank Castro, Martin Charns, Shannon Wiltsey Stirman, John Kimberly, Natasha Cook, Amber Calloway, Frank Castro, Martin Charns

Abstract

Background: The introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research.

Methods: Two coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized.

Results: Although "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves.

Conclusions: Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment.

Figures

Figure 1
Figure 1
Diagram of Study Selection and Exclusion Process.
Figure 2
Figure 2
Sustainability Outcomes By Field. Note: More rigorous studies are defined as having included independent or objective observation and a judgment of fidelity, quality, or level of implementation. Ranges are provided when multiple studies reported these rates.

References

    1. McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. American Psychology. 2010;65(2):73–84.
    1. Proctor EK. et al.Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–35. doi: 10.1007/s10488-008-0197-4.
    1. Greenhalgh T, How to Spread Good Ideas: A systematic review of the literature on diffusion, dissemination, and sustainability of innovations in health service delivery and organization, in Report for the National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO) London: University College; 2004. p. 362.
    1. Bowman C. et al.Measuring persistence of implementation: QUERI Series. Implement Sci. 2008;3(1):21. doi: 10.1186/1748-5908-3-21.
    1. Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998;13(1):87–108. doi: 10.1093/her/13.1.87.
    1. Massatti RR. et al.The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Health. 2008;35(1-2):50–65. doi: 10.1007/s10488-007-0141-z.
    1. Scheirer MA. The life cycle of an innovation: adoption versus discontinuation of the fluoride mouth rinse program in schools. J Health Soc Behav. 1990;31(2):203–215. doi: 10.2307/2137173.
    1. Seffrin B, Panzano PC, Roth D. What Gets Noticed: How Barrier and Facilitator Perceptions Relate to the Adoption and Implementation of Innovative Mental Health Practices. Community Ment Health J. 2008;44(6):475. doi: 10.1007/s10597-008-9151-x.
    1. Rogers EM. Diffusion of Innovations. New York: The Free Press, A Division of Simon & Schuster, Inc; 2003. pp. 1–551.
    1. McHugo GJ. et al.Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatr Serv. 1999;50(6):818.
    1. McGlynn EA. et al.The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–2645. doi: 10.1056/NEJMsa022615.
    1. Jerrell JM, Ridgely MS. The relative impact of treatment program [] robustness' and [] dosage'on client outcomes. Eval Program Plann. 1999;22(3):323–330. doi: 10.1016/S0149-7189(99)00023-3.
    1. Maher L, Gustafson DA. Sustainability Model and Guide: Evans; 2007.
    1. von Krogh G, Roos J. A perspective on knowledge, competence and strategy. Pers Rev. 1995;24(3):56. doi: 10.1108/00483489510089650.
    1. Aarons GA, Palinkas LA. Implementation of evidence, evidence-based practice in child welfare: service provider perspective. Adm Policy Ment Health Serv Res. 2007;34:411–419. doi: 10.1007/s10488-007-0121-3.
    1. Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011;101(11):2059–2067. doi: 10.2105/AJPH.2011.300193.
    1. Racine DP. Reliable effectiveness: a theory on sustaining and replicating worthwhile innovations. Adm Policy Ment Health. 2006;33(3):356–387. doi: 10.1007/s10488-006-0047-1.
    1. Stirman SW, Sustainability: A systematic review of methods and conceptualizations. in Fourth Annual NIH Conference on the Science of Dissemination and Implementation. Bethesda, MD; 2011.
    1. Gruen RL. et al.Sustainability science: an integrated approach for health-programme planning. Lancet. 2008;372(9649):1579. doi: 10.1016/S0140-6736(08)61659-1.
    1. Aarons G, Hurlburt M, Horwitz S. Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors. Adm Policy Ment Health Ment Health Serv Res. 2011;38(1):4–23. doi: 10.1007/s10488-010-0327-7.
    1. Kirsh SR, Lawrence RH, Aron DC. Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes. Implement Sci. 2008;3(1):34. doi: 10.1186/1748-5908-3-34.
    1. Scheirer MA, Hartling G, Hagerman D. Defining sustainability outcomes of health programs: Illustrations from an on-line survey. Eval Program Plann. 2008;31(4):335–346. doi: 10.1016/j.evalprogplan.2008.08.004.
    1. Scheirer MA, J Dearing. An Agenda for Research on the Sustainability of Public Health Programs. American Journal of Public Health; 2011. in press .
    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–1327. doi: 10.2105/AJPH.89.9.1322.
    1. Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Am J Eval. 2005;23:320–347.
    1. Kimberly JR, Evanisko MJ. Organizational innovation: The influence of individual, organizational, and contextual factors on hospital adoption of technological and administrative innovations. Acad Manage J. 1981;24(4):689–713.
    1. Kimberly JR, Starbuck WH. In: Managerial Innovation, in Handbook of Organizational Design. Nystrom PC, editor. New York: Oxford University Press; 1981. pp. 84–104.
    1. Durlak J, DuPre E. Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation. Am J Community Psychol. 2008;41:327–350. doi: 10.1007/s10464-008-9165-0.
    1. Swerissen H, Crisp BR. The sustainability of health promotion interventions for different levels of social organization. Health Promot Int. 2004;19(1):123–130. doi: 10.1093/heapro/dah113.
    1. Pettigrew A. On studying organizational cultures. Adm Sci Q. 1979;24:570–581. doi: 10.2307/2392363.
    1. Fixsen D, Implementation Research: A Synthesis of the Literature. 2005.
    1. Greenhalgh T. et al.Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi: 10.1111/j.0887-378X.2004.00325.x.
    1. Moher D. et al.Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097.
    1. Marty D. et al.Factors influencing consumer outcome monitoring in implementation of evidence-based practices: results from the National EBP Implementation Project. Adm Policy Ment Health Ment Health Serv Res. 2008;35(3):204. doi: 10.1007/s10488-007-0157-4.
    1. Glisson C. et al.Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Adm Policy Ment Health Ment Health Serv Res. 2008;35(1-2):98. doi: 10.1007/s10488-007-0148-5.
    1. Feldstein AC, Glasgow RE, Smith DH. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–243.
    1. Glaser EM. Durability of Innovations in Human Service Organizations. Sci Commun. 1981;3(2):167–185. doi: 10.1177/107554708100300204.
    1. Goodman RM. et al.Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20:161–178. doi: 10.1177/109019819302000208.
    1. Johnson K. et al.Building capacity and sustainable prevention innovations: a sustainability planning model. Eval Program Plann. 2004;27:135–149. doi: 10.1016/j.evalprogplan.2004.01.002.
    1. Mancini JA, Marek LI. Sustaining community-based programs for families: Conceptualization and measurement. Fam Relat. 2004;53(4):339–347. doi: 10.1111/j.0197-6664.2004.00040.x.
    1. Pluye P. et al.Program sustainability: focus on organizational routines. Health Promot Int. 2004;19(4):489–500. doi: 10.1093/heapro/dah411.
    1. Sarriot EG. et al.A methodological approach and framework for sustainability assessment in NGO-implemented primary health care programs. Int J Health Plann Manage. 2004;19(1):23–41. doi: 10.1002/hpm.744.
    1. Silimperi DR. et al.A framework for institutionalizing quality assurance. Int J Qual Health Care. 2002;14(suppl 1):67–073.
    1. Yin RK, Quick SK, Bateman PM, Marks EL. Changing Urban Bureaucracies: How New Practices Become Routinized. Santa Monica: Rand Corp; 1978. pp. 1–155.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174. doi: 10.2307/2529310.
    1. Bossert TJ. Can they get along without us? Sustainability of donor-supported health projects in Central America and Africa. Soc Sci Med. 1990;30(9):1015–1023. doi: 10.1016/0277-9536(90)90148-L.
    1. Bartholomew L, Planning Health Promotion Programs: An Intervention Mapping Approach. San Francisco: Jossey-Bass; 2006.
    1. Botvin GJ. et al.Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: results of a 3-year study. J Consult Clin Psychol. 1990;58(4):437.
    1. Rohrbach LA, Graham JW, Hansen WB. Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993;22(2):237–260. doi: 10.1006/pmed.1993.1020.
    1. Claquin P. Sustainability of EPI: Utopia or Sine Qua Non Condition of Child Survival, in Resources for Child Health Project. Arlington; REACH; 1989.
    1. Rabin B. et al.Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis. Implement Sci. 2010;5:40–53. doi: 10.1186/1748-5908-5-40.
    1. Stetler CB. et al.Improving quality of care through routine, successful implementation of evidence-based practice at the bedside: an organizational case study protocol using the Pettigrew and Whipp model of strategic change. Implement Sci. 2007;2:3–15. doi: 10.1186/1748-5908-2-3.
    1. Sibthorpe BM, Glasgow NJ, Wells RW. Emergent themes in tlie sustainability of primary health care innovation. Med J Aust. 2005;183(Suppl 10):S77–S80.
    1. Lafond AK. Improving the quality of investment in health: lessons on sustainability. Health Policy Plan. 1995;10:63–76.
    1. Ovretveit J. Making temporary quality improvement continuous. Stockholm: Swedish Association of County Councils; 2003.
    1. Winett RA, King AC, Altman DG. Health Psychology and Public Health: An Integrative Approach. Pergamon Press; 1989.
    1. Pluye P, Potvin L, Denis J-L. Making public health programs last: conceptualizing sustainability. Eval Program Plann. 2004;27(2):121–133. doi: 10.1016/j.evalprogplan.2004.01.001.
    1. Goodman RM, Steckler AB. A model for the institutionalization of health promotion programs. Fam Community Health. 1987;11:63–78.
    1. Schoenwald SK, Toward the Effective and Efficient Measurement of Implementation Fidelity. Administration and Policy in Mental Health and Mental Health Services Research; 2011. p. 38.
    1. Dusenbury L. et al.A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–256. doi: 10.1093/her/18.2.237.
    1. Henggeler SW. et al.Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. J Consult Clin Psychol. 1997;65(5):821–833.
    1. Woolf SH, Johnson RE. Inattention to the fidelity of health care delivery is costing lives. Am J Public Health. 2007;97(10):1732–1733. author reply 1733.
    1. Nilsen P. et al.Towards improved understanding of injury prevention program sustainability. Saf Sci. 2005;43(10):815. doi: 10.1016/j.ssci.2005.08.015.
    1. Damschroder LJ. et al.Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50.
    1. Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: implications for services and interventions research. Clin Psychol Sci Pract. 2006;13(1):73. doi: 10.1111/j.1468-2850.2006.00008.x.
    1. VanDeusen Lukas C. et al.Strengthening organizations to implement evidence-based clinical practice. Health Care Manage Rev. 2010;35(3):235–245.
    1. Aarons G, Hurlburt M, Horwitz S. Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors. Administration and Policy in Mental Health and Mental Health Services Research; in press .
    1. Schein E. Organizational Culture and Leadership. San Francisco: Jossey-Bass; 2004.
    1. Clarke GN, Kazdin AE. Methodological issues & strategies in clinical research (3rd ed.) 3. Washington: American Psychological Association; 2003. Improving the transition from basic efficacy research to effectiveness studies: Methodological issues and procedures; p. 569.
    1. Blasinsky M, Goldman HH, Unutzer J. Project IMPACT: a report on barriers and facilitators to sustainability. Adm Policy Ment Health Ment Health Serv Res. 2006;33(6):718–729. doi: 10.1007/s10488-006-0086-7.
    1. Woolf SH, Johnson RE. The break-even point: when medical advances are less important than improving the fidelity with which they are delivered. Ann Fam Med. 2005;3(6):545–552. doi: 10.1370/afm.406.
    1. Kimberly J, Rye CB. In: The Morphology of Innovation, in Handbook of Culture, Organization, and Work. Bhagat RS, Steers RM, editor. London: Cambridge University Press; 2009. pp. 197–218.
    1. Kimberly JR, de Pouvourville G, D'Aunno T. The Globalization of Managerial Innovation in Health Care. London: Cambridge University Press; 2008.
    1. Waltz J. et al.Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. J Consult Clin Psychol. 1993;61(4):620–630.
    1. Jana S. et al.The Sonagachi Project: a sustainable community intervention program. AIDS Educ Prev. 2004;16(5):405–414. doi: 10.1521/aeap.16.5.405.48734.
    1. Plochg T. et al.Collaborating while competing? The sustainability of community-based integrated care initiatives through a health partnership. BMC Health Serv Res. 2006;20:6–37.
    1. Blakely CH. et al.The fidelity-adaptation debate: implications for the implementation of public sector social programs. Am J Community Psychol. 1987;15(3):253–268. doi: 10.1007/BF00922697.
    1. Langley GJ, The improvement guide: a practical approach to enhancing organizational performance. New York: Jossey-Bass; 2009.
    1. Spencer BA. Models of organization and total quality management: a comparison and critical evaluation. Academy of Management Review. 1994;19(3):446–471.
    1. Weiss CH. Have we learned anything new about the use of evaluation? Am J Eval. 1998;19(1):21.
    1. Crossan MM, Lane HW, White RE. An organizational learning framework: From intuition to institution. 1999. pp. 522–537. Academy of Management Review.
    1. March JG. Exploration and exploitation in organizational learning. 1. Vol. 2. Organization Science; 1991. pp. 71–87.
    1. Berman P. The study of macro and micro implementation of social policy. Santa Monica: Rand Corporation; 1978.
    1. Hill LG, Maucione K, Hood BK. A focused approach to assessing program fidelity. Prev Sci. 2007;8:25–34. doi: 10.1007/s11121-006-0051-4.
    1. Lundgren L. et al.Modifications of evidence-based practices in community-based addiction treatment organizations: A qualitative research study addictive behaviors. Addict Behav. 2011;36(6):630–635. doi: 10.1016/j.addbeh.2011.01.003.
    1. Levitt JT. et al.The flexible application of a manualized treatment for PTSD symptoms and functional impairment related to the 9/11 World Trade Center attack. Behav Res Ther. 2007;45(7):1419. doi: 10.1016/j.brat.2007.01.004.
    1. SW S, CF. In: Moving From the Laboratory to the Real World: Implementation Science and Effectiveness in Practice Settings, in Toward an Integrated Approach to Trauma Focused Therapy: Placing Evidence-Based Interventions in an Expanded Psychological Context. R McMackin, et al, editor. American Psychological Association: Washington, D.C; in press .
    1. Perepletchikova F, Treat TA, Kazdin AE. Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. J Consult Clin Psychol. 2007;75(6):829–841.
    1. Davies B, Tremblay D, Edwards N. In: Sustaining evidence-based practice systems and measuring the impacts, in Evaluating the Impact of Implementing Evidence-Based Practice. Bick D, Ingram ID, editor. Oxford: Wiley Blackwell; 2010.
    1. Tyre M, Orlikowski W. Windows of opportunity: temporal patterns in technical adaptation in organizations. Organ Sci. 1994;5(1):98–105. doi: 10.1287/orsc.5.1.98.
    1. Charns MP, Multilevel Interventions: Measurement and Measures. J Natl Cancer Inst. in press .
    1. Glanz K, Bishop DB. The role of behavioral science theory in development and implementation of public health interventions. Annu Rev Public Health. 2010;31:399–418. doi: 10.1146/annurev.publhealth.012809.103604.
    1. Edward JR Jr. Testing ecological models: the meaning of validation. Ecol Model. 1996;90(3):229–244. doi: 10.1016/0304-3800(95)00152-2.
    1. Steckler AB, Goodman RM, McLeory KR, Davis S, Koch G. Measuring the diffusion of innovative health promotion programs. Am J Health Promot. 1992;6(3):214–224. doi: 10.4278/0890-1171-6.3.214.
    1. Barab SA, Redman BK, Froman RD. Measurement characteristics of the levels of institutionalization scales: examining reliability and validity. J Nurs Meas. 1998;6:19–33.
    1. Ruch-Ross H. et al.Evaluation of community-based health projects: the healthy tomorrows experience. Pediatrics. 2008;122(3):e564–e572. doi: 10.1542/peds.2006-3273.
    1. Patton MQ. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: The Guilford Press; 2010.
    1. Abraham AJ, Knudsen HK, Roman PM. A longitudinal examination of alcohol pharmacotherapy adoption in substance use disorder treatment programs: patterns of sustainability and discontinuation. J Stud Alcohol Drugs. 2011;72(4):669–677.
    1. Ahluwalia IB, Robinson D, Vallely L, Gieseker KE, Kabakama A. Sustainability of community-capacity to promote safer motherhood in northwestern Tanzania: what remains? Glob Health Promot. 2010;17(1):39–49. doi: 10.1177/1757975909356627.
    1. Aitaoto N, Tsark J, Braun KL. Sustainability of the pacific diabetes today coalitions. Prev Chronic Dis. 2009;6(4):A130–A138.
    1. Amazigo U, Okeibunor J, Matovu V, Zouré H, Bump J, Seketeli A. Performance of predictors: evaluating sustainability in community-directed treatment projects of the African programme for onchocerciasis control. Soc Sci Med. 2007;64(10):2070–2082. doi: 10.1016/j.socscimed.2007.01.018.
    1. August GJ, Bloomquist ML, Lee SS, Realmuto GM, Hektner JM. Can evidence-based prevention programs be sustained in community practice settings? The early risers' advanced-stage effectiveness trial. Prev Sci. 2006;7(2):151–165. doi: 10.1007/s11121-005-0024-z.
    1. Austin G, Bell T, Caperchione C, Mummery WK. Translating research to practice: using the RE-AIM framework to examine an evidence-based physical activity intervention in primary school settings. Health Promot Pract. 2011;12(6):932–941. doi: 10.1177/1524839910366101.
    1. Babl FE, Krieser D, Belousoff J, Theophilos T. Evaluation of a paediatric procedural sedation training and credentialing programme: sustainability of change. Emerg Med J. 2010;27(8):577–581. doi: 10.1136/emj.2009.077024.
    1. Baer JS, Ball SA, Campbell BK, Miele GM, Schoener EP, Tracy K. Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug Alcohol Depend. 2007;87(2):107–118. doi: 10.1016/j.drugalcdep.2006.08.028.
    1. Bailie RS, Robinson G, Kondalsamy-Chennakesavan SN, Halpin S, Wang Z. Investigating the sustainability of outcomes in a chronic disease treatment programme. Soc Sci Med. 2006;63(6):1661–1670. doi: 10.1016/j.socscimed.2006.04.010.
    1. Barnett LM, Van Beurden E, Eakin EG, Beard J, Dietrich U, Newman B. Program sustainability of a community-based intervention to prevent falls among older Australians. Health Promot Int. 2004;19(3):281–288. doi: 10.1093/heapro/dah302.
    1. Baum F, Jolley G, Hicks R, Saint K, Parker S. What makes for sustainable Healthy Cities initiatives?-a review of the evidence from Noarlunga, Australia after 18 years. Health Promot Int. 2006;21(4):259–265. doi: 10.1093/heapro/dal023.
    1. Beery WL, Senter S, Cheadle A, Greenwald HP, Pearson D, Brousseau R, Nelson GD. Evaluating the legacy of community health initiatives: a conceptual framework and example from the California Wellness Foundation's health improvement initiative. Am J Evaluation. 2005;26:150–165. doi: 10.1177/1098214005275627.
    1. Bere E, Veierod MB, Bjelland M, Klepp KI. Free school fruit-sustained effect 1 year later. Health Educ Res. 2006;21(2):268–275.
    1. Bisset S, Potvin L. Expanding our conceptualization of program implementation: lessons from the genealogy of a school-based nutrition program. Health Educ Res. 2006;22(5):737–746. doi: 10.1093/her/cyl154.
    1. Blasinsky M, Goldman HH, Unutzer J. Project IMPACT: a report on barriers and facilitators to sustainability. Adm Policy Ment Health. 2006;33(6):718–729. doi: 10.1007/s10488-006-0086-7.
    1. Bowman C, Sobo E, Asch S, Gifford A. The H. I. V. Hepatitis Quality Enhancement Research Initiative: Measuring persistence of implementation: QUERI series. Implement Sci. 2008;3(1):21. doi: 10.1186/1748-5908-3-21.
    1. Bratcht NF, Finnegan JR, Rissel C, Weisbrod R, Gleason J, Corbett J, Mortenson S. Community ownership and program coninuation following a health demonstration program. Health Educ Res. 1994;9:243–255. doi: 10.1093/her/9.2.243.
    1. Brand C, Landgren F, Hutchinson A, Jones C, MacGregor L, Campbell D. Clinical practice guidelines: barriers to durability after effective early implementation. Intern Med J. 2005;35(3):162–169. doi: 10.1111/j.1445-5994.2004.00763.x.
    1. Bunik M, Federico MJ, Beaty B, Rannie M, Olin JT, Kempe A. Quality improvement for asthma care within a hospital-based teaching clinic. Acad Pediatr. 2011;11(1):58–65. doi: 10.1016/j.acap.2010.10.004.
    1. Cherry RA, West CE, Hamilton MC, Rafferty CM, Hollenbeak CS, Caputo GM. Reduction of central venous catheter associated blood stream infections following implementation of a resident oversight and credentialing policy. Patient Saf Surg. 2011;5:15. doi: 10.1186/1754-9493-5-15.
    1. DeWein M, Miller L. The effects of a classroom-based intervention on aggression-related injuries. Child and Youth Care Forum. 2009;38(4):201–218. doi: 10.1007/s10566-009-9076-8.
    1. Dückers MLA, Wagner C, Vos L, Groenewegen PP. Understanding organisational development, sustainability, and diffusion of innovations within hospitals participating in a multilevel quality collaborative. Implement Sci. 2011;6(1):18. doi: 10.1186/1748-5908-6-18.
    1. Ebert-May D, Derting TL, Hodder J, Momsen JL, Long TM, Jardeleza SE. What we say is not what we do: effective evaluation of faculty professional development programs. Bioscience. 2011;61(7):550–558. doi: 10.1525/bio.2011.61.7.9.
    1. Edvarsson K, Garvare R, Ivarsson A, Eurenius E, Morgen I, Nystrom M. Sustainable practice change: professionals' experiences with a multisectoral child health promotion programme in Sweden. BMC Health Serv Res. 2011;11:61. doi: 10.1186/1472-6963-11-61.
    1. Eliason RN. Towards sustainability in village health care in rural Cameroon. Health Promot Int. 1999;14:301–306. doi: 10.1093/heapro/14.4.301.
    1. Ellingson K, Muder RR, Jain R, Kleinbaum D, Feng PJ, Cunningham C, Squier C, Lloyd J, Edwards J, Gebski V, Jernigan J. Sustained reduction in the clinical incidence of methicillin-resistant Staphylococcus aureu colonization or infection associated with a multifaceted infection control intervention. Infect Control Hosp Epidemiol. 2011;32(1):1–8. doi: 10.1086/657665.
    1. Epstein JN, Langberg JM, Lichtenstein PK, Kolb RC, Stark LJ. Sustained improvement in pediatricians' ADHD practice behaviors in the context of a community-based quality improvement initiative. Child Health Care. 2010;39(4):296–311. doi: 10.1080/02739615.2010.515931.
    1. Escoffery C, Glanz K, Hall D, Elliott T. A multi-method process evaluation for a skin cancer prevention diffusion trial. Eval Health Prof. 2009;32(2):184–203. doi: 10.1177/0163278709333154.
    1. Evashwick C, Ory M. Organizational characteristics of successful innovative health care programs sustained over time. Fam Community Health. 2003;26(3):177–193.
    1. Feinberg ME, Bontempo DE, Greenberg MT. Predictors and level of sustainability of community prevention coalitions. Am J Prev Med. 2008;34(6):495–501. doi: 10.1016/j.amepre.2008.01.030.
    1. Fonck K, Claeys P, Bashir F, Bwayo J, Fransen L, Temmerman M. Syphilis control during pregnancy: effectiveness and sustainability of a decentralized program. Am J Public Health. 2001;91(5):705–707.
    1. Glaser EM, Backer TE. Durability of innovations: how goal attainment scaling programs fare over time. Community Ment Health J. 1980;16(2):130–143. doi: 10.1007/BF00778585.
    1. Glisson C, Schoenwald SK, Kelleher K, Landsverk J, Hoagwood KE, Mayberg S, Green P. Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Adm Policy Ment Health. 2008;35(1-2):124–133. doi: 10.1007/s10488-007-0152-9.
    1. Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large scale dissemination and implementation model for evidence based treatment and continuing care. Clin Psychol Sci Pract. 2011;18(1):67–83. doi: 10.1111/j.1468-2850.2011.01236.x.
    1. Goetz MB, Hoang T, Henry SR, Knapp H, Anaya HD, Gifford AL, Asch SM. Evaluation of the sustainability of an intervention to increase HIV testing. J Gen Intern Med. 2009;24(12):1275–1280. doi: 10.1007/s11606-009-1120-8.
    1. Goodson P, Murphy Smith M, Evans A, Meyer B, Gottlieb NH. Maintaining prevention in practice: survival of PPIP in primary care settings. Am J Prev Med. 2001;20(3):184–189. doi: 10.1016/S0749-3797(00)00310-X.
    1. Greenwood CR, Tapia Y, Abbott M, Walton C. A building-based case study of evidence-based literacy practices: implementation, reading behavior, and growth in reading fluency, K-4. J Spec Educ. 2003;37(2):95–110. doi: 10.1177/00224669030370020401.
    1. Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, Lavis JN. Sustainability science: an integrated approach for health-programme planning. Lancet. 2008;372(9649):1579–1589. doi: 10.1016/S0140-6736(08)61659-1.
    1. Gurtler RE, Kitron U, Cecere MC, Segura EL, Cohen JE. Sustainable vector control and management of Chagas disease in the Gran Chaco, Argentina. Proc Natl Acad Sci USA. 2007;104(41):16194–16199. doi: 10.1073/pnas.0700863104.
    1. Harris DL, Henry RC, Bland CJ, Starnaman SM, Voytek KL. Lessons learned from implementing multidisciplinary health professions educational models in community settings. J Interprof Care. 2003;17(1):7–20. doi: 10.1080/1356182021000044111.
    1. Helfrich CD, Damschroder LJ, Hagedorn HJ, Daggett GS, Sahay A, Ritchie M, Damush T, Guihan M, Ullrich PM, Stetler CB. A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. 2010;5:82. doi: 10.1186/1748-5908-5-82.
    1. Henggeler SW, Sheidow AJ, Cunningham PB, Donohue BC, Ford JD. Promoting the implementation of an evidence-based intervention for adolescent marijuana abuse in community settings: testing the use of intensive quality assurance. J Clin Child Adolesc Psychol. 2008;37(3):682–689. doi: 10.1080/15374410802148087.
    1. Higuchi KS, Davies BL, Edwards N, Ploeg J, Virani T. Implementation of clinical guidelines for adults with asthma and diabetes: a three-year follow-up evaluation of nursing care. J Clin Nurs. 2011;20(9-10):1329–1338. doi: 10.1111/j.1365-2702.2010.03590.x.
    1. Hii JL, Chee KC, Vun YS, Awang J, Chin KH, Kan SK. Sustainability of a successful malaria surveillance and treatment program in a Runggus community in Sabah, east Malaysia. Southeast Asian J Trop Med Public Health. 1996;27(3):512–521.
    1. Hoelscher DM, Feldman HA, Johnson CC, Lytle LA, Osganian SK, Parcel GS, Kelder SH, Stone EJ, Nader PR. School-based health education programs can be maintained over time: results from the CATCH Institutionalization study. Prev Med. 2004;38(5):594–606. doi: 10.1016/j.ypmed.2003.11.017.
    1. Hoffman KA, Ford II, James H, Choi D, Gustafson DH, McCarty D. Replication and sustainability of improved access and retention within the Network for the Improvement of Addiction Treatment. Drug Alcohol Depend. 2008;98(1-2):63–69. doi: 10.1016/j.drugalcdep.2008.04.016.
    1. Hogg W, Baskerville N, Nykiforuk C, Mallen D. Improved preventive care in family practices with outreach facilitation: understanding success and failure. J Health Serv Res Policy. 2002;7(4):195–201. doi: 10.1258/135581902320432714.
    1. Hoque BA, Juncker T, Sack RB, Ali M, Aziz KM. Sustainability of a water, sanitation and hygiene education project in rural Bangladesh: a 5-year follow-up. Bulletin WHO. 1996;74(4):431–437.
    1. Jansen M, Harting J, Ebben N, Kroon B, Stappers J, VanEngelshoven E. deVries, N: The concept of sustainability and the use of outcome indicators: a case study to continue a successful health counselling intervention. Fam Pract. 2008;25:i32–i37. doi: 10.1093/fampra/cmn066.
    1. Johnson C, Fargo J, Kahle JB. The cumulative and residual impact of a systemic reform program on teacher change and student learning of science. Sch Sci Math. 2010;110(3):144–159. doi: 10.1111/j.1949-8594.2010.00017.x.
    1. Kalafat J, Ryerson DM. The implementation and institutionalization of a school-based youth suicide prevention program. J Prim Prev. 1999;19(3):157–175. doi: 10.1023/A:1022658826641.
    1. Kay BH, Tuyet Hanh TT, Le NH, Quy TM, Nam VS, Hang PV, Yen NT, Hill PS, Vos T, Ryan PA. Sustainability and cost of a community-based strategy against Aedes aegypti in northern and central Vietnam. AmJTrop Med Hyg. 2010;82(5):822.
    1. Kellie SM, Timmins A, Brown C. A statewide collaborative to reduce methicillin-resistant Staphylococcus aureu bacteremias in New Mexico. Jt Comm J Qual Patient Saf. 2011;37:154–162.
    1. Kennedy MT, Fiss PC. Institutionalization, framing, and diffusion: the logic of TQM adoption and implementation decisions among U.S. hospitals. Acad Manage J. 2009;52(5):897–918.
    1. Klingner J, Vaughn S. Tejero Hughes M, Arguelles ME: Sustaining research-based practices in reading: a 3-year follow-up. Rem Spec Ed. 1999;20(5):263–275. doi: 10.1177/074193259902000502.
    1. Knapp H, Anaya HD, Goetz MB. Attributes of an independently self-sustaining implementation: nurse-administered HIV rapid testing in VA primary care. Qual Manag Health Care. 2010;19(4):292–297.
    1. Knippenberg R, Soucat A, Oyegbite K, Sene M, Bround D, Pangu K, Hopwood I, Grandcourt R, Tinguiri KL, Fall I, Ammassari S, Alihonou E. Sustainability of primary health care including expanded program of immunizations in Bamako Initiative programs in West Africa: an assessment of 5 years' field experience in Benin and Guinea. Int J Health Plann Manage. 1997;12:S9–S28. doi: 10.1002/(SICI)1099-1751(199706)12:1+<S9::AID-HPM471>;2-U.
    1. Knudsen HK, Studts JL. Availability of nicotine replacement therapy in substance use disorder treatment: longitudinal patterns of adoption, sustainability, and discontinuation. Drug Alcohol Depend. 2011;118(2-3):244–250. doi: 10.1016/j.drugalcdep.2011.03.028.
    1. Kolko DJ, Iselin A-MR, Gully KJ. Evaluation of the sustainability and clinical outcome of Alternatives for Families: A Cognitive-Behavioral Therapy (AF-CBT) in a child protection center. Child Abuse Negl. 2011;35(2):105–116. doi: 10.1016/j.chiabu.2010.09.004.
    1. LaPelle NR, Zapka J, Ockene JK. Sustainability of public health programs: the example of tobacco treatment services in Massachusetts. Am J Public Health. 2006;96:1363–1369. doi: 10.2105/AJPH.2005.067124.
    1. Lee AJ, Bonson APV, Yarmirr D, O'Dea K, Mathews JD. Sustainability of a successful health and nutrition program in a remote Aboriginal community. Med J Aust. 1995;162:632–635.
    1. Lee PW, Dietrich AJ, Oxman TE, Williams JWJ, Barry SL. Sustainable impact of a primary care depression intervention. J Am Board Fam Med. 2007;20(5):427–433. doi: 10.3122/jabfm.2007.05.070045.
    1. Lichtenstein E, Thompson B, Nettekoven L, Corbett K. Durability of tobacco control activities in 11 North American communities: life after the community intervention trial for smoking cessation (COMMIT) Health Educ Res. 1996;11(4):527–534. doi: 10.1093/her/11.4.527.
    1. Lieber J, Butera G, Hanson M, Palmer S, Horn E, Czaja C. Sustainability of a preschool curriculum: what encourages continued use among teachers? NHSA Dialog. 2010;13(4):225–242.
    1. Lodl K, Stevens G. Coalition sustainability: long-term successes & lessons learned. J Ext. 2002;40(1):1–8.
    1. Loman SL, Rodriguez BJ, Horner RH. Sustainability of a targeted intervention package: first step to success in Oregon. J Emot Behav Disord. 2010;18(3):178–191. doi: 10.1177/1063426610362899.
    1. Lyon AR, Stirman SW, Kerns SE, Bruns EJ. Developing the mental health workforce: review and application of training approaches from multiple disciplines. Adm Policy Ment Health. 2011;38(4):238–253. doi: 10.1007/s10488-010-0331-y.
    1. Martin GW, Herie MA, Turner BJ, Cunningham JA. A social marketing model for disseminating research-based treatments to addictions treatment providers. Addiction. 1998;93(11):1703–1715. doi: 10.1046/j.1360-0443.1998.931117038.x.
    1. Massatti RR, Sweeney HA, Panzano PC, Roth D. The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Health. 2008;35(1-2):50–65. doi: 10.1007/s10488-007-0141-z.
    1. Maticka-Tyndale E, Wildish J, Gichuru M. Thirty-month quasi-experimental evaluation follow-up of a national primary school HIV intervention in Kenya. Sex Educ: Sex Soc Learn. 2010;10(2):113–130.
    1. Mayer J, Mooney B, Gundlapalli A, Harbarth S, Stoddard GJ, Rubin MA, Eutropius L, Brinton B, Samore MH. Dissemination and sustainability of a hospital-wide hand hygiene program emphasizing positive reinforcement. Infect Control Hosp Epidemiol. 2011;32(1):59–66. doi: 10.1086/657666.
    1. McCormick LK, Steckler AB, McLeroy KR. Diffusion of innovations in schools: a study of adoption and implementation of school-based tobacco prevention curricula. Am J Health Promot. 1995;9(3):210–219. doi: 10.4278/0890-1171-9.3.210.
    1. McDermott R, Tulip F, Schmidt B, Sinha A. Sustaining better diabetes care in remote indigenous Australian communities. Qual Saf Health Care. 2004;13(4):295–298. doi: 10.1136/qhc.13.4.295.
    1. McHugo GJ, Drake RE, Whitley R, Bond GR, Campbell K, Rapp CA, Goldman HH, Lutz WJ, Finnerty MT. Fidelity outcomes in the national implementing evidence-based practices project. Psychiatr Serv. 2007;58(10):1279–1284. doi: 10.1176/appi.ps.58.10.1279.
    1. Miller WR, Yahne CE, Moyers TB, Martinez J, Pirritano M. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050–1062.
    1. Morgenstern LB, Bartholomew LK, Grotta JC, Staub L, King M, Chan W. Sustained benefit of a community and professional intervention to increase acute stroke therapy. Arch Intern Med. 2003;163(18):2198–2202. doi: 10.1001/archinte.163.18.2198.
    1. Nease DE Jr, Nutting PA, Graham DG, Dickinson WP, Gallagher KM, Jeffcott-Pera M. Sustainability of depression care improvements: success of a practice change improvement collaborative. J Am Board Fam Med. 2010;23(5):598–605. doi: 10.3122/jabfm.2010.05.090212.
    1. Nilsen P, Timpka T, Nordenfelt L, Lindqvist K. Towards improved understanding of injury prevention program sustainability. Saf Sci. 2005;43(10):815. doi: 10.1016/j.ssci.2005.08.015.
    1. O'Loughlin J, Renaud L, Richard L, Gomez LS, Paradis G. Correlates of the sustainability of community-based heart health promotion interventions. Prev Med. 1998;27(5):702–712. doi: 10.1006/pmed.1998.0348.
    1. Osganian SK, Hoelscher DM, Zive M, Mitchell PD, Snyder P, Webber LS. Maintenance of effects of the Eat Smart School Food Service Program: results from the CATCH-ON study. Health Educ Behav. 2003;30(4):418–433. doi: 10.1177/1090198103253509.
    1. Paine-Andrews A, Fisher JL, Campuzano MK, Fawcett SB, Berkley-Patton J. Promoting sustainability of community health initiatives: an empirical case study. Health Promot Pract. 2000;1:248–258. doi: 10.1177/152483990000100311.
    1. Perlstein PH, Kotagal UR, Schoettker PJ, HD, Farrell MK, Gerhardt WE, Alfaro MP. Sustaining the implementation of an evidence-based guideline for bronchiolitis. Arch Pediatr Adolesc Med. 2000;154(10):1001–1007.
    1. Plochg T, Delnoij DM, Hoogedoorn NP, Klazinga NS. Collaborating while competing? The sustainability of community-based integrated care initiatives through a health partnership. BMC Health Serv Res. 2006;20:6–37.
    1. Pronovost PJ, Goeschel CA, Colantuoni E, Watson S, Lubomski LH, Berenholtz SM, Thompson DA, Sinopoli DJ, Cosgrove S, Sexton JB, Marsteller JA, Hyzy RC, Welsh R, Posa P, Schumacher K, Needham D. Sustaining reductions in catheter related bloodstream infections in Michigan intensive care units: observational study. BMJ. 2010;340:c309–c313. doi: 10.1136/bmj.c309.
    1. Rabin B, Nehl E, Elliott T, Deshpande A, Brownson R, Glanz K. Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis. Implement Sci. 2010;5:40–53. doi: 10.1186/1748-5908-5-40.
    1. Rapoport A. Sustainability of teachers' international experiences: conditions for institutionalization of international program outcomes. Educ Res Int. 2011;2011:1–9.
    1. Rau R, Rumpeltin C, Hoop R, Pfeiffer H, Drees J, Paas B, Schmitz-Buhl G, Geraedts M. Five years "Healthy Lower Rhine...Against Stroke": implementation of a regional, intersectoral and sustainable public health program. J Public Health. 2010;18(1):29–34. doi: 10.1007/s10389-009-0278-1.
    1. Rog D, Boback N, Barton-Villagrana H, Marrone-Bennett P, Cardwell J, Hawdon J, Diaz J, Jenkins P, Kridler J, Reischl T. Sustaining collaboratives: a cross-site analysis of the National Funding Collaborative on Violence Prevention. Eval Program Plann. 2004;27(3):249–261. doi: 10.1016/j.evalprogplan.2003.10.001.
    1. Rohrbach LA, Graham JW, Hansen WB. Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993;22(2):237–260. doi: 10.1006/pmed.1993.1020.
    1. Rollins A, Salyers M, Tsai J, Lydick J. Staff turnover in statewide implementation of ACT: relationship with ACT fidelity and other team characteristics. Adm Policy Ment Health. 2009;37(5):417–426.
    1. Rosenberg A, Hartwig K, Merson M. Government-NGO collaboration and sustainability of orphans and vulnerable children projects in southern Africa. Eval Program Plann. 2008;31(1):51–60. doi: 10.1016/j.evalprogplan.2007.08.005.
    1. Rubin FH, Neal K, Fenlon K, Hassan S, Inouye SK. Sustainability and scalability of the hospital elder life program at a community hospital. J Am Geriatr Soc. 2011;59(2):359–365. doi: 10.1111/j.1532-5415.2010.03243.x.
    1. Ruch-Ross H, Keller D, Miller N, Bassewitz J, Melinkovich P. Evaluation of community-based health projects: the healthy tomorrows experience. Pediatrics. 2008;122(3):e564–e572. doi: 10.1542/peds.2006-3273.
    1. Sadof MD, Boschert KA, Brandt SJ, Motyl AP. An analysis of predictors of sustainability efforts at the Inner-City Asthma Intervention sites: after the funding is gone. Ann Allergy Asthma Immunol. 2006;97(S1):S31–S35.
    1. Sanci L, Coffey C, Patton G, Bowes G. Sustainability of change with quality general practitioner education in adolescent health: a 5-year follow-up. Med Educ. 2005;39:557–560. doi: 10.1111/j.1365-2929.2005.02172.x.
    1. Sanci LA, Coffey CM, Veit FC, Carr-Gregg M, Patton GC, Day N, Bowes G. Evaluation of the effectiveness of an educational intervention for general practitioners in adolescent health care: randomised controlled trial. BMJ. 2000;320(7229):224–230. doi: 10.1136/bmj.320.7229.224.
    1. Scheirer MA. The life cycle of an innovation: adoption versus discontinuation of the fluoride mouth rinse program in schools. J Health Soc Behav. 1990;31(2):203–215. doi: 10.2307/2137173.
    1. Scheirer MA, Hartling G, Hagerman D. Defining sustainability outcomes of health programs: Illustrations from an on-line survey. Eval Program Plann. 2008;31(4):335–346. doi: 10.1016/j.evalprogplan.2008.08.004.
    1. Schetzina KE, Dalton WT III, Pfortmiller DT, Robinson HF, Lowe EF, Stern HP. The Winning With Wellness pilot project: rural Appalachian elementary student physical activity and eating behaviors and program implementation 4 years later. Fam Community Health. 2011;34(2):154–162.
    1. Schoenwald SK, Carter RE, Chapman JE, Sheidow AJ. Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Adm Policy Ment Health. 2008;35(5):379–394. doi: 10.1007/s10488-008-0181-z.
    1. Sebotsa MLD, Dannhauser A, Jooste PL, Joubert G. Assessment of the sustainability of the iodine-deficiency disorders control program in Lesotho. Food and Nutrition Bulletin. 2007;28(3):337–347.
    1. Simonsen B, Eber L, Black AC, Sugai G, Lewandowski H, Sims B, Myers D. Illinois statewide positive behavioral interventions and supports: evolution and impact on student outcomes across years. J Posit Behav Interv. 2012;14:5–16. doi: 10.1177/1098300711412601.
    1. Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med. 2003;25(4):296–300. doi: 10.1016/S0749-3797(03)00219-8.
    1. Steadman HJ, Cocozza JJ, Dennis DL, Lassiter MG, Randolph FL, Goldman H, Blasinsky M. Successful program maintenance when federal demonstration dollars stop: the ACCESS program for homeless mentally ill persons. Adm Policy Ment Health. 2002;29(6):481–493. doi: 10.1023/A:1020776310331.
    1. Stetler CB, Ritchie JA, Rycroft-Malone J, Schultz AA, Charns MP. Institutionalizing evidence-based practice: an organizational case study using a model of strategic change. Implement Sci. 2009;4:78. doi: 10.1186/1748-5908-4-78.
    1. Stevens B, Peikes D. When the funding stops: do grantees of the Local Initiative Funding Partners Program sustain themselves? Eval Program Plann. 2006;29(2):153–161. doi: 10.1016/j.evalprogplan.2006.01.009.
    1. Stroul BA, Manteuffel BA. The sustainability of systems of care for children's mental health: lessons learned. J Behav Health Serv Res. 2007;34(3):237–259. doi: 10.1007/s11414-007-9065-3.
    1. Swain K, Whitley R, McHugo GJ, Drake RE. The sustainability of evidence-based practices in routine mental health agencies. Community Ment Health J. 2009;46(2):119–129.
    1. Thompson B, Lichtenstein E, Corbett K, Nettekoven L, Feng Z. Durability of tobacco control efforts in the 22 Community Intervention Trial for Smoking Cessation (COMMIT) communities 2 years after the end of intervention. Health Educ Res. 2000;15(3):353–366. doi: 10.1093/her/15.3.353.
    1. Thorsen AV, Lassen AD, Tetens I, Hels O, Mikkelsen BE. Long-term sustainability of a worksite canteen intervention of serving more fruit and vegetables. Public Health Nutr. 2010;13(10):1647–1652. doi: 10.1017/S1368980010001242.
    1. Tibbits M, Bumbarger B, Kyler S, Perkins D. Sustaining evidence-based interventions under real-world conditions: results from a large-scale diffusion project. Prev Sci. 2010;11(3):252–262. doi: 10.1007/s11121-010-0170-9.
    1. Toledo Romani ME, Vanlerberghe V, Perez D, Lefevre P, Ceballos E, Bandera D, Baly Gil A, Van der Stuyft P. Achieving sustainability of community-based dengue control in Santiago de Cuba. Soc Sci Med. 2007;64(4):976. doi: 10.1016/j.socscimed.2006.10.033.
    1. Ullrich S, McCutcheon H, Parker B. Reclaiming time for nursing practice in nutritional care: outcomes of implementing Protected Mealtimes in a residential aged care setting. J Clin Nurs. 2010;20(9-10):1339–1348.
    1. Visrutaratna S, Lindan CP, Sirhorachai A, Mandel JS. "Superstar" and"model brothel": developing and evaluating a condom promotion program for sex establishments in Chiang Mai, Thailand. AIDS. 1995;9(1):S69–S75.
    1. Wallin L, Bostrom A, Wikblad K, Ewald U. Sustainability in changing clinical practice promotes evidence-based nursing care. J Adv Nurs. 2003;41(5):509–518. doi: 10.1046/j.1365-2648.2003.02574.x.
    1. Westrick SC, Breland ML. Sustainability of pharmacy-based innovations: the case of in-house immunization services. J Am Pharm Assoc. 2009;49(4):500–508. doi: 10.1331/JAPhA.2009.08055.
    1. Whitford DL, Roberts SH, Griffin S. Sustainability and effectiveness of comprehensive diabetes care to a district population. Diabet Med. 2004;21(11):1221–1228. doi: 10.1111/j.1464-5491.2004.01324.x.
    1. Woltmann EM, Whitley R, McHugo GJ, Brunette M, Torrey WC, Coots L, Lynde D, Drake RE. The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatr Serv. 2008;59(7):732–737. doi: 10.1176/appi.ps.59.7.732.
    1. Wong LC, Amega B, Barker R, Connors C, Dulla ME, Ninnal A, Cumaiyi MM, Kolumboort L, Currie BJ. Factors supporting sustainability of a community-based scabies control program. Australas J Dermatol. 2002;43(4):274–277. doi: 10.1046/j.1440-0960.2002.00626.x.
    1. Wong ML, Chan KW, Koh D. A sustainable behavioral intervention to increase condom use and reduce gonorrhea among sex workers in Singapore: 2-year follow-up. Prev Med. 1998;27:891–900. doi: 10.1006/pmed.1998.0398.
    1. Wright C, Catty J, Watt H, Burns T. A systematic review of home treatment services: classification and sustainability. Soc Psychiatry Psychiatr Epidemiol. 2004;39(10):789–796.
    1. Wright DB. Care in the country: a historical case study of long-term sustainability in 4 rural health centers. Am J Public Health. 2009;99(9):1612–1618. doi: 10.2105/AJPH.2008.146050.
    1. Xian Y, Pan W, Peterson ED, Heidenreich PA, Cannon CP, Hernandez AF, Friedman B, Holloway RG, Fonarow GC. Are quality improvements associated with the Get With the Guidelines-Coronary Artery Disease (GWTG-CAD) program sustained over time?: A longitudinal comparison of GWTG-CAD hospitals versus non-GWTG-CAD hospitals. Am Heart J. 2010;159(2):207–214. doi: 10.1016/j.ahj.2009.11.002.

Source: PubMed

Szponzorok és közreműködők

Egészségi állapot

Kábítószer-beavatkozások

3
Iratkozz fel