Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation

Denise C Gottfredson, Thomas D Cook, Frances E M Gardner, Deborah Gorman-Smith, George W Howe, Irwin N Sandler, Kathryn M Zafft, Denise C Gottfredson, Thomas D Cook, Frances E M Gardner, Deborah Gorman-Smith, George W Howe, Irwin N Sandler, Kathryn M Zafft

Abstract

A decade ago, the Society of Prevention Research (SPR) endorsed a set of standards for evidence related to research on prevention interventions. These standards (Flay et al., Prevention Science 6:151-175, 2005) were intended in part to increase consistency in reviews of prevention research that often generated disparate lists of effective interventions due to the application of different standards for what was considered to be necessary to demonstrate effectiveness. In 2013, SPR's Board of Directors decided that the field has progressed sufficiently to warrant a review and, if necessary, publication of "the next generation" of standards of evidence. The Board convened a committee to review and update the standards. This article reports on the results of this committee's deliberations, summarizing changes made to the earlier standards and explaining the rationale for each change. The SPR Board of Directors endorses "The Standards of Evidence for Efficacy, Effectiveness, and Scale-up Research in Prevention Science: Next Generation."

Keywords: Policy; Standards of evidence.

Conflict of interest statement

Denise C. Gottfredson, Thomas D. Cook, Frances E.M. Gardner, Deborah Gorman-Smith, George W. Howe, Irwin N. Sandler, and Kathryn M. Zafft declare that they have no conflicts of interest with respect to their authorship or the publication of this article.

References

    1. Aarons GA, Horowitz JD, Dlugosz LR, Ehrhart MG. The role of organizational processes in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012. pp. 128–153.
    1. Allen JD, Linnan LA, Emmons KM. Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012. pp. 281–304.
    1. Bloom HS, Michalopoulos C, Hill CJ. Using experiments to assess nonexperimental comparison-group methods for measuring program effects. In: Bloom HS, editor. Learning more from social experiments. New York: Russell Sage Foundation; 2005. pp. 173–235.
    1. Bloomquist ML, August GJ, Lee SS, Lee CS, Realmuto GM, Klimes-Dougan B. Going-to-scale with the early risers conduct problems prevention program: Use of a comprehensive implementation support (CIS) system to optimize fidelity, participation and child outcomes. Evaluation and Program Planning. 2013;38:19–27. doi: 10.1016/j.evalprogplan.2012.11.001.
    1. Boruch, R. F. (Ed). (2005). Place randomized trials: Special issue. Annals of the American Academy of Political and Social Sciences, 599, whole issue.
    1. Brown CH. Statistical methods for prevention trials in mental health. Statistics in Medicine. 1993;12:289–300. doi: 10.1002/sim.4780120312.
    1. Brown CH, Wang W, Kellam SG, Muthén BO, Petras H, Toyinbo P, The Prevention Science and Methodology Group Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence. 2008;95:S74–S104. doi: 10.1016/j.drugalcdep.2007.11.013.
    1. Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012.
    1. Bryk AS, Raudenbush SW. Hierarchical linear models: Applications and data analysis methods. Newbury Park: Sage; 1992.
    1. Campbell DT. The experimenting society. In: Dunn WN, editor. The experimenting society: Essays in honor of Donald T. Campbell. New Brunswick: Transaction Publishers; 1968. pp. 35–68.
    1. Campbell MK, Piaggio G, Elbourne DR, Altman DG, for the CONSORT Group Consort 2010 statement: Extension to cluster randomised trials. BMJ. 2012;345:1–21.
    1. CDC Foundation. (2013). Adaptations of evidence-based interventions in violence prevention. Retrieved from
    1. Centre for Children and Families in the Justice System. (2006). Randomized study of MST in Ontario, Canada: Final results. Retrieved from .
    1. Chamberlain P, Brown CH, Saldana L, Reid J, Wang W, Marsenich L, Bouwman G. Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. [Research Support, N.I.H., Extramural Research Support, U.S. Government, Non-P.H.S.] Administration & Policy in Mental Health. 2008;35:250–260. doi: 10.1007/s10488-008-0167-x.
    1. Chambers, D.A., Glasgow, R.E., & Strange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, Published Online. Retrieved from . doi: 10.1186/1748-5908-8-117.
    1. Chen HT. Theory-driven evaluations. Newbury Park: Sage; 1990.
    1. Cook TD, Campbell DT. Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton-Mifflin; 1979.
    1. Cook TD, Payne MR. Objecting to the objections to using random assignment in educational studies. In: Mosteller F, Boruch R, editors. Evidence matters: Randomized trials in education research. Washington: Brookings Institution Press; 2002. pp. 150–178.
    1. Cook TD, Shadish WR, Wong VC. Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management. 2008;27:724–750. doi: 10.1002/pam.20375.
    1. Cook TD, Steiner PM, Pohl S. How bias reduction is affected by covariate choice, unreliability, and mode of data analysis: Results from two types of within-study comparisons. Multivariate Behavioral Research. 2009;44:828–847. doi: 10.1080/00273170903333673.
    1. Curran GM, Bauer M, Mitman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care. 2013;50:217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. Des Jarlais DC, Lyles C, Crepaz N. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND statement. American Journal of Public Health. 2004;94:361–366. doi: 10.2105/AJPH.94.3.361.
    1. Diaz JJ, Handa S. An assessment of propensity score matching as a nonexperimental impact estimator evidence from Mexico’s PROGRESA program. Journal of Human Resources. 2006;41:319–345.
    1. Durlak JA, DuPre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology. 2008;41:327–350. doi: 10.1007/s10464-008-9165-0.
    1. Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prevention Science. 2004;5:47–53. doi: 10.1023/B:PREV.0000013981.28071.52.
    1. Enders C. Missing not at random models for latent growth curve analyses. Psychological Methods. 2011;16:1–16. doi: 10.1037/a0022640.
    1. Ennett ST, Ringwalt CL, Thorne J, Rohrbach LA, Vincus A, Simons-Randolf A, Jones S. A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science. 2003;4:1–14. doi: 10.1023/A:1021777109369.
    1. European Monitoring Centre for Drugs and Drug Addiction (2011). European drug prevention quality standards: A manual for prevention professionals. Retrieved from .
    1. Fagan AA, Hanson K, Hawkins JD, Arthur MW. Translation research in action: Implementation of the communities that care prevention system in 12 communities. Journal of Community Psychology. 2009;37:809–829. doi: 10.1002/jcop.20332.
    1. Fisher CB, Hoagwood K, Boyce C, Duster T, Frank DA, Grisso T, Levine RJ, Macklin R, Spencer MB, Takanishi R, Trimble JE, Zayas LH. Research ethics for mental health science involving ethnic minority children and youths. American Psychologist. 2002;57:1024–1040. doi: 10.1037/0003-066X.57.12.1024.
    1. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network; 2005.
    1. Flay BR. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive Medicine. 1986;15:451–474. doi: 10.1016/0091-7435(86)90024-1.
    1. Flay BR, Biglan A, Boruch RF, Gonzalez Castro F, Gottfredson D, Kellam S, Moscicki EK, Schinke S, Valentine JC, Ji P. Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science. 2005;6:151–175. doi: 10.1007/s11121-005-5553-y.
    1. Forgatch MS, DeGarmo DS. Sustaining fidelity following the nationwide PMTO implementation in Norway. Prevention Science. 2011;12:235–246. doi: 10.1007/s11121-011-0225-6.
    1. Foster M, Porter M, Ayers T, Kaplan D, Sandler I. Estimating costs of preventive interventions. Evaluation Review. 2007;31:261–286. doi: 10.1177/0193841X07299247.
    1. Gardner F, Burton J, Klimes I. Randomised controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: Outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry. 2006;47:1123–1132. doi: 10.1111/j.1469-7610.2006.01668.x.
    1. Gardner F, Mayo-Wilson E, Montgomery P, Hopewell S, Macdonald G, Moher D, Grant S. Editorial perspective: The need for new guidelines to improve the reporting of trials in child and adolescent mental health. Journal of Child Psychology and Psychiatry. 2013;54:810–812. doi: 10.1111/jcpp.12106.
    1. Gerber AS, Green DP, Carnegie AJ. Evaluating public health law using randomized experiments. In: Wagenaar AC, Burris SC, editors. Public health law research: Theory and methods. Somerset: Wiley; 2013. pp. 283–305.
    1. Glasgow RE, Steiner JF. Comparative effectiveness research to accelerate translation: Recommendations for an emerging field of science. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012. pp. 72–93.
    1. Glazerman S, Levy DM, Myers D. Nonexperimental versus experimental estimates of earnings impacts. The Annals of the American Academy of Political and Social Science. 2003;589:63–93. doi: 10.1177/0002716203254879.
    1. Glisson C, Schoenwald SK, Hemmelgarn A, Green P, Dukes D, Armstrong KS, Chapman JE. Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology. 2010;78:537–550. doi: 10.1037/a0019160.
    1. Gottfredson DC, Gottfredson GD. Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency. 2002;39:3–35. doi: 10.1177/002242780203900101.
    1. Gottfredson DC, Kumpfer K, Polizzi-Fox D, Wilson D, Puryear V, Beatty P, Vilmenay M. The strengthening Washington D.C. Families project: A randomized effectiveness trial of family-based prevention. Prevention Science. 2006;7:57–76. doi: 10.1007/s11121-005-0017-y.
    1. Grant SP, Mayo-Wilson E, Melendez-Torres GJ, Montgomery P. Reporting quality of social and psychological intervention trials: A systematic review of reporting guidelines and trial publications. PLoS ONE. 2013;8:e65442. doi: 10.1371/journal.pone.0065442.
    1. Greene WH. Econometric analysis. New York: MacMillan; 1993.
    1. Griffin KW, Botvin GJ, Nichols TR. Long-term follow-up effects of a school-based prevention program on adolescent risky driving. Prevention Science. 2004;5:207–212. doi: 10.1023/B:PREV.0000037643.78420.74.
    1. Gutman, M. A., Foltz, C., Mittal, R., & Kaltenbach, K. (2004). Outcomes of a family-based prevention model with women in substance abuse treatment and their children: The Philadelphia Strengthening Families Project. Unpublished manuscript. Philadelphia: Treatment Research Institute.
    1. Hallfors D, Godette D. Will the ‘principles of effectiveness’ improve prevention practice? Early findings from a diffusion study. Health Education Research. 2002;17:461–470. doi: 10.1093/her/17.4.461.
    1. Hallfors D, Cho H, Sanchez V, Khatapoush S, Kim H, Bauer D. Efficacy vs effectiveness trial results of an indicated “model” substance abuse program: Implications for public health. American Journal of Public Health. 2006;96:2254–2259. doi: 10.2105/AJPH.2005.067462.
    1. Hedeker D, Gibbons RD, Flay BR. Random-effects regression models for clustered data: With an example from smoking prevention research. Journal of Consulting and Clinical Psychology. 1994;624:57–765.
    1. Hunter JE. The desperate need for replications. Journal of Consumer Research. 2001;28:149–158. doi: 10.1086/321953.
    1. Hutchings J, Bywater T, Daley D, Gardner F, Jones K, Eames C, Edwards RT. Pragmatic randomised controlled trial of a parenting intervention in ‘Sure Start’ services for children at risk of developing conduct disorder. British Medical Journal. 2007;334:678–686. doi: 10.1136/bmj.39126.620799.55.
    1. Imai K. Statistical analysis of randomized experiments with non-ignorable missing binary outcomes: An application to a voting experiment. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2009;58:83–104. doi: 10.1111/j.1467-9876.2008.00637.x.
    1. Imai, K., Tingley, D., & Yamamoto, T. (2012). Experimental designs for identifying causal mechanisms. Journal of the Royal Statistical Society A, 1–27.
    1. Ioannidis JA. Contradicted and initially stronger effects in highly cited clinical research. Journal of the American Medical Association. 2005;294:218–228. doi: 10.1001/jama.294.2.218.
    1. Ioannidis JPA. Why science is not necessarily self-correcting. Perspectives on Psychological Science. 2012;7:645–654. doi: 10.1177/1745691612464056.
    1. Kenny DA, Judd CM. Consequences of violating the independence assumption in analysis of variance. Psychological Bulletin. 1986;99:422–431. doi: 10.1037/0033-2909.99.3.422.
    1. Löfholm CA, Olsson T, Sundell K, Hansson K. Multisystemic therapy with conduct disordered young people: Stability of treatment outcomes two years after intake. Evidence & Policy. 2009;5:373–397. doi: 10.1332/174426409X478752.
    1. Ludwig J, Phillips DA. Long-term effects of head start on low-income children. Annals of the New York Academy of Sciences. 2008;1136:257–268. doi: 10.1196/annals.1425.005.
    1. MacKinnon DT. Introduction to statistical mediation analysis. New York: Taylor & Francis; 2008.
    1. Makel M, Plucker J, Hegarty B. Replications in psychology research: How often do they really occur? Perspectives on Psychological Science. 2012;7:537–542. doi: 10.1177/1745691612460688.
    1. Malti T, Ribeaud D, Eisner M. The effectiveness of two universal preventive interventions in reducing children’s externalizing behavior: A cluster randomized controlled trial. Journal of Clinical Child & Adolescent Psychology. 2011;40:677–692. doi: 10.1080/15374416.2011.597084.
    1. Mayo-Wilson E, Grant S, Hopewell S, Macdonald G, Moher D, Montgomery P. Developing a reporting guideline for social and psychological intervention trials. Trials. 2013;14:242. doi: 10.1186/1745-6215-14-242.
    1. Menting AT, de Castro BO, Matthys W. Effectiveness of the incredible years parent training to modify disruptive and prosocial child behavior: A meta-analytic review. Clinical Psychology Review. 2013;33:901–913. doi: 10.1016/j.cpr.2013.07.006.
    1. Montgomery P, Grant S, Hopewell S, Macdonald G, Moher D, Michie S, Mayo-Wilson E. Protocol for CONSORT-SPI: An extension for social and psychological interventions. Implementation Science. 2013;8:99. doi: 10.1186/1748-5908-8-99.
    1. Montgomery P, Underhill K, Gardner F, Operario D, Mayo-Wilson E. The Oxford implementation index: A new tool for incorporating implementation data into systematic reviews and meta-analyses. Journal of Clinical Epidemiology. 2013;66:874–882. doi: 10.1016/j.jclinepi.2013.03.006.
    1. Mrazek PG, Haggerty RJ, editors. Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington: National Academy Press; 1994.
    1. Murray DM. Design and analysis of group-randomized trials. New York: Oxford University Press; 1998.
    1. Muthen B, Asparouhov T, Hunter AM, Leichter AF. Growth modeling with nonignorable dropout: Alternative analyses of the STAR*D Antidepressant Trial. Psychological Methods. 2011;16:17–33. doi: 10.1037/a0022634.
    1. Nerlove M, Diebold F. Unit roots in economic time-series: A selective survey. In: Bewley T, editor. Advances in econometrics. New York: JAI; 1990.
    1. Nosek BA, Spies JR, Motyl M. Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science. 2012;7:615–631. doi: 10.1177/1745691612459058.
    1. Olds DL, Robinson J, Pettitt L, Luckey DW, Holmberg J, Ng RK, Isacks K, Sheff K, Henderson CR. Effects of home visits by paraprofessionals and by nurses: Age 4 follow-up results of a randomized trial. Pediatrics. 2004;114:1560–1568. doi: 10.1542/peds.2004-0961.
    1. Pashler H, Harris CR. Is the replicability crisis overblown? Three arguments examined. Perspectives in Psychological Science. 2012;7:531–536. doi: 10.1177/1745691612463401.
    1. Pashler H, Wagenmakers E. Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science. 2012;7:528–530. doi: 10.1177/1745691612465253.
    1. Perrino, T., Howe, G., Sperling, A., Beardslee, W., Sandler, I., Shern, D., Pantin, H., Kaupert, S., Cano, N., Cruden, G., Bandiera, F, & Brown, C. H. (2013). Advancing science through collaborative data sharing and synthesis. Perspectives in Psychological Science, Published Online (NIH Public Access). doi: 10.1177/1745691613491579.
    1. Petrosino A, Soydan H. The impact of program developers as evaluators on criminal recidivism: Results from meta-analyses of experimental and quasi-experimental research. Journal of Experimental Criminology. 2005;1:435–450. doi: 10.1007/s11292-005-3540-8.
    1. Puma, M., Bell, S., Cook, R., Heid, C., Broene, P., Jenkins, F., Mashburn, A., & Downer, J. (2012). Third grade follow-up to the Head Start Impact Study final report. (OPRE Report # 2012-45).Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
    1. Rabin BA, Brownson RC. Developing the terminology for dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: Translating science to practice. New York: Oxford University Press; 2012. pp. 23–51.
    1. Ringwalt CL, Clark HK, Hanley S, Shamblen SR, Flewelling RL. The effects of Project ALERT one year past curriculum completion. Prevention Science. 2010;11:172–184. doi: 10.1007/s11121-009-0163-8.
    1. Rohrbach LA, Grana R, Sussman S, Valente TW. Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions. 2006;29:302–333. doi: 10.1177/0163278706290408.
    1. Rohrbach LA, Sun P, Sussman S. One-year follow-up evaluation of the project Towards No Drug Abuse (TND) dissemination trial. Preventive Medicine. 2010;51:313–319. doi: 10.1016/j.ypmed.2010.07.016.
    1. Scariano SM, Davenport JM. The effects of violations of the independence assumption in the one-way ANOVA. The American Statistician. 1987;41:123–128.
    1. Schafer JL, Graham JW. Missing data: Our view of the state of the art. Psychological Methods. 2002;7:147–177. doi: 10.1037/1082-989X.7.2.147.
    1. Schirm A, Stuart E, McKie A. The quantum opportunity program demonstration: Final impacts. Princeton: Mathematica Policy Research, Inc; 2006.
    1. Schochet PZ. Guidelines for multiple testing in experimental evaluations of educational interventions. Princeton: Mathematica Policy Research, Inc; 2007.
    1. Schroeder, B. A., Messina, A., Schroeder, D., Good, K., Barto, S., Saylor, J., & Masiello, M. (2011). The implementation of a statewide bullying prevention program: Preliminary findings from the field and the importance of coalitions. Health Promotion Practice, Advance online publication. doi: 10.1177/1524839910386887
    1. Schulz KF, Altman DG, Moher D, for the CONSORT Group CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. The British Medical Journal. 2010;340:698–702. doi: 10.1136/bmj.c332.
    1. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin Company; 2002.
    1. Shadish WR, Clark MH, Steiner PM. Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assignments. Journal of the American Statistical Association. 2008;103:1334–1356. doi: 10.1198/016214508000000733.
    1. Shumaker SA, Legault C, Rapp SR, Thal L, Wallace RB, Ockene JK, Hendrix SL, Jones BN, Assaf AR, Jackson RD, Kotchen JM, Wassertheil-Smoller S, Wactawski-Wende J. Estrogen plus progestin and the incidence of dementia and mild cognitive impairment in post-menopausal women: The women’s health initiative memory study: A randomized controlled trial. Journal of the American Medical Association. 2003;289:2651–2662. doi: 10.1001/jama.289.20.2651.
    1. Social and Character Development Research Consortium . Efficacy of schoolwide programs to promote social and character development and reduce problem behavior in elementary school children (NCER 2011-2001) Washington: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education; 2010.
    1. Spoth RL, Greenberg MT. Impact challenges in community science-with-practice: Lessons from PROSPER on transformative practitioner–scientist partnerships and prevention infrastructure development. American Journal of Community Psychology. 2011;40:1178–1191.
    1. Spoth RL, Guyll M, Redmond C, Greenberg MT, Feinberg ME. Six-year sustainability of evidence-based intervention implementation quality by community–university partnerships: The PROSPER study. American Journal of Community Psychology. 2011;48:412–425. doi: 10.1007/s10464-011-9430-5.
    1. Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., Hawkins, J. D., & Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, Published Online (Open Access). doi: 10.1007/s11121-012-0362-6
    1. St. Clair, T. Cook, T. D. & Hallberg, K. (2014). Examining the internal validity and statistical precision of the comparative interrupted times series design by comparison with a randomized experiment. American Journal of Evaluation, 35, 311–327.
    1. Supplee LH, Kelly BC, MacKinnon DM, Yoches Barofsky M. Introduction to the special issue: Subgroup analysis in prevention and intervention research. Prevention Science. 2013;14:107–110. doi: 10.1007/s11121-012-0335-9.
    1. Trochim WMK. Research design for program evaluation: The regression-discontinuity approach. Newbury Park: Sage; 1984.
    1. Trochim W. The research methods knowledge base. 2. Cincinnati: Atomic Dog Publishing; 2000.
    1. Valentine JC, Biglan A, Boruch RF, González Castro F, Collins LM, Flay BR, Kellam S, Mościcki EK, Schinke SP. Replication in prevention science. Prevention Science. 2011;12:103–117. doi: 10.1007/s11121-011-0217-6.
    1. Wagenaar AC, Komro KA. Natural experiments: Research design elements for optimal causal inference without randomization. In: Wagenaar AC, Burris SC, editors. Public health law research: Theory and methods. Somerset: Wiley; 2013. pp. 307–324.
    1. Wagenaar AC, Webster DW. Preventing injuries to children through compulsory automobile safety seat use. [erratum appears in Pediatrics Jun;79(6):863] Pediatrics. 1986;78:662–672.
    1. Wing C, Cook TD. Strengthening the regression discontinuity design using additional design elements: A within-study comparison. Journal of Policy Analysis and Management. 2013;32:853–877. doi: 10.1002/pam.21721.
    1. Winokur Early K, Hand G, Blankenship J, Chapman S. Redirection continues to save money and reduce recidivism. Tallahassee: Justice Research Center; 2012.
    1. Wolchik SA, Sandler IN, Millsap RE, Plummer BA, Greene SM, Anderson ER, et al. Six-year follow-up of a randomized, controlled trial of preventive interventions for children of divorce. Journal of the American Medical Association. 2002;288:1–8. doi: 10.1001/jama.288.15.1.
    1. Zeger SL, Liang KY, Albert PS. Models for longitudinal data: A generalized estimating equation approach. Biometrics. 1988;44:1049–1060. doi: 10.2307/2531734.

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren