Study protocol for a group randomized controlled trial of a classroom-based intervention aimed at preventing early risk factors for drug abuse: integrating effectiveness and implementation research

Jeanne Poduska, Sheppard Kellam, C Hendricks Brown, Carla Ford, Amy Windham, Natalie Keegan, Wei Wang, Jeanne Poduska, Sheppard Kellam, C Hendricks Brown, Carla Ford, Amy Windham, Natalie Keegan, Wei Wang

Abstract

Background: While a number of preventive interventions delivered within schools have shown both short-term and long-term impact in epidemiologically based randomized field trials, programs are not often sustained with high-quality implementation over time. This study was designed to support two purposes. The first purpose was to test the effectiveness of a universal classroom-based intervention, the Whole Day First Grade Program (WD), aimed at two early antecedents to drug abuse and other problem behaviors, namely, aggressive, disruptive behavior and poor academic achievement. The second purpose--the focus of this paper--was to examine the utility of a multilevel structure to support high levels of implementation during the effectiveness trial, to sustain WD practices across additional years, and to train additional teachers in WD practices.

Methods: The WD intervention integrated three components, each previously tested separately: classroom behavior management; instruction, specifically reading; and family-classroom partnerships around behavior and learning. Teachers and students in 12 schools were randomly assigned to receive either the WD intervention or the standard first-grade program of the school system (SC). Three consecutive cohorts of first graders were randomized within schools to WD or SC classrooms and followed through the end of third grade to test the effectiveness of the WD intervention. Teacher practices were assessed over three years to examine the utility of the multilevel structure to support sustainability and scaling-up.

Discussion: The design employed in this trial appears to have considerable utility to provide data on WD effectiveness and to inform the field with regard to structures required to move evidence-based programs into practice.

Clinical trials registration number: NCT00257088.

Figures

Figure 1
Figure 1
WD Teachers Over Three Years. R = random assignment; WD = Whole Day First Grade Program classroom; SC = standard classroom (control); SY = school year.
Figure 2
Figure 2
Multilevel Structure of a School System.

References

    1. Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–256. doi: 10.1093/her/18.2.237.
    1. Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5:47–53. doi: 10.1023/B:PREV.0000013981.28071.52.
    1. Ringwalt CL, Ennett S, Johnson R, Rohrbach LA, Simons-Rudolph A, Vincus A, Thorne J. Factors associated with fidelity to substance use prevention curriculum guides in the nation's middle schools. Health Education and Behavior. 2003;30:375–391. doi: 10.1177/1090198103030003010.
    1. Brown CH. Statistical methods for preventive trials in mental health. Statistics in Medicine. 1993;12:289–300. doi: 10.1002/sim.4780120312.
    1. Dolan LJ, Kellam SG, Brown CH, Werthamer-Larsson L, Rebok GW, Mayer LS, Laudolf J, Turkkan JS, Ford C, Wheeler L. The short-term impact of two classroom-based preventive interventions on aggressive and shy behaviors and poor achievement. Journal of Applied Developmental Psychology. 1993;14:345. doi: 10.1016/0193-3973(93)90013-L.
    1. Kellam SG, Rebok GW, Ialongo N, Mayer LS. The course and malleability of aggressive behavior from early first grade into middle school: results of a developmental epidemiologically-based preventive trial. J Child Psychol Psychiatry. 1994;35:259–281. doi: 10.1111/j.1469-7610.1994.tb01161.x.
    1. Kellam SG, Rebok GW, Mayer LS, Ialongo N, Kalodner CR. Depressive symptoms over first grade and their response to a developmental epidemiologically based preventive trial aimed at improving achievement. Development and Psychopathology. 1994;6:463–481. doi: 10.1017/S0954579400006052.
    1. Kellam SG, Anthony JC. Targeting early antecedents to prevent tobacco smoking: findings from an epidemiologically based randomized field trial. Am J Public Health. 1998;88:1490–1495. doi: 10.2105/AJPH.88.10.1490.
    1. Kellam SG, Ling X, Merisca R, Brown CH, Ialongo N. The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Dev Psychopathol. 1998;10:165–185. doi: 10.1017/S0954579498001564.
    1. Ialongo NS, Poduska JM, Werthamer L, Kellam S. The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders. 2001;9:146–160. doi: 10.1177/106342660100900301.
    1. Kellam SG, Brown CH, Poduska JM, Ialongo NS, Wang W, Toyinbo P, Petras H, Ford C, Windham A, Wilcox HC. Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug Alcohol Depend. 2008;95:S5–S28. doi: 10.1016/j.drugalcdep.2008.01.004.
    1. Poduska JM, Kellam SG, Wang W, Brown CH, Ialongo NS, Toyinbo P. Impact of the Good Behavior Game, a universal classroom-based behavior intervention, on young adult service use for problems with emotions, behavior, or drugs or alcohol. Drug Alcohol Depend. 2008;95:S29–S44. doi: 10.1016/j.drugalcdep.2007.10.009.
    1. Petras H, Kellam SG, Brown CH, Muthen BO, Ialongo NS, Poduska JM. Developmental epidemiological courses leading to antisocial personality disorder and violent and criminal behavior: effects by young adulthood of a universal preventive intervention in first- and second-grade classrooms. Drug Alcohol Depend. 2008;95:S45–S59. doi: 10.1016/j.drugalcdep.2007.10.015.
    1. Wilcox HC, Kellam SG, Brown CH, Poduska JM, Ialongo NS, Wang W, Anthony JC. The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts. Drug Alcohol Depend. 2008;95:S60–S73. doi: 10.1016/j.drugalcdep.2008.01.005.
    1. Brown CH, Wang W, Kellam SG, Muthen BO, Petras H, Toyinbo P, Poduska J, Ialongo N, Wyman PA, Chamberlain P, Sloboda Z, MacKinnon DP, Windham A, Prevention Science and Methodology Group Methods for testing theory and evaluating impact in randomized field trials: intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug Alcohol Depend. 2008;95:S74–S104. doi: 10.1016/j.drugalcdep.2007.11.013.
    1. Ialongo NS, Werthamer L, Kellam SG, Brown CH, Wang S, Lin Y. Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and antisocial behavior. Am J Community Psychol. 1999;27:599–641. doi: 10.1023/A:1022137920532.
    1. Brown CH, Liao J. Principles for designing randomized preventive trials in mental health: an emerging developmental epidemiology paradigm. Am J Community Psychol. 1999;27:673–710. doi: 10.1023/A:1022142021441.
    1. Adelman HS, Taylor L. On sustainability of project innovations as systemic change. Journal of Educational and Psychological Consultation. 2003;14:1–25. doi: 10.1207/S1532768XJEPC1401_01.
    1. Coburn CE. Rethinking scale: Moving beyond numbers to deep and lasting change. Educational Researcher. 2003;32:3–12. doi: 10.3102/0013189X032006003.
    1. Datnow A, Castellano M. Teachers' responses to Success for All: how beliefs, experiences, and adaptations shape implementation. American Educational Research. 2000;37:775–799.
    1. Elias MJ, Zins JE, Graczyk PA, Weissberg RP. Implementation, sustainability, and scaling up of social-emotional and academic innovations in public schools. School Psychology Review. 2003;32:303–319.
    1. Fagan AA, Mihalic S. Strategies for enhancing the adoption of school-based prevention programs: lessons learned from the Blueprints for Violence Prevention replications of The Life Skills Training Program. Journal of Community Psychology. 2003;31:235–253. doi: 10.1002/jcop.10045.
    1. Gottfredson Associates Inc National Study of Delinquency in Schools (Final Report, Grant No 96-MU-MU-008), Ellicott City, MD. 2000.
    1. Gottfredson DC. Schools and Delinquency. New York: Cambridge University Press; 2001.
    1. Gottfredson DC. Preventing Crime: What Works, What Doesn't, What's Promising: A Report to the United States Congress. Washington, DC: U.S. Department of Justice, Office of Justice Programs; 1997. School-based crime prevention.
    1. Payne AA, Gottfredson DC, Gottfredson GD. School predictors of the intensity of implementation of school-based prevention programs: results from a national study. Prev Sci. 2006;7:225–237. doi: 10.1007/s11121-006-0029-2.
    1. Hallfors D, Godette D. Will the 'principles of effectiveness' improve prevention practice? early findings from a diffusion study. Health Educ Res. 2002;17:461–470. doi: 10.1093/her/17.4.461.
    1. McLaughlin MW. The Rand change agent study revisited: macro perspectives and micro realities. Educational Researcher. 1990;19:11–16.
    1. Mihalic S, Ballard D, Michalski A, Tororice J, Cunningham L, Argamaso S. Blueprints for Violence Prevention, Violence Initiative: Final Process Evaluation Report. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado; 2002.
    1. Garet M, Porter A, Desimone L, Birman B, Yoon KS. What makes professional development effective? results from a national sample of teachers. American Educational Research. 2001;38:915–945. doi: 10.3102/00028312038004915.
    1. Lieberman A. Practices that support teacher development: transforming conceptions of professional learning. In: McLaughlin MW, Oberman I, editor. Teacher Learning: New Policies, New Practices. New York: Teachers College Press; 1996. pp. 185–201.
    1. Loucks-Horsley S, Hewson PW, Love N, Stiles KE. Designing Professional Development for Teachers of Science and Mathematics. Thousand Oaks, CA: Corwin Press; 1998.
    1. Cohen DK, Hill HC. Instructional policy and classroom performance: the mathematics reform in California. Teachers College Record. 2000;102:294–343. doi: 10.1111/0161-4681.00057.
    1. Lieberman A, McLaughlin MW. Networks for educational change: powerful and problematic. Phi Delta Kappan. 1992;73:673–677.
    1. Grant SG, Peterson PL, Shojgreen-Downer A. Learning to teach mathematics in the context of systemic reform. American Educational Research. 1996;33:502–541.
    1. Hargreaves A, Fullan MG. Understanding Teacher Development. London: Cassell; 1992.
    1. Little JW. Teachers' professional development in a climate of educational reform. Educational Revaluation and Policy Analysis. 1993;15:129–151.
    1. Stiles KE, Loucks-Horsley S, Hewson PW. Principles of Effective Professional Development for Mathematics and Science Education: A Synthesis of Standards (NISE Brief) Vol. 1. Madison, WI: National Institutes for Science Education; 1996.
    1. Ball DL. Teacher learning and the mathematics reforms: what we think we know and what we need to learn. Phi Delta Kappan. 1996;77:500–508.
    1. Knapp MS. Between systemic reforms and the mathematics and science classroom: the dynamics of innovation, implementation, and professional learning. Review of Educational Research. 1997;67:227–266.
    1. Talbert JE, McLaughlin MW. Understanding teaching in context. In: Cohen DK, McLaughlin MW, Talbert JE, editor. Teaching for Understanding: Challenges for Policy and Practice. San Francisco: Jossey-Bass; 1993. pp. 167–206.
    1. Elmore RF. Doing the Right Thing, Knowing the Right Thing to Do: Low-Performing Schools and Performance-Based Accountability. National Governors Association Policy Education Advisors Institute. Los Angeles, CA; 2003.
    1. Bowers DG. Systems of Organization: Management of the Human Resource. Ann Arbor: University of Michigan Press; 1976.
    1. Likert R. New Patterns of Management. New York: McGraw-Hill Book Company; 1961.
    1. Seashore LK, Marks H. Does professional community affect the classroom? teachers' work and student experiences in restructuring schools. American Journal of Education. 1998;106:532–575. doi: 10.1086/444197.
    1. Resnick LB, Glennan TK., Jr . Leadership for learning: a theory of action for urban school districts. In: Hightower AT, Knapp MS, Marsh JA, McLaughlin MW, editor. School Districts and Instructional Renewal. New York: Teachers College Press; 2002. pp. 160–172.
    1. Resnick LB, Hall MW. Learning organizations for sustainable education reform. Journal of the American Academy of Arts and Sciences. 1998;127:89–118.
    1. Spouse J. Bridging theory and practice in the supervisory relationship: a sociocultural perspective. J Adv Nurs. 2001;33:512–522. doi: 10.1046/j.1365-2648.2001.01683.x.
    1. Sweeney D. Learning the Way: Professional Development by and for Teachers. Portland: Stenhouse; 2003.
    1. Joyce B, Showers B. Student Achievement Through Staff Development. 3. Alexandria, VA: Association for Supervision and Curriculum Development; 2002.
    1. McCormick KM, Brennan S. Mentoring the new professional in interdisciplinary early childhood education: the Kentucky Internship Program. Topics in Early Childhood Special Education. 2001:131–144. doi: 10.1001/jama.273.14.1106.
    1. Botvin GJ, Baker E, Dusenbury L, Botvin EM, Diaz T. Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA. 1995;273:1106–1112. doi: 10.1001/jama.273.14.1106.
    1. Derzon JH, Sale E, Springer JF, Brounstein P. Estimating intervention effectiveness: synthetic projection of field evaluation results. J Prim Prev. 2005;26:321–343. doi: 10.1007/s10935-005-5391-5.
    1. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45. doi: 10.1177/0193841X9001400303.
    1. Pentz MA, Trebow EA, Hansen WB, McKinnon DP. Effects of program implementation on adolescent drug use behavior. Evaluation Review. 1990;14:264–289. doi: 10.1177/0193841X9001400303.
    1. Rohrbach LA, Graham JW, Hansen WB. Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993;22:237–260. doi: 10.1006/pmed.1993.1020.
    1. Tobler NS. Meta-analysis of 143 adolescent drug prevention programs: quantitative outcome results of program participants compared to a control or comparison group. Journal of Drug Issues. 1986;16:537–567.
    1. Tortu S, Botvin GJ. School-based smoking prevention: the teacher training process. Prev Med. 1989;18:280–289. doi: 10.1016/0091-7435(89)90075-3.
    1. Durlak JA. Why program implementation is important. Journal of Prevention and Intervention in the Community. 1998;17:5–18. doi: 10.1300/J005v17n02_02.
    1. Foorman BR, Schatschneider C. Measuring teaching practice during reading/language arts instruction and its relation to student achievement. In: Vaughn S, Briggs KL, editor. Systems for Observing Teaching and Learning. Baltimore: Brooks Publishing; 2003. pp. 1–30.
    1. Muthen B, Curran P. General longitudinal modeling of individual differences in experimental designs: a latent variable framework for analysis and power estimation. Psychological Methods. 1997;2:371–402. doi: 10.1037/1082-989X.2.4.371.
    1. Muthen LK, Muthen BO. Mplus User's Guide Fifth edition 1998-2007. Los Angeles, CA: Muthen & Muthen; 2007.
    1. Curran PJ, Muthen BO. The application of latent curve analysis to testing developmental theories in intervention research. Am J Community Psychol. 1999;27:567–595. doi: 10.1023/A:1022137429115.
    1. Muthen B, Brown CH, Masyn K, Jo B, Khoo ST, Yang CC, Wang CP, Kellam SG, Carlin JB, Liao J. General growth mixture modeling for randomized preventive interventions. Biostatistics. 2002;3:459–475. doi: 10.1093/biostatistics/3.4.459.
    1. Muthen B, Shedden K. Finite mixture modeling with mixture outcomes using the EM algorithm. Biometrics. 1999;55:463–469. doi: 10.1111/j.0006-341X.1999.00463.x.
    1. Muthen B, Masyn K. Discrete-time survival mixture analysis. Journal of Educational and Behavioral Statistics. 2005;30:27–58. doi: 10.3102/10769986030001027.
    1. Nylund KL, Asparouhov T, Muthen BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Structural Equation Modeling. 2007;14:535–569.
    1. Wang CP, Brown CH, Bandeen-Roche K. Residual diagnostics for growth mixture models: examining the impact of a preventive intervention on multiple trajectories of aggressive behavior. Journal of the American Statistical Association. 2005;100:1054–1076. doi: 10.1198/016214505000000501.
    1. Carlin JB, Wolfe R, Brown CH, Gelman A. A case study on the choice, interpretation and checking of multilevel models for longitudinal binary outcomes. Biostatistics. 2001;2:397–416. doi: 10.1093/biostatistics/2.4.397.
    1. Brown CH, Indurkhya A, Kellam SG. Power calculations for data missing by design: applications to a follow-up study of lead exposure and attention. Journal of the American Statistical Association. 2000;95:383–395. doi: 10.2307/2669375.

Source: PubMed

Sponsor e collaboratori

Condizioni mediche

Interventi farmacologici

3
Sottoscrivi