Engendering healthy masculinities to prevent sexual violence: Rationale for and design of the Manhood 2.0 trial

Kaleab Z Abebe, Kelley A Jones, Alison J Culyba, Nayck B Feliz, Heather Anderson, Irving Torres, Sarah Zelazny, Patricia Bamwine, Adwoa Boateng, Benjamin Cirba, Autumn Detchon, Danielle Devine, Zoe Feinstein, Justin Macak, Michael Massof, Summer Miller-Walfish, Sarah Elizabeth Morrow, Paul Mulbah, Zabi Mulwa, Taylor Paglisotti, Lisa Ripper, Katie A Ports, Jennifer L Matjasko, Aapta Garg, Jane Kato-Wallace, Julie Pulerwitz, Elizabeth Miller, Kaleab Z Abebe, Kelley A Jones, Alison J Culyba, Nayck B Feliz, Heather Anderson, Irving Torres, Sarah Zelazny, Patricia Bamwine, Adwoa Boateng, Benjamin Cirba, Autumn Detchon, Danielle Devine, Zoe Feinstein, Justin Macak, Michael Massof, Summer Miller-Walfish, Sarah Elizabeth Morrow, Paul Mulbah, Zabi Mulwa, Taylor Paglisotti, Lisa Ripper, Katie A Ports, Jennifer L Matjasko, Aapta Garg, Jane Kato-Wallace, Julie Pulerwitz, Elizabeth Miller

Abstract

Violence against women and girls is an important global health concern. Numerous health organizations highlight engaging men and boys in preventing violence against women as a potentially impactful public health prevention strategy. Adapted from an international setting for use in the US, "Manhood 2.0" is a "gender transformative" program that involves challenging harmful gender and sexuality norms that foster violence against women while promoting bystander intervention (i.e., giving boys skills to interrupt abusive behaviors they witness among peers) to reduce the perpetration of sexual violence (SV) and adolescent relationship abuse (ARA). Manhood 2.0 is being rigorously evaluated in a community-based cluster-randomized trial in 21 lower resource Pittsburgh neighborhoods with 866 adolescent males ages 13-19. The comparison intervention is a job readiness training program which focuses on the skills needed to prepare youth for entering the workforce, including goal setting, accountability, resume building, and interview preparation. This study will provide urgently needed information about the effectiveness of a gender transformative program, which combines healthy sexuality education, gender norms change, and bystander skills to interrupt peers' disrespectful and harmful behaviors to reduce SV/ARA perpetration among adolescent males. In this manuscript, we outline the rationale for and evaluation design of Manhood 2.0. Clinical Trials #: NCT02427061.

Keywords: Adolescent health; Adolescent relationship abuse; Gender violence; Sexual harassment; Sexual violence; Teen dating violence.

Conflict of interest statement

Conflict of interest

The authors have nothing to disclose.

Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Figures

Fig. 1.
Fig. 1.
Conceptual model for Program H.
Fig. 2.
Fig. 2.
Manhood 2.0: engendering healthy masculinities – study flow.
Fig. 3.
Fig. 3.
CONSORT diagram.

References

    1. World Health Organization, Prevalence and Health Effects of Intimate Partner Violence and Non-partner Sexual Violence, Italy: (2013).
    1. Black MC, Basile K, Breiding M, Smith S, Walters M, Merrick M, Chen J, Stevens M, The National Intimate Partner and Sexual Violence Survey (NISVS): 2010 Summary Report, National Center for Injury Prevention and Control Centers for Disease Control and Prevention, Atlanta, GA, 2011.
    1. Dick RN, McCauley HL, Jones KA, Tancredi DJ, Goldstein S, Blackburn S, Monasterio E, James L, Silverman JG, Miller E, Cyber dating abuse among teens using school-based health centers, Pediatrics 134 (6) (2014) e1560–e1567.
    1. Silverman JG, Raj A, Mucci LA, Hathaway JE, Dating violence against adolescent girls and associated substance use, unhealthy weight control, sexual risk behavior, pregnancy, and suicidality, JAMA 286 (5) (2001) 572–579.
    1. Ackard DM, Neumark-Sztainer D, Hannan P, Dating violence among a nationally representative sample of adolescent girls and boys: associations with behavioral and mental health, J. Gend. Specif. Med 6 (3) (2003) 39–48.
    1. Amar AF, Gennaro S, Dating violence in college women - associated physical injury, healthcare usage, and mental health symptoms, Nurs. Res 54 (4) (2005) 235–242.
    1. Ramisetty-Mikler S, Goebert D, Nishimura S, Caetano R, Dating violence victimization: associated drinking and sexual risk behaviors of Asian, Native Hawaiian, and Caucasian high school students in Hawaii, J. Sch. Health. 76 (8) (2006) 423–429.
    1. Howard D, Wang M, Yan F, Psychosocial factors associated with reports of physical dating violence among U.S. adolescent females, Adolescence 42 (166) (2007) 311–324.
    1. Champion H, Wagoner K, Song E, Brown V, Wolfson M, Adolescent date fighting victimization and perpetration from a multi-community sample: associations with substance use and other violent victimization and perpetration, Int. J. Adolesc. Med. Health 20 (4) (2008) 419–429.
    1. Basile KC, Smith SG, Sexual violence victimization of women: prevalence, characteristics, and the role of public health and prevention, Am. J. Lifestyle Med 5 (5) (2011) 407–417.
    1. Exner-Cortens D, Eckenrode J, Rothman E, Longitudinal associations between teen dating violence victimization and adverse health outcomes, Pediatrics 131 (1) (2013) 71–78.
    1. Foshee V, Reyes H, Gottfredson N, Chang L, Ennett S, A longitudinal examination of psychological, behavioral, academic, and relationship consequences of dating abuse victimization among a primarily rural sample of adolescents, J. Adolesc. Health 53 (6) (2013) 723–729.
    1. Decker MR, Peitzmeier S, Olumide A, Acharya R, Ojengbede O, Covarrubias L, Gao E, Cheng Y, Delany-Moretlwe S, Brahmbhatt H, Prevalence and health impact of intimate partner violence and non-partner sexual violence among female adolescents aged 15–19 years in vulnerable urban environments: a multi-country study, J. Adolesc. Health 55 (6, Supplement) (2014) S58–S67.
    1. Tharp AT, DeGue S, Valle LA, Brookmeyer KA, Massetti GM, Matjasko JL, A systematic qualitative review of risk and protective factors for sexual violence perpetration, Trauma Violence Abuse 14 (2) (2012) 133–167.
    1. Wekerle C, Wolfe DA, The role of child maltreatment and attachment style in adolescent relationship violence, Dev. Psychopathol 10 (1998) 571–586.
    1. Foshee VA, Linder F, MacDougall JE, Bangdiwala S, Gender differences in the longitudinal predictors of adolescent dating violence, Prev. Med 32 (2) (2001) 128–141.
    1. Cleveland H, Herrera V, Stuewig J, Abusive males and abused females in adolescent relationships: risk factor similarity and dissimilarity and the role of relationship seriousness, J. Fam. Violence 18 (6) (2003) 325–339.
    1. Abbey A, McAuslan P, Longitudinal examination of male college students perpetration of sexual assault, J. Consult. Clin. Psychol 72 (5) (2004) 747–756.
    1. Degue S, DiLillo D, Understanding perpetrators of nonphysical sexual coercion: characteristics of those who cross the line, Violence Vict. 19 (4) (2004) 673–688.
    1. Foshee VA, Bauman KE, Ennett ST, Linder GF, Benefield T, Suchindran C, Assessing the long-term effects of the Safe Dates program and a booster in preventing and reducing adolescent dating violence victimization and perpetration, Am. J. Public Health 94 (4) (2004) 619–624.
    1. Foshee VA, Benefield TS, Ennett ST, Bauman KE, Suchindran C, Longitudinal predictors of serious physical and sexual dating violence victimization during adolescence, Prev. Med 39 (5) (2004) 1007–1016.
    1. Santana MC, Raj A, Decker MR, La Marche A, Silverman JG, Masculine gender roles associated with increased sexual risk and intimate partner violence perpetration among young adult men, J. Urban Health 83 (4) (2006) 575–585.
    1. Hines DA, Predictors of sexual coercion against women and men: a multilevel, multinational study of university students, Arch. Sex. Behav 36 (3) (2007) 403–422.
    1. Warkentin J, Gidycz C, The use and acceptance of sexually aggressive tactics in college men, J. Interpers. Violence 22 (7) (2007) 829–850.
    1. Reed E, Intimate partner violence: a gender-based issue? Am. J. Public Health 98 (2) (2008) 197–198.
    1. McMahon S, Rape myth beliefs and bystander attitudes among incoming college students, J. Am. Coll. Heal. 59 (1) (2010) 3–11.
    1. McCauley HL, Jaime MC, Tancredi DJ, Silverman JG, Decker MR, Austin SB, Jones K, Miller E, Differences in adolescent relationship abuse perpetration and gender-inequitable attitudes by sport among male high school athletes, J. Adolesc. Health 54 (6) (2014. June) 742–744, 10.1016/j.jadohealth.2014.01.001 (Epub 2014 Feb 28).
    1. Courtenay WH, Constructions of masculinity and their influence on men’s well-being: a theory of gender and health, Soc. Sci. Med 50 (10) (2000) 1385–1401.
    1. Barker G, Ricardo C, Nascimento M, Engaging Men and Boys in Changing Gender-Based Inequity in Health: Evidence from Programme Interventions, World Health Organization, Geneva, Switzerland, 2007.
    1. Jewkes R, Sikweyiya Y, Morrell R, Dunkle K, Gender inequitable masculinity and sexual entitlement in rape perpetration South Africa: findings of a cross-sectional study, PLoS One 6 (12) (2011).
    1. Pulerwitz J, Michaelis A, Verma R, Weiss E, Addressing gender dynamics and engaging men in HIV programs: lessons learned from Horizons research, Public Health Rep 125 (2) (2010) 282–292 Washington, DC: 1974.
    1. Jewkes R, Nduna M, Levin J, Jama N, Dunkle K, Puren A, Duwury N, Impact of Stepping Stones on incidence of HIV and HSV-2 and sexual behaviour in rural South Africa: cluster randomised controlled trial, Br. Med. J 337 (7666) (2008).
    1. Miller E, Heisterkamp A, Moideen F, “Coaching boys into men”: training coaches to influence young male athletes to prevent violence Against women and girls, Poster Presented at American Public Health Association San Diego, CA, 2008.
    1. Jewkes R, Dunkle K, Nduna M, Shai N, Intimate partner violence, relationship power inequity, and incidence of HIV infection in young women in South Africa: a cohort study, Lancet 376 (9734) (2010) 41–48.
    1. Jewkes R, Wood K, Duwury N, I woke up after I joined stepping Stones’: meanings of an HIV behavioural intervention in rural south African young people’s lives, Health Educ. Res 25 (6) (2010) 1074–1084.
    1. United Nations Population Fund (UNFPA), Promundo, Engaging Men and Boys in Gender Equality and Health, New York, 2010, p. 98.
    1. Miller E, Tancredi DJ, McCauley HL, Decker MR, Virata MC, Anderson HA, Stetkevich N, Brown EW, Moideen F, Silverman JG, “Coaching boys into men”: a cluster-randomized controlled trial of a dating violence prevention program, J. Adolesc. Health 51 (5) (2012) 431–438.
    1. Pulerwitz J, Hughes L, Mehta M, Kidanu A, Verani F, Tewolde S, Changing gender norms and reducing intimate partner violence: results from a quasi-experimental intervention study with young men in Ethiopia, Am. J. Public Health 105 (1) (2015) 132–137.
    1. Pulerwitz J, Hui W, Arney J, Scott LM, Changing gender norms and reducing HIV and violence risk among workers and students in China, J. Health Commun. 20 (8) (2015) 869–878.
    1. Espelage DL, Bosworth K, Simon TR, Examining the social context of bullying behaviors in early adolescence, J. Couns. Dev 78 (3) (2000) 326–333.
    1. Espelage DL, Bosworth K, Simon TR, Short-term stability and prospective correlates of bullying in middle-school students: an examination of potential demographic, psychosocial and environmental influences, Violence Vict. 16 (4) (2001) 411–426.
    1. Berkowitz A, Fostering men’s responsibility for preventing sexual assault, in: Schewe P (Ed.), Preventing Violence in Relationships: Interventions Across the Life Span, American Psychological Association, Washington, DC, 2002.
    1. Verma R, Pulerwitz J, Mahendra V, Khandekar S, Barker G, Fulpagare P, Singh SK, Challenging and changing gender attitudes among young men in Mumbai, India, Reprod. Health Matters 14 (28) (2006) 135–143.
    1. Espelage DL, Aragon SR, Birkett M, Koenig B, Homophobic teasing, psychological outcomes, and sexual orientation among high school students: what influence do parents and schools have? Sch. Psychol. Rev 37 (2) (2008) 202–216.
    1. Reed E, Silverman JG, Raj A, Rothman EF, Decker MR, Gottlieb B, Molnar BE, Miller E, Social and environmental contexts of adolescent and young adult perpetrators of intimate partner violence, Am. J. Mens Health 2 (2008) 260–272.
    1. McMahon S, Postmus JL, Koenick RA, Conceptualizing the engaging bystander approach to sexual violence prevention on college campuses, J. Coll. Stud. Dev 52 (1) (2011) 115–130.
    1. Reed E, Silverman JG, Raj A, Decker MR, Miller E, Male perpetration of teen dating violence: associations with neighborhood violence involvement, gender attitudes, and perceived peer and neighborhood norms, J. Urban Health 88 (2) (2011) 226–239.
    1. Banyard VL, Plante EG, Moynihan MM, Bystander education: bringing a broader community perspective to sexual violence prevention, J. Community Psychol 32 (1) (2004) 61–79.
    1. Foubert JD, Perry BC, Creating lasting attitude and behavior change in fraternity members and male student athletes—the qualitative impact of an empathy-based rape prevention program, Violence Against Women 13 (1) (2007) 70–86.
    1. Tulloch T, Kaufman M, Adolescent sexuality, Pediatr. Rev 34 (1) (2013) 29–37 (quiz 38).
    1. Marques M, Ressa N, The sexuality education initiative: a programme involving teenagers, schools, parents and sexual health services in Los Angeles, CA, USA, Reprod. Health Matters 21 (41) (2013) 124–135.
    1. Kimmel A, Williams TT, Veinot TC, Campbell B, Campbell TR, Valacak M, Kruger DJ, ‘I make sure I am safe and I make sure I have myself in every way possible’: African-American youth perspectives on sexuality education, Sex Educ 13 (2) (2013) 172–185.
    1. Haberland NA, The case for addressing gender and power in sexuality and HIV education: a comprehensive review of evaluation studies, Int. Perspect. Sex. Reprod. Health 41 (1) (2015) 31–42.
    1. Pulerwitz J, Martin S, Mehta M, Castillo T, Kidanu A, Verani F, Tewolde S, Promoting Gender Equity for HIV and Violence Prevention: Results from the PEPFAR Male Norms Initiative Evaluation in Ethiopia, PATH, Washington, DC, 2010.
    1. Kim JC, Watts CH, Hargreaves JR, Ndhlovu LX, Phetla G, Morison LA, Busza J, Porter JD, Pronyk P, Understanding the impact of a micro finance-based intervention on women’s empowerment and the reduction of intimate partner violence in South Africa, Am. J. Public Health 97 (10) (2007) 1794–1802.
    1. Basile KC, DeGue S, Jones K, Freire K, Dills J, Smith SG, Raiford JL, STOP SV: A Technical Package to Prevent Sexual Violence, (2016).
    1. Basile KC, A Comprehensive Approach to Sexual Violence Prevention, Mass Medical Soc, 2015.
    1. DeGue S, Valle LA, Holt MK, Massetti GM, Matjasko JL, Tharp AT, A systematic review of primary prevention strategies for sexual violence perpetration, Aggress. Violent Behav 19 (4) (2014) 346–362.
    1. Harvey A, Garcia-Moreno C, Butchart A, Primary Prevention of Intimate-Partner Violence and Sexual Violence: Background Paper for WHO Expert Meeting May 2-3, 2007, World Health Organization, Department of Violence and Injuy Prevention and Disability, Geneva, 2007.
    1. Fabiano PM, Perkins HW, Berkowitz A, Linkenbach J, Stark C, Engaging men as social justice allies in ending violence against women: evidence for a social norms approach, J. Am. Coll. Heal 52 (3) (2003) 105–112.
    1. Heise LL, Violence against women: an integrated, ecological framework, Violence Against Women 4 (3) (1998) 262–290.
    1. Tharp AT, Carter M, Fasula AM, Hatfield-Timajchy K, Jayne PE, Latzman NE, Kinsey J, Advancing adolescent sexual and reproductive health by promoting healthy relationships, J. Women’s Health 22 (11) (2013) 911–914.
    1. Trenholm C, Devaney B, Fortson K, Quay L, Wheeler J, Clark M, Impacts of Four Title V, Section 510 Abstinence Education Programs, Mathematica Policy Research, Inc, Princeton, NJ, 2007.
    1. Taylor BG, Stein ND, Mumford EA, Woods D, Shifting boundaries: an experimental evaluation of a dating violence prevention program in middle schools, Prev. Sci 14 (1) (2013) 64–76.
    1. Wolfe DA, Crooks C, Jaffe P, Chiodo D, Hughes R, Ellis W, Stitt L, Donner A, A school-based program to prevent adolescent dating violence a cluster randomized trial, Arch. Pediatr. Adolesc. Med 163 (8) (2009) 692–699.
    1. Foshee VA, Bauman KE, Arriaga XB, Helms RW, Koch GG, Linder GF, An evaluation of Safe Dates, an adolescent dating violence prevention program, Am. J. Public Health 88 (1) (1998) 45–50.
    1. Nation M, Crusto C, Wandersman A, Kumpfer KL, Seybolt D, Morrissey-Kane E, Davino K, What works in prevention: principles of effective prevention programs, Am. Psychol 58 (6-7) (2003) 449–456.
    1. Pennsylvania Department of Health Division of Health Informatics, Resident Live Births by Age and Race of Mother by Year of Birth; Counties and Pennsylvania, 2011-2015, (Accessed 11/15/2017 2017).
    1. Centers for Disease Control and Prevention, Sexually transmitted disease surveillance 2016, Atlanta: (2017).
    1. Allegheny County Health Department, Allegheny County Health Department STD/HIV Program 2014 Annual STD Report, (Pittsburgh, PA: ).
    1. Friedman D, Coben J, Allegheny County injury surveillance system (ACISS) firearm injuries and fatalities 2000, Department of Emergency Medicine, Center for Violence and Injury Control, Allegheny General Hospital, Pittsburgh, PA, 2001.
    1. O.O.V.P. Allegheny County Health Department, Allegheny County Health Department, New Page Template, , (2017) Accessed 11/9/2017 2017.
    1. Miller E, Levenson R, Herrera L, Kurek L, Stofflet M, Marin L, Exposure to partner, family, and community violence: gang-affiliated Latina women and risk of unintended pregnancy, J. Urban Health 89 (1) (2012) 74–86.
    1. Jewkes R, Sen P, Garcia-Moreno C, Sexual violence, in: Krug E, Dahlberg LL, Mercy JA, et al. (Eds.), World Report on Violence and Health, World Health Organization, Geneva, Switzerland, 2002, pp. 213–239.
    1. Decker M, Miller E, McCauley HL, Tancredi D, Levenson R, Waldman J, Schoenwald P, Silverman J, Sex trade among young women attending family planning clinics in Northern California, Int. J. Gynecol. Obstet 117 (2) (2012. May) 173–177, 10.1016/j.ijgo.2011.12.019 (Epub 2012 Feb 21).
    1. Greco D, Dawgert S, Poverty and Sexual Violence: Building Prevention and Intervention Responses, Pennsylvania Coalition Against Rape (PCAR), (2007).
    1. Miller E, Tancredi DJ, McCauley HL, Decker MR, Virata MC, Anderson HA, O’Connor B, Silverman JG, One-year follow-up of a coach-delivered dating violence prevention program: a cluster randomized controlled trial, Am. J. Prev. Med 45 (1) (2013) 108–112.
    1. National Research Council and Institute of Medicine, Community Programs to Promote Youth Development, National Academy Press, Washington, DC, 2002.
    1. Tancredi DJ, Silverman JG, Decker MR, McCauley HL, Anderson HA, Jones KA, Ciaravino S, Hicks A, Raible C, Zelazny S, James L, Miller E, Cluster randomized controlled trial protocol: addressing reproductive coercion in health settings (ARCHES). BMC Womens Health 15 (2015) 57.
    1. Dartnall E, Jewkes R, Sexual violence against women: the scope of the problem, Best Pract. Res. Clin. Obstet. Gynaecol 27 (1) (2013) 3–13.
    1. Koss M, Gidycz C, Sexual experiences survey: reliability and validity, J. Consult. Clin. Psychol 53 (423) (1985) 422–423.
    1. AAUW Educational Foundation Sexual Harassment Task Force, Harassment-Free Hallways: How to Stop Sexual Harassment in Schools, (2001).
    1. Espelage DL, Holt MK, Dating violence & sexual harassment across the bully-victim continuum among middle and high school students, J. Youth Adolesc 36 (6) (2006) 799–811.
    1. Ybarra ML, Espelage DL, Mitchell KJ, The co-occurrence of internet harassment and unwanted sexual solicitation victimization and perpetration: associations with psychosocial indicators, J. Adolesc. Health 41 (6 Suppl 1) (2007) S31–S41.
    1. Bennett DC, Guran EL, Ramos MC, Margolin G, College students’ electronic victimization in friendships and dating relationships: anticipated distress and associations with risky behaviors, Violence Vict. 26 (4) (2011) 410–429.
    1. Brafford LJ, Beck KH, Development and validation of a condom self-efficacy scale for college students, J. Am. Coll. Heal 39 (5) (1991) 219–225.
    1. Cabral RJ, Galavotti C, Stark MJ, Gargiullo PM, Semaan S, Adams J, Green BM, Psychosocial factors associated with stage of change for contraceptive use among women at increased risk for HIV and STDs, J. Appl. Soc. Psychol 34 (5) (2004) 959–983.
    1. Aalsma MC, Carpentier MY, Azzouz F, Fortenberry JD, Longitudinal effects of health-harming and health-protective behaviors within adolescent romantic dyads, Soc. Sci. Med 74 (9) (2012) 1444–1451.
    1. Borrero S, Farkas A, Dehlendorf C, Rocca CH, Racial and ethnic differences in men’s knowledge and attitudes about contraception, Contraception 88 (4) (2013) 532–538.
    1. Carvajal DN, Ghazarian SR, Shea Crowne S, Bohrer Brown P, Carter Pokras O, Duggan AK, Barnet B, Is depression associated with contraceptive motivations, intentions, and use among a sample of low-income Latinas? Womens Health Issues 24 (1) (2014) e105–e113.
    1. Rothman EF, Decker MR, Silverman JG, Evaluation of a teen dating violence social marketing campaign: lessons learned when the null hypothesis was accepted, N. Dir. Eval 2006 (110) (2006) 33–44.
    1. Pulerwitz J, Barker G, Measuring attitudes toward gender norms among young men in Brazil: development and psychometric evaluation of the GEM scale, Men Masculinities 10 (3) (2008) 322–338.
    1. Chu JY, Porche MV, Tolman DL, The adolescent masculinity ideology in relationships scale: development and validation of a new measure for boys, Men Masculinities 8 (1) (2005) 93–115.
    1. Hemming K, Girling AJ, Sitch AJ, Marsh J, Lilford RJ, Sample size calculations for cluster randomised controlled trials with a fixed number of clusters, BMC Med. Res. Methodol 11 (2011) 102.
    1. Miller E, Tancredi DJ, McCauley HL, Decker MR, Virata MCD, Anderson HA, O’Connor B, Silverman JG, One-year follow-up of a coach-delivered dating violence prevention program: a cluster randomized controlled trial, Am. J. Prev. Med 45 (1) (2013) 108–112.
    1. Ripper L, Ciaravino S, Jones K, Jaime MCD, Miller E, Use of a respondentgenerated personal code for matching anonymous adolescent surveys in longitudinal studies, J. Adolesc. Health 60 (6) (2017) 751–753.
    1. Krumpal I, Determinants of social desirability bias in sensitive surveys: a literature review, Qual. Quant 47 (4) (2013) 2025–2047.
    1. Whelan TJ, Anonymity and confidentiality: Do survey respondents know the difference, Poster Presented at the 30th Annual Meeting of the Society of Southeastern Social Psychologists, Durham, NC, 2007.
    1. Joinson AN, Woodley A, Reips U-D, Personalization, authentication and self-disclosure in self-administered Internet surveys, Comput. Hum. Behav 23 (1) (2007) 275–285.
    1. Proper K, Twisk J, Is analysis of covariance the most appropriate way to analyse changes in randomized controlled trials? J. Clin. Epidemiol 58 (2) (2005) 211–212.
    1. Miller E, Goldstein S, McCauley HL, Jones KA, Dick RN, Jetton J, Silverman J, Blackburn S, James L, Tancredi DJ, School Health Center Healthy Adolescent Relationships Program (SHARP): A Cluster Randomized Controlled Trial, (2014).
    1. Kraemer H, Kiernan M, Essex M, Kupfer D, How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches, Health Psychol 27 (2 Suppl) (2008) S101–S108.
    1. A+ Schools, 2017 Report to the Community Report to the Community, A + Schools, Pittsburgh, PA, 2017.
    1. U.S. News, Pittsburgh SD Public Schools | Pennsylvania|Best High Schools, , (2017) Accessed 11/2/2017 2017.

Source: PubMed

3
Tilaa