Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) through non-specialist providers and telemedicine: a study protocol for a non-inferiority randomized controlled trial

D R Singla, S E Meltzer-Brody, R K Silver, S N Vigod, J J Kim, L M La Porte, P Ravitz, C E Schiller, N Schoueri-Mychasiw, S D Hollon, A Kiss, D Clark, A K Dalfen, S Dimidjian, B N Gaynes, S R Katz, A Lawson, M Leszcz, R G Maunder, B H Mulsant, K E Murphy, J A Naslund, M L Reyes-Rodríguez, A M Stuebe, C-L Dennis, V Patel, D R Singla, S E Meltzer-Brody, R K Silver, S N Vigod, J J Kim, L M La Porte, P Ravitz, C E Schiller, N Schoueri-Mychasiw, S D Hollon, A Kiss, D Clark, A K Dalfen, S Dimidjian, B N Gaynes, S R Katz, A Lawson, M Leszcz, R G Maunder, B H Mulsant, K E Murphy, J A Naslund, M L Reyes-Rodríguez, A M Stuebe, C-L Dennis, V Patel

Abstract

Background: Depression and anxiety impact up to 1 in 5 pregnant and postpartum women worldwide. Yet, as few as 20% of these women are treated with frontline interventions such as evidence-based psychological treatments. Major barriers to uptake are the limited number of specialized mental health treatment providers in most settings, and problems with accessing in-person care, such as childcare or transportation. Task sharing of treatment to non-specialist providers with delivery on telemedicine platforms could address such barriers. However, the equivalence of these strategies to specialist and in-person models remains unproven.

Methods: This study protocol outlines the Scaling Up Maternal Mental healthcare by Increasing access to Treatment (SUMMIT) randomized trial. SUMMIT is a pragmatic, non-inferiority test of the comparable effectiveness of two types of providers (specialist vs. non-specialist) and delivery modes (telemedicine vs. in-person) of a brief, behavioral activation (BA) treatment for perinatal depressive and anxiety symptoms. Specialists (psychologists, psychiatrists, and social workers with ≥ 5 years of therapy experience) and non-specialists (nurses and midwives with no formal training in mental health care) were trained in the BA protocol, with the latter supervised by a BA expert during treatment delivery. Consenting pregnant and postpartum women with Edinburgh Postnatal Depression Scale (EPDS) score of ≥ 10 (N = 1368) will be randomized to one of four arms (telemedicine specialist, telemedicine non-specialist, in-person specialist, in-person non-specialist), stratified by pregnancy status (antenatal/postnatal) and study site. The primary outcome is participant-reported depressive symptoms (EPDS) at 3 months post-randomization. Secondary outcomes are maternal symptoms of anxiety and trauma symptoms, perceived social support, activation levels and quality of life at 3-, 6-, and 12-month post-randomization, and depressive symptoms at 6- and 12-month post-randomization. Primary analyses are per-protocol and intent-to-treat. The study has successfully continued despite the COVID-19 pandemic, with needed adaptations, including temporary suspension of the in-person arms and ongoing randomization to telemedicine arms.

Discussion: The SUMMIT trial is expected to generate evidence on the non-inferiority of BA delivered by a non-specialist provider compared to specialist and telemedicine compared to in-person. If confirmed, results could pave the way to a dramatic increase in access to treatment for perinatal depression and anxiety.

Trial registration: ClinicalTrials.gov NCT04153864 . Registered on November 6, 2019.

Keywords: Anxiety; Behavioral activation; Depression; Perinatal; Psychological treatments; Randomized controlled trial; Telemedicine.

Conflict of interest statement

The study team and all authors report no conflicts of interest. However, SNV reports royalties from UpToDate Inc. for authorship of materials related to depression and pregnancy. JJK is partly supported by a Small Business Innovation Research award from the National Institute of Mental Health (RS, PI). PR receives support from the Sinai Health System, Morgan Firestone Psychotherapy Chair. SD reports being a co-founder of Mindful Noggin, Inc. and receiving revenue from MindfulNoggin.com, receiving royalties from Guilford Press for books on Behavioral Activation and mindfulness. BHM receives financial support from the Labatt Family Chair in Biology of Depression in Late-Life Adults at the University of Toronto. He directly owns stocks of General Electric (less than $5000). Within the past 3 years, he has also received research support from Eli Lilly (medications for a NIH-funded clinical trial) and Pfizer (medications for a NIH-funded clinical trial). He has been an unpaid consultant to Myriad Neuroscience. AMS is a co-investigator for a Janssen Research and Development study, Optimizing Clinical Screening and Management of Maternal Mental Health: Predicting Women at Risk for Perinatal Depression.

Figures

Fig. 1
Fig. 1
Recruitment pathways
Fig. 2
Fig. 2
SUMMIT treatment arms
Fig. 3
Fig. 3
Study randomization and adaptation due to COVID-19
Fig. 4
Fig. 4
Study flow chart

References

    1. Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJ, et al. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11):e1001547. doi: 10.1371/journal.pmed.1001547.
    1. O’hara MW, Swain AM. Rates and risk of postpartum depression—a meta-analysis. Int Rev Psychiatry. 1996;8(1):37–54. doi: 10.3109/09540269609037816.
    1. Wisner KL, Sit DKY, McShea MC, Rizzo DM, Zoretich RA, Hughes CL, et al. Onset timing, thoughts of self-harm, and diagnoses in postpartum women with screen-positive depression findings. JAMA Psychiatry. 2013;70(5):490–498. doi: 10.1001/jamapsychiatry.2013.87.
    1. Robertson E, Grace S, Wallington T, Stewart DE. Antenatal risk factors for postpartum depression: a synthesis of recent literature. Gen Hosp Psychiatry. 2004;26(4):289–295. doi: 10.1016/j.genhosppsych.2004.02.006.
    1. Bauer A, Knapp M, Parsonage M. Lifetime costs of perinatal anxiety and depression. J Affect Disord. 2016;192:83–90. doi: 10.1016/j.jad.2015.12.005.
    1. Dennis C-L, Falah-Hassani K, Shiri R. Prevalence of antenatal and postnatal anxiety: systematic review and meta-analysis. Br J Psychiatry. 2017;210(5):315–323. doi: 10.1192/bjp.bp.116.187179.
    1. Falah-Hassani K, Shiri R, Dennis C-L. Prevalence and risk factors for comorbid postpartum depressive symptomatology and anxiety. J Affect Disord. 2016;198:142–147. doi: 10.1016/j.jad.2016.03.010.
    1. Stein A, Pearson RM, Goodman SH, Rapa E, Rahman A, McCallum M, et al. Effects of perinatal mental disorders on the fetus and child. Lancet. 2014;384(9956):1800–1819. doi: 10.1016/S0140-6736(14)61277-0.
    1. Field T. Prenatal depression effects on early development: a review. Infant Behav Dev. 2011;34(1):1–14. doi: 10.1016/j.infbeh.2010.09.008.
    1. Meltzer-Brody S, Howard LM, Bergink V, Vigod S, Jones I, Munk-Olsen T, et al. Postpartum psychiatric disorders. Nat Rev Dis Primers. 2018;4:18022. doi: 10.1038/nrdp.2018.22.
    1. Sockol LE, Epperson CN, Barber JP. A meta-analysis of treatments for perinatal depression. Clin Psychol Rev. 2011;31(5):839–849. doi: 10.1016/j.cpr.2011.03.009.
    1. O’hara MW, McCabe JE. Postpartum depression: current status and future directions. Annu Rev Clin Psychol. 2013;9:379–407. doi: 10.1146/annurev-clinpsy-050212-185612.
    1. Goodman JH. Women’s attitudes, preferences, and perceived barriers to treatment for perinatal depression. Birth. 2009;36(1):60–69. doi: 10.1111/j.1523-536X.2008.00296.x.
    1. O’Mahen HA, Flynn HA. Preferences and perceived barriers to treatment for depression during the perinatal period. J Women’s Health. 2008;17(8):1301–1309. doi: 10.1089/jwh.2007.0631.
    1. Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, Davidson KW, et al. Interventions to prevent perinatal depression: US preventive services task force recommendation statement. Jama. 2019;321(6):580–587. doi: 10.1001/jama.2018.19089.
    1. Byatt N, Xiao RS, Dinh KH, Waring ME. Mental health care use in relation to depressive symptoms among pregnant women in the USA. Arch Womens Mental Health. 2016;19(1):187–191. doi: 10.1007/s00737-015-0524-1.
    1. Dennis CL, Chung-Lee L. Postpartum depression help-seeking barriers and maternal treatment preferences: a qualitative systematic review. Birth. 2006;33(4):323–331. doi: 10.1111/j.1523-536X.2006.00130.x.
    1. Singla DR, Kohrt BA, Murray LK, Anand A, Chorpita BF, Patel V. Psychological treatments for the world: lessons from low-and middle-income countries. Annu Rev Clin Psychol. 2017;13:149–81. 10.1146/annurev-clinpsy-032816-045217. PMID: 28482687; PMCID: PMC5506549.
    1. Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review. J Rural Health. 2018;34(1):48–62. doi: 10.1111/jrh.12229.
    1. Singla D, Lazarus A, Atif N, Sikander S, Bhatia U, Ahmad I, et al. “Someone like us”: delivering maternal mental health through peers in two South Asian contexts. J Affect Disord. 2014;168:452–458. doi: 10.1016/j.jad.2014.07.017.
    1. O’Mahen HA, Grieve H, Jones J, McGinley J, Woodford J, Wilkinson EL. Women’s experiences of factors affecting treatment engagement and adherence in internet delivered Behavioural Activation for Postnatal Depression. Internet Interv. 2015;2(1):84–90. doi: 10.1016/j.invent.2014.11.003.
    1. Patel V, Weobong B, Weiss HA, Anand A, Bhat B, Katti B, et al. The Healthy Activity Program (HAP), a lay counsellor-delivered brief psychological treatment for severe depression, in primary care in India: a randomised controlled trial. Lancet. 2017;389(10065):176–185. doi: 10.1016/S0140-6736(16)31589-6.
    1. Dimidjian S, Goodman SH, Sherwood NE, Simon GE, Ludman E, Gallop R, et al. A pragmatic randomized clinical trial of behavioral activation for depressed pregnant women. J Consult Clin Psychol. 2017;85(1):26. doi: 10.1037/ccp0000151.
    1. Singla DR, Lawson A, Kohrt BA, Jung JW, Meng Z, Ratjen C, Zahedi N, Dennis CL, Patel V. Implementation and effectiveness of non-specialist delivered interventions for perinatal mental health in high-income countries: a systematic review and meta-analysis. JAMA Psychiatry. 2021. 10.1001/jamapsychiatry.2020.4556. Epub ahead of print. PMID: 33533904.
    1. Singla DR, Lemberg-Pelly S, Lawson A, Zahedi N, Thomas-Jacques T, Dennis C-L. Implementing psychological interventions through nonspecialist providers and telemedicine in high-income countries: qualitative study from a multistakeholder perspective. JMIR Mental Health. 2020;7(8):e19271. doi: 10.2196/19271.
    1. Lee EW, Denison FC, Hor K, Reynolds RM. Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review. BMC Pregnancy Childbirth. 2016;16(1):38. doi: 10.1186/s12884-016-0831-1.
    1. Andrews G. Utility of computerised cognitive–behavioural therapy for depression. Br J Psychiatry. 2010;196(4):257–258. doi: 10.1192/bjp.bp.109.076356.
    1. Lokkerbol J, Adema D, Cuijpers P, Reynolds CF, Schulz R, Weehuizen R, et al. Improving the cost-effectiveness of a healthcare system for depressive disorders by implementing telemedicine: a health economic modeling study. Am J Geriatr Psychiatry. 2014;22(3):253–262. doi: 10.1016/j.jagp.2013.01.058.
    1. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196. doi: 10.1371/journal.pone.0013196.
    1. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018;47(1):1–18. doi: 10.1080/16506073.2017.1401115.
    1. Dimidjian S, Barrera M, Jr, Martell C, Muñoz RF, Lewinsohn PM. The origins and current status of behavioral activation treatments for depression. Annu Rev Clin Psychol. 2011;7:1–38. doi: 10.1146/annurev-clinpsy-032210-104535.
    1. Jacobson NS, Martell CR, Dimidjian S. Behavioral activation treatment for depression: returning to contextual roots. Clin Psychol Sci Pract. 2001;8(3):255–270. doi: 10.1093/clipsy.8.3.255.
    1. Cuijpers P, Van Straten A, Warmerdam L. Behavioral activation treatments of depression: a meta-analysis. Clin Psychol Rev. 2007;27(3):318–326. doi: 10.1016/j.cpr.2006.11.001.
    1. Mazzucchelli T, Kane R, Rees C. Behavioral activation treatments for depression in adults: a meta-analysis and review. Clin Psychol Sci Pract. 2009;16(4):383–411. doi: 10.1111/j.1468-2850.2009.01178.x.
    1. Dimidjian S, Hollon SD, Dobson KS, Schmaling KB, Kohlenberg RJ, Addis ME, et al. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J Consult Clin Psychol. 2006;74(4):658. doi: 10.1037/0022-006X.74.4.658.
    1. Dobson KS, Hollon SD, Dimidjian S, Schmaling KB, Kohlenberg RJ, Gallop RJ, et al. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the prevention of relapse and recurrence in major depression. J Consult Clin Psychol. 2008;76(3):468. doi: 10.1037/0022-006X.76.3.468.
    1. Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren FC, et al. Cost and Outcome of Behavioural Activation versus Cognitive Behavioural Therapy for Depression (COBRA): a randomised, controlled, non-inferiority trial. Lancet. 2016;388(10047):871–880. doi: 10.1016/S0140-6736(16)31140-0.
    1. Dimidjian S, Goodman SH. Preferences and attitudes toward approaches to depression relapse/recurrence prevention among pregnant women. Behav Res Ther. 2014;54:7–11. doi: 10.1016/j.brat.2013.11.008.
    1. O’mahen H, Richards D, Woodford J, Wilkinson E, McGinley J, Taylor RS, et al. Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression. Psychol Med. 2014;44(08):1675–1689. doi: 10.1017/S0033291713002092.
    1. Singla DR, Kumbakumba E, Aboud FE. Effects of a parenting intervention to address maternal psychological wellbeing and child development and growth in rural Uganda: a community-based, cluster-randomised trial. Lancet Glob Health. 2015;3(8):e458–ee69. doi: 10.1016/S2214-109X(15)00099-6.
    1. Weobong B, Weiss HA, McDaid D, Singla DR, Hollon SD, Nadkarni A, Park AL, Bhat B, Katti B, Anand A, Dimidjian S, Araya R, King M, Vijayakumar L, Wilson GT, Velleman R, Kirkwood BR, Fairburn CG, Patel V. Sustained effectiveness and cost-effectiveness of the Healthy Activity Programme, a brief psychological treatment for depression delivered by lay counsellors in primary care: 12-month follow-up of a randomised controlled trial. PLoS Med. 2017;14(9):e1002385. 10.1371/journal.pmed.1002385. PMID: 28898283; PMCID: PMC5595303.
    1. Jordans MJ, Luitel NP, Garman E, Kohrt BA, Rathod SD, Shrestha P, et al. Effectiveness of psychological treatments for depression and alcohol use disorder delivered by community-based counsellors: two pragmatic randomised controlled trials within primary healthcare in Nepal. Br J Psychiatry. 2019;215(2):485–493. doi: 10.1192/bjp.2018.300.
    1. Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren F, et al. Behavioural Therapy for Depression (COBRA): a randomised, controlled, non-inferiority trial. 2016.
    1. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150(6):782–786. doi: 10.1192/bjp.150.6.782.
    1. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092.
    1. Hollander JE, Carr BG. Virtually perfect? Telemedicine for COVID-19. N Engl J Med. 2020;382(18):1679–1681. doi: 10.1056/NEJMp2003539.
    1. McDermott MM, Newman AB. Preserving clinical trial integrity during the coronavirus pandemic. Jama. 2020;323(21):2135–2136. doi: 10.1001/jama.2020.4689.
    1. Chowdhary N, Anand A, Dimidjian S, Shinde S, Weobong B, Balaji M, et al. The Healthy Activity Program lay counsellor delivered treatment for severe depression in India: systematic development and randomised evaluation. Br J Psychiatry. 2016;208(4):381–388. doi: 10.1192/bjp.bp.114.161075.
    1. Boswell JF, Iles BR, Gallagher MW, Farchione TJ. Behavioral activation strategies in cognitive-behavioral therapy for anxiety disorders. Psychotherapy (Chic) 2017;54(3):231–236. doi: 10.1037/pst0000119.
    1. Stein AT, Carl E, Cuijpers P, Karyotaki E, Smits JAJ. Looking beyond depression: a meta-analysis of the effect of behavioral activation on depression, anxiety, and activation. Psychol Med. 2020. p. 1–14. 10.1017/S0033291720000239. Epub ahead of print. PMID: 32138802.
    1. Singla DR, Weobong B, Nadkarni A, Chowdhary N, Shinde S, Anand A, et al. Improving the scalability of psychological treatments in developing countries: an evaluation of peer-led therapy quality assessment in Goa, India. Behav Res Ther. 2014;60:53–59. doi: 10.1016/j.brat.2014.06.006.
    1. Restivo JL, Mitchell L, Joshi U, Anand A, Gugiu PC, Singla DR, et al. Assessing health worker competence to deliver a brief psychological treatment for depression: development and validation of a scalable measure. J Behav Cognitive Ther. 2020;30(4):253–266. doi: 10.1016/j.jbct.2020.10.001.
    1. Fairburn CG, Cooper Z. Therapist competence, therapy quality, and therapist training. Behav Res Ther. 2011;49(6):373–378. doi: 10.1016/j.brat.2011.03.005.
    1. Dennis C-L, Hodnett E, Kenton L, Weston J, Zupancic J, Stewart DE, et al. Effect of peer support on prevention of postnatal depression among high risk women: multisite randomised controlled trial. Bmj. 2009;338:a3064. doi: 10.1136/bmj.a3064.
    1. Dennis C-L, Ravitz P, Grigoriadis S, Jovellanos M, Hodnett E, Ross L, et al. The effect of telephone-based interpersonal psychotherapy for the treatment of postpartum depression: study protocol for a randomized controlled trial. Trials. 2012;13(1):38. doi: 10.1186/1745-6215-13-38.
    1. Spitzer RL, Kroenke K, Williams JB, Group PHQPCS Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Jama. 1999;282(18):1737–1744. doi: 10.1001/jama.282.18.1737.
    1. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. 1988;52(1):30–41. doi: 10.1207/s15327752jpa5201_2.
    1. Üstün TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J, et al. Developing the World Health Organization disability assessment schedule 2.0. Bull World Health Organ. 2010;88:815–823. doi: 10.2471/BLT.09.067231.
    1. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L) Qual Life Res. 2011;20(10):1727–1736. doi: 10.1007/s11136-011-9903-x.
    1. Lang AJ, Stein MB. An abbreviated PTSD checklist for use as a screening instrument in primary care. Behav Res Ther. 2005;43(5):585–594. doi: 10.1016/j.brat.2004.04.005.
    1. Singla DR, MacKinnon DP, Fuhr DC, Sikander S, Rahman A, Patel V. Multiple mediation analysis of the peer-delivered Thinking Healthy Programme for perinatal depression: findings from two parallel, randomised controlled trials. Br J Psychiatry. 2019. p. 1–8. 10.1192/bjp.2019.184. Epub ahead of print. PMID: 31362799.
    1. Attkisson CC, Zwick R. The Client Satisfaction Questionnaire: psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–237. doi: 10.1016/0149-7189(82)90074-X.
    1. Munder T, Wilmers F, Leonhart R, Linster HW, Barth J. Working Alliance Inventory-Short Revised (WAI-SR): psychometric properties in outpatients and inpatients. Clin Psychol Psychother. 2010;17(3):231–239.
    1. Fuhr DC, Calvert C, Ronsmans C, Chandra PS, Sikander S, De Silva MJ, et al. Contribution of suicide and injuries to pregnancy-related mortality in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Psychiatry. 2014;1(3):213–225. doi: 10.1016/S2215-0366(14)70282-2.
    1. Brown G. Health service utilization and cost of care questionnaire. Health and Social Service Utilization Research Unit. Hamilton, ON: McMaster University; 2001.
    1. Bradley RH, Caldwell BM. The HOME Inventory and family demographics. Dev Psychol. 1984;20(2):315. doi: 10.1037/0012-1649.20.2.315.
    1. Bayley N. Bayley scales of infant development and toddler development: technical manual: the PsychCorp. 2006.
    1. Aboud FE, Singla DR. Challenges to changing health behaviours in developing countries: a critical overview. Soc Sci Med. 2012;75(4):589–594. doi: 10.1016/j.socscimed.2012.04.009.
    1. Singla DR, Hollon SD, Velleman R, Weobong B, Nadkarni A, Fairburn CG, Bhat B, Gurav M, Anand A, McCambridge J, Dimidjian S, Patel V. Temporal pathways of change in two randomized controlled trials for depression and harmful drinking in Goa, India. Psychol Med. 2020;50(1):68–76. 10.1017/S0033291718003963. Epub 2019 Jan 8. PMID: 30616698; PMCID: PMC6945322.
    1. Bodner TE. What improves with increased missing data imputations? Struct Equ Model Multidiscip J. 2008;15(4):651–675. doi: 10.1080/10705510802339072.
    1. McCabe-Beane JE, Segre LS, Perkhounkova Y, Stuart S, O’Hara MW. The identification of severity ranges for the Edinburgh Postnatal Depression Scale. J Reprod Infant Psychol. 2016;34(3):293–303. doi: 10.1080/02646838.2016.1141346.
    1. Singla DR, Kumbakumba E. The development and implementation of a theory-informed, integrated mother-child intervention in rural Uganda. Soc Sci Med. 2015;147:242–251. doi: 10.1016/j.socscimed.2015.10.069.
    1. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. Bmj. 2002;324(7347):1183. doi: 10.1136/bmj.324.7347.1183.
    1. Seed M, Juarez M, Alnatour R. Improving recruitment and retention rates in preventive longitudinal research with adolescent mothers. J Child Adolescent Psychiatric Nurs. 2009;22(3):150–153. doi: 10.1111/j.1744-6171.2009.00193.x.
    1. Katz KS, El-Mohandes A, Johnson DM, Jarrett M, Rose A, Cober M. Retention of low income mothers in a parenting intervention study. J Community Health. 2001;26(3):203–218. doi: 10.1023/A:1010373113060.
    1. Hough RL, Tarke H, Renker V, Shields P, Glatstein J. Recruitment and retention of homeless mentally ill participants in research. J Consult Clin Psychol. 1996;64(5):881–891. doi: 10.1037/0022-006X.64.5.881.

Source: PubMed

3
Iratkozz fel