Towards precision home visiting: results at six months postpartum from a randomized pilot implementation trial to assess the feasibility of a precision approach to Family Spirit

Allison Ingalls, Paul Rebman, Lisa Martin, Elizabeth Kushman, Amanda Leonard, Aimee Cisler, Ingrid Gschwind, Amanda Brayak, Ann Marie Amsler, Emily E Haroz, Allison Ingalls, Paul Rebman, Lisa Martin, Elizabeth Kushman, Amanda Leonard, Aimee Cisler, Ingrid Gschwind, Amanda Brayak, Ann Marie Amsler, Emily E Haroz

Abstract

Background: Shared implementation challenges at scale in early childhood home visiting have led researchers to explore precision home visiting as a promising service delivery mechanism to better address families' unique needs and build greater program efficiencies. This randomized controlled pilot study aimed to assess the acceptability of a precision approach to one home visiting model, Family Spirit® and explore potential differences between Precision Family Spirit (PFS) and Standard Family Spirit (Standard FS) on participant-home visitor relationship and maternal outcomes.

Methods: Participants (N = 60) were at least 14 years old, pregnant or within 2 months postpartum, and enrolled in Family Spirit. Four sites in Michigan were randomized 1:1 to deliver PFS (up to 17 core lessons plus up to 13 additional lessons as needed) or Standard FS (home visiting services as usual). Primary (program acceptability, participant satisfaction, home visitor-participant relationship quality, retention, adherence) and secondary (knowledge, quality of life, difficulty with parenting problems, substance use, depression, stress) outcomes at 6 months postpartum are presented. PFS participants also self-reported on quality of life, difficulty with parenting problems, stress, substance use, and concerns with sexual and reproductive health and self and child's nutrition status at each home visit. This informed which lessons they should receive.

Results: Mothers in both groups reported positive program acceptability, satisfaction, and home visitor-participant relationships at 6 months postpartum. However, open-ended feedback from Standard FS participants indicates that some lesson content may not be applicable to all participants. At 6 months, retention was 82.3% for PFS and 66.7% for Standard FS, and adherence was 30.1% for PFS and 20.6% for Standard FS.

Conclusions: Preliminary findings indicate that precision home visiting may be acceptable and feasible. A definitive trial is needed to build on this pilot data, assess outcomes for mothers and children participating in a precision approach to home visiting as compared to standard home visiting, and ready this approach for scale.

Trial registration: ClinicalTrials.gov NCT03975530 (first posted on 05/06/2019).

Keywords: Home visiting; Hybrid design; Implementation; Precision; Precision home visiting; Precision prevention science.

Conflict of interest statement

We have no competing interests to disclose.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
CONSORT trial flow diagram for Precision Family Spirit study. CONSORT flow diagram showing participant flow through each stage of the randomized controlled trial (enrollment, intervention allocation, follow-up, and data analysis). Those who were undecided when the study enrollment period closed were excluded. No participants who completed a baseline were excluded from analysis unless data was missing at a major assessment time point

References

    1. Duffee JH, Mendelsohn AL, Kuo AA, Legano LA, Earls MF, COUNCIL ON COMMUNITY PEDIATRICS, et al. Early Childhood Home Visiting. Pediatrics. 2017;140(3). Available from: 10.1542/peds.2017-2150.
    1. Michalopoulos C, Crowne SS, Portilla XA, Lee H, Filene JH, Duggan A, et al. A Summary of Results from the MIHOPE and MIHOPE-Strong Start Studies Of Evidence-Based Home Visiting. Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Dep Health Hum Serv. 2019; Report No.: OPRE Report 2019–09.
    1. Duggan A, Ximena PA, Filene JH, Crowne SS, Hill CJ, Lee H, et al. Implementation of Evidence-Based Early Childhood Home Visiting: Results from the Mother and Infant Home Visiting Program Evaluation. Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Depa Health Hum Serv. 2018; Report No.: OPRE Report # 2018-76A.
    1. Chazan-Cohen R, Fisk E, Ginsberg I, Gordon A, Green BL, Kappeser K, et al. Parents’ experiences with remote home visiting and infant mental health programs during COVID-19: important lessons for future service delivery. Perigee fund. 2021; Available from: .
    1. Supplee LH, Parekh J, Johnson M. Principles of precision prevention science for improving recruitment and retention of participants. Prev Sci. 2018;19(5):689–694. doi: 10.1007/s11121-018-0884-7.
    1. Supplee LH, Duggan A. Innovative research methods to advance precision in home visiting for more efficient and effective programs. Child Dev Perspect. 2019;13(3):173–179. doi: 10.1111/cdep.12334.
    1. Duggan AK, Bower KM, Zagaja C, O’Neill K, Daro D, Harding K, et al. Changing the home visiting research paradigm: models’ perspectives on behavioral pathways and intervention techniques to promote good birth outcomes. BMC Public Health.
    1. Holland ML, Olds DL, Dozier AM, Kitzman HJ. Visit attendance patterns in nurse-family partnership community sites. Prev Sci. 2018;19(4):516–527. doi: 10.1007/s11121-017-0829-6.
    1. Ingoldsby EM, Baca P, McClatchey MW, Luckey DW, Ramsey MO, Loch JM, et al. Quasi-experimental pilot study of intervention to increase participant retention and completed home visits in the nurse-family partnership. Prev Sci. 2013;14(6):525–534. doi: 10.1007/s11121-013-0410-x.
    1. O’Brien RA, Moritz P, Luckey DW, McClatchey MW, Ingoldsby EM, Olds DL. Mixed methods analysis of participant attrition in the nurse-family partnership. Prev Sci. 2012;13(3):219–228. doi: 10.1007/s11121-012-0287-0.
    1. Mullany B, Barlow A, Neault N, Billy T, Jones T, Tortice I, et al. The family Spirit trial for American Indian teen mothers and their children: CBPR rationale, design, methods and baseline characteristics. Prev Sci. 2012;13(5):504–518. doi: 10.1007/s11121-012-0277-2.
    1. Barlow A, Mullany B, Neault N, Goklish N, Billy T, Hastings R, et al. Paraprofessional-delivered home-visiting intervention for American Indian teen mothers and children: 3-year outcomes from a randomized controlled trial. Am J Psychiatry. 2015;172(2):154–162. doi: 10.1176/appi.ajp.2014.14030332.
    1. Walkup JT, Barlow A, Mullany BC, Pan W, Goklish N, Hasting R, et al. Randomized controlled trial of a paraprofessional-delivered in-home intervention for young reservation-based American Indian mothers. J Am Acad Child Adolesc Psychiatry. 2009;48(6):591–601. doi: 10.1097/CHI.0b013e3181a0ab86.
    1. Barlow A, Mullany B, Neault N, Compton S, Carter A, Hastings R, et al. Effect of a paraprofessional home-visiting intervention on American Indian teen mothers’ and infants’ behavioral risks: a randomized controlled trial. Am J Psychiatry. 2013;170(1):83–93. doi: 10.1176/appi.ajp.2012.12010121.
    1. OPRE. Reviewing Evidence of Effectiveness. September 2020, Updated December 2020. Report No.: OPRE Report #2020–126.
    1. Haroz EE, Ingalls A, Kee C, Goklish N, Neault N, Begay M, et al. Informing precision home visiting: identifying meaningful subgroups of families who benefit Most from family Spirit. Prev Sci. 2019;20(8):1244–1254. doi: 10.1007/s11121-019-01039-9.
    1. Haroz EE, Ingalls A, Wadlin J, Kee C, Begay M, Neault N, et al. Utilizing broad-based partnerships to design a precision approach to implementing evidence-based home visiting. J Community Psychol. 2020;48(4):1100–1113. doi: 10.1002/jcop.22281.
    1. Fortney JC, Unützer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–188. doi: 10.1176/appi.ps.201500439.
    1. Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, et al. Implementing measurement-based Care in Behavioral Health: a review. JAMA Psychiatry. 2019;76(3):324–335. doi: 10.1001/jamapsychiatry.2018.3329.
    1. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812.
    1. Ingalls A, Barlow A, Kushman E, Leonard A, Martin L, Precision Family Spirit Study Team, West, Allison L, et al. Precision family Spirit: a pilot randomized implementation trial of a precision home visiting approach with families in Michigan-trial rationale and study protocol. Pilot Feasibility Stud. 2021;7(1):8. Available from: 10.1186/s40814-020-00753-4.
    1. Chorpita BF, Daleiden EL, Weisz JR. Modularity in the design and application of therapeutic interventions. Appl Prev Psychol. 2005;11(3):141–156. doi: 10.1016/j.appsy.2005.05.002.
    1. Chorpita BF, Daleiden EL, Weisz JR. Identifying and selecting the common elements of evidence based interventions: a distillation and matching model. Ment Health Serv Res. 2005;7(1):5–20. doi: 10.1007/s11020-005-1962-6.
    1. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.
    1. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud. 2016;21(2):64. doi: 10.1186/s40814-016-0105-8.
    1. Care4Software, Inc ©. Community-driven Case Management Software. [cited 2021 Mar 26]. Available from:
    1. Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45(5):626–629. doi: 10.1016/j.jpsychires.2010.10.008.
    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–1327. doi: 10.2105/ajph.89.9.1322.
    1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. doi: 10.1186/1748-5908-4-50.
    1. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23. doi: 10.1007/s10488-010-0327-7.
    1. Haroz EE, Bolton P, Nguyen AJ, Lee C, Bogdanov S, Bass J, et al. Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design. BMC Health Serv Res. 2019;19(1):262. doi: 10.1186/s12913-019-4097-y.
    1. Tracey TJ, Kokotovic AM. Factor structure of the Working Alliance Inventory. Psychological Assessment: J Consul Clin Psych. 1989;1:207–210. doi: 10.1037/1040-3590.1.3.207.
    1. Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Counseling Psych. 1989;36:223–233. doi: 10.1037/0022-0167.36.2.223.
    1. Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the working alliance inventory. Psychother Res. 2006;16(1):12–25. doi: 10.1080/10503300500352500.
    1. Sharp EA, Ispa JM, Thornburg KR. Lane V. Relations among mother and home visitor personality, relationship quality, and amount of time spent in home visits. J Community Psychol. 2003;31(6):591–606. doi: 10.1002/jcop.10070.
    1. Becker B, Patterson F, Fagan J, Whitaker R. Mindfulness among home visitors in head start and the quality of their working Alliance with parents. J Child Fam Stud. 2016;25. Available from. 10.1007/s10826-015-0352-y.
    1. Humeniuk R, Ali R, Babor TF, Farrell M, Formigoni ML, Jittiwutikarn J, et al. Validation of the alcohol, smoking and substance involvement screening test (ASSIST) Addiction. 2008;103(6):1039–1047. doi: 10.1111/j.1360-0443.2007.02114.x.
    1. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150:782–786. doi: 10.1192/bjp.150.6.782.
    1. Cox JL, Chapman G, Murray D, Jones P. Validation of the Edinburgh postnatal depression scale (EPDS) in non-postnatal women. J Affect Disord. 1996;39(3):185–189. doi: 10.1016/0165-0327(96)00008-0.
    1. Weisz JR, Chorpita BF, Frye A, Ng MY, Lau N, Bearman SK, et al. Youth top problems: using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. J Consult Clin Psychol. 2011;79(3):369–380. doi: 10.1037/a0023307.
    1. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–396. doi: 10.2307/2136404.
    1. Twisk J, de Boer M, de Vente W, Heymans M. Multiple imputation of missing values was not necessary before performing a longitudinal mixed-model analysis. J Clin Epidemiol. 2013;66(9):1022–1028. doi: 10.1016/j.jclinepi.2013.03.017.
    1. Core R. Team. R: a language and environment for statistical computing. Vienna, Austria: R Foundation for statistical. Computing. 2021; Available from: .
    1. StataCorp . Stata statistical software: release 15. College Station, TX: StataCorp LLC; 2017.
    1. Lee EC, Whitehead AL, Jacques RM, Julious SA. The statistical interpretation of pilot trials: should significance thresholds be reconsidered? BMC Med Res Methodol. 2014;14(1):41. doi: 10.1186/1471-2288-14-41.
    1. Daro D, Boller K, Hart B. U.S. Department of Health and Human Services, Administration for Children and Families, Children’s Bureau. 2014. Implementation Fidelity in Early Childhood Home Visiting: Successes Meeting Staffing Standards, Challenges Hitting Dosage and Duration Targets.
    1. Ramakrishnan R, Holland V, Agu N, Brady C, Marshall J. Characteristics associated with participant attrition and retention in a perinatal home visiting program, Jan 22. Prev Sci, Available from. 2022. 10.1007/s11121-022-01338-8.
    1. O’Neill K, Korfmacher J, Zagaja C, Duggan A. COVID-19’s early impact on home visiting. First report from a national HARC-beat survey of local home visiting programs. Home Visiting Applied Research Collaborative. 2020; Available from: .
    1. Greene CJ, Morland LA, Durkalski VL, Frueh BC. Noninferiority and equivalence designs: issues and implications for mental health research. J Trauma Stress. 2008;21(5):433–439. doi: 10.1002/jts.20367.

Source: PubMed

3
Tilaa