Families First Program Evaluation in Indonesia

Families First Positive Discipline for Everyday Parenting With Home Visiting Program in Indonesia

Families First Home Visiting Program (Families First) is a parenting support program anchored on children's rights that gives parents clear guidance on child development, parenting, and positive discipline practices. Families First is an adaptation of the Positive Discipline in Everyday Parenting (PDEP) Program for the West Java context. This trial aims to evaluate the effectiveness of Families First. This is a pragmatic, delayed-entry, parallel-group, stratified, cluster-randomized controlled trial in a real-world setting. Twenty rural and urban villages in the Cianjur district of Indonesia, involving 720 caregivers of children up to 7 years of age, are randomized to two parallel arms. Villages receive either a parenting program consisting of 10 group sessions and 4 home visits or the standard community health and social services. After completion of the trial period, the delayed group is offered the program. The primary outcome is self-reported frequency of corporal/physical and emotional punishment. The secondary outcomes are indicators of involved and positive parenting. Concurrent process evaluation and qualitative research are conducted to identify program satisfaction and facilitators and barriers to the implementation. Outcome data are collected immediately after the intervention and six months later. The results will be used to inform a violence prevention strategy in West Java and possible scale up in of the intervention in Indonesia.

Study Overview

• Status: Unknown
• Conditions: Child Abuse; Parent-Child Relations
• Intervention / Treatment: Other: Families First Home Visiting Program

Detailed Description

Aims and objectives The primary objective of this study is to compare, among caregivers of children aged 0-7 years in Cianjur district, Indonesia, the effectiveness of the Families First Program in reducing rates of violent discipline episodes in the home in comparison to rates observed under the standard community health and social service provision. The study will also identify unintended positive and negative effects of this program; determine facilitators and barriers to its implementation in this context; and assess facilitators, mentors, and families' satisfaction with the program.

Site eligibility Data will be collected across 20 villages or clusters that represent the general population in four sub-districts (Campaka, Ciranjang, Karang tengah, and Naringgul) in Cianjur district, West Java Province, Indonesia. Selected villages will consist of (a) rural and urban/peri-urban communities; (b) not been exposed to the Families First Program; (c) reachable within a 1-hour driving distance of the sub-district office and 1-8 hours driving distance of the district capital; (d) located at ample distance from other clusters; and (e) local political leaders provide approval for the intervention and the evaluation.

Randomization Stratified randomization will be used to select 20 clusters among the eligible 38 study clusters in rural and urban settings in the four sub-districts in a 1:1 ratio for the intervention and the control arms. Clusters will be randomized to avoid the resentment or contamination that might occur as a result of delivering the intervention to some families but not others in the community. Randomization will be done in a Random Allocation Ceremony led by the research team and attended by the chiefs from all participating villages as well as staff from the implementing agency. The ceremony will follow a step-by-step lottery and documentation procedure that includes the use of 20 sequentially numbered, opaque, sealed and stapled envelopes independently prepared by the lead investigator. Aluminium foil inside the envelope will render the envelope impermeable to intense light. The ceremony will be video-recorded. Eligible families will be identified before randomly assigning villages.

Measurement strategy The outcome measures for this study are given in the measurement section of the registration document. The original measurement strategy was to use full measures that have already been applied in this field. Piloting of the original plan indicated that this would not be feasible as there were too many items, many of which would not be appropriate or relevant to the context. Instead, the measurement strategy was to use outcome indicators: single items; indices by cumulating responses over several related items; or full measures/subscales with total scores validated using Rasch analysis.

Socio-demographic covariates Socio-demographic characteristics that will be documented include: a) Child: age, gender, orphanhood status, siblings, physical health, and school status; (b) Mother/caretaker: age, gender, marital status, education level, physical and mental health, ethnicity and cultural background, school/employment status; (c) Family: urban/rural location & type of residence, household structure, family structure, economy, and functioning.

Qualitative and process evaluation assessments Linked qualitative methods will be used to develop and validate data collection measures (pilot) and to add depth and understanding of process and outcomes. During the randomized trial stages, they will explore caregivers' and implementers' experiences in the program and how service delivery, socio-economic, cultural, and other factors may impact the effectiveness and scalability of the intervention. Qualitative methods (in Bahasa and Sundanese) include semi-structured interviews with caregivers, implementers (Save the Children/non-governmental organization staff, mentors, and facilitators) and community leaders; focus group interviews with participating caregivers and implementers; observation of group sessions; record analysis; and visual methods.

Facilitator's tracking forms will be used to record attendance and level of engagement by caregivers, as well as the extent to which facilitators followed the program manual. Process evaluation outcomes will be assessed through checklists to track implementation fidelity, program exposure/attendance, and a brief program satisfaction questionnaire for caregivers in intervention sites, facilitators, and mentors post-intervention. Implementer records of program attendance and fidelity in the delivery of the intervention (as assessed by observation of sessions by mentors) will also be reviewed.

Statistical analysis and sample size calculation The study is powered to detect a change considered to be both significant clinically and plausible on the primary outcome. A sample size of N = 720 families will allow measuring a reduction of 15.2% in parent-reported use of violent discipline at home from the initial estimated prevalence of 30% (SKTA 2013) with an α level of 0.05 and 90% power, assuming 0.02 intra-class correlation and 80% participation rate. While each family will likely have more than one child, the outcome concordance across children is likely to be very high (>0.8) and so the sample size calculation considers the number of families, recognizing that the unit of analysis will be the child.

Types of analysis There will be only one analysis when all participants have been randomized. There will be administrative analyses done to ensure data accuracy on a continual basis. A baseline table reflecting the demographic profile of the households and caregivers by arm will be compiled.

The primary outcome is frequency of three types of punishment practices in the past month which will be aggregated into a cumulative rate of number of punishments over days. For comparative purposes, the primary outcome will be evaluated as any- vs. non-punishment. This rate will be ascertained for all participants in both trial arms three times. The main analysis will be logistic regression using generalized estimating equations (GEE) to nest families within villages to test the main hypothesis related to the superiority of the program in reducing the rate of physical and emotional punishment over the period of the study. Outcomes will be measured at baseline, end of intervention, and follow-up (i.e., 6 months after end of intervention). The primary comparison is at the end of the intervention; comparisons at follow-up are considered exploratory. The superiority of the program will be tested by including main effects for program and for time along with a program by time interaction. The linearity of the association with time will be considered to allow for the possibility of non-linear associations. Variables which reduce variance in the outcome will be considered for inclusion (sex and position (parent or child) of the reporting family member, number of children in the family, etc.). Although confounding is not expected to be an issue due to the randomization, villages will be compared on key factors and any variables showing large imbalances by randomization group will be added to the model. The investigators will adopt an intention-to-treat principle to analyze all outcomes and all persons will be analyzed in the groups to which they were randomized. A secondary analysis will estimate the impact of the program the other relevant outcomes. Program effects will also be examined using GEE to adjust for clustering of members within families and families within villages. Counts will be analyzed with poisson regression, binary outcomes with logistic regression and continuous scales with linear regression. The investigators will conduct a gender-based analysis (sex of the child) for exploratory purposes. The investigators will also explore whether families with more children or children of different age groups, or families with differently-abled children respond differently to the program. Another sub-group analyses will explore the impact of the intervention among people in single-headed households, first-time parents, and teenage parents. Analysis and reporting of the results will follow the CONSORT guidelines for reporting randomized controlled trials. Preliminary findings will be shared with the Advisory Committee and interpreted in the context of relevant policies.

Data management and monitoring Tablet-based questionnaires will be administered orally to caregivers in their homes. The Census and Survey Processing System (CSPro), a widely-used public domain software package that allows for collection of data and later uploading to the secure server, will be used for entering, editing, and tabulating data. An index child will be randomly selected at the beginning of the baseline interview.

The study will be monitored for quality, contextual appropriateness, and regulatory compliance. An independent advisory committee composed of academics and specialists with an expertise in child protection in Indonesia from government, non-governmental, and donor agencies will participate in the continuous monitoring of the study. Program implementers will monitor the intervention through facilitators and mentors' weekly meetings, and local visits by other program staff. Any adverse events observed by researchers or implementers will be assessed to decide whether additional investigation or a modification of the intervention may be indicated.

• Study Type: Interventional
• Enrollment (Anticipated): 720
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Canada
  • Quebec
    • Montreal, Quebec, Canada, H3A 1A1
      • Division fo Clinical epidemiology

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 14 years and older (Child, Adult, Older Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: Female

Description

Inclusion:

• Have at least one child aged up to 7 years, regardless of whether the child is their biological child or not;
• Have at least one of the risk factors associated with the placement of children into residential care: live below the government poverty line; be a single and teenage mother; father or mother has migrated/or mother is considering migration;
• Have basic needs met or be referred to social protection program before start of program;
• Reside in the village;
• Not been previously identified as having cognitive impairment
• Able to speak and read in Bahasa;
• Have never engaged in another parenting program;
• Does not plan to move from this village for a year ahead

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Prevention
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Families First Home Visiting Program; 10 group sessions conducted weekly and 4 home visits for the duration of the program. Sessions and visits of the Families First Home Visiting Program cover child development, parenting skills, parent-child communications, and positive discipline practices. The intervention is delivered by para-professional community facilitators, trained in the program.	Other: Families First Home Visiting Program; 10 group sessions and 4 home visits with community facilitators emphasizing positive parenting
No Intervention: Control Group; The control group receives the standard, government run, services provided by community health workers in West Java. Once the evaluation of the intervention arm is completed, participants in the control arm will be offered the intervention.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Change in frequency of physical and emotional punishment at 3 and 6 months	Self-report frequency in the past month of use of physical discipline including harsh physical discipline, and verbal/emotional discipline.	Baseline, post-intervention (3 months), and 6 months follow-up

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Positive and involved parenting	Positive Parenting Subscale (6 self-report items) and 1 single self-report item from Involvement Subscale of the Alabama Parenting Questionnaire (APQ).	Baseline, post-intervention (3 months), and 6 months follow-up
Positive discipline	Four self-report items adapted from the International Society for Prevention of Child Abuse and Neglect Child Abuse Screening Tool (ICAST) Nonviolent Subscale.	Baseline, post-intervention (3 months), and 6 months follow-up
Opinion on discipline	Two items from the International Society for Prevention of Child Abuse and Neglect Child Abuse Screening Tool (ICAST)-Parent.	Baseline, post-intervention (3 months), and 6 months follow-up
Setting limits	2 items from the Setting Limits Subscale of the Parenting Young Children (PARYC)	Baseline, post-intervention (3 months), and 6 months follow-up

Other Outcome Measures

Outcome Measure	Measure Description	Time Frame
Inter-parental conflict regarding child rearing	11 items from the Parent Problem Checklist (PPC)	Baseline, post-intervention (3 months), and 6 months follow-up
Caregiver mental health	Wold Health Organization Well-Being Index-5 (WHO-5) comprising 5 items	Baseline, post-intervention (3 months), and 6 months follow-up
Child social and emotional well-being	Strengths and Difficulties Questionnaire (SDQ): emotional problems (5-items), conduct problems (5-items), hyperactivity (5-items), peer problems (5-items), and pro-social (3 items)	Baseline, post-intervention (3 months), and 6 months follow-up
Monitoring and supervision	Poor Monitoring/Supervision Subscale of the Alabama Parenting Questionnaire (APQ: 10-items) and 1 item from the Parent Supervision Attributes Profile Questionnaire (PSAPQ)	Baseline, post-intervention (3 months), and 6 months follow-up
Parenting stress	Parental Stress Scale comprising 18-items	Baseline, post-intervention (3 months), and 6 months follow-up
Stimulating home environment	6 items from the Early Childhood Development Module from the Multiple Indicator Cluster Survey, 1 item from the Involvement Subscale of the APQ, and two items (sharing meals and exploring toys alone)	Baseline, post-intervention (3 months), and 6 months follow-up
Institutionalization of children	Modified Child Protection Knowledge, Attitudes, and Practices (CP-KAP)	Baseline, post-intervention (3 months), and 6 months follow-up
Perceived Social Support	Tangible/Instrumental Support Subscale (3 items) and Emotional Support Subscale (4 items) from the Modified Social Support Survey of the Medical Outcomes Study (mMOS-SS)	Baseline, post-intervention (3 months), and 6 months follow-up

Collaborators and Investigators

• Sponsor: McGill University
• Collaborators: Save the Children; European Network of Foundations Children and Violence Evaluation Challenge Fund; SMERU Research Institute
• Investigators: Principal Investigator: Monica Ruiz-Casares, PhD, McGill University

Publications and helpful links

General Publications

• Ruiz-Casares M, Lilley S, Thombs BD, Platt RW, Scott S, Isdijoso W, Hermanus E, Andrina M, Mayo N. Protocol for a cluster randomised controlled trial evaluating a parenting with home visitation programme to prevent physical and emotional abuse of children in Indonesia: the Families First Programme. BMJ Open. 2019 Jan 15;9(1):e021751. doi: 10.1136/bmjopen-2018-021751.

Study record dates

Study Major Dates

• Study Start (Actual): March 22, 2017
• Primary Completion (Actual): March 24, 2018
• Study Completion (Anticipated): August 31, 2019

Study Registration Dates

• First Submitted: November 30, 2017
• First Submitted That Met QC Criteria: December 11, 2017
• First Posted (Actual): December 15, 2017

Study Record Updates

• Last Update Posted (Actual): August 7, 2019
• Last Update Submitted That Met QC Criteria: August 5, 2019
• Last Verified: August 1, 2019

More Information

Terms related to this study

• Keywords: parenting; Indonesia; low and middle income countries; child abuse; child discipline
• Other Study ID Numbers: A10-B53-16B

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: No

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No