The Effect of Monetary Incentive on Survey Response for Vulnerable Children and Youth

ABSTRACT The purpose of the study is to investigate if a monetary incentive can increase the response rate for vulnerable children and youth in a postal survey. A secondary purpose is to test if monetary incentive has an effect on the content of answers in a postal survey. The study is a randomized controlled trial where participants will be randomly allocated to receive a questionnaire together with a €15 voucher for a supermarket or to only receive a questionnaire. Data are taken from an intervention study aiming at creating network for different groups of vulnerable children and youth aged 8-23 years. The questionnaire survey in the present study is a follow up survey of the original study which are performed 1-2½ years after the participant have left the study. Recruitment to the original study is still ongoing and the investigators expect the total participation to be around 250. In the primary analysis the investigators will estimate the relative risk (RR) to assess whether there is a difference between group allocation and questionnaire response rate. The investigators will adjust for age in the analysis. In the secondary analyses the investigators will test whether scores on the five SDQ scales are different between group allocations. The investigators will adjust for the covariates age and gender, since the scores may depend on age and gender (4).

Study Overview

• Status: Completed
• Conditions: Quality of Life
• Intervention / Treatment: Behavioral: Questionnaire and monetary incentive; Behavioral: Questionnaire only

Detailed Description

TITELPAGE Title: The effect of monetary incentive on survey response for vulnerable children and youth

Name and contact details for head of the project:

Seniorresearcher, Jan Hyld Pejtersen SFI - The Danish National Centre for Social Research Herluf Trolles Gade 11 DK-1052 Copenhagen K +45 3348 0898 jhp@sfi.dk

Name and affiliation of people in the project group:

Seniorresearcher, Turf Böcker Jakobsen SFI - The Danish National Centre for Social Research

Responsible institution:

SFI - The Danish National Centre for Social Research Herluf Trolles Gade 11 DK-1052 Copenhagen K

+45 3348 0800 sfi@sfi.dk

ABSTRACT The purpose of the study is to investigate if a monetary incentive can increase the response rate for vulnerable children and youth in a postal survey. A secondary purpose is to test if monetary incentive has an effect on the content of answers in a postal survey. The study is a randomized controlled trial where participants will be randomly allocated to receive a questionnaire together with a €15 voucher for a supermarket or to only receive a questionnaire. Data are taken from an intervention study aiming at creating network for different groups of vulnerable children and youth aged 8-23 years. The questionnaire survey in the present study is a follow up survey of the original study which are performed 1-2½ years after the participant have left the study. Recruitment to the original study is still ongoing and The inestigators expect the total participation to be around 250. In the primary analysis the investigators will estimate the relative risk (RR) to assess whether there is a difference between group allocation and questionnaire response rate. The investigators will adjust for age in the analysis. In the secondary analyses the investigators will test whether scores on the five SDQ scales are different between group allocations. The investigators will adjust for the covariates age and gender, since the scores may depend on age and gender (4).

BACKGROUND Non-responders in questionnaire surveys may introduce bias and lower the validity of the studies. A Cochrane review has identified trials evaluating different ways of increasing response rates (1). The odds of responding on postal questionnaires were almost doubled using monetary incentive, and the odds were higher when the incentive was given with the questionnaires compare to only given after participants had responded. However, to our knowledge none of the studies concerned vulnerable children and youth. The purpose of the study is to investigate if a monetary incentive can increase the response rate for vulnerable children and youth in a postal survey. A secondary purpose is to test if monetary incentive has an effect on the content of answers in a postal survey.

METHODS/DESIGN Study design The study is a randomized controlled trial. To study the effect of incentive on survey response participants will be randomly allocated to receive a questionnaire together with a €15 voucher for a supermarket or to only receive a questionnaire.

Participants Inclusion criteria: Participants are taken from an established intervention study aiming at creating network for different groups of vulnerable children and youth aged 10-23 years. The groups comprise: children in foster care, former foster youth, children of mental ill parents, children of parents with alcohol abuse and children raised in violent families. Participants who have given informed consent to take part in the evaluation of the established intervention study and thereby agree to fill out questionnaires and report their unique personal identification number are eligible to take part in the study.

Exclusion criteria: Based on the participants unique personal identification number (CPR-number in the Danish Civil Registration System) the Central Office of Civil Registration will provide us with addresses of the participants. Participants, who are not available in the Civil Register either because participants are dead, immigrated or have requested survey exemption, are excluded from the study. Participants who have reported incomplete identification number will also be excluded.

Participant recruitment At the moment 215 children and youth have given informed consent that they will participate in the evaluation of the original study. Recruitment to the original study is still ongoing and the investigators expect the total participation to be around 250. The questionnaire survey in the present study is a follow up survey of the original study which will be performed 1-2½ years after the participant have left the original study. The present study will be performed in 4 waves. The first wave will be performed in November 2012 and will include participants who have left the original study 1-2½ years ago. The second, third and fourth waves will be performed May 2013, November 2013 and May 2014, respectively, 1-1½ years after the participants have left the original study. The outcome will be measured over a perod of 1½ years.

Randomisation The randomization will be performed within each wave of the survey. The participants are given a unique identification number in the original study and this number will also be used for the present study. The first 3 digit in the identification number identifies the municipality of the participants and the last digit are given in the order the participants enters the original study. Within each wave of the study participants will be sorted according to their identification number and will be assigned a random number between 0 and 1. The investigators will use the Rand ('uniform') function in SAS to create the randomization sequence. If the numbers are less than 0.5 the participants will be allocated to control otherwise participants will be allocated to treatment.

Blinding Neither participant nor researchers are blinded to the intervention.

INTERVENTION The intervention group will receive a postal questionnaire together with a voucher worth €15 for the largest supermarket chain in Denmark. Non-responders will after three weeks receive a reminder together with another copy of the questionnaire. In both cases the questionnaire will be sent with a cover letter and a reply paid return envelope.

The control group will only receive a postal questionnaire. Non-responders will after three weeks receive a reminder together with another copy of the questionnaire. In both cases the questionnaire will be sent with a cover letter and a reply paid return envelope.

After 10 weeks duration the study period will be over and the participants in the control group will receive a similar voucher as the intervention group. This is done for ethical reason, so both groups are treated equal. Any responses after 10 weeks will be reported, but will not be included in the primary and secondary analyses.

OUTCOME MEASURES The postal questionnaire consists of 91 items. The core of the questionnaire is the strengths and difficulties questionnaire SDQ (3) covering children and young people's behaviours, emotions, and relationships. Further topics in the questionnaire are: Family and housing; education and training; leisure time; alcohol consumption and evaluation of the intervention in the original study.

The primary outcome measure will be questionnaire response rate which is defined as the proportion of questionnaires returned by participants. The secondary outcomes will be scores on the five multiitems scales in the strengths and difficulties questionnaire (3).

POWERCALCULATION The sample size calculation is determined by the sample size recruited to the original study. Consequently, the investigators did not undertake a formal power calculation to determine the sample size.

DATA ANALYSIS In the primary analysis the investigators will estimate the relative risk (RR) to assess whether there is a difference between group allocation and questionnaire response rate. The investigators will adjust for age in the analysis. The analysis will be performed using PROC GENMOD in SAS. Level of significant will be at 5% significance level.

In the secondary analyses the investigators will test whether scores on the five SDQ scales are different between group allocations. The investigators will adjust for the covariates age and gender, since the scores may depend on age and gender (4). If scores are normally distributed the investigators will use GLM in SAS, otherwise the investigators will use ordinal logistic regression (PROC GENMOD).

ETHICS The study is registered with the Danish Data Protection Agency. In Denmark studies of this kind do not need approval by the local ethical committee. This has been verified by the Ethical committee, protocol: H-1-2012-FSP.

The trial will be registered at www.clinicaltrials.gov

PUBLICATION The study will be published in a peer reviewed international journal as for instance Journal of Child Psychology and Psychiatry or similar.

The first participant will be included in November 2012 and the last participant will be included in May 2014. The overall time frame of the study will be 1½ years.

ORGANISATIONAL ISSUES/AUTHORS' CONTRIBUTIONS All authors contributed to the study design. JHP drafted the protocol, and TBJ reviewed and revised the manuscript. All authors read and approved the final version.

ACKNNOWLEDMENTS AND FUNDING The study is partly funded by the National Board of Social Services as part of the evaluation of the intervention project 'Lige Muligheder [in Danish], and partly by The Danish National Centre for Social Research.

COMPETING INTERESTS The authors declare that they have no competing interests.

REFERENCES

1. Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews 2009;(3).
2. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ 2002 May 18;324(7347):1183.
3. Obel C, Heiervang E, Rodriguez A, Heyerdahl S, Smedje H, Sourander A, et al. The Strengths and Difficulties Questionnaire in the Nordic countries. European Child & Adolescent Psychiatry 2004;13:32-9.
4. Niclasen J, Teasdale TW, Andersen AMN, Skovgaard AM, Elberling H, Obel C. Psychometric Properties of the Danish Strength and Difficulties Questionnaire: The SDQ Assessed for More than 70,000 Raters in Four Different Cohorts. Plos One 2012 Feb 27;7(2).

• Study Type: Interventional
• Enrollment (Actual): 270
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Denmark
  • Copenhagen, Denmark, DK-1052
    • SFI - The Danish National Centre for Social Research

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 10 years to 30 years (Child, Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• Participants are taken from an established intervention study aiming at creating network for different groups of vulnerable children and youth aged 10-23 years. The groups comprise: children in foster care, former foster youth, children of mental ill parents, children of parents with alcohol abuse and children raised in violent families. Participants who have given informed consent to take part in the evaluation of the established intervention study and thereby agree to fill out questionnaires and report their unique personal identification number are eligible to take part in the study.

Exclusion Criteria:

• Based on the participants unique personal identification number (CPR-number in the Danish Civil Registration System) the Central Office of Civil Registration will provide us with addresses of the participants. Participants, who are not available in the Civil Register either because participants are dead, immigrated or have requested survey exemption, are excluded from the study. Participants who have reported incomplete identification number will also be excluded.

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Basic Science
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Monetary incentive; The intervention group will receive a postal questionnaire together with a voucher worth €15 for the largest supermarket chain in Denmark. Non-responders will after three weeks receive a reminder together with another copy of the questionnaire. In both cases the questionnaire will be sent with a cover letter and a reply paid return envelope.	Behavioral: Questionnaire and monetary incentive
Other: Control; The control group will only receive a postal questionnaire. Non-responders will after three weeks receive a reminder together with another copy of the questionnaire. In both cases the questionnaire will be sent with a cover letter and a reply paid return envelope.	Behavioral: Questionnaire only

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Response rate	The primary outcome measure will be questionnaire response rate which is defined as the proportion of questionnaires returned by participants.	up to 10 weeks after receiving the questionnaire

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
The secondary outcomes will be scores on the five multiitems scales in the strengths and difficulties questionnaire	The secondary outcomes will be scores on the five multiitems scales in the strengths and difficulties questionnaire	up to 10 weeks after receiving the questionnaire

Collaborators and Investigators

• Sponsor: VIVE - The Danish Center for Social Science Research
• Investigators: Principal Investigator: Jan H Pejtersen, Ph D, SFI - The Danish National Centre for Social Research

Publications and helpful links

General Publications

• Pejtersen JH. The effect of monetary incentive on survey response for vulnerable children and youths: A randomized controlled trial. PLoS One. 2020 May 12;15(5):e0233025. doi: 10.1371/journal.pone.0233025. eCollection 2020.

Study record dates

Study Major Dates

• Study Start: November 1, 2012
• Primary Completion (Actual): August 1, 2014
• Study Completion (Actual): August 1, 2014

Study Registration Dates

• First Submitted: November 26, 2012
• First Submitted That Met QC Criteria: December 4, 2012
• First Posted (Estimate): December 5, 2012

Study Record Updates

• Last Update Posted (Estimate): February 27, 2015
• Last Update Submitted That Met QC Criteria: February 26, 2015
• Last Verified: February 1, 2015

More Information

Terms related to this study

• Keywords: Quality of Life; Questionnaires; Response rate
• Other Study ID Numbers: SFI - 2251