Motivating Survey Compliance: Game Play Study 1

Self-reports, especially for patients with chronic physical or mental diseases, are critical for disease research and drug development. Historically, it has been very difficult to collect self-reported data for long periods of time as it is an unpleasant and inconvenient task. Paper and digital surveys are the traditional way of collecting self-reports and have been around for a long time, but still suffer from lack of adherence despite the best efforts of researchers to remind and motivate individuals to fill them out.

Mobile games, on the other hand, benefit from an enormous amount of human adherence. These video games can be played on a smartphone and have captured the attention of a wide variety of demographics. The investigators have used established game design principles to develop a mobile game to motivate individuals to fill out a daily survey.

The purpose of this study is to determine which method of survey administration (paper, digital survey, or game- motivated survey) leads to the highest adherence rates for daily surveys.

Study Overview

• Status: Completed
• Conditions: Patient Reported Outcome Measures; Compliance
• Intervention / Treatment: Other: Paper Survey; Other: Electronic Survey; Other: The Guardians: A smartphone game

Detailed Description

The recruitment flyers, emails, and postings will invite eligible individuals to participate in a 35-day study about mood, games, and time use for $100. Interested persons will be invited to go to a link to fill out a screening survey. Potential participants will be screened to make sure they are in the appropriate age range and have a smartphone. This will be accomplished via an online survey.

Once a potential participant has been identified, he or she will be directed to digital information about the study that is written in an easily understandable format. This information will include the types of questions that will be asked on a daily basis, information about the pre- and post- surveys, information about payment ($40 for finishing the first 4 of 7 surveys and an additional $60 for finishing the post-study survey), and notification that the participant does not need to fill out any question if it makes him/her uncomfortable. If the individual still wants to participate, they will be instructed to enter the email address of a parent or guardian who can provide consent for them. If the individual is 18 years old or older, they will provide their own consent. Individuals under 18 will read and digitally sign an assent form.

After a participant has consented to participate, he or she will be randomized into one of 3 groups for filling out the daily surveys: paper surveys, digital surveys, or game-motivated digital surveys. The participant will then fill out a pre-study survey about general demographics (age, gender), gaming and time use habits, and complete a couple of quick assessments to determine reading level and arithmetic level. Then participants will provide an email address to receive payment at the end of the study. Participants will be reminded of the payment schedule and then be directed to download the free app that matches his or her randomized group. Note that the paper surveys group will visit a webpage that displays a randomized word that he or she will need to write on the paper survey so that we can approximate when the survey was filled out. In addition, the paper surveys group participants will also be directed to print out their surveys for the study.

After the pre-study survey is complete, participants will receive a daily notification from their downloaded app to remember to fill out their survey for the day for 35 days. Each participant will be asked the following 5 questions each day:

1. What was your mood during the last 24 hours?
2. How many minutes did you spend playing mobile games in the last 24 hours?
3. How many times did you watch ads for in-game rewards in the past 24 hours?
4. How many minutes did you spend outside in the last 24 hours?
5. What has the weather been like in the last 24 hours?

Additionally, participants in the paper survey will be required to write the word that is on the webpage. This allows us to get an approximation of when the paper survey was filled out.

In the digital survey, we will record the time taken to complete each question and the latency between the notification to complete the survey and the actual survey completion. In the game-motivated survey, we will also record the participant's interactions with the game.

Once the 35-day study is over, participants will be sent a link to fill out the post-study survey. Participants in the paper survey group will also be given instructions for returning the forms to us via FedEx (participants will be given $10 to cover any charges incurred for returning the surveys).

Participants will then be sent their compensation in the form they indicated (Amazon Giftcard via email).

Analysis will be completed to compare average completion rates between the three study arms.

• Study Type: Interventional
• Enrollment (Actual): 232
• Phase: Not Applicable

Contacts and Locations

Study Locations

• United States
  • Massachusetts
    • Cambridge, Massachusetts, United States, 02142
      • Massachusetts Institute of Technology

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 6 years to 24 years (ADULT, CHILD)
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• Aged 6-24
• Own and use either an iPhone or Android smartphone
• Access to US Apple App Store or US GooglePlayStore

Exclusion Criteria:

• N/A

Study Plan

How is the study designed?

Design Details

• Primary Purpose: SUPPORTIVE_CARE
• Allocation: RANDOMIZED
• Interventional Model: PARALLEL
• Masking: NONE

Number of Arms

3

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
ACTIVE_COMPARATOR: Paper PRO; Participants in the Paper PRO arm completed daily patient reported outcome diaries on paper	Other: Paper Survey; Paper version of daily survey
ACTIVE_COMPARATOR: ePRO; Participants in the ePRO arm completed daily patient reported outcome diaries online via a smartphone app.	Other: Electronic Survey; Electronic version of daily survey administered via a smartphone app.
EXPERIMENTAL: Game-Motivated ePRO; Participants in the Game-Motivated ePRO arm completed daily patient reported outcome diaries online via a smartphone app. These participants were also given access to a game that rewarded the participant with an in-game reward that helped the participant complete various in-game quests.	Other: The Guardians: A smartphone game; "The Guardians" is a mix of two popular game genres: idle games (a game that doesn't require constant player input in order to progress in the game, but often progresses exponentially in response to a few user inputs, e.g., Cookie Clicker and Adventure Capitalist) and pet collection games (a game where the player seeks to collect all of the pets in a set, e.g., Pokemon or Neko Atsume). The game gives the player an in-game reward for completing a survey.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Adherence Rates to various methods of daily survey administration	For each study arm, the average adherence rate (computed as the percent of days (out of 35 total) a participant completed 100% of the daily survey questions, averaged over all participants in the study arm) will be computed and compared	35 days

Collaborators and Investigators

• Sponsor: Massachusetts Institute of Technology
• Collaborators: Millennium Pharmaceuticals, Inc.
• Investigators: Principal Investigator: Rosalind W Picard, ScD, Massachusetts Institute of Technology

Publications and helpful links

General Publications

• Taylor S, Ferguson C, Peng F, Schoeneich M, Picard RW. Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial. J Med Internet Res. 2019 Jan 3;21(1):e11683. doi: 10.2196/11683.

Study record dates

Study Major Dates

• Study Start (ACTUAL): October 9, 2017
• Primary Completion (ACTUAL): November 11, 2017
• Study Completion (ACTUAL): January 11, 2018

Study Registration Dates

• First Submitted: November 7, 2018
• First Submitted That Met QC Criteria: November 8, 2018
• First Posted (ACTUAL): November 13, 2018

Study Record Updates

• Last Update Posted (ACTUAL): February 22, 2019
• Last Update Submitted That Met QC Criteria: February 20, 2019
• Last Verified: February 1, 2019

More Information

Terms related to this study

• Other Study ID Numbers: 1708061907

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No