Outcomes of two randomized controlled trials, employing participants recruited through Mechanical Turk, of Internet interventions targeting unhealthy alcohol use

John A Cunningham, Alexandra Godinho, Nicolas Bertholet, John A Cunningham, Alexandra Godinho, Nicolas Bertholet

Abstract

Background: Two randomized controlled trials (RCTs) were conducted to explore the utility of the Mechanical Turk (MTurk) crowdsourcing platform to conduct rapid trials evaluating online interventions for unhealthy alcohol use.

Methods: Both trials employed a staged recruitment procedure where participants who drank in an unhealthy fashion were identified using a baseline survey and then invited to take part in a 6-month follow-up. Participants in both trials were randomized to receive one of several different online interventions or to a no intervention control condition. In study 1, the online interventions were password protected and only those who accessed the study portal were randomized to condition. In study 2, participants were directed to free-of charge interventions and asked to send a screenshot of the intervention to demonstrate that they had complied.

Results: Participants reporting unhealthy alcohol use were recruited fairly rapidly. Large numbers of screeners were completed (Study 1: n = 4910; Study 2: n = 5812), found eligible (Study 1: n = 3741; Study 2: n = 4095), and randomized to condition (Study 1: n = 511; Study 2: n = 878). Fair follow-up rates were observed at 6 months for each study (Study 1: 82%; Study 2: 66%). Neither trial was able to clearly demonstrate that providing access to the online interventions lead to increased reductions in alcohol use as compared to the control group.

Conclusions: While recruitment through a crowdsourcing platform is rapid and relatively low cost, it is possible that the lack of impact of the online websites employed in these trials could be due to the source of participants rather than the lack of efficacy of the interventions.

Trial registration: ClinicalTrials.gov # NCT02977026 and NCT03060135 .

Keywords: Alcohol; Amazon mechanical Turk; Data collection; Internet intervention; MTurk; Online web; Research methods.

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Trial consort diagram for Study 1
Fig. 2
Fig. 2
Trial consort diagram for Study 2

References

    1. Kaner EF, Beyer FR, Garnett C, Crane D, Brown J, Muirhead C, Redmore J, O'Donnell A, Newham JJ, de Vocht F, et al. Personalised digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. Cochrane Database Syst Rev. 2017;9:CD011479.
    1. Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, Ebert D, Cuijpers P. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912. doi: 10.1371/journal.pone.0099912.
    1. Cunningham JA. Addiction and eHealth. Addiction. 2016;111(3):389–390. doi: 10.1111/add.13243.
    1. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, et al. Global burden of disease attributable to mental and substance use disorders: findings from the global burden of disease study 2010. Lancet. 2013;382:1575–1586. doi: 10.1016/S0140-6736(13)61611-6.
    1. Cunningham JA, Breslin FC. Only one in three people with alcohol abuse or dependence ever seek treatment. Addict Behav. 2004;29(1):221–223. doi: 10.1016/S0306-4603(03)00077-7.
    1. Koski-Jännes A, Cunningham JA. Interest in different forms of self-help in a general population sample of drinkers. Addict Behav. 2001;26:91–99. doi: 10.1016/S0306-4603(00)00092-7.
    1. Bunge EL, Williamson RE, Cano M, Leykin Y, Munoz RF. Mood management effects of brief unsupported internet interventions. Internet Interv. 2016;5:36–43. doi: 10.1016/j.invent.2016.06.001.
    1. Chandler J, Shapiro D. Conducting clinical research using crowdsourced convenience samples. Annu Rev Clin Psychol. 2016;12:53–81. doi: 10.1146/annurev-clinpsy-021815-093623.
    1. Cunningham JA, Godinho A, Kushnir V. Using mechanical Turk to recruit participants for internet intervention research: experience from recruitment for four trials targeting hazardous alcohol consumption. BMC Med Res Methodol. 2017;17(1):156. doi: 10.1186/s12874-017-0440-3.
    1. Kim HS, Hodgins DC. Reliability and validity of data obtained from alcohol, Cannabis, and gambling populations on Amazon's mechanical Turk. Psychol Addict Behav. 2017;31(1):85–94. doi: 10.1037/adb0000219.
    1. Cunningham JA, Koski-Jannes A, Wild TC, Cordingley J. Treating alcohol problems with self-help materials: a population study. J Stud Alcohol. 2002;63(6):649–654. doi: 10.15288/jsa.2002.63.649.
    1. Cunningham JA, Wild TC, Cordingley J, van Mierlo T, Humphreys K. A randomized controlled trial of an internet-based intervention for alcohol abusers. Addiction. 2009;104(12):2023–2032. doi: 10.1111/j.1360-0443.2009.02726.x.
    1. Doumas DM, Hannah E. Preventing high-risk drinking in youth in the workplace: a web-based normative feedback program. J Subst Abus Treat. 2008;34(3):263–271. doi: 10.1016/j.jsat.2007.04.006.
    1. Doumas DM, Haustveit T. Reducing heavy drinking in intercollegiate athletes: evaluation of a web-based personalized feedback program. The Sport Psychologist. 2008;22:213–229. doi: 10.1123/tsp.22.2.212.
    1. Doumas DM, McKinley LL, Book P. Evaluation of two web-based alcohol interventions for mandated college students. J Subst Abus Treat. 2009;36(1):65–74. doi: 10.1016/j.jsat.2008.05.009.
    1. Cunningham JA, Murphy M, Hendershot CS. Treatment dismantling pilot study to identify the active ingredients in personalized feedback interventions for hazardous alcohol use: randomized controlled trial. Addict Sci Clin Pract. 2014;e9:22.
    1. Cunningham JA, Godinho A, Kushnir V. Can Amazon's mechanical Turk be used to recruit participants for internet intervention trials? A pilot study involving a randomized controlled trial of a brief online intervention for hazardous alcohol use. Internet Interv. 2017;10:12–16. doi: 10.1016/j.invent.2017.08.005.
    1. Cunningham John A., Shorter Gillian W., Murphy Michelle, Kushnir Vladyslav, Rehm Jürgen, Hendershot Christian S. Randomized Controlled Trial of a Brief Versus Extended Internet Intervention for Problem Drinkers. International Journal of Behavioral Medicine. 2016;24(5):760–767. doi: 10.1007/s12529-016-9604-5.
    1. Cunningham JA. Comparison of two internet-based interventions for problem drinkers: randomized controlled trial. J Med Internet Res. 2012;14(4):e107. doi: 10.2196/jmir.2090.
    1. Cunningham JA, Kypri K, McCambridge J. Exploratory randomized controlled trial evaluating the impact of a waiting list control design. BMC Med Res Methodol. 2013;13(1):150. doi: 10.1186/1471-2288-13-150.
    1. Saunders JB, Conigrave KM. Early identification of alcohol problems. Cmaj. 1990;143:1060–1069.
    1. Wechsler H, Davenport A, Dowdall G, Moeykens B, Castillo S. Health and behavioral consequences of binge drinking in college: a national survey of students at 140 campuses. JAMA. 1994;272:1672–1677. doi: 10.1001/jama.1994.03520210056032.
    1. Cunningham JA. Unintended impact of using different inclusion cut-offs for males and females in intervention trials for hazardous drinking. Addiction. 2017;112(5):910–911. doi: 10.1111/add.13760.
    1. Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived alcohol use disorders identification test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res. 2005;29(5):844–854. doi: 10.1097/01.ALC.0000164374.32229.A2.
    1. Kirkman JJL, Leo B, Moore JC. Alcohol consumption reduction among a web-based supportive community using the hello Sunday morning blog platform: observational study. J Med Internet Res. 2018;20(5):e196. doi: 10.2196/jmir.9605.
    1. Bertholet N, Godhino A, Cunningham JA. Smartphone application for unhealthy alcohol use: pilot randomized controlled trial in the general population. Drug Alcohol Depend. 2019;195:101–105. doi: 10.1016/j.drugalcdep.2018.12.002.
    1. Cunningham JA, Wong HTA. Assessing the immediate impact of normative drinking information using an immediate post-test randomized controlled design: implications for normative feedback interventions? Addict Behav. 2013;38(6):2252–2256. doi: 10.1016/j.addbeh.2013.02.005.
    1. Paolacci G, Chandler J, Ipeirotis PG. Running experiments on Amazon mechanical Turk. Judgm Decis Mak. 2010;5(5):411–419.
    1. Paolacci G, Chandler J. Inside the Turk: understanding mechanical Turk as a participant Pool. Curr Dir Psychol Sci. 2014;23(3):184–188. doi: 10.1177/0963721414531598.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren