Potential of Online Recruitment Among 15-25-Year Olds: Feasibility Randomized Controlled Trial

Sofie Have Hoffmann, Anna Paldam Folker, Mark Buskbjerg, Marie Paldam Folker, Andrea Huber Jezek, Durita Lyngsø Svarta, Ida Nielsen Sølvhøj, Lau Thygesen, Sofie Have Hoffmann, Anna Paldam Folker, Mark Buskbjerg, Marie Paldam Folker, Andrea Huber Jezek, Durita Lyngsø Svarta, Ida Nielsen Sølvhøj, Lau Thygesen

Abstract

Background: Recruiting young people for health and intervention studies by traditional methods has become increasingly challenging. The widespread access to the internet may offer new strategies for online recruitment.

Objective: This study aims to assess the feasibility of online recruitment for a randomized controlled trial evaluating the effectiveness of Mindhelper, an online national youth mental health promotion service. The target group was young Danes aged 15-25 in need of mental health promotion.

Methods: Advertisements for recruitment were set up on Facebook and Instagram. Browser history was collected for a subsample of participants. We compared basic characteristics of participants who completed the baseline survey and those who did not, as well as of participants who completed the follow-up survey and those who were lost to follow-up. The significance of these differences was tested with the Pearson chi-square test.

Results: A total of 560 Danes aged 15-25 were recruited within 1 month (ie, had completed the baseline survey). Among these participants, 356 (63.6%) were at risk of developing depression or stress. The average advertisement price per participant completing the baseline questionnaire was 31 DKK (approximately €4 [US $4.2]). The follow-up survey was sent to 545 participants, of whom 318 (58.3%) completed the survey. No statistically significant differences were observed in baseline characteristics of participants who completed the follow-up and those who were lost to follow-up in terms of gender (P=.45), age (P=.35), occupation (P=.17), cohabitation (P=.90), mental well-being (P=.26), mental illness (P=.44; impact of the illness, P=.05), or use of the internet when having a hard time (P=.92).

Conclusions: We conclude that it is feasible to recruit young Danes online for a large-scale randomized controlled trial assessing the effectiveness of Mindhelper.

Trial registration: ClinicalTrials.gov NCT04650906; https://ichgcp.net/clinical-trials-registry/NCT04650906.

Keywords: mental health; online; recruitment; web based; well-being; young people.

Conflict of interest statement

Conflicts of Interest: None declared.

©Sofie Have Hoffmann, Anna Paldam Folker, Mark Buskbjerg, Marie Paldam Folker, Andrea Huber Jezek, Durita Lyngsø Svarta, Ida Nielsen Sølvhøj, Lau Thygesen. Originally published in JMIR Formative Research (https://formative.jmir.org), 25.05.2022.

Figures

Figure 1
Figure 1
Study flowchart presenting participant recruitment.

References

    1. Liu Y, Pencheon E, Hunter RM, Moncrieff J, Freemantle N. Recruitment and retention strategies in mental health trials - A systematic review. PLoS One. 2018;13(8):e0203127. doi: 10.1371/journal.pone.0203127. PONE-D-18-00827
    1. Iannaccone CK, Fossel A, Tsao H, Cui J, Weinblatt M, Shadick N. Factors associated with attrition in a longitudinal rheumatoid arthritis registry. Arthritis Care Res (Hoboken) 2013 Jul 01;65(7):1183–9. doi: 10.1002/acr.21940. doi: 10.1002/acr.21940.
    1. Leonard A, Hutchesson M, Patterson A, Chalmers K, Collins C. Recruitment and retention of young women into nutrition research studies: practical considerations. Trials. 2014 Jan 16;15:23. doi: 10.1186/1745-6215-15-23. 1745-6215-15-23
    1. Smith KL, Straker LM, McManus A, Fenner AA. Barriers and enablers for participation in healthy lifestyle programs by adolescents who are overweight: a qualitative study of the opinions of adolescents, their parents and community stakeholders. BMC Pediatr. 2014 Feb 19;14(1):53. doi: 10.1186/1471-2431-14-53. 1471-2431-14-53
    1. Johnson J. Share of individuals using the internet daily in Denmark 2020, by age group. Statista. [2022-05-05]. .
    1. Tankovska H. Share of social media users in Denmark 2017-2020, by age group. Statista. [2022-05-05]. .
    1. Tankovska H. Most popular social networks in Denmark 2021, by market share. Statista. 2021. May 05, [2022-05-05]. .
    1. Kesse-Guyot E, Assmann K, Andreeva V, Castetbon K, Méjean Caroline, Touvier M, Salanave B, Deschamps V, Péneau Sandrine, Fezeu L, Julia C, Allès Benjamin, Galan P, Hercberg S. Lessons Learned From Methodological Validation Research in E-Epidemiology. JMIR Public Health Surveill. 2016 Oct 18;2(2):e160. doi: 10.2196/publichealth.5880. v2i2e160
    1. Kesse-Guyot E, Andreeva V, Castetbon K, Vernay M, Touvier M, Méjean Caroline, Julia C, Galan P, Hercberg S. Participant profiles according to recruitment source in a large Web-based prospective study: experience from the Nutrinet-Santé study. J Med Internet Res. 2013 Sep 13;15(9):e205. doi: 10.2196/jmir.2488. v15i9e205
    1. Huybrechts KF, Mikkelsen EM, Christensen T, Riis AH, Hatch EE, Wise LA, Sørensen Henrik Toft, Rothman KJ. A successful implementation of e-epidemiology: the Danish pregnancy planning study 'Snart-Gravid'. Eur J Epidemiol. 2010 May 11;25(5):297–304. doi: 10.1007/s10654-010-9431-y.
    1. Wise LA, Rothman KJ, Mikkelsen EM, Stanford JB, Wesselink AK, McKinnon C, Gruschow SM, Horgan CE, Wiley AS, Hahn KA, Sørensen Henrik Toft, Hatch EE. Design and Conduct of an Internet-Based Preconception Cohort Study in North America: Pregnancy Study Online. Paediatr Perinat Epidemiol. 2015 Jul;29(4):360–71. doi: 10.1111/ppe.12201.
    1. Harris ML, Loxton D, Wigginton B, Lucke JC. Recruiting online: lessons from a longitudinal survey of contraception and pregnancy intentions of young Australian women. Am J Epidemiol. 2015 May 15;181(10):737–46. doi: 10.1093/aje/kwv006.kwv006
    1. McAlindon T, Formica Margaret, Kabbara Karim, LaValley Michael, Lehmer Melissa. Conducting clinical trials over the internet: feasibility study. BMJ. 2003 Aug 30;327(7413):484–7. doi: 10.1136/bmj.327.7413.484. 327/7413/484
    1. Thornton LK, Harris K, Baker AL, Johnson M, Kay-Lambkin FJ. Recruiting for addiction research via Facebook. Drug Alcohol Rev. 2016 Jul;35(4):494–502. doi: 10.1111/dar.12305.
    1. Zlotorzynska M, Bauermeister JA, Golinkoff JM, Lin W, Sanchez TH, Hightow-Weidman L. Online recruitment of youth for mHealth studies. Mhealth. 2021;7:27. doi: 10.21037/mhealth-20-64. doi: 10.21037/-07-20-64
    1. Kayrouz R, Dear BF, Karin E, Titov N. Facebook as an effective recruitment strategy for mental health research of hard to reach populations. Internet Interv. 2016 May;4:1–10. doi: 10.1016/j.invent.2016.01.001. S2214-7829(16)00002-6
    1. Amon KL, Campbell AJ, Hawke C, Steinbeck K. Facebook as a recruitment tool for adolescent health research: a systematic review. Acad Pediatr. 2014;14(5):439–447.e4. doi: 10.1016/j.acap.2014.05.049.S1876-2859(14)00186-7
    1. Whitaker C, Stevelink S, Fear N. The Use of Facebook in Recruiting Participants for Health Research Purposes: A Systematic Review. J Med Internet Res. 2017 Aug 28;19(8):e290. doi: 10.2196/jmir.7071. v19i8e290
    1. Christensen T, Riis AH, Hatch EE, Wise LA, Nielsen MG, Rothman KJ, Toft Sørensen Henrik, Mikkelsen EM. Costs and Efficiency of Online and Offline Recruitment Methods: A Web-Based Cohort Study. J Med Internet Res. 2017 Mar 01;19(3):e58. doi: 10.2196/jmir.6716. v19i3e58
    1. Leach LS, Butterworth P, Poyser C, Batterham PJ, Farrer LM. Online Recruitment: Feasibility, Cost, and Representativeness in a Study of Postpartum Women. J Med Internet Res. 2017 Mar 08;19(3):e61. doi: 10.2196/jmir.5745. v19i3e61
    1. Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, Gunasekaran B, Wark JD. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res. 2012 Feb 01;14(1):e20. doi: 10.2196/jmir.1978. v14i1e20
    1. Brøgger-Mikkelsen Mette, Ali Z, Zibert JR, Andersen AD, Thomsen SF. Online Patient Recruitment in Clinical Trials: Systematic Review and Meta-Analysis. J Med Internet Res. 2020 Nov 04;22(11):e22179. doi: 10.2196/22179. v22i11e22179
    1. Thornton Louise, Batterham Philip J, Fassnacht Daniel B, Kay-Lambkin Frances, Calear Alison L, Hunt Sally. Recruiting for health, medical or psychosocial research using Facebook: Systematic review. Internet Interv. 2016 May;4:72–81. doi: 10.1016/j.invent.2016.02.001. S2214-7829(15)30016-6
    1. Etter J F, Perneger T V. A comparison of cigarette smokers recruited through the Internet or by mail. Int J Epidemiol. 2001 Jun;30(3):521–5. doi: 10.1093/ije/30.3.521.
    1. Guo X, Vittinghoff E, Olgin JE, Marcus GM, Pletcher MJ. Volunteer Participation in the Health eHeart Study: A Comparison with the US Population. Sci Rep. 2017 May 16;7(1):1956. doi: 10.1038/s41598-017-02232-y. doi: 10.1038/s41598-017-02232-y.10.1038/s41598-017-02232-y
    1. Benedict C, Hahn AL, Diefenbach MA, Ford JS. Recruitment via social media: advantages and potential biases. Digit Health. 2019;5:2055207619867223. doi: 10.1177/2055207619867223. 10.1177_2055207619867223
    1. Jeppesen P, Obel C, Lund L, Madsen KB, Nielsen L, Nordentoft M. Mental sundhed og sygdom hos børn og unge i alderen 10-24 år - forekomst, udvikling og forebyggelsesmuligheder. København, Denmark: Vidensråd For Forebyggelse; 2018. Dec 03,
    1. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, Burstein R, Murray CJL, Vos T. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. The Lancet. 2013 Nov 09;382(9904):1575–1586. doi: 10.1016/S0140-6736(13)61611-6.S0140-6736(13)61611-6
    1. McGorry P, Bates T, Birchwood M. Designing youth mental health services for the 21st century: examples from Australia, Ireland and the UK. Br J Psychiatry Suppl. 2013 Jan;54:s30–5. doi: 10.1192/bjp.bp.112.119214.202/s54/s30
    1. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010 Dec 30;10:113. doi: 10.1186/1471-244X-10-113. 1471-244X-10-113
    1. Rickwood DJ, Deane FP, Wilson CJ. When and how do young people seek professional help for mental health problems? Med J Aust. 2007 Oct 01;187(S7):S35–9. doi: 10.5694/j.1326-5377.2007.tb01334.x.ric10279_fm
    1. Andrews G, Issakidis C, Carter G. Shortfall in mental health service utilisation. Br J Psychiatry. 2001 Nov 02;179(5):417–25. doi: 10.1192/bjp.179.5.417.S0007125000267792
    1. Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, Morgan C, Rüsch N, Brown JSL, Thornicroft G. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015 Jan;45(1):11–27. doi: 10.1017/S0033291714000129.S0033291714000129
    1. Salaheddin K, Mason B. Identifying barriers to mental health help-seeking among young adults in the UK: a cross-sectional survey. Br J Gen Pract. 2016 Sep 29;66(651):e686–e692. doi: 10.3399/bjgp16x687313.
    1. Kahl B, Miller H, Cairns K, Giniunas H, Welland L, Nicholas M. A measurable impact: Helping young people to be and stay well. Pyrmont, NSW, Australia: ReachOut; 2020. Jan 01, p. 2020.
    1. Kauer SD, Buhagiar K, Blake V, Cotton S, Sanci L. Facilitating mental health help-seeking by young adults with a dedicated online program: a feasibility study of Link. BMJ Open. 2017 Jul 09;7(7):e015303. doi: 10.1136/bmjopen-2016-015303. bmjopen-2016-015303
    1. Le LK, Sanci L, Chatterton ML, Kauer S, Buhagiar K, Mihalopoulos C. The Cost-Effectiveness of an Internet Intervention to Facilitate Mental Health Help-Seeking by Young Adults: Randomized Controlled Trial. J Med Internet Res. 2019 Jul 22;21(7):e13065. doi: 10.2196/13065. v21i7e13065
    1. Sanci L, Kauer S, Thuraisingam S, Davidson S, Duncan A, Chondros P, Mihalopoulos C, Buhagiar K. Effectiveness of a Mental Health Service Navigation Website (Link) for Young Adults: Randomized Controlled Trial. JMIR Ment Health. 2019 Oct 17;6(10):e13189. doi: 10.2196/13189. v6i10e13189
    1. Bidargaddi N, Musiat P, Winsall M, Vogl G, Blake V, Quinn S, Orlowski S, Antezana G, Schrader G. Efficacy of a Web-Based Guided Recommendation Service for a Curated List of Readily Available Mental Health and Well-Being Mobile Apps for Young People: Randomized Controlled Trial. J Med Internet Res. 2017 May 12;19(5):e141. doi: 10.2196/jmir.6775. v19i5e141
    1. O'Dea B, Han J, Batterham PJ, Achilles MR, Calear AL, Werner-Seidler A, Parker B, Shand F, Christensen H. A randomised controlled trial of a relationship-focussed mobile phone application for improving adolescents' mental health. J Child Psychol Psychiatry. 2020 Aug;61(8):899–913. doi: 10.1111/jcpp.13294.
    1. The Mindhelper Team Mindhelper. [2022-05-07].
    1. Moffitt TE, Caspi A. Psychiatry's Opportunity to Prevent the Rising Burden of Age-Related Disease. JAMA Psychiatry. 2019 May 01;76(5):461–462. doi: 10.1001/jamapsychiatry.2019.0037. 2729445
    1. Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc. 2015 Jan;44(1):90–113. doi: 10.1007/s10964-014-0165-0.
    1. Facebook Vejledning til Facebook-annoncer. Facebook. [2022-05-06]. .
    1. SurveyXact. [2022-05-08]. .
    1. de Wit M, Pouwer F, Gemke RJ, Delemarre-van de Waal HA, Snoek FJ. Validation of the WHO-5 Well-Being Index in adolescents with type 1 diabetes. Diabetes Care. 2007 Aug 02;30(8):2003–6. doi: 10.2337/dc07-0447.dc07-0447
    1. Bech P, Olsen LR, Kjoller M, Rasmussen NK. Measuring well-being rather than the absence of distress symptoms: a comparison of the SF-36 Mental Health subscale and the WHO-Five Well-Being Scale. Int J Methods Psychiatr Res. 2003 Jun;12(2):85–91. doi: 10.1002/mpr.145.
    1. Haver A, Akerjordet K, Caputi P, Furunes T, Magee C. Measuring mental well-being: A validation of the Short Warwick-Edinburgh Mental Well-Being Scale in Norwegian and Swedish. Scand J Public Health. 2015 Nov 03;43(7):721–7. doi: 10.1177/1403494815588862.1403494815588862
    1. Wilson C, Deane F, Ciarrochi J, Rickwood D. Measuring Help-Seeking Intentions: Properties of the General Help Seeking Questionnaire. Canadian Journal of Counselling. 2005;39(1):15. doi: 10.1037/t42876-000.
    1. de Rada VD, de Leeuw ED, Hox JJ, Dillman DA. International Handbook of Survey Methodology. New York, NY: Oxford University Press; 2009. pp. 551–554.
    1. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, Lancaster GA, PAFS consensus group CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud. 2016 Oct 21;2(1):64. doi: 10.1186/s40814-016-0105-8.105
    1. Liverpool S, Mota CP, Sales CMD, Čuš Anja, Carletto S, Hancheva C, Sousa S, Cerón Sonia Conejo, Moreno-Peral P, Pietrabissa G, Moltrecht B, Ulberg R, Ferreira N, Edbrooke-Childs J. Engaging Children and Young People in Digital Mental Health Interventions: Systematic Review of Modes of Delivery, Facilitators, and Barriers. J Med Internet Res. 2020 Jun 23;22(6):e16317. doi: 10.2196/16317. v22i6e16317

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe