Use of Videos Improves Informed Consent Comprehension in Web-Based Surveys Among Internet-Using Men Who Have Sex With Men: A Randomized Controlled Trial

Eric William Hall, Travis H Sanchez, Aryeh D Stein, Rob Stephenson, Maria Zlotorzynska, Robert Craig Sineath, Patrick S Sullivan, Eric William Hall, Travis H Sanchez, Aryeh D Stein, Rob Stephenson, Maria Zlotorzynska, Robert Craig Sineath, Patrick S Sullivan

Abstract

Background: Web-based surveys are increasingly used to capture data essential for human immunodeficiency virus (HIV) prevention research. However, there are challenges in ensuring the informed consent of Web-based research participants.

Objective: The aim of our study was to develop and assess the efficacy of alternative methods of administering informed consent in Web-based HIV research with men who have sex with men (MSM).

Methods: From July to September 2014, paid advertisements on Facebook were used to recruit adult MSM living in the United States for a Web-based survey about risk and preventive behaviors. Participants were randomized to one of the 4 methods of delivering informed consent: a professionally produced video, a study staff-produced video, a frequently asked questions (FAQs) text page, and a standard informed consent text page. Following the behavior survey, participants answered 15 questions about comprehension of consent information. Correct responses to each question were given a score of 1, for a total possible scale score of 15. General linear regression and post-hoc Tukey comparisons were used to assess difference (P<.001) in mean consent comprehension scores. A mediation analysis was used to examine the relationship between time spent on consent page and consent comprehension.

Results: Of the 665 MSM participants who completed the comprehension questions, 24.2% (161/665) received the standard consent, 27.1% (180/665) received the FAQ consent, 26.8% (178/665) received the professional consent video, and 22.0% (146/665) received the staff video. The overall average consent comprehension score was 6.28 (SD=2.89). The average consent comprehension score differed significantly across consent type (P<.001), age (P=.04), race or ethnicity (P<.001), and highest level of education (P=.001). Compared with those who received the standard consent, comprehension was significantly higher for participants who received the professional video consent (score increase=1.79; 95% CI 1.02-2.55) and participants who received the staff video consent (score increase=1.79; 95% CI 0.99-2.59). There was no significant difference in comprehension for those who received the FAQ consent. Participants spent more time on the 2 video consents (staff video median time=117 seconds; professional video median time=115 seconds) than the FAQ (median=21 seconds) and standard consents (median=37 seconds). Mediation analysis showed that though time spent on the consent page was partially responsible for some of the differences in comprehension, the direct effects of the professional video (score increase=0.93; 95% CI 0.39-1.48) and the staff-produced video (score increase=0.99; 95% CI 0.42-1.56) were still significant.

Conclusions: Video-based consent methods improve consent comprehension of MSM participating in a Web-based HIV behavioral survey. This effect may be partially mediated through increased time spent reviewing the consent material; however, the video consent may still be superior to standard consent in improving participant comprehension of key study facts.

Trail registration: Clinicaltrials.gov NCT02139566; https://ichgcp.net/clinical-trials-registry/NCT02139566 (Archived by WebCite at http://www.webcitation.org/6oRnL261N).

Keywords: HIV; informed consent; surveys and questionnaires.

Conflict of interest statement

Conflicts of Interest: None declared.

©Eric William Hall, Travis H Sanchez, Aryeh D Stein, Rob Stephenson, Maria Zlotorzynska, Robert Craig Sineath, Patrick S Sullivan. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 06.03.2017.

Figures

Figure 1
Figure 1
Consort diagram and study scheme for participant enrollment of men who have sex with men in a randomized trial of informed consent methods, United States, 2014.
Figure 2
Figure 2
Correlation of time spent on informed consent and consent comprehension score, by type of informed consent, among 665 MSM in a randomized trial of informed consent methods, United States, 2014.
Figure 3
Figure 3
Boxplot of consent comprehension scores, by type of informed consent, among 665 men who have sex with men in a randomized trial of informed consent methods, United States, 2014.

References

    1. CDC. [2016-09-22]. HIV Surveillance Report
    1. Beyrer C, Sullivan P, Sanchez J, Baral SD, Collins C, Wirtz AL, Altman D, Trapence G, Mayer K. The increase in global HIV epidemics in MSM. AIDS. 2013 Nov 13;27(17):2665–78. doi: 10.1097/01.aids.0000432449.30239.fe.
    1. Beyrer C, Baral SD, van Griensven F, Goodreau SM, Chariyalertsak S, Wirtz AL, Brookmeyer R. Global epidemiology of HIV infection in men who have sex with men. Lancet. 2012 Jul 28;380(9839):367–77. doi: 10.1016/S0140-6736(12)60821-6.
    1. Sullivan PS, Hamouda O, Delpech V, Geduld JE, Prejean J, Semaille C, Kaldor J, Folch C, Op de Coul E, Marcus U, Hughes G, Archibald CP, Cazein F, McDonald A, Casabona J, van Sighem A, Fenton KA, Annecy MSM Epidemiology Study Group Reemergence of the HIV epidemic among men who have sex with men in North America, Western Europe, and Australia, 1996-2005. Ann Epidemiol. 2009 Jun;19(6):423–31. doi: 10.1016/j.annepidem.2009.03.004.
    1. Liau A, Millett G, Marks G. Meta-analytic examination of online sex-seeking and sexual risk behavior among men who have sex with men. Sex Transm Dis. 2006 Sep;33(9):576–84. doi: 10.1097/01.olq.0000204710.35332.c5.
    1. Garofalo R, Herrick A, Mustanski BS, Donenberg GR. Tip of the Iceberg: young men who have sex with men, the Internet, and HIV risk. Am J Public Health. 2007 Jun;97(6):1113–7. doi: 10.2105/AJPH.2005.075630.
    1. Grov C, Breslow AS, Newcomb ME, Rosenberger JG, Bauermeister JA. Gay and bisexual men's use of the Internet: research from the 1990s through 2013. J Sex Res. 2014;51(4):390–409. doi: 10.1080/00224499.2013.871626.
    1. Lewnard JA, Berrang-Ford L. Internet-based partner selection and risk for unprotected anal intercourse in sexual encounters among men who have sex with men: a meta-analysis of observational studies. Sex Transm Infect. 2014 Jun;90(4):290–6. doi: 10.1136/sextrans-2013-051332.
    1. Perrin A, Duggan M. Pew Research Center. [2016-09-22]. Americans' Internet Access: 2000-2015
    1. Sullivan PS, Carballo-Diéguez A, Coates T, Goodreau SM, McGowan I, Sanders EJ, Smith A, Goswami P, Sanchez J. Successes and challenges of HIV prevention in men who have sex with men. Lancet. 2012 Jul 28;380(9839):388–99. doi: 10.1016/S0140-6736(12)60955-6.
    1. Chiasson MA, Parsons JT, Tesoriero JM, Carballo-Dieguez A, Hirshfield S, Remien RH. HIV behavioral research online. J Urban Health. 2006 Jan;83(1):73–85. doi: 10.1007/s11524-005-9008-3.
    1. Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health. 2003 Jan;57(1):68–73.
    1. Ross MW. Typing, doing, and being: sexuality and the internet. J Sex Res. 2005 Nov;42(4):342–52. doi: 10.1080/00224490509552290.
    1. Sanchez T, Smith A, Denson D, Dinenno E, Lansky A. Internet-based methods may reach higher-risk men who have sex with men not reached through venue-based sampling. Open AIDS J. 2012;6:83–9. doi: 10.2174/1874613601206010083.
    1. Hernandez-Romieu AC, Sullivan PS, Sanchez TH, Kelley CF, Peterson JL, Del RC, Salazar LF, Frew PM, Rosenberg ES. The comparability of men who have sex with men recruited from venue-time-space sampling and facebook: a cohort study. JMIR Res Protoc. 2014;3(3):e37. doi: 10.2196/resprot.3342.
    1. Shi L, Wei C, McFarland W, Yan H, Li J, Raymond HF. Comparing samples of men who have sex with men recruited online and in venues, Jiangsu Province, China, 2013. LGBT Health. 2016 Jun;3(3):238–42. doi: 10.1089/lgbt.2014.0129.
    1. Tsui HY, Lau JT. Comparison of risk behaviors and socio-cultural profile of men who have sex with men survey respondents recruited via venues and the internet. BMC Public Health. 2010;10:232. doi: 10.1186/1471-2458-10-232.
    1. Evans AR, Wiggins RD, Mercer CH, Bolding GJ, Elford J. Men who have sex with men in Great Britain: comparison of a self-selected internet sample with a national probability sample. Sex Transm Infect. 2007 Jun;83(3):200–5; discussion 205. doi: 10.1136/sti.2006.023283.
    1. Pequegnat W, Rosser BR, Bowen AM, Bull SS, DiClemente RJ, Bockting WO, Elford J, Fishbein M, Gurak L, Horvath K, Konstan J, Noar SM, Ross MW, Sherr L, Spiegel D, Zimmerman R. Conducting Internet-based HIV/STD prevention survey research: considerations in design and evaluation. AIDS Behav. 2007 Jul;11(4):505–21. doi: 10.1007/s10461-006-9172-9.
    1. Sullivan PS, Khosropour CM, Luisi N, Amsden M, Coggia T, Wingood GM, DiClemente RJ. Bias in online recruitment and retention of racial and ethnic minority men who have sex with men. J Med Internet Res. 2011;13(2):e38. doi: 10.2196/jmir.1797.
    1. Sullivan PS, Grey JA, Simon RB. Emerging technologies for HIV prevention for MSM: what we have learned, and ways forward. J Acquir Immune Defic Syndr. 2013 Jun 1;63 Suppl 1:S102–7. doi: 10.1097/QAI.0b013e3182949e85.
    1. Curtis BL. Social networking and online recruiting for HIV research: ethical challenges. J Empir Res Hum Res Ethics. 2014 Feb;9(1):58–70. doi: 10.1525/jer.2014.9.1.58.
    1. Bull SS, Breslin LT, Wright EE, Black SR, Levine D, Santelli JS. Case study: an ethics case study of HIV prevention research on Facebook: the Just/Us study. J Pediatr Psychol. 2011;36(10):1082–92. doi: 10.1093/jpepsy/jsq126.
    1. Purcell K. Pew Research Center. 2013. [2016-09-22]. Online Video 2013
    1. Rosser BR, Gurak L, Horvath KJ, Oakes JM, Konstan J, Danilenko GP. The challenges of ensuring participant consent in internet-based sex studies: a case study of the Men's INTernet Sex (MINTS-I and II) studies. J Comput Mediat Commun. 2009 Apr;14(3):602–626. doi: 10.1111/j.1083-6101.2009.01455.x.
    1. Arora A, Rajagopalan S, Shafiq N, Pandhi P, Bhalla A, Dhibar DP, Malhotra S. Development of tool for the assessment of comprehension of informed consent form in healthy volunteers participating in first-in-human studies. Contemp Clin Trials. 2011 Nov;32(6):814–7. doi: 10.1016/j.cct.2011.05.012.
    1. US Department of Health Human Services HHS. 2009. [2017-02-21]. Code of Federal Regulations .
    1. Bauermeister J, Pingel E, Zimmerman M, Couper M, Carballo-Diéguez A, Strecher VJ. Data quality in web-based HIV/AIDS research: handling invalid and suspicious data. Field methods. 2012 Aug 1;24(3):272–291. doi: 10.1177/1525822X12443097.
    1. Von AL, Blum M, Hopper N, Langford J. Advances in Cryptology — EUROCRYPT 2003. EUROCRYPT 2003. Lecture Notes in Computer Science, vol 2656. Berlin, Heidelberg: Springer; 2003. CAPTCHA: Using hard AI problems for security; pp. 294–311.
    1. Tukey JW. Comparing individual means in the analysis of variance. Biometrics. 1949 Jun;5(2):99–114.
    1. Hayes AF, Preacher KJ. Statistical mediation analysis with a multicategorical independent variable. Br J Math Stat Psychol. 2014 Nov;67(3):451–70. doi: 10.1111/bmsp.12028.
    1. Schenker Y, Fernandez A, Sudore R, Schillinger D. Interventions to improve patient comprehension in informed consent for medical and surgical procedures: a systematic review. Med Decis Making. 2011;31(1):151–73. doi: 10.1177/0272989X10364247.
    1. Grey JA, Konstan J, Iantaffi A, Wilkerson JM, Galos D, Rosser BR. An updated protocol to detect invalid entries in an online survey of men who have sex with men (MSM): how do valid and invalid submissions compare? AIDS Behav. 2015 Oct;19(10):1928–37. doi: 10.1007/s10461-015-1033-y.
    1. Sanchez TH, Sineath RC, Kahle EM, Tregear SJ, Sullivan PS. The annual American men's internet survey of behaviors of men who have sex with men in the United States: protocol and key indicators report 2013. JMIR Public Health Surveill. 2015;1(1):e3. doi: 10.2196/publichealth.4314.
    1. Sanchez T, Zlotorzynska M, Sineath C, Kahle E, Sullivan P. The annual American men's internet survey of behaviors of men who have sex with men in the United States: 2014 key indicators report. JMIR Public Health Surveill. 2016;2(1):e23. doi: 10.2196/publichealth.5476.
    1. Sanchez T, Smith A, Denson D, Dinenno E, Lansky A. Developing a web-based HIV behavioral surveillance pilot project among men who have sex with men. Open AIDS J. 2012;6:224–31. doi: 10.2174/1874613601206010224.
    1. Stephenson R, Chard A, Finneran C, Sullivan P. Willingness to use couples voluntary counseling and testing services among men who have sex with men in seven countries. AIDS Care. 2014 Feb;26(2):191–8. doi: 10.1080/09540121.2013.808731.
    1. Chard AN, Finneran C, Sullivan PS, Stephenson R. Experiences of homophobia among gay and bisexual men: results from a cross-sectional study in seven countries. Cult Health Sex. 2015;17(10):1174–89. doi: 10.1080/13691058.2015.1042917.
    1. Chiu CJ, Menacho L, Fisher C, Young SD. Ethics issues in social media-based HIV prevention in low- and middle-income countries. Camb Q Healthc Ethics. 2015 Jul;24(3):303–10. doi: 10.1017/S0963180114000620.
    1. Krogstad DJ, Diop S, Diallo A, Mzayek F, Keating J, Koita OA, Touré YT. Informed consent in international research: the rationale for different approaches. Am J Trop Med Hyg. 2010 Oct;83(4):743–7. doi: 10.4269/ajtmh.2010.10-0014.
    1. Aldridge J, Charles V. Researching the intoxicated: informed consent implications for alcohol and drug research. Drug Alcohol Depend. 2008 Mar 1;93(3):191–6. doi: 10.1016/j.drugalcdep.2007.09.001.
    1. Smith A. Pew Research Center. [2016-09-22]. US smartphone use in 2015
    1. Grov C, Ventuneac A, Rendina HJ, Jimenez RH, Parsons JT. Perceived importance of five different health issues for gay and bisexual men: implications for new directions in health education and prevention. Am J Mens Health. 2013 Jul;7(4):274–84. doi: 10.1177/1557988312463419.

Source: PubMed

3
구독하다