Developing a Mobile App (LYNX) to Support Linkage to HIV/Sexually Transmitted Infection Testing and Pre-Exposure Prophylaxis for Young Men Who Have Sex With Men: Protocol for a Randomized Controlled Trial

Albert Liu, Kenneth Coleman, Kelly Bojan, Pedro Alonso Serrano, Temitope Oyedele, Amayvis Garcia, Elizabeth Enriquez-Bruce, Patricia Emmanuel, Jeb Jones, Patrick Sullivan, Lisa Hightow-Weidman, Susan Buchbinder, Hyman Scott, Albert Liu, Kenneth Coleman, Kelly Bojan, Pedro Alonso Serrano, Temitope Oyedele, Amayvis Garcia, Elizabeth Enriquez-Bruce, Patricia Emmanuel, Jeb Jones, Patrick Sullivan, Lisa Hightow-Weidman, Susan Buchbinder, Hyman Scott

Abstract

Background: Young men who have sex with men (YMSM) in the United States have among the highest incidence of HIV and sexually transmitted infection (STI) and the lowest uptake of HIV and STI testing and pre-exposure prophylaxis (PrEP). Nearly universal mobile phone ownership among youth provides an opportunity to leverage mobile health apps to increase HIV/STI testing and PrEP uptake among YMSM.

Objective: The goals of this project are to develop and refine LYNX, a novel mobile app to support linkage to HIV/STIs testing and PrEP services among YMSM in the United States, and to evaluate the acceptability and feasibility of LYNX in a pilot randomized controlled trial (RCT).

Methods: This research protocol will be conducted in 3 phases: an iterative development phase with a series of 3 focus groups among 20 YMSM to refine the LYNX app; an open technical pilot among 15 YMSM to optimize usability of the app; and then a 6-month pilot RCT among 60 HIV-uninfected YMSM at risk for HIV acquisition. Developed using the Information, Motivation, and Behavioral skills theoretical model, the LYNX app includes an electronic diary to track sexual behaviors (information), a personalized risk score to promote accurate risk perception (information/motivation), testing reminders (motivation/behavioral skills), and access to home-based HIV/STI testing options and geospatial-based HIV/STI testing care sites (behavioral skills). Feasibility and acceptability will be assessed through app analytics of usage patterns and acceptability scales administered via computer-assisted self-interview at 3 and 6 months. We will also evaluate preliminary efficacy by comparing the proportion of YMSM who test at least once during the 6-month pilot and the proportion who successfully link to a PrEP provider in the intervention versus control groups.

Results: Formative work is currently underway. The LYNX pilot RCT will begin enrollment in October 2018, with study results available in 2019.

Conclusions: The LYNX app is one of the first mobile apps designed to increase HIV/STI testing and PrEP uptake among YMSM. As low-perceived risk is a barrier to HIV/STI testing and PrEP use among youth, the personalized risk assessment and interactive sexual diary in LYNX could assist YMSM in better understanding their HIV risk and providing motivation to test for HIV/STIs and initiate PrEP. Coupled with community-based recruitment, this novel mobile app has great potential to reach and engage YMSM not currently involved in care and increase rates of HIV/STI testing and PrEP uptake in this vulnerable population.

Trial registration: ClinicalTrials.gov NCT03177512; https://ichgcp.net/clinical-trials-registry/NCT03177512 (Archived by WebCite at http://www.webcitation.org/73c917wAw).

International registered report identifier (irrid): PRR1-10.2196/10659.

Keywords: HIV testing; adolescent; men who have sex with men; mobile app; pre-exposure prophylaxis; sexually transmitted diseases; sexually transmitted infections; youth.

Conflict of interest statement

Conflicts of Interest: AL has led studies for which Gilead Sciences has donated the study drug. SB has been an investigator on studies for which Gilead Sciences has donated the study drug.

©Albert Liu, Kenneth Coleman, Kelly Bojan, Pedro Alonso Serrano, Temitope Oyedele, Amayvis Garcia, Elizabeth Enriquez-Bruce, Patricia Emmanuel, Jeb Jones, Patrick Sullivan, Lisa Hightow-Weidman, Susan Buchbinder, Hyman Scott. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 25.01.2019.

References

    1. CDC. Atlanta, GA: Centers for Disease Control And Prevention; 2017. [2018-11-03]. HIV/AIDS Slide Sets .
    1. CDC. Atlanta, GA: Centers for Disease Control and Prevention; 2016. Nov, [2018-11-03]. HIV Surveillance Report: Diagnoses of HIV Infection in the United States and Dependent Areas .
    1. DiNenno EA, Prejean J, Irwin K, Delaney KP, Bowles K, Martin T, Tailor A, Dumitru G, Mullins MM, Hutchinson AB, Lansky A. Recommendations for HIV screening of gay, bisexual, and other men who have sex with men-United States, 2017. MMWR Morb Mortal Wkly Rep. 2017 Aug 11;66(31):830–2. doi: 10.15585/mmwr.mm6631a3. doi: 10.15585/mmwr.mm6631a3.
    1. Sanchez TH, Sineath RC, Kahle EM, Tregear SJ, Sullivan PS. The annual American men's internet survey of behaviors of men who have sex with men in the United States: protocol and key indicators report 2013. JMIR Public Health Surveill. 2015;1(1):e3. doi: 10.2196/publichealth.4314. v1i1e3
    1. CDC. Atlanta, GA: Centers for Disease Control and Prevention; 2015. Jul, [2018-11-03]. HIV Surveillance Supplemental Report: Monitoring selected national HIV prevention and care objectives by using HIV surveillance data?United States and 6 dependent areas?2013 .
    1. Krieger N. Epidemiology and the web of causation: has anyone seen the spider? Soc Sci Med. 1994 Oct;39(7):887–903.
    1. Baral S, Logie CH, Grosso A, Wirtz AL, Beyrer C. Modified social ecological model: a tool to guide the assessment of the risks and risk contexts of HIV epidemics. BMC Public Health. 2013 May 17;13:482. doi: 10.1186/1471-2458-13-482. 1471-2458-13-482
    1. Poundstone KE, Strathdee SA, Celentano DD. The social epidemiology of human immunodeficiency virus/acquired immunodeficiency syndrome. Epidemiol Rev. 2004;26:22–35. doi: 10.1093/epirev/mxh005.26/1/22
    1. Smith LR, Fisher JD, Cunningham CO, Amico KR. Understanding the behavioral determinants of retention in HIV care: a qualitative evaluation of a situated information, motivation, behavioral skills model of care initiation and maintenance. AIDS Patient Care STDS. 2012 Jun;26(6):344–55. doi: 10.1089/apc.2011.0388.
    1. CDC. Atlanta, GA: Centers for Disease Control and Prevention; 2014. [2018-11-03]. HIV Surveillance Special Report: HIV Risk, Prevention, and Testing Behaviors—National HIV Behavioral Surveillance System: Men Who Have Sex With Men, 20 U.S. Cities, 2011 .
    1. Galvin SR, Cohen MS. The role of sexually transmitted diseases in HIV transmission. Nat Rev Microbiol. 2004 Jan;2(1):33–42. doi: 10.1038/nrmicro794.
    1. Berman SM, Cohen MS. STD treatment: how can it improve HIV prevention in the South? Sex Transm Dis. 2006 Jul;33(7 Suppl):S50–7. doi: 10.1097/01.olq.0000175395.95911.85.
    1. Buchbinder SP, Douglas JM, McKirnan DJ, Judson FN, Katz MH, MacQueen KM. Feasibility of human immunodeficiency virus vaccine trials in homosexual men in the United States: risk behavior, seroincidence, and willingness to participate. J Infect Dis. 1996 Nov;174(5):954–61.
    1. Koblin BA, Husnik MJ, Colfax G, Huang Y, Madison M, Mayer K, Barresi PJ, Coates TJ, Chesney MA, Buchbinder S. Risk factors for HIV infection among men who have sex with men. AIDS. 2006 Mar 21;20(5):731–9. doi: 10.1097/01.aids.0000216374.61442.55.00002030-200603210-00013
    1. Bernstein KT, Marcus JL, Nieri G, Philip SS, Klausner JD. Rectal gonorrhea and chlamydia reinfection is associated with increased risk of HIV seroconversion. J Acquir Immune Defic Syndr. 2010 Apr 01;53(4):537–43. doi: 10.1097/QAI.0b013e3181c3ef29.
    1. Scott KC, Philip S, Ahrens K, Kent CK, Klausner JD. High prevalence of gonococcal and chlamydial infection in men who have sex with men with newly diagnosed HIV infection: an opportunity for same-day presumptive treatment. J Acquir Immune Defic Syndr. 2008 May 01;48(1):109–12. doi: 10.1097/QAI.0b013e318165dc0b.
    1. Koblin BA, Chesney MA, Husnik MJ, Bozeman S, Celum CL, Buchbinder S, Mayer K, McKirnan D, Judson FN, Huang Y, Coates TJ, EXPLORE Study Team High-risk behaviors among men who have sex with men in 6 US cities: baseline data from the EXPLORE Study. Am J Public Health. 2003 Jun;93(6):926–32.
    1. Kent CK, Chaw JK, Wong W, Liska S, Gibson S, Hubbard G, Klausner JD. Prevalence of rectal, urethral, and pharyngeal chlamydia and gonorrhea detected in 2 clinical settings among men who have sex with men: San Francisco, California, 2003. Clin Infect Dis. 2005 Jul 01;41(1):67–74. doi: 10.1086/430704.CID35177
    1. Fleming DT, Wasserheit JN. From epidemiological synergy to public health policy and practice: the contribution of other sexually transmitted diseases to sexual transmission of HIV infection. Sex Transm Infect. 1999 Feb;75(1):3–17. doi: 10.1136/sti.75.1.3.
    1. Zetola NM, Bernstein KT, Wong E, Louie B, Klausner JD. Exploring the relationship between sexually transmitted diseases and HIV acquisition by using different study designs. J Acquir Immune Defic Syndr. 2009 Apr 15;50(5):546–51. doi: 10.1097/QAI.0b013e318195bd2b.
    1. Buchbinder SP, Vittinghoff E, Heagerty PJ, Celum CL, Seage GR, Judson FN, McKirnan D, Mayer KH, Koblin BA. Sexual risk, nitrite inhalant use, and lack of circumcision associated with HIV seroconversion in men who have sex with men in the United States. J Acquir Immune Defic Syndr. 2005 May 01;39(1):82–9.00126334-200505010-00012
    1. Centers for Disease Control and Prevention . CDC. Atlanta, GA: Department of Health and Human Services; 2015. [2018-11-03]. Sexually Transmitted Disease Surveillance .
    1. Bourne C, Knight V, Guy R, Wand H, Lu H, McNulty A. Short message service reminder intervention doubles sexually transmitted infection/HIV re-testing rates among men who have sex with men. Sex Transm Infect. 2011 Apr;87(3):229–31. doi: 10.1136/sti.2010.048397.sti.2010.048397
    1. Centers for Disease Control Prevention HIV testing among men who have sex with men—21 cities, United States, 2008. MMWR Morb Mortal Wkly Rep. 2011 Jun 03;60(21):694–9. mm6021a3
    1. Kellerman SE, Lehman JS, Lansky A, Stevens MR, Hecht FM, Bindman AB, Wortley PM. HIV testing within at-risk populations in the United States and the reasons for seeking or avoiding HIV testing. J Acquir Immune Defic Syndr. 2002 Oct 01;31(2):202–10.
    1. McDaid LM, Hart GJ. Contact with HIV prevention services highest in gay and bisexual men at greatest risk: cross-sectional survey in Scotland. BMC Public Health. 2010 Dec 31;10:798. doi: 10.1186/1471-2458-10-798. 1471-2458-10-798
    1. Miller LG, Simon PA, Miller ME, Long A, Yu EI, Asch SM. High-risk sexual behavior in Los Angeles: who receives testing for HIV? J Acquir Immune Defic Syndr. 1999 Dec 15;22(5):490–7.
    1. Makulowich GS. HIV and STD prevention update. Multisite HIV prevention trial. AIDS Patient Care STDS. 1998 Sep;12(9):725–7. doi: 10.1089/apc.1998.12.725.
    1. Fuqua V, Chen YH, Packer T, Dowling T, Ick TO, Nguyen B, Colfax GN, Raymond HF. Using social networks to reach Black MSM for HIV testing and linkage to care. AIDS Behav. 2012 Feb;16(2):256–65. doi: 10.1007/s10461-011-9918-x.
    1. Finlayson TJ, Le B, Smith A, Bowles K, Cribbin M, Miles I, Oster AM, Martin T, Edwards A, Dinenno E, Centers for Disease Control Prevention HIV risk, prevention, and testing behaviors among men who have sex with men—National HIV Behavioral Surveillance System, 21 U.S. cities, United States, 2008. MMWR Surveill Summ. 2011 Oct 28;60(14):1–34. ss6014a1
    1. MacKellar DA, Valleroy LA, Secura GM, Behel S, Bingham T, Celentano DD, Koblin BA, LaLota M, Shehan D, Thiede H, Torian LV, Young Men's Survey Study Group Perceptions of lifetime risk and actual risk for acquiring HIV among young men who have sex with men. AIDS Behav. 2007 Mar;11(2):263–70. doi: 10.1007/s10461-006-9136-0.
    1. Dorell CG, Sutton MY, Oster AM, Hardnett F, Thomas PE, Gaul ZJ, Mena LA, Heffelfinger JD. Missed opportunities for HIV testing in health care settings among young African American men who have sex with men: implications for the HIV epidemic. AIDS Patient Care STDS. 2011 Nov;25(11):657–64. doi: 10.1089/apc.2011.0203.
    1. Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY, Vargas L, Goicochea P, Casapía M, Guanira-Carranza JV, Ramirez-Cardich ME, Montoya-Herrera O, Fernández T, Veloso VG, Buchbinder SP, Chariyalertsak S, Schechter M, Bekker L, Mayer KH, Kallás EG, Amico KR, Mulligan K, Bushman LR, Hance RJ, Ganoza C, Defechereux P, Postle B, Wang F, McConnell JJ, Zheng J, Lee J, Rooney JF, Jaffe HS, Martinez AI, Burns DN, Glidden DV, iPrEx ST. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med. 2010 Dec 30;363(27):2587–99. doi: 10.1056/NEJMoa1011205.
    1. Anderson PL, Glidden DV, Liu A, Buchbinder S, Lama JR, Guanira JV, McMahan V, Bushman LR, Casapía M, Montoya-Herrera O, Veloso VG, Mayer KH, Chariyalertsak S, Schechter M, Bekker L, Kallás EG, Grant RM, iPrEx Study Team Emtricitabine-tenofovir concentrations and pre-exposure prophylaxis efficacy in men who have sex with men. Sci Transl Med. 2012 Sep 12;4(151):151ra125. doi: 10.1126/scitranslmed.3004006. 4/151/151ra125
    1. Saberi P, Gamarel KE, Neilands TB, Comfort M, Sheon N, Darbes LA, Johnson MO. Ambiguity, ambivalence, and apprehensions of taking HIV-1 pre-exposure prophylaxis among male couples in San Francisco: a mixed methods study. PLoS One. 2012;7(11):e50061. doi: 10.1371/journal.pone.0050061. PONE-D-12-21618
    1. Fuchs JD, Sobieszczyk ME, Madenwald T, Grove D, Karuna ST, Andrasik M, Sherwat A, Broder G, Mayer K, Koblin B, Hammer S, HVTN 505 Protocol Team Intentions to use preexposure prophylaxis among current phase 2B preventive HIV-1 vaccine efficacy trial participants. J Acquir Immune Defic Syndr. 2013 Jul 01;63(3):259–62. doi: 10.1097/QAI.0b013e318296df94.
    1. Krakower DS, Mimiaga MJ, Rosenberger JG, Novak DS, Mitty JA, White JM, Mayer KH. Limited awareness and low immediate uptake of pre-exposure prophylaxis among men who have sex with men using an internet social networking site. PLoS One. 2012;7(3):e33119. doi: 10.1371/journal.pone.0033119. PONE-D-11-19249
    1. Liu A, Cohen S, Follansbee S, Cohan D, Weber S, Sachdev D, Buchbinder S. Early experiences implementing pre-exposure prophylaxis (PrEP) for HIV prevention in San Francisco. PLoS Med. 2014 Mar;11(3):e1001613. doi: 10.1371/journal.pmed.1001613. PMEDICINE-D-13-02139
    1. Bush S, Ng L, Magnuson D, Piontkowsky D, Giler R. Significant Uptake of Truvada for Pre-Exposure Prophylaxis (PrEP) Utilization in the US in Late 2014-1Q2015. IAPC IAPAC Treatment, Prevention, and Adherence Conference; June 28-30, 2015; Miami, FL. 2015.
    1. Sullivan P, Sineath C, Kahle E, Sanchez T. Awareness, willingness and use of oral pre-exposure prophylaxis (PrEP) among a national sample of US men who have sex with men. AIDS IMPACT 2015, Abstract 2362; AIDS Impact; July 28-31,2015; Amsterdam, Netherlands. 2015.
    1. Cohen SE, Vittinghoff E, Bacon O, Doblecki-Lewis S, Postle BS, Feaster DJ, Matheson T, Trainor N, Blue RW, Estrada Y, Coleman ME, Elion R, Castro JG, Chege W, Philip SS, Buchbinder S, Kolber MA, Liu AY. High interest in preexposure prophylaxis among men who have sex with men at risk for HIV infection: baseline data from the US PrEP demonstration project. J Acquir Immune Defic Syndr. 2015 Apr 01;68(4):439–48. doi: 10.1097/QAI.0000000000000479.
    1. Hosek SG, Rudy B, Landovitz R, Kapogiannis B, Siberry G, Rutledge Brandy, Liu Nancy, Brothers Jennifer, Mulligan Kathleen, Zimet Gregory, Lally Michelle, Mayer Kenneth H, Anderson Peter, Kiser Jennifer, Rooney James F, Wilson Craig M. An HIV Preexposure Prophylaxis Demonstration Project and Safety Study for Young MSM. J Acquir Immune Defic Syndr. 2017 Dec 01;74(1):21–29. doi: 10.1097/QAI.0000000000001179.
    1. Gold J, Lim MS, Hocking JS, Keogh LA, Spelman T, Hellard ME. Determining the impact of text messaging for sexual health promotion to young people. Sex Transm Dis. 2011 Apr;38(4):247–52. doi: 10.1097/OLQ.0b013e3181f68d7b.
    1. Holloway IW, Cederbaum JA, Ajayi A, Shoptaw S. Where are the young men in HIV prevention efforts? Comments on HIV prevention programs and research from young men who sex with men in Los Angeles county. J Prim Prev. 2012 Dec;33(5-6):271–8. doi: 10.1007/s10935-012-0282-z.
    1. Eyrich-Garg KM. Mobile phone technology: a new paradigm for the prevention, treatment, and research of the non-sheltered “street” homeless? J Urban Health. 2010 May;87(3):365–80. doi: 10.1007/s11524-010-9456-2.
    1. Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med. 2011 Mar;1(1):53–71. doi: 10.1007/s13142-011-0021-7. 21
    1. Muessig KE, Pike EC, Fowler B, LeGrand S, Parsons JT, Bull SS, Wilson PA, Wohl DA, Hightow-Weidman LB. Putting prevention in their pockets: developing mobile phone-based HIV interventions for black men who have sex with men. AIDS Patient Care STDS. 2013 Apr;27(4):211–22. doi: 10.1089/apc.2012.0404.
    1. Anderson M. Pew Internet. 2015. [2018-11-03]. Technology Device Ownership: 2015 .
    1. Smith A. Pew Internet. 2015. [2018-11-03]. US Smartphone Use in 2015
    1. Anderson M. Pew Research Center. 2015. [2018-11-03]. Racial and ethnic differences in how people use mobile technology
    1. Sex Pro. San Francisco, CA: San Francisco Department of Public Health; 2015. [2018-11-09]. Welcome to Sex Pro!
    1. Bartholow BN, Goli V, Ackers M, McLellan E, Gurwith M, Durham M, Greenberg AE. Demographic and behavioral contextual risk groups among men who have sex with men participating in a phase 3 HIV vaccine efficacy trial: implications for HIV prevention and behavioral/biomedical intervention trials. J Acquir Immune Defic Syndr. 2006 Dec 15;43(5):594–602. doi: 10.1097/01.qai.0000243107.26136.82.
    1. Koblin BA, Mayer KH, Noonan E, Wang CY, Marmor M, Sanchez J, Brown SJ, Robertson MN, Buchbinder SP. Sexual risk behaviors, circumcision status, and preexisting immunity to adenovirus type 5 among men who have sex with men participating in a randomized HIV-1 vaccine efficacy trial: step study. J Acquir Immune Defic Syndr. 2012 Aug 01;60(4):405–13. doi: 10.1097/QAI.0b013e31825325aa.
    1. Scott H, Vittinghoff E, Irvin R, Liu A, Fields S, Magnus M. Sex Pro: A Personalized HIV Risk Assessment Tool for Men Who Have Sex With Men. CROI 2015; February 23-26, 2015; Seattle, WA. 2015.
    1. Hightow-Weidman LB, Muessig K, Rosenberg E, Sanchez T, LeGrand S, Gravens L, Sullivan PS. University of North Carolina/Emory Center for Innovative Technology (iTech) for Addressing the HIV Epidemic Among Adolescents and Young Adults in the United States: Protocol and Rationale for Center Development. JMIR Res Protoc. 2018 Aug 03;7(8):e10365. doi: 10.2196/10365. v7i8e10365
    1. Statista. 2017. [2018-11-03]. Subscriber share held by smartphone operating systems in the United States from January 2012 to June 2017
    1. Brooke J. SUS: a quick and dirty usability scale. In: Jordan P, Thomas BW, McClelland I, editors. Usability Evaluation in Industry. London, UK: Taylor and Francis; 1996. pp. 189–94.
    1. Kernan WN, Viscoli CM, Makuch RW, Brass LM, Horwitz RI. Stratified randomization for clinical trials. J Clin Epidemiol. 1999 Jan;52(1):19–26. doi: 10.1016/S0895-4356(98)00138-3.S0895435698001383
    1. Patton MQ. Qualitative interviewing. Qual Health Res. 2002;3:344–7.
    1. Rotheram-Borus MJ, Wu Z, Liang L, Li L, Detels R, Guan J, Yin Y, Swendeman D, NIMH Collaborative HIV/STD Prevention Trial Group Reductions in sexually transmitted infections associated with popular opinion leaders in China in a randomised controlled trial. Sex Transm Infect. 2011 Jun;87(4):337–43. doi: 10.1136/sti.2010.046243. sti.2010.046243
    1. Horvath KJ, Oakes JM, Rosser BR, Danilenko G, Vezina H, Amico KR, Williams ML, Simoni J. Feasibility, acceptability and preliminary efficacy of an online peer-to-peer social support ART adherence intervention. AIDS Behav. 2013 Jul;17(6):2031–44. doi: 10.1007/s10461-013-0469-1.
    1. Fisher CM. Are information, motivation, and behavioral skills linked with HIV-related sexual risk among young men who have sex with men? J HIV AIDS Soc Serv. 2011;10(1):5–21. doi: 10.1080/15381501.2011.549064.
    1. Misovich S, Fisher W, Fisher J. A measure of AIDS prevention, information, motivation, behavioral skills, and behavior. In: Davis C, Yarber W, Bauserman R, Schreer G, Davis S, editors. Handbook of Sexuality Related Measures. Thousand Oaks, CA: Sage; 1998. pp. 328–37.
    1. WHO ASSIST Working Group The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction. 2002 Sep;97(9):1183–94.185
    1. Bradley KA, DeBenedetti A, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a brief screen for alcohol misuse in primary care. Alcohol Clin Exp Res. 2007 Jul;31(7):1208–17. doi: 10.1111/j.1530-0277.2007.00403.x.ACER403
    1. Jamil MS, Guy RJ, Bavinton BR, Fairley CK, Grulich AE, Holt M, Smith KS, Chen M, McNulty AM, Conway DP, Keen P, Bradley J, Russell D, Kaldor JM, Prestage G, FORTH Investigator Group HIV testing self-efficacy is associated with higher HIV testing frequency and perceived likelihood to self-test among gay and bisexual men. Sex Health. 2017 Apr;14(2):170–8. doi: 10.1071/SH16100.SH16100
    1. Erlen JA, Cha ES, Kim KH, Caruthers D, Sereika SM. The HIV Medication Taking Self-efficacy Scale: psychometric evaluation. J Adv Nurs. 2010 Nov;66(11):2560–72. doi: 10.1111/j.1365-2648.2010.05400.x. JAN5400
    1. Rotheram-Borus M, Murphy D, Coleman C, Kennedy M, Reid H, Cline T, Birnbaum J, Futterman D, Levin L, Schneir A, Chabon B, O'Keefe Z, Kipke M. Risk acts, health care,medical adherence among HIV+ youths in care over time. AIDS and Behavior. 1997;1(1):43–52. doi: 10.1023/A:1026213905034.
    1. Napper LE, Fisher DG, Reynolds GL. Development of the perceived risk of HIV scale. AIDS Behav. 2012 May;16(4):1075–83. doi: 10.1007/s10461-011-0003-2.
    1. Meltzer-Brody S, Churchill E, Davidson JR. Derivation of the SPAN, a brief diagnostic screening test for post-traumatic stress disorder. Psychiatry Res. 1999 Oct;88(1):63–70. doi: 10.1016/s0165-1781(99)00070-0.
    1. Hahn EA, Devellis RF, Bode RK, Garcia SF, Castel LD, Eisen SV, Bosworth HB, Heinemann AW, Rothrock N, Cella D. Measuring social health in the patient-reported outcomes measurement information system (PROMIS): item bank development and testing. Qual Life Res. 2010 Sep;19(7):1035–44. doi: 10.1007/s11136-010-9654-0.
    1. Williams DR, Yan Y, Jackson JS, Anderson NB. Racial differences in physical and mental health: socio-economic status, stress and discrimination. J Health Psychol. 1997 Jul;2(3):335–51. doi: 10.1177/135910539700200305.2/3/335
    1. Hatzenbuehler ML, Nolen-Hoeksema S, Erickson SJ. Minority stress predictors of HIV risk behavior, substance use, and depressive symptoms: results from a prospective study of bereaved gay men. Health Psychol. 2008 Jul;27(4):455–62. doi: 10.1037/0278-6133.27.4.455.2008-09239-007
    1. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4(3):114–23.
    1. Spiegelman D, Hertzmark E. Easy SAS calculations for risk or prevalence ratios and differences. Am J Epidemiol. 2005 Aug 01;162(3):199–200. doi: 10.1093/aje/kwi188.kwi188
    1. Sullivan PS, Jones J, Kishore N, Stephenson R. The roles of technology in primary HIV prevention for men who have sex with men. Curr HIV/AIDS Rep. 2015 Dec;12(4):481–8. doi: 10.1007/s11904-015-0293-5.10.1007/s11904-015-0293-5
    1. Goldenberg T, McDougal SJ, Sullivan PS, Stekler JD, Stephenson R. Preferences for a mobile HIV prevention app for men who have sex with men. JMIR Mhealth Uhealth. 2014 Oct 29;2(4):e47. doi: 10.2196/mhealth.3745. v2i4e47
    1. Sheehan J, Sherman KA. Computerised decision aids: a systematic review of their effectiveness in facilitating high-quality decision-making in various health-related contexts. Patient Educ Couns. 2012 Jul;88(1):69–86. doi: 10.1016/j.pec.2011.11.006.S0738-3991(11)00569-6
    1. Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Légaré F, Thomson R. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011;(10):CD001431. doi: 10.1002/14651858.CD001431.pub3.
    1. Doumas DM, Hannah E. Preventing high-risk drinking in youth in the workplace: a web-based normative feedback program. J Subst Abuse Treat. 2008 Apr;34(3):263–71. doi: 10.1016/j.jsat.2007.04.006.S0740-5472(07)00110-9
    1. Kypri K, McCambridge J, Cunningham JA, Vater T, Bowe S, De Graaf B, Saunders JB, Dean J. Web-based alcohol screening and brief intervention for Māori and non-Māori: the New Zealand e-SBINZ trials. BMC Public Health. 2010;10:781. doi: 10.1186/1471-2458-10-781. 1471-2458-10-781
    1. Harle CA, Downs JS, Padman R. Effectiveness of personalized and interactive health risk calculators: a randomized trial. Med Decis Making. 2012;32(4):594–605. doi: 10.1177/0272989X11431736.0272989X11431736
    1. Wagener TL, Leffingwell TR, Mignogna J, Mignogna MR, Weaver CC, Cooney NJ, Claborn KR. Randomized trial comparing computer-delivered and face-to-face personalized feedback interventions for high-risk drinking among college students. J Subst Abuse Treat. 2012 Sep;43(2):260–7. doi: 10.1016/j.jsat.2011.11.001.S0740-5472(11)00253-4
    1. Grover SA, Lowensteyn I, Joseph L, Kaouache M, Marchand S, Coupal L, Boudreau G, Cardiovascular Health Evaluation to Improve ComplianceKnowledge Among Uninformed Patients (CHECK-UP) Study Group Patient knowledge of coronary risk profile improves the effectiveness of dyslipidemia therapy: the CHECK-UP study: a randomized controlled trial. Arch Intern Med. 2007 Nov 26;167(21):2296–303. doi: 10.1001/archinte.167.21.2296.167/21/2296
    1. Soureti A, Murray P, Cobain M, Chinapaw M, van Mechelen W, Hurling R. Exploratory study of web-based planning and mobile text reminders in an overweight population. J Med Internet Res. 2011 Dec 20;13(4):e118. doi: 10.2196/jmir.1773. v13i4e118
    1. Muessig KE, Pike EC, Legrand S, Hightow-Weidman LB. Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review. J Med Internet Res. 2013;15(1):e1. doi: 10.2196/jmir.2301. v15i1e1
    1. Menza TW, Hughes JP, Celum CL, Golden MR. Prediction of HIV acquisition among men who have sex with men. Sex Transm Dis. 2009 Sep;36(9):547–55. doi: 10.1097/OLQ.0b013e3181a9cc41. 00007435-200909000-00004
    1. Carpenter KM, Stoner SA, Mikko AN, Dhanak LP, Parsons JT. Efficacy of a web-based intervention to reduce sexual risk in men who have sex with men. AIDS Behav. 2010 Jun;14(3):549–57. doi: 10.1007/s10461-009-9578-2.
    1. Horvath K, Ecklund AM, Hunt SL, Nelson TF, Toomey TL. Developing internet-based health interventions: a guide for public health researchers and practitioners. J Med Internet Res. 2015 Jan 23;17(1):e28. doi: 10.2196/jmir.3770. v17i1e28
    1. Carnegie NB, Goodreau SM, Liu A, Vittinghoff E, Sanchez J, Lama JR, Buchbinder S. Targeting pre-exposure prophylaxis among men who have sex with men in the United States and Peru: partnership types, contact rates, and sexual role. J Acquir Immune Defic Syndr. 2015 May 01;69(1):119–25. doi: 10.1097/QAI.0000000000000555. 00126334-201505010-00016

Source: PubMed

3
Tilaa