Hormonal contraception and the risk of HIV acquisition: an individual participant data meta-analysis

Charles S Morrison, Pai-Lien Chen, Cynthia Kwok, Jared M Baeten, Joelle Brown, Angela M Crook, Lut Van Damme, Sinead Delany-Moretlwe, Suzanna C Francis, Barbara A Friedland, Richard J Hayes, Renee Heffron, Saidi Kapiga, Quarraisha Abdool Karim, Stephanie Karpoff, Rupert Kaul, R Scott McClelland, Sheena McCormack, Nuala McGrath, Landon Myer, Helen Rees, Ariane van der Straten, Deborah Watson-Jones, Janneke H H M van de Wijgert, Randy Stalter, Nicola Low, Charles S Morrison, Pai-Lien Chen, Cynthia Kwok, Jared M Baeten, Joelle Brown, Angela M Crook, Lut Van Damme, Sinead Delany-Moretlwe, Suzanna C Francis, Barbara A Friedland, Richard J Hayes, Renee Heffron, Saidi Kapiga, Quarraisha Abdool Karim, Stephanie Karpoff, Rupert Kaul, R Scott McClelland, Sheena McCormack, Nuala McGrath, Landon Myer, Helen Rees, Ariane van der Straten, Deborah Watson-Jones, Janneke H H M van de Wijgert, Randy Stalter, Nicola Low

Abstract

Background: Observational studies of a putative association between hormonal contraception (HC) and HIV acquisition have produced conflicting results. We conducted an individual participant data (IPD) meta-analysis of studies from sub-Saharan Africa to compare the incidence of HIV infection in women using combined oral contraceptives (COCs) or the injectable progestins depot-medroxyprogesterone acetate (DMPA) or norethisterone enanthate (NET-EN) with women not using HC.

Methods and findings: Eligible studies measured HC exposure and incident HIV infection prospectively using standardized measures, enrolled women aged 15-49 y, recorded ≥15 incident HIV infections, and measured prespecified covariates. Our primary analysis estimated the adjusted hazard ratio (aHR) using two-stage random effects meta-analysis, controlling for region, marital status, age, number of sex partners, and condom use. We included 18 studies, including 37,124 women (43,613 woman-years) and 1,830 incident HIV infections. Relative to no HC use, the aHR for HIV acquisition was 1.50 (95% CI 1.24-1.83) for DMPA use, 1.24 (95% CI 0.84-1.82) for NET-EN use, and 1.03 (95% CI 0.88-1.20) for COC use. Between-study heterogeneity was mild (I(2) < 50%). DMPA use was associated with increased HIV acquisition compared with COC use (aHR 1.43, 95% CI 1.23-1.67) and NET-EN use (aHR 1.32, 95% CI 1.08-1.61). Effect estimates were attenuated for studies at lower risk of methodological bias (compared with no HC use, aHR for DMPA use 1.22, 95% CI 0.99-1.50; for NET-EN use 0.67, 95% CI 0.47-0.96; and for COC use 0.91, 95% CI 0.73-1.41) compared to those at higher risk of bias (p(interaction) = 0.003). Neither age nor herpes simplex virus type 2 infection status modified the HC-HIV relationship.

Conclusions: This IPD meta-analysis found no evidence that COC or NET-EN use increases women's risk of HIV but adds to the evidence that DMPA may increase HIV risk, underscoring the need for additional safe and effective contraceptive options for women at high HIV risk. A randomized controlled trial would provide more definitive evidence about the effects of hormonal contraception, particularly DMPA, on HIV risk.

Conflict of interest statement

NL is a member of the Editorial Board of PLOS Medicine. All other authors have declared that no competing interests exist.

Figures

Fig 1. Flow diagram of studies included…
Fig 1. Flow diagram of studies included in individual participant data meta-analysis of hormonal contraception and HIV acquisition.
Fig 2. Multivariable associations between hormonal contraceptive…
Fig 2. Multivariable associations between hormonal contraceptive use and HIV acquisition by study, with non-hormonal-contraceptive group as the reference.
(A) aHRs for COC use versus no HC use—primary model. (B) aHRs for DMPA use versus no HC—primary model. (C) aHRs for NET-EN use versus no HC—primary model. Individual study results from Cox regression modeling. Pooled aHRs from random effects meta-analysis adjusted for age, married/living with partner, number of sex partners, condom use, and region (east Africa, southern Africa, and South Africa). Each horizontal line represents the 95% confidence interval around the HR. Shaded areas represent the comparative weight of each study. No estimate was possible if there were not events in the specified contraceptive group. NA, not applicable.
Fig 3. Multivariable associations directly comparing different…
Fig 3. Multivariable associations directly comparing different hormonal contraceptives and HIV acquisition by study.
(A) aHRs for DMPA versus COC use—primary model. (B) aHRs for NET-EN versus COC use—primary model. (C) aHRs for DMPA versus NET-EN use—primary model. Individual study results from Cox regression modeling. Pooled aHRs from random effects meta-analysis adjusted for age, married/living with partner, number of sex partners, condom use, and region (east Africa, southern Africa, and South Africa). Each horizontal line represents the 95% confidence interval around the HR. Shaded areas represent the comparative weight of each study. No estimate was possible if there were not events in the specified contraceptive group.

References

    1. Morrison CS, Turner AN, Jones LB (2009) Highly effective contraception and acquisition of HIV and other sexually transmitted infections. Best Pract Res Clin Obstet Gynaecol 23: 263–284. 10.1016/j.bpobgyn.2008.11.004
    1. Morrison CS, Nanda K (2012) Hormonal contraception and HIV: an unanswered question. Lancet Infect Dis 12: 2–3. 10.1016/S1473-3099(11)70254-7
    1. Polis CB, Curtis KM (2013) Use of hormonal contraceptives and HIV acquisition in women: a systematic review of the epidemiological evidence. Lancet Infect Dis 13: 797–808. 10.1016/S1473-3099(13)70155-5
    1. Polis CB, Phillips SJ, Curtis KM, Westreich DJ, Steyn PS, et al. (2014) Hormonal contraceptive methods and risk of HIV acquisition in women: a systematic review of epidemiological evidence. Contraception 90: 360–390. 10.1016/j.contraception.2014.07.009
    1. Abdool K, Abdool K, Frohlich J, Grobler A, Baxter C, et al. (2010) Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science 329: 1168–1174. 10.1126/science.1193748
    1. Van Damme L, Corneli A, Ahmed K, Agot K, Lombaard J, et al. (2012) Preexposure prophylaxis for HIV infection among African women. N Engl J Med 367: 411–422. 10.1056/NEJMoa1202614
    1. Marazzo J, Cates W Jr (2011) Interventions to prevent sexually transmitted infections, including HIV infection. Clin Infect Dis 53: 64–78. 10.1093/cid/cir695
    1. Petruney T, Robinson E, Reynolds H, Wilcher R, Cates W (2008) Contraception is the best kept secret for prevention of mother-to-child HIV transmission. Bull World Health Organ 86: B 10.2471/BLT.08.051458
    1. United Nations Department of Economic and Social Affairs Poulation Division (2011) World Contraceptive Use 2011. New York: United Nations.
    1. Kaushic C, Roth KL, Anipindi V, Xiu F (2011) Increased prevalence of sexually transmitted viral infections in women: the role of female sex hormones in regulating susceptibility and immune responses. J Reprod Immunol 88: 204–209. 10.1016/j.jri.2010.12.004
    1. World Health Organization (2012) Hormonal contraception and HIV: technical statement. Geneva: World Health Organization.
    1. Simmonds MC, Higgins JP, Stewart LA, Tierney JF, Clarke MJ, et al. (2005) Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials 2: 209–217. 10.1191/1740774505cn087oa
    1. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6: e1000097 10.1371/journal.pmed.1000097
    1. Riley RD, Lambert PC, Abo-Zaid G (2010) Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ 340: c221 10.1136/bmj.c221
    1. Myer L, Denny L, Wright TC, Kuhn L (2007) Prospective study of hormonal contraception and women’s risk of HIV infection in South Africa. Int J Epidemiol 36: 166–174. 10.1093/ije/dyl251
    1. Watson-Jones D, Baisley K, Weiss H, Tanton C, Changalucha J, et al. (2009) Risk factors for HIV incidence in women participating in an HSV suppressive treatment trial in Tanzania. AIDS 23: 415–422. 10.1097/QAD.0b013e32831ef523
    1. Heffron R, Donnell D, Rees H, Celum C, Mugo N, et al. (2012) Use of hormonal contraceptives and risk of HIV-1 transmission: a prospective cohort study. Lancet Infect Dis 12: 19–26. 10.1016/S1473-3099(11)70247-X
    1. Morrison C, Skoler-Karpoff S, Kwok C, Chen P, van de Wijgert J, et al. (2012) Hormonal contraception and the risk of HIV acquisition among women in South Africa. AIDS 26: 497–504. 10.1097/QAD.0b013e32834fa13d
    1. Crook AM, Ford D, Gafos M, Hayes R, Kamali A, et al. (2014) Injectable and oral contraceptives and risk of HIV acquisition in women: an analysis of data from the MDP301 trial. Hum Reprod 29: 1810–1817. 10.1093/humrep/deu113
    1. McCoy S, Zheng W, Montgomery E, Blanchard K, van der Straten A, et al. (2013) Oral and injectable contraception use and risk of HIV acquisition among women in sub-Saharan Africa. AIDS 27: 1001–1009. 10.1097/QAD.0b013e32835da401
    1. Low N, Chersich M, Schmidlin K, Egger M, Francis S, et al. (2011) Intravaginal practices, bacterial vaginosis, and HIV infection in women: individual participant data meta-analysis. PLoS Med 8: e1000416 10.1371/journal.pmed.1000416
    1. Phillips SJ, Curtis KM, Polis CB (2013) Effect of hormonal contraceptive methods on HIV disease progression: a systematic review. AIDS 27: 787–794. 10.1097/QAD.0b013e32835bb672
    1. Wells G, Shea B, O’Connell D, Peterson J, Welch V, et al. (2014) The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Ottawa: Ottawa Hospital Research Institute; . Accessed 18 December 2014.
    1. Downs SH, Black N (1998) The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 52: 377–384. 10.1136/jech.52.6.377
    1. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, et al. (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med 4: e296 10.1371/journal.pmed.0040296
    1. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, et al. (2000) Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 283: 2008–2012. 10.1001/jama.283.15.2008
    1. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, et al. (2011) GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 64: 383–394. 10.1016/j.jclinepi.2010.04.026
    1. Higgins JP, Thompson SG (2002) Quantifying heterogeneity in a meta-analysis. Stat Med 21: 1539–1558. 10.1002/sim.1186
    1. Smith CT, Williamson PR, Marson AG (2005) Investigating heterogeneity in an individual patient data meta-analysis of time to event outcomes. Stat Med 24: 1307–1319. 10.1002/sim.2050
    1. Morrison CS, Richardson BA, Mmiro F, Chipato T, Celentano DD, et al. (2007) Hormonal contraception and the risk of HIV acquisition. AIDS 21: 85–95. 10.1097/QAD.0b013e3280117c8b
    1. Morrison C, Chen P, Kwok C, Richardson B, Chipato T, et al. (2010) Hormonal contraception and HIV acquisition: reanalysis using marginal structural modeling. AIDS 24: 1778–1781. 10.1097/QAD.0b013e32833a2537
    1. Baeten JM, Benki S, Chohan V, Lavreys L, McClelland RS, et al. (2007) Hormonal contraceptive use, herpes simplex virus infection, and risk of HIV-1 acquisition among Kenyan women. AIDS 21: 1771–1777. 10.1097/QAD.0b013e328270388a
    1. Kaul R, Kimani J, Nagelkerke NJ, Fonck K, Ngugi EN, et al. (2004) Monthly antibiotic chemoprophylaxis and incidence of sexually transmitted infections and HIV-1 infection in Kenyan sex workers: a randomized controlled trial. JAMA 291: 2555–2562. 10.1001/jama.291.21.2555
    1. Vallely A, Kasindi S, Hambleton IR, Knight L, Chirwa T, et al. (2007) Microbicides development program, Tanzania-baseline characteristics of an occupational cohort and reattendance at 3 months. Sex Transm Dis 34: 638–643. 10.1097/OLQ.0b013e3180325120
    1. Kumwenda N, Kemewenda J, Kafulafula G, Makanani B, Taulo F, et al. (2008) HIV-1 incidence among women of reproductive age in Malawi. Int J STD AIDS 19: 339–341. 10.1258/ijsa.2007.007165
    1. Padian NS, van der Straten A, Ramjee G, Chipato T, de Bruyn G, et al. (2007) Diaphragm and lubricant gel for prevention of HIV acquisition in southern African women: a randomised controlled trial. Lancet 370: 251–261. 10.1016/S0140-6736(07)60950-7
    1. Delany-Moretlwe S, Rees H (2010) Tshireletso study for women’s health. Microbicide feasibility study. Protocol. Hillbrow (South Africa): Reproductive Health Research Unit, University of Witwatersrand.
    1. McGrath N, Chimbwete C, Bennish M, Cassol S, Nunn A, et al. (2014) A feasibility study in preparation for phase III microbicide trials in the Hlabisa sub-district, South Africa. . Accessed 16 April 2014.
    1. Martin HLJ, Nyange PM, Richardson BA, Lavreys L, Mandaliya K, et al. (1998) Hormonal contraception, sexually transmitted diseases, and risk of heterosexual transmission of human immunodeficiency virus type 1. J Infect Dis 178: 1053–1059. 10.1086/515654
    1. Watson-Jones D, Weiss HA, Rusizoka M, Changalucha J, Baisley K, et al. (2008) Effect of herpes simplex suppression on incidence of HIV among women in Tanzania. N Engl J Med 358: 1560–1571. 10.1056/NEJMoa0800260
    1. Myer L, Denny L, de Souza M, Wright TC Jr, Kuhn L (2006) Distinguishing the temporal association between women’s intravaginal practices and risk of human immunodeficiency virus infection: a prospective study of South African women. Am J Epidemiol 163: 552–560. 10.1093/aje/kwj071
    1. Kumwenda N, Hoffman I, Chirenje M, Kelly C, Coletti A, et al. (2006) HIV incidence among women of reproductive age in Malawi and Zimbabwe. Sex Transm Dis 33: 646–651. 10.1097/01.olq.0000223283.27142.9f
    1. Skoler-Karpoff S, Ramjee G, Ahmed K, Altini L, Plagianos MG, et al. (2008) Efficacy of Carraguard for prevention of HIV infection in women in South Africa: a randomised, double-blind, placebo-controlled trial. Lancet 372: 1977–1987. 10.1016/S0140-6736(08)61842-5
    1. McCormack S, Ramjee G, Kamali A, Rees H, Crook AM, et al. (2010) PRO2000 vaginal gel for prevention of HIV-1 infection (Microbicides Development Programme 301): a phase 3, randomised, double-blind, parallel-group trial. Lancet 376: 1329–1337. 10.1016/S0140-6736(10)61086-0
    1. Van Damme L, Ramjee G, Alary M, Vuylsteke B, Chandeying V, et al. (2002) Effectiveness of COL-1492, a nonoxynol-9 vaginal gel, on HIV-1 transmission in female sex workers: a randomised controlled trial. Lancet 360: 971–977. 10.1016/S0140-6736(02)11079-8
    1. Karim QA, Kharsany AB, Frohlich JA, Werner L, Mashego M, et al. (2011) Stabilizing HIV prevalence masks high HIV incidence rates amongst rural and urban women in KwaZulu-Natal, South Africa. Int J Epidemiol 40: 922–930. 10.1093/ije/dyq176
    1. Baeten JM, Donnell D, Ndase P, Mugo NR, Campbell JD, et al. (2012) Antiretroviral prophylaxis for HIV prevention in heterosexual men and women. N Engl J Med 367: 399–410. 10.1056/NEJMoa1108524
    1. Kapiga SH, Ewings FM, Ao T, Chilongani J, Mongi A, et al. (2013) The epidemiology of HIV and HSV-2 infections among women participating in microbicide and vaccine feasibility studies in Northern Tanzania. PLoS ONE 8: e68825 10.1371/journal.pone.0068825
    1. Vandepitte J, Bukenya J, Weiss HA, Nakubulwa S, Francis SC, et al. (2011) HIV and other sexually transmitted infections in a cohort of women involved in high-risk sexual behavior in Kampala, Uganda. Sex Transm Dis 38: 316–323.
    1. Feldblum P, Lie C, Weaver M, Van Damme L, Halpern V, et al. (2010) Baseline factors associated with incident HIV and STI in four microbicide trials. Sex Transm Dis 37: 594–601.
    1. Ungchusak K, Rehle T, Thammapornpilap P, Spiegelman D, Brinkmann U, et al. (1996) Determinants of HIV infection among female commercial sex workers in northeastern Thailand: results from a longitudinal study. J Acquir Immune Defic Syndr Hum Retrovirol 12: 500–507. 10.1097/00042560-199608150-00010
    1. Kiddugavu M, Makumbi F, Wawer MJ, Serwadda D, Sewankambo NK, et al. (2003) Hormonal contraceptive use and HIV-1 infection in a population-based cohort in Rakai, Uganda. AIDS 17: 233–240. 10.1097/00002030-200301240-00014
    1. Kapiga SH, Lyamuya EF, Lwihula GK, Hunter DJ (1998) The incidence of HIV infection among women using family planning methods in Dar es Salaam, Tanzania. AIDS 12: 75–84. 10.1097/00002030-199801000-00009
    1. Reid S, Dai J, Wang J, Sichalwe B, Akpomiemie G, et al. (2010) Pregnancy, contraceptive use, and HIV acquisition in HPTN 039: relevance for HIV prevention trials among African women. J Acquir Immune Defic Syndr 53: 606–613. 10.1097/QAI.0b013e3181bc4869
    1. Bulterys M, Chao A, Habimana P, Dushimimana A, Nawrocki P, et al. (1994) Incident HIV-1 infection in a cohort of young women in Butare, Rwanda. AIDS 8: 1585–1591. 10.1097/00002030-199411000-00010
    1. Kilmarx PH, Limpakarnjanarat K, Mastro TD, Saisorn S, Kaewkungwal J, et al. (1998) HIV-1 seroconversion in a prospective study of female sex workers in northern Thailand: continued high incidence among brothel-based women. AIDS 12: 1889–1898. 10.1097/00002030-199814000-00021
    1. Kleinschmidt I, Rees H, Delany S, Smith D, Dinat N, et al. (2007) Injectable progestin contraceptive use and risk of HIV infection in a South African family planning cohort. Contraception 75: 461–467. 10.1016/j.contraception.2007.02.002
    1. Abdool Karim SS, Richardson BA, Ramjee G, Hoffman IF, Chirenje ZM, et al. (2011) Safety and effectiveness of BufferGel and 0.5% PRO2000 gel for the prevention of HIV infection in women. AIDS 25: 957–966. 10.1097/QAD.0b013e32834541d9
    1. Celum C, Wald A, Lingappa JR, Magaret AS, Wang RS, et al. (2010) Acyclovir and transmission of HIV-1 from persons infected with HIV-1 and HSV-2. N Engl J Med 362: 427–439. 10.1056/NEJMoa0904849
    1. Lutalo T, Musoke R, Kong X, Makumbi F, Serwadda D, et al. (2013) Effects of hormonal contraceptive use on HIV acquisition and transmission among HIV-discordant couples. AIDS 27 (Suppl 1): S27–S34. 10.1097/QAD.0000000000000045
    1. Chirenje M, Kelly C, Ramjee G, Nyaradzo M, Coletti A, et al. (2012) Association between hormonal contraception and HIV infection in HPTN 035 [abstract]. International Microbicides Conference; 15–18 April 2012; Sydney Australia.
    1. Noguchi L, Richardson B, Chirenje Z, Ramjee G, Nair G, et al. (2014) Injectable contraception and HIV acquisition in the VOICE Study (MTN-003) [abstract]. Conference on Retroviruses and Opportunistic Infection 2014s; 3–6 March 2014; Boston, Massachusetts, US.
    1. Wand H, Ramjee G (2012) The effects of injectable hormonal contraceptives on HIV seroconversion and on sexually transmitted infections. AIDS 26: 375–380. 10.1097/QAD.0b013e32834f990f
    1. Jones AP, Riley RD, Williamson PR, Whitehead A (2009) Meta-analysis of individual patient data versus aggregate data from longitudinal clinical trials. Clin Trials 6: 16–27. 10.1177/1740774508100984
    1. Werawatgoompa S, Vaivanijkul B, Leepipatpaiboon S, Channiyom K, Virutamasen P, et al. (1980) The effect of injectable norethisterone oenanthate on ovarian hormones in Thai women. Contraception 21: 299–309. 10.1016/0010-7824(80)90008-6
    1. Fotherby K, Hamawi A, Howard G, Bye PG, Elder M (1984) Pharmacokinetics of different doses of norethisterone oenanthate. Contraception 29: 325–333. 10.1016/0010-7824(84)90066-0
    1. Wira CR, Fahey JV (2008) A new strategy to understand how HIV infects women: identification of a window of vulnerability during the menstrual cycle. AIDS 22: 1909–1917. 10.1097/QAD.0b013e3283060ea4
    1. Schindler AE, Campagnoli C, Druckmann R, Huber J, Pasqualini JR, et al. (2003) Classification and pharmacology of progestins. Maturitas 46 (Suppl 1): S7–S16. 10.1016/j.maturitas.2003.09.014
    1. Hapgood JP, Tomasicchio M (2010) Modulation of HIV-1 virulence via the host glucocorticoid receptor: towards further understanding the molecular mechanisms of HIV-1 pathogenesis. Arch Virol 155: 1009–1019. 10.1007/s00705-010-0678-0
    1. Huijbregts R, Michel K, Hel Z (2014) Effect of progestins on immunity: medroxyprogesterone but not norethisterone or levonorgestrel suppresses the function of T cells and pDCs. Contraception 90: 123–129. 10.1016/j.contraception.2014.02.006
    1. van de Wijgert JH, Verwijs MC, Turner AN, Morrison CS (2013) Hormonal contraception decreases bacterial vaginosis but oral contraception may increase candidiasis: implications for HIV transmission. AIDS 27: 2141–2153. 10.1097/QAD.0b013e32836290b6
    1. Miller L, Patton DL, Meier A, Thwin SS, Hooton TM, et al. (2000) Depomedroxyprogesterone-induced hypoestrogenism and changes in vaginal flora and epithelium. Obstet Gynecol 96: 431–439. 10.1016/S0029-7844(00)00906-6
    1. Bahamondes L, Trevisan M, Andrade L, Marchi NM, Castro S, et al. (2000) The effect upon the human vaginal histology of the long-term use of the injectable contraceptive Depo-Provera. Contraception 62: 23–27. 10.1016/S0010-7824(00)00132-3
    1. Hel Z, Stringer E, Mestecky J (2010) Sex steroid hormones, hormonal contraception, and the immunobiology of human immunodeficiency virus-1 infection. Endocr Rev 31: 79–97. 10.1210/er.2009-0018
    1. Trunova N, Tsai L, Tung S, Schneider E, Harouse J, et al. (2006) Progestin-based contraceptive suppresses cellular immune responses in SHIV-infected rhesus macaques. Virology 352: 169–177. 10.1016/j.virol.2006.04.004
    1. Morrison C, Fichorova RN, Mauck C, Chen PL, Kwok C, et al. (2014) Cervical inflammation and immunity associated with hormonal contraception, pregnancy, and HIV-1 seroconversion. J Acquir Immune Defic Syndr 66: 109–117.
    1. Viechtbauer W, Cheung MWL (2010) Outlier and influence diagnostics for meta-analysis. Res Synth Methods 1: 112–125. 10.1002/jrsm.11
    1. Hernán M, Brumback B, Robins JM (2001) Marginal structural models to estimate the joint causal effect of nonrandomized treatments. J Am Stat Assoc 96: 440–448. 10.1198/016214501753168154
    1. Robins J (1997) Causal inference from complex longitudinal data. In: Berkane M, editor. Latent variable modeling and applications to causality. Lecture notes in statistics 120. New York: Springer Verlag; pp. 69–117.
    1. Cates W, Evidence for Contraceptive Options and HIV Outcomes (ECHO) Consortium (2014) Research on hormonal contraception and HIV. Lancet 383: 303–304. 10.1016/S0140-6736(14)60097-0
    1. Rees H (2014) DMPA and HIV: why we need a trial. Contraception 90: 354–356. 10.1016/j.contraception.2014.08.007

Source: PubMed

3
Subskrybuj