Adjuvant-containing control arms in pivotal quadrivalent human papillomavirus vaccine trials: restoration of previously unpublished methodology

Peter Doshi, Florence Bourgeois, Kyungwan Hong, Mark Jones, Haeyoung Lee, Larissa Shamseer, O'Mareen Spence, Tom Jefferson, Peter Doshi, Florence Bourgeois, Kyungwan Hong, Mark Jones, Haeyoung Lee, Larissa Shamseer, O'Mareen Spence, Tom Jefferson

Abstract

Purpose: Trustworthy reporting of quadrivalent human papillomavirus (HPV) vaccine trials is the foundation for assessing the vaccine's risks and benefits. However, several pivotal trial publications incompletely reported important methodological details and inaccurately described the formulation that the control arms received. Under the Restoring Invisible and Abandoned Trials initiative (RIAT), we aim to restore the public record regarding the content and rationale of the controls used in the trials.

Methods: We assembled a cohort (five randomised controlled trials) described as placebo-controlled using clinical study reports (CSRs) obtained from the European Medicines Agency. We extracted the content and rationale for the choice of control used in each trial across six data sources: trial publications, register records, CSR synopses, CSR main bodies, protocols and informed consent forms.

Results: Across data sources, the control was inconsistently reported as 'placebo'-containing aluminium adjuvant (sometimes with dose information). Amorphous aluminium hydroxyphosphate sulfate (AAHS) was not mentioned in any trial registry entry, but was mentioned in all publications and CSRs. In three of five trials, consent forms described the control as an 'inactive' substance. No rationale for the selection of the control was reported in any trial publication, register, consent form, CSR synopsis or protocol. Three trials reported the rationale for choice of control in CSRs: to preserve blinding and assess the safety of HPV virus-like particles as the 'safety profile of (AAHS) is well characterised'.

Conclusions: The stated rationale of using AAHS control-to characterise the safety of the HPV virus-like particles-lacks clinical relevance. A non-placebo control may have obscured an accurate assessment of safety and the participant consent process of some trials raises ethical concerns.

Trial registration numbers: NCT00092482, NCT00092521, NCT00092534, NCT00090220, NCT00090285.

Keywords: paediatric infectious disease & immunisation.

Conflict of interest statement

Competing interests: The Laura and John Arnold Foundation funds the RIAT Support Center which supports the salaries of Doshi, Bourgeois, Hong, Jefferson, Jones, Shamseer (until 2018) and Spence. In addition, PD has received travel funds from the European Respiratory Society (2012) and Uppsala Monitoring Center (2018); grants from the Laura and John Arnold Foundation (2017–2021), American Association of Colleges of Pharmacy (2015), Patient-Centered Outcomes Research Institute (2014–2016), Cochrane Methods Innovations Fund (2016–2018) and UK National Institute for Health Research (2011–2014); and is an editor at the BMJ and unpaid member of the Reagan-Udall Foundation for the FDA. TJ was a recipient of a UK National Institute for Health Research grant for a Cochrane review of neuraminidase inhibitors for influenza. In addition, TJ receives royalties from his books published by Il Pensiero Scientifico Editore, Rome and Blackwells. TJ is occasionally interviewed by market research companies about phase I or II pharmaceutical products. In 2011–2013, TJ acted as an expert witness in litigation related to the antiviral oseltamivir, in two litigation cases on potential vaccine-related damage (including the vaccine Pandemrix (2015–2017)) and in a labour case on influenza vaccines in healthcare workers in Canada. He has acted as a consultant for Roche (1997–1999), GSK (2001–2002), Sanofi-Synthelabo (2003) and IMS Health (2013). In 2014, he was retained as a scientific adviser to a legal team acting on oseltamivir. TJ has a potential financial conflict of interest in the drug oseltamivir. In 2014–2016, TJ was a member of three advisory boards for Boehringer Ingelheim. TJ was holder of a Cochrane Methods Innovations Fund grant to develop guidance on the use of regulatory data in Cochrane reviews. TJ was a member of an independent data monitoring committee for a Sanofi Pasteur clinical trial on an influenza vaccine. Between 1994 and 2013, TJ was the coordinator of the Cochrane Vaccines Field. TJ was a cosignatory of the Nordic Cochrane Centre Complaint to the European Medicines Agency (EMA) over maladministration at the EMA in relation to the investigation of alleged harms of HPV vaccines and consequent complaints to the European Ombudsman. TJ is coholder of a John and Laura Arnold Foundation grant for development of a RIAT Support Center (2017–2020) and Jean Monnet Network Grant, 2017–2020 for the Jean Monnet Health Law and Policy Network. TJ is an unpaid collaborator to the project Beyond Transparency in Pharmaceutical Research and Regulation led by Dalhousie University and funded by the Canadian Institutes of Health Research (2018–2022). TJ is a consultant to Illumina LLC (2019-current). MJ was a coinvestigator on a UK National Institute for Health Research grant for a Cochrane review of neuraminidase inhibitors for influenza; was a corecipient of a Cochrane Methods Innovations Fund grant to develop guidance on the use of regulatory data in Cochrane reviews; and is a paid consultant on a John and Laura Arnold Foundation grant for development of an RIAT Support Center (2017–2020). LS, HL, FB and KH: no competing interests to declare. OS received the Maryland CERSI Scholar award from the Food and Drug Administration (grant #1U01FD005946) and the PhRMA Foundation’s Predoctoral Fellowship in Health Outcomes.

© Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Figures

Figure 1
Figure 1
Summary of Trial Search. CSR, clinical study reports; EMA, European Medicines Agency; HPV, human papillomavirus.

References

    1. CDC HPV vaccination is safe and effective [Internet], 2019. Available: [Accessed 12 Dec 2019].
    1. World Health Organization Human papillomavirus vaccines: WHO position paper, May 2017. Wkly Epidemiol Rec 2017;92:241–68.
    1. World Health Organization Ten threats to global health in 2019 [Internet], 2019. Available: [Accessed 12 Dec 2019].
    1. FUTURE II Study Group Quadrivalent vaccine against human papillomavirus to prevent high-grade cervical lesions. N Engl J Med 2007;356:1915–27. 10.1056/NEJMoa061741
    1. Muñoz N, Manalastas R, Pitisuttithum P, et al. . Safety, immunogenicity, and efficacy of quadrivalent human papillomavirus (types 6, 11, 16, 18) recombinant vaccine in women aged 24-45 years: a randomised, double-blind trial. Lancet 2009;373:1949–57. 10.1016/S0140-6736(09)60691-7
    1. Giuliano AR, Palefsky JM, Goldstone S, et al. . Efficacy of quadrivalent HPV vaccine against HPV infection and disease in males. N Engl J Med 2011;364:401–11. 10.1056/NEJMoa0909537
    1. Garland SM, Steben M, Hernandez-Avila M, et al. . Noninferiority of antibody response to human papillomavirus type 16 in subjects vaccinated with monovalent and quadrivalent L1 virus-like particle vaccines. Clin Vaccine Immunol 2007;14:792–5. 10.1128/CVI.00478-06
    1. Garland SM, Hernandez-Avila M, Wheeler CM, et al. . Quadrivalent vaccine against human papillomavirus to prevent anogenital diseases. N Engl J Med 2007;356:1928–43. 10.1056/NEJMoa061760
    1. Rid A, Saxena A, Baqui AH, et al. . Placebo use in vaccine trials: recommendations of a WHO expert panel. Vaccine 2014;32:4708–12. 10.1016/j.vaccine.2014.04.022
    1. European Medicines Agency Guideline on clinical evaluation of vaccines (2 EMEA/CHMP/VWP/164653/05 Rev. 1) [Internet], 2018. Available: [Accessed 24 Aug 2019].
    1. Merck Frequently asked questions [Internet]. Available: [Accessed 24 Aug 2017].
    1. National Library of Medicine, . Glossary of Common Site Terms [Internet], 2018. Available: [Accessed 29 Nov 2018].
    1. Doshi P, Jefferson T, Jones M, et al. . Call to action: RIAT restoration of a previously unpublished methodology in Gardasil vaccine trials, 2019. Available:
    1. Doshi P, Bourgeois F, Hong K, et al. . Additional trials within scope: a follow-up to our “Call to action: RIAT restoration of a previously unpublished methodology in Gardasil vaccine trials”, 2019. Available:
    1. Doshi P, Dickersin K, Healy D, et al. . Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ 2013;346:f2865 10.1136/bmj.f2865
    1. Treasure T, Monson K, Fiorentino F, et al. . The CEA second-look trial: a randomised controlled trial of carcinoembryonic antigen prompted reoperation for recurrent colorectal cancer. BMJ Open 2014;4:e004385 10.1136/bmjopen-2013-004385
    1. Le Noury J, Nardo JM, Healy D, et al. . Restoring study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ 2015;351:h4320 10.1136/bmj.h4320
    1. Le Noury J, Nardo JM, Healy D, et al. . Study 329 continuation phase: safety and efficacy of paroxetine and imipramine in extended treatment of adolescent major depression. Int J Risk Saf Med 2016;28:143–61. 10.3233/JRS-160728
    1. Zhang R, Persaud N. 8-Way randomized controlled trial of Doxylamine, pyridoxine and dicyclomine for nausea and vomiting during pregnancy: restoration of unpublished information. PLoS One 2017;12:e0167609 10.1371/journal.pone.0167609
    1. Riva C, Tinari S, Spinosa J-P. Cochrane review on HPV vaccines: Concerns over methodological flaws in the [Internet], 2018. Available: [Accessed 10 Dec 2019].
    1. Shamseer L, Jefferson T, Jones M. Protocol [Internet]. Open Science Framework, 2019. Available: 10.17605/
    1. European Medicines Agency European Medicines Agency policy on access to documents (related to medicinal products for human and veterinary use) POLICY/0043 [Internet], 2018. Available: [Accessed 23 Jun 2019].
    1. ICH International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Structure and Content of Clinical Study Reports (ICH E3) [Internet], 1995. Available:
    1. Doshi P, Jefferson T. Clinical study reports of randomised controlled trials: an exploratory review of previously Confidential industry reports. BMJ Open 2013;3 10.1136/bmjopen-2012-002496. [Epub ahead of print: 26 Feb 2013].
    1. European Medicines Agency European medicines Agency policy on publication of clinical data for medicinal products for human use (POLICY/0070; EMA/240810/2013) 2014.
    1. European Medicines Agency Online access to clinical data for medicinal products for human use [Internet]. European Medicines Agency Clinical Data, 2017. Available: [Accessed 6 Jul 2017].
    1. European Medicines Agency Background to clinical data publication policy [Internet], 2018. Available: [Accessed 4 Feb 2018].
    1. Lexchin J, Herder M, Doshi P. Canada finally opens up data on new drugs and devices. BMJ 2019;365:l1825 10.1136/bmj.l1825
    1. Jørgensen L, Gøtzsche PC, Jefferson T. Index of the human papillomavirus (HPV) vaccine industry clinical study programmes and non-industry funded studies: a necessary basis to address reporting bias in a systematic review. Syst Rev 2018;7:8 10.1186/s13643-018-0675-z
    1. Jørgensen L, Doshi P, Gøtzsche P, et al. . Challenges of independent assessment of potential harms of HPV vaccines. BMJ 2018;362:k3694 10.1136/bmj.k3694
    1. Beecher HK. The powerful placebo. J Am Med Assoc 1955;159:1602–6. 10.1001/jama.1955.02960340022006
    1. Gardasil [package insert]. Whitehouse Station, NJ: Merck & Co [Internet], 2006. Available: [Accessed 19 Jun 2019].
    1. Gardasil [package insert]. Whitehouse Station, NJ: Merck & Co [Internet], 2007. Available: [Accessed 19 Jun 2019].
    1. Gardasil [package insert]. Whitehouse Station, NJ: Merck & Co [Internet], 2008. Available: [Accessed 19 Jun 2019].
    1. Golomb BA, Erickson LC, Koperski S, et al. . What's in placebos: who knows? analysis of randomized, controlled trials. Ann Intern Med 2010;153:532–5. 10.7326/0003-4819-153-8-201010190-00010
    1. Gruber MF, Marshall VB. 79. Regulation and Testing of Vaccines : Plotkin S, Orenstein W, Offit P, Plotkin’s Vaccines. Elsevier, 2017: 1547–65.
    1. MSD. 2.5 臨床に関する概括評価 [2.5 Clinical Summary] [Internet]. Available: [Accessed 29 Nov 2018].
    1. Miller N. Clinical Review of Biologics License Application for Human Papillomavirus 6, 11, 16, 18 L1 Virus Like Particle Vaccine (S. cerevisiae) (STN 125126 GARDASIL), manufactured by Merck, Inc [Internet], 2006. Available: [Accessed 29 Nov 2018].
    1. Takeuchi J, Noma H, Sakanishi Y, et al. . Adverse events associated with human papillomavirus vaccines: a protocol for systematic review with network meta-analysis incorporating all randomised controlled trials comparing with placebo, adjuvants and other vaccines. BMJ Open 2019;9:e026924 10.1136/bmjopen-2018-026924
    1. Garçon N, Friede M. 6. Evolution of Adjuvants Across the Centuries : Plotkin S, Orenstein W, Offit P, Plotkin’s Vaccines. Elsevier, 2017: 61–74.
    1. Djurisic S, Jakobsen JC, Petersen SB, et al. . Aluminium adjuvants used in vaccines versus placebo or no intervention. Cochrane Database Syst Rev 2017;347:f5906 10.1002/14651858.CD012805
    1. Moher D, Hopewell S, Schulz KF, et al. . CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c869 10.1136/bmj.c869
    1. Food and Drug Administration Guidance for Industry: E10 Choice of Control Group and Related Issues in Clinical Trials [Internet], 2001. Available:
    1. Koutsky LA, Ault KA, Wheeler CM, et al. . A controlled trial of a human papillomavirus type 16 vaccine. N Engl J Med 2002;347:1645–51. 10.1056/NEJMoa020586

Source: PubMed

3
Tilaa