What defines an efficacious COVID-19 vaccine? A review of the challenges assessing the clinical efficacy of vaccines against SARS-CoV-2

Susanne H Hodgson, Kushal Mansatta, Garry Mallett, Victoria Harris, Katherine R W Emary, Andrew J Pollard, Susanne H Hodgson, Kushal Mansatta, Garry Mallett, Victoria Harris, Katherine R W Emary, Andrew J Pollard

Abstract

The novel coronavirus, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has caused more than 1 million deaths in the first 6 months of the pandemic and huge economic and social upheaval internationally. An efficacious vaccine is essential to prevent further morbidity and mortality. Although some countries might deploy COVID-19 vaccines on the strength of safety and immunogenicity data alone, the goal of vaccine development is to gain direct evidence of vaccine efficacy in protecting humans against SARS-CoV-2 infection and COVID-19 so that manufacture of efficacious vaccines can be selectively upscaled. A candidate vaccine against SARS-CoV-2 might act against infection, disease, or transmission, and a vaccine capable of reducing any of these elements could contribute to disease control. However, the most important efficacy endpoint, protection against severe disease and death, is difficult to assess in phase 3 clinical trials. In this Review, we explore the challenges in assessing the efficacy of candidate SARS-CoV-2 vaccines, discuss the caveats needed to interpret reported efficacy endpoints, and provide insight into answering the seemingly simple question, "Does this COVID-19 vaccine work?"

Copyright © 2021 Elsevier Ltd. All rights reserved.

Figures

Figure 1
Figure 1
Potential endpoints of an efficacious COVID-19 vaccine An efficacious COVID-19 vaccine could reduce the likelihood of infection of an individual, severity of disease in an individual, or degree of transmission within a population.
Figure 2
Figure 2
Key variables for SARS-CoV-2 exposure, infection, and poor outcome

References

    1. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020;20:533–534.
    1. World Bank . World Bank; Washington, DC: 2020. Global economic prospects.
    1. Gavi The Gavi COVAX AMC: an investment opportunity.
    1. WHO . World Health Organization; Geneva: 2020. Draft landscape of COVID-19 candidate vaccines.
    1. WHO . World Health Organisation; Geneva: 2020. 2019 novel coronavirus (2019-nCoV): strategic preparedness and response plan.
    1. US Department of Health and Human Services: Food and Drug Administration Development and licensure of vaccines to prevent COVID-19: guidance for industry. June, 2020.
    1. WHO . World Health Organization; Geneva: 2020. WHO target product profiles for COVID-19 vaccines.
    1. Bose S, Adapa S, Aeddula NR, et al. Medical management of COVID-19: evidence and experience. J Clin Med Res. 2020;12:329–343.
    1. Weinberg GA, Szilagyi PG. Vaccine epidemiology: efficacy, effectiveness, and the translational research roadmap. J Infect Dis. 2010;201:1607–1610.
    1. Basta NE, Halloran ME, Matrajt L, Longini IM., Jr Estimating influenza vaccine efficacy from challenge and community-based study data. Am J Epidemiol. 2008;168:1343–1352.
    1. Hanquet G, Valenciano M, Simondon F, Moren A. Vaccine effects and impact of vaccination programmes in post-licensure studies. Vaccine. 2013;31:5634–5642.
    1. Velázquez RF, Linhares AC, Muñoz S, et al. Efficacy, safety and effectiveness of licensed rotavirus vaccines: a systematic review and meta-analysis for Latin America and the Caribbean. BMC Pediatr. 2017;17:14.
    1. Wagner A, Weinberger B. Vaccines to prevent infectious diseases in the older population: immunological challenges and future perspectives. Front Immunol. 2020;11:717.
    1. Docherty AB, Harrison EM, Green CA, et al. Features of 20 133 UK patients in hospital with COVID-19 using the ISARIC WHO clinical characterisation protocol: prospective observational cohort study. BMJ. 2020;369
    1. Arons MM, Hatfield KM, Reddy SC, et al. Presymptomatic SARS-CoV-2 Infections and transmission in a skilled nursing facility. N Engl J Med. 2020;382:2081–2090.
    1. WHO . World Health Organization; Geneva: 2020. R&D blueprint: an international randomised trial of candidate vaccines against COVID-19.
    1. Centers for Disease Control and Prevention COVID-19 pandemic planning scenarios. Sept 10, 2020.
    1. Verity R, Okell LC, Dorigatti I, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. Lancet Infect Dis. 2020;20:669–677.
    1. Office for National Statistics All data related to coronavirus (covid-19)
    1. Allsup SJ, Gosney MA. Difficulties of recruitment for a randomised controlled trial involving influenza vaccination in healthy older people. Gerontology. 2002;48:170–173.
    1. Cassidy EL, Baird E, Sheikh JI. Recruitment and retention of elderly patients in clinical trials: issues and strategies. Am J Geriatr Psychiatry. 2001;9:136–140.
    1. Demicheli V, Jefferson T, Ferroni E, Rivetti A, Di Pietrantonj C. Vaccines for preventing influenza in healthy adults. Cochrane Database Syst Rev. 2018;2
    1. Demicheli V, Jefferson T, Di Pietrantonj C, et al. Vaccines for preventing influenza in the elderly. Cochrane Database Syst Rev. 2018;2
    1. Raheja D, Davila EP, Johnson ET, Deović R, Paine M, Rouphael N. Willingness to participate in vaccine-related clinical trials among older adults. Int J Environ Res Public Health. 2018;15:158.
    1. McMurdo ME, Roberts H, Parker S, et al. Improving recruitment of older people to research through good practice. Age Ageing. 2011;40:659–665.
    1. Velavan TP, Pollard AJ, Kremsner PG. Herd immunity and vaccination of children for COVID-19. Int J Infect Dis. 2020;98:14–15.
    1. Petkova E, Antman EM, Troxel AB. pooling data from individual clinical trials in the COVID-19 era. JAMA. 2020;324:543–545.
    1. Bangdiwala SI, Bhargava A, O'Connor DP, et al. Statistical methodologies to pool across multiple intervention studies. Transl Behav Med. 2016;6:228–235.
    1. Vesikari T, Matson DO, Dennehy P, et al. Safety and efficacy of a pentavalent human-bovine (WC3) reassortant rotavirus vaccine. N Engl J Med. 2006;354:23–33.
    1. Soares-Weiser K, Maclehose H, Bergman H, et al. Vaccines for preventing rotavirus diarrhoea: vaccines in use. Cochrane Database Syst Rev. 2012;11
    1. WHO Rotavirus vaccines. WHO position paper—January 2013. Wkly Epidemiol Rec. 2013;88:49–64.
    1. Bar-Zeev N, King C, Phiri T, et al. Impact of monovalent rotavirus vaccine on diarrhoea-associated post-neonatal infant mortality in rural communities in Malawi: a population-based birth cohort study. Lancet Glob Health. 2018;6:e1036–e1044.
    1. Auranen K, Rinta-Kokko H, Goldblatt D, et al. Colonisation endpoints in Streptococcus pneumoniae vaccine trials. Vaccine. 2013;32:153–158.
    1. Hitchings MD, Grais RF, Lipsitch M. Using simulation to aid trial design: ring-vaccination trials. PLoS Negl Trop Dis. 2017;11
    1. Henao-Restrepo AM, Camacho A, Longini IM, et al. Efficacy and effectiveness of an rVSV-vectored vaccine in preventing Ebola virus disease: final results from the Guinea ring vaccination, open-label, cluster-randomised trial (Ebola Ça Suffit!) Lancet. 2017;389:505–518.
    1. Mercatelli D, Giorgi FM. Geographic and genomic distribution of SARS-CoV-2 mutations. Front Microbiol. 2020;11
    1. Dearlove B, Lewitus E, Bai H, et al. A SARS-CoV-2 vaccine candidate would likely match all currently circulating strains. bioRxiv. 2020 doi: 10.1101/2020.04.27.064774. published online April 27. (preprint)
    1. D'Cruz RJ, Currier AW, Sampson VB. Laboratory testing methods for novel severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) Front Cell Dev Biol. 2020;8:468.
    1. Loeliger E, Chaudhari A, Coalition for Epidemic Preparedness Innovations COVID-19 Clinical Working Group COVID-19 efficacy endpoints in interventional trials: what constitutes an incident clinical disease case and what triggers diagnostic work-up. June 25, 2020.
    1. Zhu J, Ji P, Pang J, et al. Clinical characteristics of 3062 COVID-19 patients: a meta-analysis. J Med Virol. 2020 doi: 10.1002/jmv.25884. published online April 15.
    1. Watson J, Whiting PF, Brush JE. Interpreting a COVID-19 test result. BMJ. 2020;369
    1. van Kasteren PB, van der Veer B, van den Brink S, et al. Comparison of seven commercial RT-PCR diagnostic kits for COVID-19. J Clin Virol. 2020;128
    1. Younes N, Al-Sadeq DW, Al-Jighefee H, et al. Challenges in laboratory diagnosis of the novel coronavirus SARS-CoV-2. Viruses. 2020;12:126.
    1. He X, Lau EHY, Wu P, et al. Temporal dynamics in viral shedding and transmissibility of COVID-19. Nat Med. 2020;26:672–675.
    1. La Scola B, Le Bideau M, Andreani J, et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39:1059–1061.
    1. Lachenbruch PA. Sensitivity, specificity, and vaccine efficacy. Control Clin Trials. 1998;19:569–574.
    1. Lambert P-H, Ambrosino DM, Andersen SR, et al. Consensus summary report for CEPI/BC March 12–13, 2020 meeting: assessment of risk of disease enhancement with COVID-19 vaccines. Vaccine. 2020;38:4783–4791.
    1. Oran DP, Topol EJ. Prevalence of asymptomatic SARS-CoV-2 infection: a narrative review. Ann Intern Med. 2020;173:362–367.
    1. Long QX, Liu BZ, Deng HJ, et al. Antibody responses to SARS-CoV-2 in patients with COVID-19. Nat Med. 2020;26:845–848.
    1. Thanh Le T, Andreadakis Z, Kumar A, et al. The COVID-19 vaccine development landscape. Nat Rev Drug Discov. 2020;19:305–306.
    1. Lipsitch M, Kahn R, Mina MJ. Antibody testing will enhance the power and accuracy of COVID-19-prevention trials. Nat Med. 2020;26:818–819.
    1. Zhao J, Yuan Q, Wang H, et al. Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. Clin Infect Dis. 2020 doi: 10.1093/cid/ciaa344. published online March 28.
    1. Whitman JD, Hiatt J, Mowery CT, et al. Test performance evaluation of SARS-CoV-2 serological assays. medRxiv. 2020 doi: 10.1101/2020.04.25.20074856. published online May 17. (preprint)
    1. Seow J, Graham C, Merrick B, et al. Longitudinal evaluation and decline of antibody responses in SARS-CoV-2 infection. medRxiv. 2020 doi: 10.1101/2020.07.09.20148429. published online July 11. (preprint)
    1. Sekine T, Perez-Potti A, Rivera-Ballesteros O, et al. Robust T cell immunity in convalescent individuals with asymptomatic or mild COVID-19. Cell. 2020 doi: 10.1101/2020.06.29.174888. published online Aug 14.
    1. Khan S, Liu J, Xue M. Transmission of SARS-CoV-2, required developments in research and associated public health concerns. Front Med (Lausanne) 2020;7:310.
    1. Zheng S, Fan J, Yu F, et al. Viral load dynamics and disease severity in patients infected with SARS-CoV-2 in Zhejiang province, China, January–March 2020: retrospective cohort study. BMJ. 2020;369
    1. To KK-W, Tsang OT-Y, Leung W-S, et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study. Lancet Infect Dis. 2020;20:565–574.
    1. Zhu L, Gong N, Liu B, et al. Coronavirus disease 2019 pneumonia in immunosuppressed renal transplant recipients: a summary of 10 confirmed cases in Wuhan, China. Eur Urol. 2020;77:748–754.
    1. Wölfel R, Corman VM, Guggemos W, et al. Virological assessment of hospitalised patients with COVID-2019. Nature. 2020;581:465–469.
    1. Kim D, Lee J-Y, Yang J-S, Kim JW, Kim VN, Chang H. The architecture of SARS-CoV-2 transcriptome. Cell. 2020;181:914–921.
    1. Alexandersen S, Chamings A, Bhatta TR. SARS-CoV-2 genomic and subgenomic RNAs in diagnostic samples are not an indicator of active replication. medRxiv. 2020 doi: 10.1101/2020.06.01.20119750. published online Aug 16. (preprint)
    1. WHO . World Health Organization; Geneva: 2013. Correlates of vaccine-induced protection: methods and implications.
    1. Bi Q, Wu Y, Mei S, et al. Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study. Lancet Infect Dis. 2020;20:911–919.
    1. Yu J, Tostanoski LH, Peter L, et al. DNA vaccine protection against SARS-CoV-2 in rhesus macaques. Science. 2020;369:806–811.
    1. Vabret N, Britton GJ, Gruber C, et al. Immunology of COVID-19: current state of the science. Immunity. 2020;52:910–941.
    1. Plotkin SA. Correlates of protection induced by vaccination. Clin Vaccine Immunol. 2010;17:1055–1065.
    1. Vekemans J, Crofts J, Baker CJ, et al. The role of immune correlates of protection on the pathway to licensure, policy decision and use of group B Streptococcus vaccines for maternal immunisation: considerations from World Health Organization consultations. Vaccine. 2019;37:3190–3198.
    1. Lakdawala SS, Menachery VD. The search for a COVID-19 animal model. Science. 2020;368:942–943.
    1. Chandrashekar A, Liu J, Martinot AJ, et al. SARS-CoV-2 infection protects against rechallenge in rhesus macaques. Science. 2020;369:812–817.
    1. Yu J, Tostanoski LH, Peter L, et al. DNA vaccine protection against SARS-CoV-2 in rhesus macaques. Science. 2020;369:806–811.
    1. US Department of Health and Human Services: Food and Drug Administration Product development under the animal rule: guidance for industry. November, 2015.
    1. European Medicines Agency New vaccine for prevention of Ebola virus disease recommended for approval in the European Union. May 29, 2020.
    1. Academy of Medical Sciences Microbial challenge studies. 2005.
    1. Cooper MM, Loiseau C, McCarthy JS, Doolan DL. Human challenge models: tools to accelerate the development of malaria vaccines. Expert Rev Vaccines. 2019;18:241–251.
    1. Meiring JE, Giubilini A, Savulescu J, Pitzer VE, Pollard AJ. Generating the evidence for typhoid vaccine introduction: considerations for global disease burden estimates and vaccine testing through human challenge. Clin Infect Dis. 2019;69(suppl 5):S402–S407.
    1. Eyal N, Lipsitch M, Smith PG. Human challenge studies to accelerate coronavirus vaccine licensure. J Infect Dis. 2020;221:1752–1756.
    1. Baay M, Neels P. SARS-CoV-2 controlled human infection models: ethics, challenge agent production and regulatory issues. Biologicals. 2020 doi: 10.1016/j.biologicals.2020.08.006. published online Aug 15.
    1. WHO . World Health Organization; Geneva: 2020. Feasibility, potential value and limitations of establishing a closely monitored challenge model of experimental COVID-19 infection and illness in healthy young adult volunteers—final report draft for public consultation.

Source: PubMed

Sponsors en medewerkers

Medische omstandigheden

Geneesmiddelinterventies

3
Abonneren