Development of an objective gene expression panel as an alternative to self-reported symptom scores in human influenza challenge trials

Julius Muller, Eneida Parizotto, Richard Antrobus, James Francis, Campbell Bunce, Amanda Stranks, Marshall Nichols, Micah McClain, Adrian V S Hill, Adaikalavan Ramasamy, Sarah C Gilbert, Julius Muller, Eneida Parizotto, Richard Antrobus, James Francis, Campbell Bunce, Amanda Stranks, Marshall Nichols, Micah McClain, Adrian V S Hill, Adaikalavan Ramasamy, Sarah C Gilbert

Abstract

Background: Influenza challenge trials are important for vaccine efficacy testing. Currently, disease severity is determined by self-reported scores to a list of symptoms which can be highly subjective. A more objective measure would allow for improved data analysis.

Methods: Twenty-one volunteers participated in an influenza challenge trial. We calculated the daily sum of scores (DSS) for a list of 16 influenza symptoms. Whole blood collected at baseline and 24, 48, 72 and 96 h post challenge was profiled on Illumina HT12v4 microarrays. Changes in gene expression most strongly correlated with DSS were selected to train a Random Forest model and tested on two independent test sets consisting of 41 individuals profiled on a different microarray platform and 33 volunteers assayed by qRT-PCR.

Results: 1456 probes are significantly associated with DSS at 1% false discovery rate. We selected 19 genes with the largest fold change to train a random forest model. We observed good concordance between predicted and actual scores in the first test set (r = 0.57; RMSE = -16.1%) with the greatest agreement achieved on samples collected approximately 72 h post challenge. Therefore, we assayed samples collected at baseline and 72 h post challenge in the second test set by qRT-PCR and observed good concordance (r = 0.81; RMSE = -36.1%).

Conclusions: We developed a 19-gene qRT-PCR panel to predict DSS, validated on two independent datasets. A transcriptomics based panel could provide a more objective measure of symptom scoring in future influenza challenge studies. Trial registration Samples were obtained from a clinical trial with the ClinicalTrials.gov Identifier: NCT02014870, first registered on December 5, 2013.

Keywords: Biomarker; Challenge trial; Influenza; Symptom scores; Transcriptomics.

Figures

Fig. 1
Fig. 1
a Heatmap of summed symptom scores, live viral shedding assay, RT-PCR Influenza A and RT-PCR H1N1. Each row represents one subject and each column one time point in days post challenge. b Schematic overview of the three cohorts used and the supervised learning approach used for the regression analysis
Fig. 2
Fig. 2
a Volcano plot showing all 21 probes (19 genes) associated to significant changes in DSS. The threshold was set to 15% change in DSS per unit in gene expression and a FDR of 1%. b Heatmap of scaled expression values of the 19 genes significantly associated to changes in DSS
Fig. 3
Fig. 3
Intensities from Illumina ht-12 arrays of the 19 gene signature were used to train a random forest model. The model was used to predict symptom scores in an independent test set. a Actual scores were plotted against the predicted values at each day. RMSE decrease and correlation values refer to the overall model fit. b Importance of individual markers within the panel of 19 primers. X-axis shows the increase in RMSE if the respective gene is left out of the model
Fig. 4
Fig. 4
a The predicted DSS from the qRT-PCR based assay using the deltaCt values from the 19 gene signature as a test dataset were plotted against the observed DSS. b The importance of individual markers within the panel of 19 primers is shown in decreasing importance. The x-axis shows the increase in RMSE if the respective gene is left out of the model. LVS live viral shedding assay

References

    1. Osterholm MT, Kelley NS, Sommer A, Belongia EA. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:36–44. doi: 10.1016/S1473-3099(11)70295-X.
    1. Fry AM, Gubareva L, Garten R, Clippard J, Mishin V, Spencer S, et al. Influenza vaccine effectiveness against drifted versus vaccine-like A/H3N2 viruses during the 2014–15 influenza season—US flu VE network. Open Forum Infect Dis. 2015;2(suppl):1.
    1. Chung JR, Flannery B, Thompson MG, Gaglani M, Jackson ML, Monto AS, et al. Seasonal effectiveness of live attenuated and inactivated influenza vaccine. Pediatrics. 2016;137:e20153279. doi: 10.1542/peds.2015-3279.
    1. Nohynek H, Baum U, Syrjänen R, Ikonen N, Sundman J, Jokinen J. Effectiveness of the live attenuated and the inactivated influenza vaccine in two-year-olds—a nationwide cohort study Finland, influenza season 2015/16. Eurosurveillance. 2016;21. doi:10.2807/1560-7917.ES.2016.21.38.30346.
    1. Peters W, Brandl JR, Lindbloom JD, Martinez CJ, Scallan CD, Trager GR, et al. Oral administration of an adenovirus vector encoding both an avian influenza A hemagglutinin and a TLR3 ligand induces antigen specific granzyme B and IFN-γ T cell responses in humans. Vaccine. 2013;31:1752–1758. doi: 10.1016/j.vaccine.2013.01.023.
    1. Atsmon J, Caraco Y, Ziv-Sefer S, Shaikevich D, Abramov E, Volokhov I, et al. Priming by a novel universal influenza vaccine (multimeric-001)—a gateway for improving immune response in the elderly population. Vaccine. 2014;32:5816–5823. doi: 10.1016/j.vaccine.2014.08.031.
    1. Antrobus RD, Berthoud TK, Mullarkey CE, Hoschler K, Coughlan L, Zambon M, et al. Coadministration of seasonal influenza vaccine and MVA-NP+ M1 simultaneously achieves potent humoral and cell-mediated responses. Mol Ther. 2014;22:233–238. doi: 10.1038/mt.2013.162.
    1. Berthoud TK, Hamill M, Lillie PJ, Hwenda L, Collins KA, Ewer KJ, et al. Potent CD8+ T-cell immunogenicity in humans of a novel heterosubtypic influenza A vaccine, MVA-NP+ M1. Clin Infect Dis. 2011;52:1–7. doi: 10.1093/cid/ciq015.
    1. Zaas AK, Burke T, Chen M, McClain M, Nicholson B, Veldman T, et al. A host-based RT-PCR gene expression signature to identify acute respiratory viral infection. Sci Transl Med. 2013;5:203ra126. doi: 10.1126/scitranslmed.3006280.
    1. Zaas AK, Chen M, Varkey J, Veldman T, Hero AO, Lucas J, et al. Gene expression signatures diagnose influenza and other symptomatic respiratory viral infections in humans. Cell Host Microbe. 2009;6:207–217. doi: 10.1016/j.chom.2009.07.006.
    1. Davenport EE, Antrobus RD, Lillie PJ, Gilbert S, Knight JC. Transcriptomic profiling facilitates classification of response to influenza challenge. J Mol Med. 2015;93:105–114. doi: 10.1007/s00109-014-1212-8.
    1. Huang Y, Zaas AK, Rao A, Dobigeon N, Woolf PJ, Veldman T, et al. Temporal dynamics of host molecular responses differentiate symptomatic and asymptomatic influenza a infection. PLoS Genet. 2011;7:e1002234. doi: 10.1371/journal.pgen.1002234.
    1. Woods CW, McClain MT, Chen M, Zaas AK, Nicholson BP, Varkey J, et al. A host transcriptional signature for presymptomatic detection of infection in humans exposed to influenza H1N1 or H3N2. PLoS ONE. 2013;8:e52198. doi: 10.1371/journal.pone.0052198.
    1. Watson JM, Francis JN, Mesens S, Faiman GA, Makin J, Patriarca P, et al. Characterisation of a wild-type influenza (A/H1N1) virus strain as an experimental challenge agent in humans. Virol J. 2015;12:13. doi: 10.1186/s12985-015-0240-5.
    1. Fluidigm. Real-time PCR analysis. PN 68000088 K1. . Accessed 3 May 2016.
    1. Fluidigm. Gene expression with the flex six IFC using fast/standard TaqMan assays. 2015;1–2. . Accessed 3 May 2016.
    1. Dunning MJ, Smith ML, Ritchie ME, Tavaré S. Beadarray: R classes and methods for Illumina bead-based data. Bioinformatics. 2007;23:2183–2184. doi: 10.1093/bioinformatics/btm311.
    1. Shi W, Oshlack A, Smyth GK. Optimizing the noise versus bias trade-off for Illumina whole genome expression beadChips. Nucl Acids Res. 2010;38:e204. doi: 10.1093/nar/gkq871.
    1. Ritchie ME, Phipson B, Wu D, Hu Y, Law CW, Shi W, et al. Limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res. 2015;43:e47. doi: 10.1093/nar/gkv007.
    1. Smyth GK, Michaud J, Scott HS. Use of within-array replicate spots for assessing differential expression in microarray experiments. Bioinformatics. 2005;21:2067–2075. doi: 10.1093/bioinformatics/bti270.
    1. Ritchie ME, Diyagama D, Neilson J, van Laar R, Dobrovic A, Holloway A, et al. Empirical array quality weights in the analysis of microarray data. BMC Bioinform. 2006;7:261. doi: 10.1186/1471-2105-7-261.
    1. Benjamini Y, Hochberg Y, Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57:289–300.
    1. Dvinge H, Bertone P. HTqPCR: high-throughput analysis and visualization of quantitative real-time PCR data in R. Bioinformatics. 2009;25:3325–3326. doi: 10.1093/bioinformatics/btp578.
    1. Kuhn M. Caret package. J Stat Softw. 2008;28:1–26. . Accessed 17 Nov 2016.
    1. Genuer R, Poggi J-M, Tuleau-Malot C. VSURF: an R package for variable selection using random forests. R J. 2015;7:19–33.
    1. Genuer R, Poggi J, Tuleau-Malot C. Variable selection using random forests. Pattern Recognit Lett. 2010;31:2225–2236. doi: 10.1016/j.patrec.2010.03.014.
    1. Carrat F, Vergu E, Ferguson NM, Lemaitre M, Cauchemez S, Leach S, et al. Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol. 2008;167:775–785. doi: 10.1093/aje/kwm375.
    1. Herberg JA, Kaforou M, Gormley S, Sumner ER, Patel S, Jones KDJ, et al. Transcriptomic profiling in childhood H1N1/09 influenza reveals reduced expression of protein synthesis genes. J Infect Dis. 2013;208:1664–1668. doi: 10.1093/infdis/jit348.
    1. Li Y, Zhou H, Wen Z, Wu S, Huang C, Jia G, et al. Transcription analysis on response of swine lung to H1N1 swine influenza virus. BMC Genom. 2011;12:398. doi: 10.1186/1471-2164-12-398.
    1. Go JT, Belisle SE, Tchitchek N, Tumpey TM, Ma W, Richt JA, et al. Pandemic H1N1 influenza virus elicits similar clinical course but differential host transcriptional response in mouse, macaque, and swine infection models. BMC Genom. 2009;2012(13):627.
    1. Dallas PB, Gottardo NG, Firth MJ, Beesley AH, Hoffmann K, Terry PA, et al. Gene expression levels assessed by oligonucleotide microarray analysis and quantitative real-time RT-PCR—how well do they correlate? BMC Genom. 2005;6:59. doi: 10.1186/1471-2164-6-59.

Source: PubMed

3
Abonnieren