Designing and Interpreting Limiting Dilution Assays: General Principles and Applications to the Latent Reservoir for Human Immunodeficiency Virus-1

Daniel I S Rosenbloom, Oliver Elliott, Alison L Hill, Timothy J Henrich, Janet M Siliciano, Robert F Siliciano, Daniel I S Rosenbloom, Oliver Elliott, Alison L Hill, Timothy J Henrich, Janet M Siliciano, Robert F Siliciano

Abstract

Limiting dilution assays are widely used in infectious disease research. These assays are crucial for current human immunodeficiency virus (HIV)-1 cure research in particular. In this study, we offer new tools to help investigators design and analyze dilution assays based on their specific research needs. Limiting dilution assays are commonly used to measure the extent of infection, and in the context of HIV they represent an essential tool for studying latency and potential curative strategies. Yet standard assay designs may not discern whether an intervention reduces an already miniscule latent infection. This review addresses challenges arising in this setting and in the general use of dilution assays. We illustrate the major statistical method for estimating frequency of infectious units from assay results, and we offer an online tool for computing this estimate. We recommend a procedure for customizing assay design to achieve desired sensitivity and precision goals, subject to experimental constraints. We consider experiments in which no viral outgrowth is observed and explain how using alternatives to viral outgrowth may make measurement of HIV latency more efficient. Finally, we discuss how biological complications, such as probabilistic growth of small infections, alter interpretations of experimental results.

Keywords: HIV; dilution assay; latent reservoir; maximum-likelihood statistics; viral outgrowth.

Figures

Figure 1.
Figure 1.
Precision of dilution assays increases with the number of wells into which a sample is divided. Consider two samples of the same size (total number of cells) collected from different donors. Sample A contains 2 latently infected cells, whereas Sample B contains 8 (ovals at left). Five possible assay setups are shown, distributing each sample into 1 to 5 equal wells (columns). Each assay results in a different pattern of possible outcomes for the samples, with the probability of each outcome shown in rows. The final row shows the probability that each assay yields the correct trend, ie, that more wells turn positive in Sample B than in Sample A. Positive wells (viral outgrowth) are shown in dark red. If all cells from a sample are deposited into a single well (first column), then it is impossible to distinguish between the two samples using a binary readout: the extra infected cells in Sample B are “redundant,” and each sample will show outgrowth. If the samples are divided among more wells (second through fifth columns), then the infected cells are less likely to appear redundantly in the same well, meaning that the two samples are more likely to show different outgrowth patterns. In this particular case, each sample must be divided into at least 4 equal wells to obtain the correct trend at least 95% of the time.
Figure 2.
Figure 2.
Schematic for describing quality of maximum-likelihood estimates of infected cell frequency. The thick blue line plots the typical value (median or geometric mean) of the measured infected cell frequency θ^ (y-axis) vs true frequency θ (x-axis), for an idealized experimental setup; this line is dashed outside the limits of detection for the assay. These limits are defined for a significance level α (eg, 0.05). Below the lower limit of detection (LLD), at least α of experiments result in all wells being negative. Above the upper limit of detection (ULD), at least α of experiments result in all wells being positive. In an accurate assay, the estimate tracks the diagonal line θ^=θ (light gray dashed line) between the limits of detection. The blue shaded region plots the confidence interval (CI), within which the middle (1 – α) of estimates fall. Between the lower and upper limits of quantification (LLQ, ULQ), the CI is smaller than a specified size, and a fraction less than α of experiments result in all-positive or all-negative wells. Note that it is possible for LLD = LLQ and/or ULD = ULQ.
Figure 3.
Figure 3.
Performance of the maximum likelihood estimator in simulations, using the two assay designs highlighted in Table 1. Left column: assay on row 4 (confidence interval [CI] θ^ and 95% CI plotted in blue; the diagonal line shows the case of a perfect unbiased estimator. Asymptotic CIs are reported, using likelihood of log-transformed θ. (B) Bias θ^/θ plotted in blue; the horizontal line at 1 shows the case of a perfect unbiased estimator. (C) Size of the estimated 95% CI plotted in black (note different y-axis scales). (D) Binomial probability expression used to estimate infection frequency, assuming n replicate wells of c cells apiece. According to this expression, the probability that all wells are negative equals e, where C is the total number of cells across all replicate wells. A–C plot the actual infection frequency θ used in simulations on the x-axis. Each point on the curves is the geometric mean (A and B) or arithmetic mean (C) of 20 000 replicate simulations using the same θ (step size 0.025 logs). Curves are solid where <5% of simulated assays yield all-negative or all-positive results, dashed at 5%–50%, and not shown at >50%. Blue (A and B) or gray (C) shaded regions show the middle 95% of simulations; jaggedness results from the discrete nature of the dilution assay. Left to right in each panel, the thin vertical lines show the LLD, the LLQ, and the ULQ = ULD. Note that the assay shown at right is more sensitive (20-fold lower LLD), more precise (narrower shaded regions in A and B, smaller CI in C), and more accurate (curve in A better tracks the diagonal; curve in B better tracks the horizontal).

References

    1. Finzi D, Hermankova M, Pierson T et al. . Identification of a reservoir for HIV-1 in patients on highly active antiretroviral therapy. Science 1997; 278:1295–300.
    1. Siliciano JD, Kajdas J, Finzi D et al. . Long-term follow-up studies confirm the stability of the latent reservoir for HIV-1 in resting CD4+ T cells. Nat Med 2003; 9:727–8.
    1. Ho Y-C, Shan L, Hosmane NN et al. . Replication-competent noninduced proviruses in the latent reservoir increase barrier to HIV-1 cure. Cell 2013; 155:540–51.
    1. Eriksson S, Graf EH, Dahl V et al. . Comparative analysis of measures of viral reservoirs in HIV-1 eradication studies. PLoS Pathog 2013; 9:e1003174.
    1. Cohn LB, Silva IT, Oliveira TY et al. . HIV-1 integration landscape during latent and active infection. Cell 2015; 160:420–32.
    1. Myers LE, McQuay LJ, Hollinger FB. Dilution assay statistics. J Clin Microbiol 1994; 32:732–9.
    1. Fisher RA. On the mathematical foundations of theoretical statistics. Phil Trans R Soc A 1922; 222:309–68.
    1. Hütter G, Nowak D, Mossner M et al. . Long-term control of HIV by CCR5 Delta32/Delta32 stem-cell transplantation. N Engl J Med 2009; 360:692–8.
    1. Archin NM, Liberty AL, Kashuba AD et al. . Administration of vorinostat disrupts HIV-1 latency in patients on antiretroviral therapy. Nature 2012; 487:482–5.
    1. Henrich TJ, Hu Z, Li JZ et al. . Long-term reduction in peripheral blood HIV type 1 reservoirs following reduced-intensity conditioning allogeneic stem cell transplantation. J Infect Dis 2013; 207:1694–702.
    1. Persaud D, Gay H, Ziemniak C et al. . Absence of detectable HIV-1 viremia after treatment cessation in an infant. N Engl J Med 2013; 369:1828–35.
    1. Yukl SA, Boritz E, Busch M et al. . Challenges in detecting HIV persistence during potentially curative interventions: a study of the Berlin patient. PLoS Pathog 2013; 9:e1003347.
    1. Bullen CK, Laird GM, Durand CM et al. . New ex vivo approaches distinguish effective and ineffective single agents for reversing HIV-1 latency in vivo. Nat Med 2014; 20:425–9.
    1. Luzuriaga K, Gay H, Ziemniak C et al. . Viremic relapse after HIV-1 remission in a perinatally infected child. N Engl J Med 2015; 372:786–8.
    1. Laird GM, Eisele EE, Rabi SA et al. . Rapid quantification of the latent reservoir for HIV-1 using a viral outgrowth assay. PLoS Pathog 2013; 9:e1003398.
    1. Farber DL, Yudanin NA, Restifo NP. Human memory T cells: generation, compartmentalization and homeostasis. Nat Rev Immunol 2014; 14:24–35.
    1. de St Groth F. The evaluation of limiting dilution assays. J Immunol Methods 1982; 49:R11–23.
    1. Mehrabi Y, Matthews JN. Implementable Bayesian designs for limiting dilution assays. Biometrics 1998; 54:1398–406.
    1. Siliciano JD, Siliciano RF. Enhanced culture assay for detection and quantitation of latently infected, resting CD4+ T-cells carrying replication-competent virus in HIV-1-infected individuals. Methods Mol Biol 2005; 304:3–15.
    1. Hu Y, Smyth GK. ELDA: extreme limiting dilution analysis for comparing depleted and enriched populations in stem cell and other assays. J Immunol Methods 2009; 347:70–8.
    1. Buzón MJ, Sun H, Li C et al. . HIV-1 persistence in CD4(+) T cells with stem cell-like properties. Nat Med 2014; 20:139–42.
    1. Hill AL, Rosenbloom DIS, Fu F et al. . Predicting the outcomes of treatment to eradicate the latent reservoir for HIV-1. Proc Natl Acad Sci U S A 2014; 111:13475–80.
    1. Chomont N. A novel assay that precisely measures the size of the latent HIV reservoir reveals that ART-naïve individuals harbour a large pool of latently infected CD4+ T cells. In: IAS Towards a Cure Symposium; 2014; Melbourne, Australia.
    1. Pasternak AO, Jurriaans S, Bakker M et al. . Cellular levels of HIV unspliced RNA from patients on combination antiretroviral therapy with undetectable plasma viremia predict the therapy outcome. PLoS One 2009; 4:e8490.
    1. Pasternak AO, Adema KW, Bakker M et al. . Highly sensitive methods based on seminested real-time reverse transcription-PCR for quantitation of human immunodeficiency virus type 1 unspliced and multiply spliced RNA and proviral DNA. J Clin Microbiol 2008; 46:2206–11.
    1. Lassen KG, Ramyar KX, Bailey JR et al. . Nuclear retention of multiply spliced HIV-1 RNA in resting CD4+ T cells. PLoS Pathog 2006; 2:e68.
    1. Chakraborty AK, Das J. Pairing computation with experimentation: a powerful coupling for understanding T cell signalling. Nat Rev Immunol 2010; 10:59–71.
    1. Weinberger LS, Burnett JC, Toettcher JE et al. . Stochastic gene expression in a lentiviral positive-feedback loop: HIV-1 Tat fluctuations drive phenotypic diversity. Cell 2005; 122:169–82.
    1. Singh A, Weinberger LS. Stochastic gene expression as a molecular switch for viral latency. Curr Opin Microbiol 2009; 12:460–6.
    1. Rouzine IM, Razooky BS, Weinberger LS. Stochastic variability in HIV affects viral eradication. Proc Natl Acad Sci U S A 2014; 111:13251–52.
    1. Laird GM, Bullen CK, Rosenbloom DIS et al. . Ex vivo analysis identifies effective HIV-1 latency-reversing drug combinations. J Clin Invest 2015; 125:1901–12.
    1. Schwerdt CE, Fogh J. The ratio of physical particles per infectious unit observed for poliomyelitis viruses. Virology 1957; 4:41–52.
    1. Parker RF. Statistical studies of the nature of the infectious unit of vaccine virus. J Exp Med 1938; 67:725–38.
    1. Besnier C, Takeuchi Y, Towers G. Restriction of lentivirus in monkeys. Proc Natl Acad Sci U S A 2002; 99:11920–25.
    1. Debaisieux S, Rayne F, Yezid H, Beaumelle B. The ins and outs of HIV-1 Tat. Traffic 2012; 13:355–63.

Source: PubMed

3
Tilaa