Uncertainty Quantification Reveals the Importance of Data Variability and Experimental Design Considerations for in Silico Proarrhythmia Risk Assessment
Kelly C Chang, Sara Dutta, Gary R Mirams, Kylie A Beattie, Jiansong Sheng, Phu N Tran, Min Wu, Wendy W Wu, Thomas Colatsky, David G Strauss, Zhihua Li, Kelly C Chang, Sara Dutta, Gary R Mirams, Kylie A Beattie, Jiansong Sheng, Phu N Tran, Min Wu, Wendy W Wu, Thomas Colatsky, David G Strauss, Zhihua Li
Abstract
The Comprehensive in vitro Proarrhythmia Assay (CiPA) is a global initiative intended to improve drug proarrhythmia risk assessment using a new paradigm of mechanistic assays. Under the CiPA paradigm, the relative risk of drug-induced Torsade de Pointes (TdP) is assessed using an in silico model of the human ventricular action potential (AP) that integrates in vitro pharmacology data from multiple ion channels. Thus, modeling predictions of cardiac risk liability will depend critically on the variability in pharmacology data, and uncertainty quantification (UQ) must comprise an essential component of the in silico assay. This study explores UQ methods that may be incorporated into the CiPA framework. Recently, we proposed a promising in silico TdP risk metric (qNet), which is derived from AP simulations and allows separation of a set of CiPA training compounds into Low, Intermediate, and High TdP risk categories. The purpose of this study was to use UQ to evaluate the robustness of TdP risk separation by qNet. Uncertainty in the model parameters used to describe drug binding and ionic current block was estimated using the non-parametric bootstrap method and a Bayesian inference approach. Uncertainty was then propagated through AP simulations to quantify uncertainty in qNet for each drug. UQ revealed lower uncertainty and more accurate TdP risk stratification by qNet when simulations were run at concentrations below 5× the maximum therapeutic exposure (Cmax). However, when drug effects were extrapolated above 10× Cmax, UQ showed that qNet could no longer clearly separate drugs by TdP risk. This was because for most of the pharmacology data, the amount of current block measured was <60%, preventing reliable estimation of IC50-values. The results of this study demonstrate that the accuracy of TdP risk prediction depends both on the intrinsic variability in ion channel pharmacology data as well as on experimental design considerations that preclude an accurate determination of drug IC50-values in vitro. Thus, we demonstrate that UQ provides valuable information about in silico modeling predictions that can inform future proarrhythmic risk evaluation of drugs under the CiPA paradigm.
Keywords: Torsade de Pointes; action potential; cardiac electrophysiology; computational modeling; experimental variability; ion channel; pharmacology; uncertainty quantification.
Figures
References
- Antzelevitch C., Belardinelli L., Zygmunt A. C., Burashnikov A., Di Diego J. M., Fish J. M., et al. . (2004). Electrophysiological effects of ranolazine, a novel antianginal agent with antiarrhythmic properties. Circulation 110, 904–910. 10.1161/01.CIR.0000139333.83620.5D
- Britton O. J., Bueno-Orovio A., Van Ammel K., Lu H. R., Towart R., Gallacher D. J., et al. . (2013). Experimentally calibrated population of models predicts and explains intersubject variability in cardiac cellular electrophysiology. Proc. Natl. Acad. Sci. U.S.A. 110, E2098–E2105. 10.1073/pnas.1304382110
- Canty A., Ripley B. D. (2016). boot: Bootstrap R (S-Plus) Functions. R package version 1.3–18.
- Chézalviel-Guilbert F., Davy J.-M., Poirier J.-M., Weissenburger J. (1995). Mexiletine antagonizes effects of sotalol on QT interval duration and its proarrhythmic effects in a canine model of Torsade de Pointes. J. Am. Coll. Cardiol. 26, 787–792. 10.1016/0735-1097(95)00234-U
- Colatsky T., Fermini B., Gintant G., Pierson J. B., Sager P., Sekino Y., et al. . (2016). The comprehensive in vitro proarrhythmia assay (CiPA) initiative - update on progress. J. Pharmacol. Toxicol. Methods 81, 15–20. 10.1016/j.vascn.2016.06.002
- Crumb W. J., Jr., Vicente J., Johannesen L., Strauss D. G. (2016). An evaluation of 30 clinical drugs against the comprehensive in vitro proarrhythmia assay (CiPA) proposed ion channel panel. J. Pharmacol. Toxicol. Methods 81, 251–262. 10.1016/j.vascn.2016.03.009
- Davison A. C., Hinkley D. V. (1997). Bootstrap Methods and Their Applications. (Cambridge: Cambridge University Press; ).
- Duff H. J., Mitchell L. B., Manyari D., Wyse D. G. (1987). Mexiletine-quinidine combination: electrophysiologic correlates of a favorable antiarrhythmic interaction in humans. J. Am. Coll. Cardiol. 10, 1149–1156. 10.1016/S0735-1097(87)80360-1
- Dutta S., Chang K. C., Beattie K. A., Sheng J., Tran P. N., Wu W. W., et al. . (2017). Optimization of an in silico cardiac cell model for proarrhythmia risk assessment. Front. Physiol. 8:616. 10.3389/fphys.2017.00616
- Efron B., Tibshirani R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat. Sci. 1, 54–75. 10.1214/ss/1177013815
- Elkins R. C., Davies M. R., Brough S. J., Gavaghan D. J., Cui Y., Abi-Gerges N., et al. . (2013). Variability in high-throughput ion-channel screening data and consequences for cardiac safety assessment. J. Pharmacol. Toxicol. Methods 68, 112–122. 10.1016/j.vascn.2013.04.007
- Fermini B., Hancox J. C., Abi-Gerges N., Bridgland-Taylor M., Chaudhary K. W., Colatsky T., et al. . (2016). A new perspective in the field of cardiac safety testing through the comprehensive in vitro proarrhythmia assay paradigm. J. Biomol. Screen. 21, 1–11. 10.1177/1087057115594589
- Fink M., Noble D. (2009). Markov models for ion channels: versatility versus identifiability and speed. Philos. Trans. A Math. Phys. Eng. Sci. 367, 2161–2179. 10.1098/rsta.2008.0301
- Fitzmaurice G., Davidian M., Verbeke G., Molenberghs G. (2008). Longitudinal Data Analysis. New York, NY: CRC Press.
- Gintant G., Sager P. T., Stockbridge N. (2016). Evolution of strategies to improve preclinical cardiac safety testing. Nat. Rev. Drug Discov. 15, 457–471. 10.1038/nrd.2015.34
- Guo D., Zhao X., Wu Y., Liu T., Kowey P. R., Yan G.-X. (2007). L-type calcium current reactivation contributes to arrhythmogenesis associated with action potential triangulation. J. Cardiovasc. Electrophysiol. 18, 196–203. 10.1111/j.1540-8167.2006.00698.x
- Hansen N. (2006). The CMA evolution strategy: a comparing review, in Towards a New Evolutionary Computation: Advances in the Estimation of Distribution Algorithms, eds Lozano J. A., Larra-aga P., Inza I., Bengoetxea E. (Berlin; Heidelberg: Springer Berlin Heidelberg; ), 75–102.
- Harrell F. E., Jr. (2016). Rms: Regression Modeling Strategies. R package version 4.5–0.
- Hastie T., Tibshirani R., Friedman J. H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York, NY: Springer.
- January C. T., Moscucci A. (1992). Cellular mechanisms of early afterdepolarizationsa. Ann. N. Y. Acad. Sci. 644, 23–32. 10.1111/j.1749-6632.1992.tb30999.x
- January C. T., Riddle J. M. (1989). Early afterdepolarizations: mechanism of induction and block. A role for L-type Ca2+ current. Circ. Res. 64, 977–990. 10.1161/01.RES.64.5.977
- Johnstone R. H., Bardenet R., Gavaghan D. J., Mirams G. R. (2016a). Hierarchical bayesian inference for ion channel screening dose-response data. Wellcome Open Res. 1, 6. 10.12688/wellcomeopenres.9945.1
- Johnstone R. H., Chang E. T. Y., Bardenet R., de Boer T. P., Gavaghan D. J., Pathmanathan P., et al. . (2016b). Uncertainty and variability in models of the cardiac action potential: can we build trustworthy models? J. Mol. Cell. Cardiol. 96, 49–62. 10.1016/j.yjmcc.2015.11.018
- Li Z., Dutta S., Sheng J., Tran P. N., Wu W., Chang K., et al. . (2017). Improving the in silico assessment of proarrhythmia risk by combining hERG (Human ether-à-go-go-related gene) channel–drug binding kinetics and multichannel pharmacology. Circ. Arrhythm. Electrophysiol. 10:e004628. 10.1161/CIRCEP.116.004628
- Li Z., Dutta S., Sheng J., Tran P. N., Wu W., Colatsky T. (2016). A temperature-dependent in silico model of the human ether-a-go-go-related (hERG) gene channel. J. Pharmacol. Toxicol. Methods 81, 233–239. 10.1016/j.vascn.2016.05.005
- Milnes J. T., Witchel H. J., Leaney J. L., Leishman D. J., Hancox J. C. (2010). Investigating dynamic protocol-dependence of hERG potassium channel inhibition at 37 degrees C: cisapride versus dofetilide. J. Pharmacol. Toxicol. Methods 61, 178–191. 10.1016/j.vascn.2010.02.007
- Mirams G. R., Pathmanathan P., Gray R. A., Challenor P., Clayton R. H. (2016). White paper: uncertainty and variability in computational and mathematical models of cardiac physiology. J. Physiol. 594, 6833–6847. 10.1113/JP271671
- O'Hara T., Virág L., Varró A., Rudy Y. (2011). Simulation of the undiseased human cardiac ventricular action potential: model formulation and experimental validation. PLoS Comput. Biol. 7:e1002061. 10.1371/journal.pcbi.1002061
- Pathmanathan P., Gray R. A. (2013). Ensuring reliability of safety-critical clinical applications of computational cardiac models. Front. Physiol. 4:358. 10.3389/fphys.2013.00358
- Pathmanathan P., Shotwell M. S., Gavaghan D. J., Cordeiro J. M., Gray R. A. (2015). Uncertainty quantification of fast sodium current steady-state inactivation for multi-scale models of cardiac electrophysiology. Prog. Biophys. Mol. Biol. 117, 4–18. 10.1016/j.pbiomolbio.2015.01.008
- R Core Team (2016). R: A Language and Environment for Statistical Computing. R version 3.3.
- Sarkar A. X., Sobie E. A. (2011). Quantification of repolarization reserve to understand interpatient variability in the response to proarrhythmic drugs: a computational analysis. Heart Rhythm. 8, 1749–1755. 10.1016/j.hrthm.2011.05.023
- Shotwell M. S., Gray R. A. (2016). Estimability analysis and optimal design in dynamic multi-scale models of cardiac electrophysiology. J. Agric. Biol. Environ. Stat. 21, 261–276. 10.1007/s13253-016-0244-7
- Soetaert K., Petzoldt T. (2010). Inverse modelling, sensitivity and monte carlo analysis in R using package FME. J. Stat. Softw. 33, 1–28. 10.18637/jss.v033.i03
- Soetaert K., Petzoldt T., Setzer R. W. (2010). Solving differential equations in r: package desolve. J. Stat. Softw. 33, 1–25. 10.18637/jss.v033.i09
- Trautmann H., Mersmann O., Arnu D. (2011). cmaes: Covariance Matrix Adapting Evolutionary Strategy. R package version 1.0–11.
- Wickham H. (2009). ggplot2: Elegant Graphics for Data Analysis. New York, NY: Springer-Verlag New York.
- Yan G.-X., Wu Y., Liu T., Wang J., Marinchak R. A., Kowey P. R. (2001). Phase 2 early afterdepolarization as a trigger of polymorphic ventricular tachycardia in acquired long-QT syndrome. Direct evidence from intracellular recordings in the intact left ventricular wall. Circulation 103, 2851–2856. 10.1161/01.cir.103.23.2851
Source: PubMed