Meta-analysis to compare the accuracy of GeneXpert, MODS and the WHO 2007 algorithm for diagnosis of smear-negative pulmonary tuberculosis
Simon Walusimbi, Freddie Bwanga, Ayesha De Costa, Melles Haile, Moses Joloba, Sven Hoffner, Simon Walusimbi, Freddie Bwanga, Ayesha De Costa, Melles Haile, Moses Joloba, Sven Hoffner
Abstract
Background: Smear-negative pulmonary tuberculosis (SN-PTB), which is common in HIV-infected patients, is difficult to diagnose using smear microscopy alone. In 2007, the WHO developed an algorithm to improve the diagnosis and management of smear-negative tuberculosis in HIV prevalent and resource constrained settings. Implementation of the algorithm required individuals with presumptive TB to be initially evaluated using two sputum microscopy examinations followed by clinical diagnosis that may include chest X-ray and antibiotic treatment in smear-negative individuals. Since that time, the WHO has endorsed several new tests for diagnosis of tuberculosis. However, it is unclear how the new tests perform when compared to the WHO 2007 algorithm in diagnosis of SN-PTB. Using meta-analysis study design, we summarized and compared the accuracy of Xpert® MTB/Rif assay (GeneXpert) and Microscopic Observation Drug Susceptibility assay (MODS), with the WHO 2007 algorithm in the diagnosis of SN-PTB.
Methods: A systematic review and meta-analysis of publications on GeneXpert, or MODS, or the WHO 2007 algorithm for diagnosis of SN-PTB, using culture as reference test was performed. Meta-Disc software was used to obtain pooled sensitivity and specificity of the diagnostic methods. Heterogeneity in the accuracy estimates was tested by reviewing the generated forest plots, sROC curves and the Spearman correlation coefficient of the logit of true positive rate versus the logit of false positive rate.
Results: Twenty-four publications on all three diagnostic methods were meta-analyzed. The pooled sensitivity and specificity for detection of smear-negative pulmonary tuberculosis were 67% and 98% for GeneXpert, 73% and 91% for MODS, and 61% and 69% for WHO 2007 algorithm, respectively. The sensitivity of GeneXpert reduced from 67% to 54% when sub-group analysis of studies with patient HIV prevalence ≥ 30% was performed.
Conclusion: The GeneXpert, MODS, and the WHO algorithm have moderate to high accuracy for the diagnosis of SN-PTB. However, the accuracy of the tests is extremely variable. The setting and context under which the tests are conducted in addition to several other factors could explain this variability. There is therefore need to investigate these factors further. The information from these studies would inform the adoption and placement of these new tests.
Figures
References
- World Health Organization. Global Tuberculosis Report. 2012. Available from: . Accessed on August 2013.
- Steingart KR, Ng V, Henry M, Hopewell PC, Ramsay A, Cunningham J, Urbanczik R, Perkins MD, Aziz MA, Pai M. Sputum processing methods to improve the sensitivity of smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis. 2006;6(10):664–674. doi: 10.1016/S1473-3099(06)70602-8.
- Steingart KR, Henry M, Ng V, Hopewell PC, Ramsay A, Cunningham J, Urbanczik R, Perkins M, Aziz MA, Pai M. Fluorescence versus conventional sputum smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis. 2006;6(9):570–581. doi: 10.1016/S1473-3099(06)70578-3.
- Murray JF. Pulmonary complications of HIV-1 infection among adults living in Sub-Saharan Africa. Int J Tuberc Lung Dis. 2005;9(8):826–835.
- Getahun H, Harrington M, O’Brien R, Nunn P. Diagnosis of smear-negative pulmonary tuberculosis in people with HIV infection or AIDS in resource-constrained settings: informing urgent policy changes. Lancet. 2007;369(9578):2042–2049. doi: 10.1016/S0140-6736(07)60284-0.
- World Health Organization. Stop TB. Geneva: Department of HIV/AIDS; 2007. Improving the diagnosis and treatment of smear-negative pulmonary and extrapulmonary tuberculosis among adults and adolescents. Recommendations for HIV-prevalent and resource-constrained settings. Available from: . Accessed August 2013.
- Pai M, Minion J, Steingart K, Ramsay A. New and improved tuberculosis diagnostics: evidence, policy, practice, and impact. Curr Opin Pulm Med. 2010;16(3):271–284.
- Alamo ST, Kunutsor S, Walley J, Thoulass J, Evans M, Muchuro S, Matovu A, Katabira E. Performance of the new WHO diagnostic algorithm for smear-negative pulmonary tuberculosis in HIV prevalent settings: a multisite study in Uganda. Trop Med Int Health. 2012;17(7):884–895. doi: 10.1111/j.1365-3156.2012.03003.x.
- World Health Organization. Rapid implementation of the Xpert MTB/RIF diagnostic test: technical and operational “How-to”; practical considerations. 2011. Available from: . Accessed August 2013.
- Blakemore R, Story E, Helb D, Kop J, Banada P, Owens MR, Chakravorty S, Jones M, Alland D. Evaluation of the analytical performance of the Xpert MTB/RIF assay. J Clin Microbiol. 2010;48(7):2495–2501. doi: 10.1128/JCM.00128-10.
- World Health Organization. Automated real-time nucleic acid amplification technology for rapid and simultaneous detection of tuberculosis and rifampicin resistance: Xpert mtb/rif system. Policy statement 2011. 2011. Available from: . Accessed August 2013.
- World Health Organization. Noncommercial culture and drug-susceptibility testing methods for screening patients at risk for multidrug- resistant tuberculosis. Policy statement 2011. Available from: . Accessed August 2013.
- Caviedes L, Lee TS, Gilman RH, Sheen P, Spellman E, Lee EH, Berg DE, Montenegro-James S. Rapid, efficient detection and drug susceptibility testing of Mycobacterium tuberculosis in sputum by microscopic observation of broth cultures. The Tuberculosis Working Group in Peru. J Clin Microbiol. 2000;38(3):1203–1208.
- Moore DA, Evans CA, Gilman RH, Caviedes L, Coronel J, Vivar A, Sanchez E, Pinedo Y, Saravia JC, Salazar C. et al.Microscopic-observation drug-susceptibility assay for the diagnosis of TB. N Engl J Med. 2006;355(15):1539–1550. doi: 10.1056/NEJMoa055524.
- Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–536. doi: 10.7326/0003-4819-155-8-201110180-00009.
- Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol. 2006;6:31. doi: 10.1186/1471-2288-6-31.
- Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539–1558. doi: 10.1002/sim.1186.
- Identifying and measuring heterogeneity. Available at . Accessed August 12.
- Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making. 1993;13(4):313–321. doi: 10.1177/0272989X9301300408.
- Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12(14):1293–1316. doi: 10.1002/sim.4780121403.
- Colton T. Statistics in Medicine. Little, Brown and Company: Boston; 1974.
- Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, Krapp F, Allen J, Tahirli R, Blakemore R, Rustomjee R. et al.Rapid molecular detection of tuberculosis and rifampin resistance. N Engl J Med. 2010;363(11):1005–1015. doi: 10.1056/NEJMoa0907847.
- Boehme CC, Nicol MP, Nabeta P, Michael JS, Gotuzzo E, Tahirli R, Gler MT, Blakemore R, Worodria W, Gray C. et al.Feasibility, diagnostic accuracy, and effectiveness of decentralised use of the Xpert MTB/RIF test for diagnosis of tuberculosis and multidrug resistance: a multicentre implementation study. Lancet. 2011;377(9776):1495–1505. doi: 10.1016/S0140-6736(11)60438-8.
- Helb D, Jones M, Story E, Boehme C, Wallace E, Ho K, Kop J, Owens MR, Rodgers R, Banada P. et al.Rapid detection of Mycobacterium tuberculosis and rifampin resistance by use of on-demand, near-patient technology. J Clin Microbiol. 2010;48(1):229–237. doi: 10.1128/JCM.01463-09.
- Malbruny B, Le Marrec G, Courageux K, Leclercq R, Cattoir V. Rapid and efficient detection of Mycobacterium tuberculosis in respiratory and non-respiratory samples. Int J Tuberc Lung Dis. 2011;15(4):553–555. doi: 10.5588/ijtld.10.0497.
- Bowles EC, Freyee B, van Ingen J, Mulder B, Boeree MJ, van Soolingen D. Xpert MTB/RIF(R), a novel automated polymerase chain reaction-based tool for the diagnosis of tuberculosis. Int J Tuberc Lung Dis. 2011;15(7):988–989. doi: 10.5588/ijtld.10.0574.
- Moure R, Munoz L, Torres M, Santin M, Martin R, Alcaide F. Rapid detection of Mycobacterium tuberculosis complex and rifampin resistance in smear-negative clinical samples by use of an integrated real-time PCR method. J Clin Microbiol. 2011;49(3):1137–1139. doi: 10.1128/JCM.01831-10.
- Marlowe EM, Novak-Weekley SM, Cumpio J, Sharp SE, Momeny MA, Babst A, Carlson JS, Kawamura M, Pandori M. Evaluation of the Cepheid Xpert MTB/RIF assay for direct detection of Mycobacterium tuberculosis complex in respiratory specimens. J Clin Microbiol. 2011;49(4):1621–1623. doi: 10.1128/JCM.02214-10.
- Theron G, Peter J, van Zyl-Smit R, Mishra H, Streicher E, Murray S, Dawson R, Whitelaw A, Hoelscher M, Sharma S. et al.Evaluation of the Xpert MTB/RIF assay for the diagnosis of pulmonary tuberculosis in a high HIV prevalence setting. Am J Respir Crit Care Med. 2011;184(1):132–140. doi: 10.1164/rccm.201101-0056OC.
- Rachow A, Zumla A, Heinrich N, Rojas-Ponce G, Mtafya B, Reither K, Ntinginya EN, O’Grady J, Huggett J, Dheda K. et al.Rapid and accurate detection of Mycobacterium tuberculosis in sputum samples by Cepheid Xpert MTB/RIF assay–a clinical validation study. PLoS One. 2011;6(6):e20458. doi: 10.1371/journal.pone.0020458.
- Scott LE, McCarthy K, Gous N, Nduna M, Van Rie A, Sanne I, Venter WF, Duse A, Stevens W. Comparison of Xpert MTB/RIF with other nucleic acid technologies for diagnosing pulmonary tuberculosis in a high HIV prevalence setting: a prospective study. PLoS Med. 2011;8(7):e1001061. doi: 10.1371/journal.pmed.1001061.
- Lawn SD, Brooks SV, Kranzer K, Nicol MP, Whitelaw A, Vogt M, Bekker LG, Wood R. Screening for HIV-associated tuberculosis and rifampicin resistance before antiretroviral therapy using the Xpert MTB/RIF assay: a prospective study. PLoS Med. 2011;8(7):e1001067. doi: 10.1371/journal.pmed.1001067.
- Ioannidis P, Papaventsis D, Karabela S, Nikolaou S, Panagi M, Raftopoulou E, Konstantinidou E, Marinou I, Kanavaki S. Cepheid GeneXpert MTB/RIF assay for Mycobacterium tuberculosis detection and rifampin resistance identification in patients with substantial clinical indications of tuberculosis and smear-negative microscopy results. J Clin Microbiol. 2011;49(8):3068–3070. doi: 10.1128/JCM.00718-11.
- Miller MB, Popowitch EB, Backlund MG, Ager EP. Performance of Xpert MTB/RIF RUO assay and IS6110 real-time PCR for Mycobacterium tuberculosis detection in clinical samples. J Clin Microbiol. 2011;49(10):3458–3462. doi: 10.1128/JCM.05212-11.
- Teo J, Jureen R, Chiang D, Chan D, Lin R. Comparison of two nucleic acid amplification assays, the Xpert MTB/RIF assay and the amplified Mycobacterium Tuberculosis Direct assay, for detection of Mycobacterium tuberculosis in respiratory and nonrespiratory specimens. J Clin Microbiol. 2011;49(10):3659–3662. doi: 10.1128/JCM.00211-11.
- Nicol MP, Workman L, Isaacs W, Munro J, Black F, Eley B, Boehme CC, Zemanay W, Zar HJ. Accuracy of the Xpert MTB/RIF test for the diagnosis of pulmonary tuberculosis in children admitted to hospital in Cape Town, South Africa: a descriptive study. Lancet Infect Dis. 2011;11(11):819–824. doi: 10.1016/S1473-3099(11)70167-0.
- Rachow A, Clowes P, Saathoff E, Mtafya B, Michael E, Ntinginya EN, Kowour D, Rojas-Ponce G, Kroidl A, Maboko L. et al.Increased and expedited case detection by Xpert MTB/RIF assay in childhood tuberculosis: a prospective cohort study. Clin Infect Dis. 2012;54(10):1388–1396. doi: 10.1093/cid/cis190.
- Safianowska A, Walkiewicz R, Nejman-Gryz P, Grubek-Jaworska H. Two selected commercially based nucleic acid amplification tests for the diagnosis of tuberculosis. Pneumonol Alergol Pol. 2012;80(1):6–12.
- Arias M, Mello FC, Pavon A, Marsico AG, Alvarado-Galvez C, Rosales S, Pessoa CL, Perez M, Andrade MK, Kritski AL. et al.Clinical evaluation of the microscopic-observation drug-susceptibility assay for detection of tuberculosis. Clin Infect Dis. 2007;44(5):674–680. doi: 10.1086/511639.
- Mashta A, Mishra P, Philipose S, Tamilzhalagan S, Mahmud H, Bhaskar S, Upadhyay P. Diagnosis of tuberculosis: the experience at a specialized diagnostic laboratory. J Negat Results Biomed. 2011;10:16. doi: 10.1186/1477-5751-10-16.
- Shah NS, Moodley P, Babaria P, Moodley S, Ramtahal M, Richardson J, Heysell S, Li X, Moll A, Friedland G. et al.Rapid diagnosis of tuberculosis and multidrug resistance by the microscopic-observation drug-susceptibility assay. Am J Respir Crit Care Med. 2011;183(10):1427–1433. doi: 10.1164/rccm.201009-1449OC.
- Ha DT, Lan NT, Kiet VS, Wolbers M, Hang HT, Day J, Hien NQ, Tien NA, An PT, Anh TT. et al.Diagnosis of pulmonary tuberculosis in HIV-positive patients by microscopic observation drug susceptibility assay. J Clin Microbiol. 2010;48(12):4573–4579. doi: 10.1128/JCM.00687-10.
- Chaiyasirinroje B, Aung MN, Moolphate S, Kasetjaroen Y, Rienthong S, Rienthong D, Nampaisan O, Nedsuwan S, Sangchun W, Suriyon N. et al.Prospective evaluation of simply modified MODS assay: an effective tool for TB diagnosis and detection of MDR-TB. Infect Drug Resist. 2012;5:79–86.
- Wilson D, Mbhele L, Badri M, Morroni C, Nachega J, Chaisson RE, Maartens G. Evaluation of the World Health Organization algorithm for the diagnosis of HIV-associated sputum smear-negative tuberculosis. Int J Tuberc Lung Dis. 2011;15(7):919–924. doi: 10.5588/ijtld.10.0440.
- Swai HF, Mugusi FM, Mbwambo JK. Sputum smear negative pulmonary tuberculosis: sensitivity and specificity of diagnostic algorithm. BMC Res Notes. 2011;4:475. doi: 10.1186/1756-0500-4-475.
- Koole O, Thai S, Khun KE, Pe R, van Griensven J, Apers L, Van den Ende J, Mao TE, Lynen L. Evaluation of the 2007 WHO guideline to improve the diagnosis of tuberculosis in ambulatory HIV-positive adults. PLoS One. 2011;6(4):e18502. doi: 10.1371/journal.pone.0018502.
- Rosman AS, Korsten MA. Application of summary receiver operating characteristics (sroc) analysis to diagnostic clinical testing. Adv Med Sci. 2007;52:76–82.
- WHO. Fluorescent light-emitting diode (LED) microscopy for diagnosis of tuberculosis. 2011. (Policy statement). Available at . Accessed August 12. 2013.
- Steingart KR, Sohn H, Schiller I, Kloda LA, Boehme CC, Pai M, Dendukuri N. Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2013. p. CD009593. DOI:10.1002/14651858.CD009593.pub2. Available from: . Accessed August 2013.
- Chang K, Lu W, Wang J, Zhang K, Jia S, Li F, Deng S, Chen M. Rapid and effective diagnosis of tuberculosis and rifampicin resistance with Xpert MTB/RIF assay: a meta-analysis. J Infect. 2012;64(6):580–588. doi: 10.1016/j.jinf.2012.02.012.
- Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y. In: Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0. Deeks JJ, Bossuyt PM, Gatsonis C, editor. 2010. Chapter 10: Analysing and Presenting Results. (The Cochrane Collaboration). Available from: . Accessed August 12–2013.
- Bwanga F, Hoffner S, Haile M, Joloba ML. Direct susceptibility testing for multi drug resistant tuberculosis: a meta-analysis. BMC Infect Dis. 2009;9:67. doi: 10.1186/1471-2334-9-67.
- Recommendations on testing for funnel plot asymmetry. Available at . Accessed August 12. 2013.
Source: PubMed