The accuracy of Vesical Imaging-Reporting and Data System (VI-RADS): an updated comprehensive multi-institutional, multi-readers systematic review and meta-analysis from diagnostic evidence into future clinical recommendations

Francesco Del Giudice, Rocco Simone Flammia, Martina Pecoraro, Marco Moschini, David D'Andrea, Emanuele Messina, Lucia Martina Pisciotti, Ettore De Berardinis, Alessandro Sciarra, Valeria Panebianco, Francesco Del Giudice, Rocco Simone Flammia, Martina Pecoraro, Marco Moschini, David D'Andrea, Emanuele Messina, Lucia Martina Pisciotti, Ettore De Berardinis, Alessandro Sciarra, Valeria Panebianco

Abstract

Purpose: To determine through a comprehensive systematic review and meta-analysis the cumulative diagnostic performance of vesical imaging-reporting and data system (VIRADS) to predict preoperative muscle-invasiveness among different institutions, readers, and optimal scoring accuracy thresholds.

Methods: PubMed, Cochrane and Embase were searched from inception up to May 2021. Sensitivity (Sn), Specificity (Sp) were first estimated and subsequently pooled using hierarchical summary receiver operating characteristics (HSROC) modeling for both cut-off ≥ 3 and ≥ 4 to predict muscle-invasive bladder cancer (MIBC). Further sensitivity analysis, subgroup analysis and meta-regression were conducted to investigate contribution of moderators to heterogeneity.

Results: In total, n = 20 studies from 2019 to 2021 with n = 2477 patients by n = 53 genitourinary radiologists met the inclusion criteria. Pooled weighted Sn and Sp were 0.87 (95% CI 0.82-0.91) and 0.86 (95% CI 0.80-0.90) for cut-off ≥ 3 while 0.78 (95% CI 0.74-0.81) and 0.94 (95% CI 0.91-0.96) for cut-off ≥ 4. The area under the HSROC curve was 0.93 (95% CI 0.90-0.95) and 0.91 (95% CI 0.88-0.93) for cut-off ≥ 3 and ≥ 4, respectively. Meta-regression analyses showed no influence of clinical characteristics nor cumulative reader's experience while study design and radiological characteristics were found to influence the estimated outcome.

Conclusion: We demonstrated excellent worldwide diagnostic performance of VI-RADS to determine pre-trans urethral resection of bladder tumor (TURBT) staging. Our findings corroborate wide reliability of VI-RADS accuracy also between different centers with varying experience underling the importance that standardization and reproducibility of VI-RADS may confer to multiparametric magnetic resonance imaging (mpMRI) for preoperative BCa discrimination.

Keywords: Bladder cancer; Bladder cancer staging; Multiparametric magnetic resonance imaging; Muscle-invasive bladder cancer.

Conflict of interest statement

Regarding the content of this paper, the authors declare that they have no conflict of interest to disclose.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Forest plot of pooled sensitivity and specificity for VIRADS ≥ 3 (A) or ≥ 4 (B) as the cut-off criterion for MIBC identification
Fig. 2
Fig. 2
HSROC for diagnostic performance of studies using VI-RADS predicting MIBC. HSROC hierarchical summary receiver operating characteristics; VI-RADS vesical imaging reporting and data system
Fig. 3
Fig. 3
Fagan nomogram reflecting pre- and post-test probability estimation for clinical utility of VIRADS criterion ≥ 3 (A) or ≥ 4 (B), respectively. VI-RADS vesical imaging reporting and data system

References

    1. Panebianco V, Pecoraro M, Del Giudice F, Takeuchi M, Muglia VF, Messina E, Cipollari S, Giannarini G, Catalano C, Narumi Y. VI-RADS for bladder cancer: current applications and future developments. J Magn Reson Imaging. 2020 doi: 10.1002/jmri.27361.
    1. Del Giudice F, Campa R, Bicchetti M, De Berardinis E, Panebianco V. Vesical imaging-reporting and data system (VI-RADS) incorporated into bladder cancer clinical practice: what's the perspectives beyond diagnostic accuracy? Transl Androl Urol. 2020;9(5):2320–2322. doi: 10.21037/tau-2020-07.
    1. Panebianco V, Narumi Y, Altun E, Bochner BH, Efstathiou JA, Hafeez S, Huddart R, Kennish S, Lerner S, Montironi R, Muglia VF, Salomon G, Thomas S, Vargas HA, Witjes JA, Takeuchi M, Barentsz J, Catto JWF. Multiparametric Magnetic Resonance Imaging for Bladder Cancer: Development of VI-RADS (Vesical Imaging-Reporting And Data System) Eur Urol. 2018;74(3):294–306. doi: 10.1016/j.eururo.2018.04.029.
    1. Woo S, Panebianco V, Narumi Y, Del Giudice F, Muglia VF, Takeuchi M, Ghafoor S, Bochner BH, Goh AC, Hricak H, Catto JWF, Vargas HA. Diagnostic performance of vesical imaging reporting and data system for the prediction of muscle-invasive bladder cancer: a systematic review and meta-analysis. Eur Urol Oncol. 2020;3(3):306–315. doi: 10.1016/j.euo.2020.02.007.
    1. Luo C, Huang B, Wu Y, Chen J, Chen L. Use of vesical imaging-reporting and data system (VI-RADS) for detecting the muscle invasion of bladder cancer: a diagnostic meta-analysis. Eur Radiol. 2020;30(8):4606–4614. doi: 10.1007/s00330-020-06802-z.
    1. Del Giudice F, Barchetti G, De Berardinis E, Pecoraro M, Salvo V, Simone G, Sciarra A, Leonardo C, Gallucci M, Catalano C, Catto JWF, Panebianco V. Prospective assessment of vesical imaging reporting and data system (VI-RADS) and its clinical impact on the management of high-risk non-muscle-invasive bladder cancer patients candidate for repeated transurethral resection. Eur Urol. 2020;77(1):101–109. doi: 10.1016/j.eururo.2019.09.029.
    1. Necchi A, Bandini M, Calareso G, Raggi D, Pederzoli F, Farè E, Colecchia M, Marandino L, Bianchi M, Gallina A, Colombo R, Fossati N, Gandaglia G, Capitanio U, Dehò F, Giannatempo P, Lucianò R, Salonia A, Madison R, Ali SM, Chung JH, Ross JS, Briganti A, Montorsi F, De Cobelli F, Messina A. Multiparametric magnetic resonance imaging as a noninvasive assessment of tumor response to neoadjuvant pembrolizumab in muscle-invasive bladder cancer: preliminary findings from the PURE-01 study. Eur Urol. 2020;77(5):636–643. doi: 10.1016/j.eururo.2019.12.016.
    1. Bandini M, Calareso G, Raggi D, Marandino L, Colecchia M, Gallina A, Giannatempo P, Pederzoli F, Gandaglia G, Fossati N, Capitanio U, Colombo R, Salonia A, Briganti A, Montorsi F, De Cobelli F, Messina A, Necchi A. The value of multiparametric magnetic resonance imaging sequences to assist in the decision making of muscle-invasive bladder cancer. Eur Urol Oncol. 2020;S2588–9311(20):30082–30091. doi: 10.1016/j.euo.2020.06.004.
    1. Del Giudice F, Leonardo C, Simone G, Pecoraro M, De Berardinis E, Cipollari S, Flammia S, Bicchetti M, Busetto GM, Chung BI, Gallucci M, Catalano C, Panebianco V. Preoperative detection of Vesical Imaging-Reporting and Data System (VI-RADS) score 5 reliably identifies extravesical extension of urothelial carcinoma of the urinary bladder and predicts significant delayed time to cystectomy: time to reconsider the need for primary deep transurethral resection of bladder tumour in cases of locally advanced disease? BJU Int. 2020;126(5):610–619. doi: 10.1111/bju.15188.
    1. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34. doi: 10.1016/j.jclinepi.2009.06.006.
    1. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, QUADAS-2 Group QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–536. doi: 10.7326/0003-4819-155-8-201110180-00009.
    1. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539–1558. doi: 10.1002/sim.1186.
    1. Wang H, Luo C, Zhang F, Guan J, Li S, Yao H, Chen J, Luo J, Chen L, Guo Y. Multiparametric MRI for bladder cancer: validation of VI-RADS for the detection of detrusor muscle invasion. Radiology. 2019;291(3):668–674. doi: 10.1148/radiol.2019182506.
    1. Wang Z, Shang Y, Luan T, Duan Y, Wang J, Wang H, Hao J. Evaluation of the value of the VI-RADS scoring system in assessing muscle infiltration by bladder cancer. Cancer Imaging. 2020;20(1):26. doi: 10.1186/s40644-020-00304-3.PMID:32252816;PMCID:PMC7137481.
    1. Liu S, Xu F, Xu T, Yan Y, Yao X, Tang G. Evaluation of vesical imaging-reporting and data system (VI-RADS) scoring system in predicting muscle invasion of bladder cancer. Transl Androl Urol. 2020;9(2):445–451. doi: 10.21037/tau.2020.02.16.PMID:32420150;PMCID:PMC7215047.
    1. Meng X, Hu H, Wang Y, Hu D, Li Z, Feng C. Application of bi-planar reduced field-of-view DWI (rFOV DWI) in the assessment of muscle-invasiveness of bladder cancer. Eur J Radiol. 2021;136:109486. doi: 10.1016/j.ejrad.2020.109486.
    1. Li S, Liang P, Wang Y, Feng C, Shen Y, Hu X, Hu D, Meng X, Li Z. Combining volumetric apparent diffusion coefficient histogram analysis with vesical imaging reporting and data system to predict the muscle invasion of bladder cancer. Abdom Radiol (NY) 2021;46(9):4301–4310. doi: 10.1007/s00261-021-03091-y.
    1. Ueno Y, Takeuchi M, Tamada T, Sofue K, Takahashi S, Kamishima Y, Hinata N, Harada K, Fujisawa M, Murakami T. Diagnostic accuracy and interobserver agreement for the vesical imaging-reporting and data system for muscle-invasive bladder cancer: a multireader validation study. Eur Urol. 2019;76(1):54–56. doi: 10.1016/j.eururo.2019.03.012.
    1. Ueno Y, Tamada T, Takeuchi M, Sofue K, Takahashi S, Kamishima Y, Urase Y, Kido A, Hinata N, Harada K, Fujisawa M, Miyaji Y, Murakami T. VI-RADS: multiinstitutional multireader diagnostic accuracy and interobserver agreement study. AJR Am J Roentgenol. 2021;216(5):1257–1266. doi: 10.2214/AJR.20.23604.
    1. Sakamoto K, Ito M, Ikuta S, Nakanishi Y, Kataoka M, Takemura K, Suzuki H, Tobisu K-I, Kamai T, Koga F. Detection of muscle-invasive bladder cancer on biparametric MRI using vesical imaging-reporting and data system and apparent diffusion coefficient values (VI-RADS/ADC) Bladder Cancer. 2020;6:161–169. doi: 10.3233/BLC-190267.
    1. Arita Y, Shigeta K, Akita H, Suzuki T, Kufukihara R, Kwee TC, Ishii R, Mikami S, Okuda S, Kikuchi E, Oya M, Jinzaki M. Clinical utility of the vesical imaging-reporting and data system for muscle-invasive bladder cancer between radiologists and urologists based on multiparametric MRI including 3D FSE T2-weighted acquisitions. Eur Radiol. 2021;31(2):875–883. doi: 10.1007/s00330-020-07153-5.
    1. Kim SH. Validation of vesical imaging reporting and data system for assessing muscle invasion in bladder tumor. Abdom Radiol (NY) 2020;45(2):491–498. doi: 10.1007/s00261-019-02190-1.
    1. Hong SB, Lee NK, Kim S, Son IW, Ha HK, Ku JY, Kim KH, Park WY. Vesical imaging-reporting and data system for multiparametric MRI to predict the presence of muscle invasion for bladder cancer. J Magn Reson Imaging. 2020;52(4):1249–1256. doi: 10.1002/jmri.27141.
    1. Barchetti G, Simone G, Ceravolo I, Salvo V, Campa R, Del Giudice F, De Berardinis E, Buccilli D, Catalano C, Gallucci M, Catto JWF, Panebianco V. Multiparametric MRI of the bladder: inter-observer agreement and accuracy with the vesical imaging-reporting and data system (VI-RADS) at a single reference center. Eur Radiol. 2019;29(10):5498–5506. doi: 10.1007/s00330-019-06117-8.
    1. Marchioni M, Primiceri G, Delli Pizzi A, Basilico R, Berardinelli F, Mincuzzi E, Castellucci R, Sessa B, Di Nicola M, Schips L. Could bladder multiparametric MRI be introduced in routine clinical practice? Role of the new VI-RADS score: results from a prospective study. Clin Genitourin Cancer. 2020;18(5):409–415.e1. doi: 10.1016/j.clgc.2020.03.002.
    1. Delli Pizzi A, Mastrodicasa D, Marchioni M, Primiceri G, Di Fabio F, Cianci R, Seccia B, Sessa B, Mincuzzi E, Romanelli M, Castellan P, Castellucci R, Colasante A, Schips L, Basilico R, Caulo M. Bladder cancer: do we need contrast injection for MRI assessment of muscle invasion? A prospective multi-reader VI-RADS approach. Eur Radiol. 2021;31(6):3874–3883. doi: 10.1007/s00330-020-07473-6.
    1. Etxano J, Rodríguez-Vigil B, Pérez F, Beardo P, Viguri A, Tolosa E, Martínez de Guereñu B (2021) Vesical imaging-reporting and data system (VI-RADS®): initial experience in the classification of muscle-invasive bladder cancer. Actas Urol Esp (Engl Ed) 45(4):320-325. English, Spanish. 10.1016/j.acuro.2020.10.004. Epub 2021 Jan 30. PMID: 33531283.
    1. Akcay A, Yagci AB, Celen S, Ozlulerden Y, Turk NS, Ufuk F. VI-RADS score and tumor contact length in MRI: A potential method for the detection of muscle invasion in bladder cancer. Clin Imaging. 2021;77:25–36. doi: 10.1016/j.clinimag.2021.02.026.
    1. Makboul M, Farghaly S, Abdelkawi IF. Multiparametric MRI in differentiation between muscle invasive and non-muscle invasive urinary bladder cancer with vesical imaging reporting and data system (VI-RADS) application. Br J Radiol. 2019;92(1104):20190401. doi: 10.1259/bjr.20190401.
    1. Metwally MI, Zeed NA, Hamed EM, Elshetry ASF, Elfwakhry RM, Alaa Eldin AM, Sakr A, Aly SA, Mosallam W, Ziada YMA, Balata R, Harb OA, Basha MAA. The validity, reliability, and reviewer acceptance of VI-RADS in assessing muscle invasion by bladder cancer: a multicenter prospective study. Eur Radiol. 2021;31(9):6949–6961. doi: 10.1007/s00330-021-07765-5.
    1. Vaz A, Zaparolli M. Diagnostic accuracy of retrospective application of the vesical imaging-reporting and data system: preliminary results. Radiol Bras. 2020;53(1):21–26. doi: 10.1590/0100-3984.2019.0063.
    1. van der Heijden AG, Witjes JA. Vesical imaging-reporting and data system (VI-RADS) for bladder cancer diagnostics: the replacement for surgery? Eur Urol Oncol. 2020;3(3):316–317. doi: 10.1016/j.euo.2020.03.001.
    1. Del Giudice F, Pecoraro M, Vargas HA, Cipollari S, De Berardinis E, Bicchetti M, Chung BI, Catalano C, Narumi Y, Catto JWF, Panebianco V. Systematic review and meta-analysis of vesical imaging-reporting and data system (VI-RADS) inter-observer reliability: an added value for muscle invasive bladder cancer detection. Cancers (Basel) 2020;12(10):2994. doi: 10.3390/cancers12102994.

Source: PubMed

3
Abonner