Repeatability and Reproducibility of Pancreas Volume Measurements Using MRI

Jonathan M Williams, Melissa A Hilmes, Branch Archer, Aidan Dulaney, Liping Du, Hakmook Kang, William E Russell, Alvin C Powers, Daniel J Moore, John Virostko, Jonathan M Williams, Melissa A Hilmes, Branch Archer, Aidan Dulaney, Liping Du, Hakmook Kang, William E Russell, Alvin C Powers, Daniel J Moore, John Virostko

Abstract

Reduced pancreas volume, as measured by non-contrast magnetic resonance imaging (MRI), is observed in individuals with newly-diagnosed type 1 diabetes (T1D) and declines over the first year after diagnosis. In this study, we determined the repeatability and inter-reader reproducibility of pancreas volume measurements by MRI. Test-retest scans in individuals with or without T1D (n = 16) had an intraclass correlation coefficient (ICC) of 0.985 (95% CI 0.961 to 0.995) for pancreas volume. Independent pancreas outlines by two board-certified radiologists (n = 30) yielded an ICC of 0.945 (95% CI 0.889 to 0.973). The mean Dice coefficient, a measurement of the degree of overlap between pancreas regions of interest between the two readers, was 0.77. Prandial state did not influence pancreatic measurements, as stomach volume did not correlate with pancreas volume. These data demonstrate that MRI measurements of pancreas volume between two readers are repeatable and reproducible with ICCs that correspond to excellent clinical significance (ICC > 0.9), are not related to changes in stomach volume, and could be a useful tool for clinical investigation of diabetes and other pancreas pathologies.

Conflict of interest statement

The authors declare no competing interests.

Figures

Figure 1
Figure 1
Measurements of pancreas volume are repeatable. Two or three repeat MRIs were performed on the same day in individuals with and without T1D (dashed and solid lines, respectively). Repeat measurements of pancreas volume (a) and pancreas volume index (b) are shown for each subject. Pancreas volume index was calculated by dividing the pancreas volume by the subject’s weight. Intraclass correlation coefficients (ICC) were reported with a 95% confidence interval.
Figure 2
Figure 2
Measurements of pancreas volume between two readers are reproducible. Two board-certified radiologists independently outlined the pancreas of 30 different individuals (31 total scans). Correlation between measurements of pancreas volume (a) and pancreas volume index (c) between the two readers is shown. Bland–Altman plots displaying the differences in measurements between readers plotted against the average measurement taken for each subject are shown for both pancreas volume (b) and pancreas volume index (d). Pancreas volume index was calculated by dividing the pancreas volume by the subject’s weight. ICCs were reported with a 95% confidence interval.
Figure 3
Figure 3
Outlines of pancreas by two readers of the same images overlap. The pancreas from a representative subject (Dice coefficient = 0.77) was outlined by two board-certified radiologists across eight alternating MRI slices of the pancreas. The overlap between the two readers’ pancreas outlines is shown in the bottom row and zoomed in for clarity. Regions of agreement are shown in bright white, while gray regions denote regions of non-overlap. The average Dice coefficient was 0.77 for the 31 scans analyzed.
Figure 4
Figure 4
Stomach volume did not affect measurements of pancreas volume. (a) Correlation between measurements of pancreas volume and total stomach volume in individuals whose MRI data sets contained the entire stomach volume within the field of view (R2 = 0.009). (b) Individuals who had longitudinal measurements of pancreas and stomach volume. Representation of an individual with low stomach volume (c) and in an apparent fed state (d).

References

    1. Chiarelli F, Verrotti A, Altobelli E, Blasetti A, Morgese G. Size of the pancreas in type I diabetic children and adolescents. Diabetes Care. 1995;18:1505–1506. doi: 10.2337/diacare.18.11.1504.
    1. Fonseca V, Berger LA, Beckett AG, Dandona P. Size of pancreas in diabetes mellitus: a study based on ultrasound. Br. Med. J. (Clin. Res. Ed). 1985;291:1240–1241. doi: 10.1136/bmj.291.6504.1240.
    1. Goda K, et al. Pancreatic volume in type 1 and type 2 diabetes mellitus. Acta Diabetol. 2001;38:145–149. doi: 10.1007/s005920170012.
    1. Gaglia JL, et al. Noninvasive imaging of pancreatic islet inflammation in type 1A diabetes patients. J. Clin. Invest. 2011;121:442–445. doi: 10.1172/JCI44339.
    1. Garcia TS, Rech TH, Leitao CB. Pancreatic size and fat content in diabetes: A systematic review and meta-analysis of imaging studies. PLoS One. 2017;12:e0180911. doi: 10.1371/journal.pone.0180911.
    1. Williams AJ, et al. Pancreatic volume is reduced in adult patients with recently diagnosed type 1 diabetes. J. Clin. Endocrinol. Metab. 2012;97:E2109–2113. doi: 10.1210/jc.2012-1815.
    1. Virostko J, et al. Pancreas Volume Declines During the First Year After Diagnosis of Type 1 Diabetes and Exhibits Altered Diffusion at Disease Onset. Diabetes Care. 2019;42:248–257. doi: 10.2337/dc18-1507.
    1. Campbell-Thompson ML, et al. Relative Pancreas Volume Is Reduced in First-Degree Relatives of Patients With Type 1 Diabetes. Diabetes Care. 2019;42:281–287. doi: 10.2337/dc18-1512.
    1. Williams AJ, Chau W, Callaway MP, Dayan CM. Magnetic resonance imaging: a reliable method for measuring pancreatic volume in Type 1 diabetes. Diabet. Med. 2007;24:35–40. doi: 10.1111/j.1464-5491.2007.02027.x.
    1. Szczepaniak EW, Malliaras K, Nelson MD, Szczepaniak LS. Measurement of pancreatic volume by abdominal MRI: a validation study. PLoS One. 2013;8:e55991. doi: 10.1371/journal.pone.0055991.
    1. Johnson, G. B. Holt Biology: Visualizing Life. Orlando: Holt, Rinehart & Winston (1994).
    1. Garcia DA, Froes TR. Importance of fasting in preparing dogs for abdominal ultrasound examination of specific organs. J. Small Anim. Pract. 2014;55:630–634. doi: 10.1111/jsap.12281.
    1. Barberet V, et al. Quantification of the effect of various patient and image factors on ultrasonographic detection of select canine abdominal organs. Vet. Radiol. Ultrasound. 2008;49:273–276. doi: 10.1111/j.1740-8261.2008.00365.x.
    1. Lee ES, Lee JM. Imaging diagnosis of pancreatic cancer: a state-of-the-art review. World J. Gastroenterol. 2014;20:7864–7877. doi: 10.3748/wjg.v20.i24.7864.
    1. Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016;15:155–163. doi: 10.1016/j.jcm.2016.02.012.
    1. Huo, Y. et al. Splenomegaly Segmentation using Global Convolutional Kernels and Conditional Generative Adversarial Networks. Proc SPIE Int Soc Opt Eng. 10574, (2018).
    1. Farag A, et al. A Bottom-Up Approach for Pancreas Segmentation Using Cascaded Superpixels and (Deep) Image Patch Labeling. IEEE Trans Image Process. 2017;26:386–399. doi: 10.1109/TIP.2016.2624198.
    1. Roth HR, et al. An application of cascaded 3D fully convolutional networks for medical image segmentation. Comput. Med. Imaging Graph. 2018;66:90–99. doi: 10.1016/j.compmedimag.2018.03.001.
    1. Gong X, et al. Computer-aided pancreas segmentation based on 3D GRE Dixon MRI: a feasibility study. Acta Radiol Open. 2019;8:2058460119834690.
    1. Gou S, et al. Feasibility of automated pancreas segmentation based on dynamic MRI. Br. J. Radiol. 2014;87:20140248. doi: 10.1259/bjr.20140248.
    1. Nonaka, H., Onishi, H., Watanabe, M. & Nam, V. H. Assessment of abdominal organ motion using cine magnetic resonance imaging in different gastric motilities: a comparison between fasting and postprandial states. J Radiat Res. (2019).
    1. Wysocka B, et al. Assessment of nonrespiratory stomach motion in healthy volunteers in fasting and postprandial states. Pract. Radiat. Oncol. 2014;4:288–293. doi: 10.1016/j.prro.2013.10.001.
    1. Macauley M, Percival K, Thelwall PE, Hollingsworth KG, Taylor R. Altered volume, morphology and composition of the pancreas in type 2 diabetes. PLoS One. 2015;10:e0126825. doi: 10.1371/journal.pone.0126825.
    1. Burute N, et al. Pancreas volume measurement in patients with Type 2 diabetes using magnetic resonance imaging-based planimetry. Pancreatology. 2014;14:268–274. doi: 10.1016/j.pan.2014.04.031.
    1. Tirkes T, et al. Detection of exocrine dysfunction by MRI in patients with early chronic pancreatitis. Abdom Radiol (NY). 2017;42:544–551. doi: 10.1007/s00261-016-0917-2.
    1. Tirkes T, et al. T1 mapping for diagnosis of mild chronic pancreatitis. J. Magn. Reson. Imaging. 2017;45:1171–1176. doi: 10.1002/jmri.25428.
    1. Sorace, A. G. et al. Repeatability, reproducibility, and accuracy of quantitative mri of the breast in the community radiology setting. J. Magn. Reson. Imaging (2018).
    1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–310. doi: 10.1016/S0140-6736(86)90837-8.
    1. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999;8:135–160. doi: 10.1177/096228029900800204.
    1. Hanneman SK. Design, analysis, and interpretation of method-comparison studies. AACN Adv. Crit. Care. 2008;19:223–234.
    1. Zou KH, et al. Statistical validation of image segmentation quality based on a spatial overlap index. Acad. Radiol. 2004;11:178–189. doi: 10.1016/S1076-6332(03)00671-8.

Source: PubMed

3
Subscribe