Performance of Radiologists in Differentiating COVID-19 from Non-COVID-19 Viral Pneumonia at Chest CT

Harrison X Bai, Ben Hsieh, Zeng Xiong, Kasey Halsey, Ji Whae Choi, Thi My Linh Tran, Ian Pan, Lin-Bo Shi, Dong-Cui Wang, Ji Mei, Xiao-Long Jiang, Qiu-Hua Zeng, Thomas K Egglin, Ping-Feng Hu, Saurabh Agarwal, Fang-Fang Xie, Sha Li, Terrance Healey, Michael K Atalay, Wei-Hua Liao, Harrison X Bai, Ben Hsieh, Zeng Xiong, Kasey Halsey, Ji Whae Choi, Thi My Linh Tran, Ian Pan, Lin-Bo Shi, Dong-Cui Wang, Ji Mei, Xiao-Long Jiang, Qiu-Hua Zeng, Thomas K Egglin, Ping-Feng Hu, Saurabh Agarwal, Fang-Fang Xie, Sha Li, Terrance Healey, Michael K Atalay, Wei-Hua Liao

Abstract

Background Despite its high sensitivity in diagnosing coronavirus disease 2019 (COVID-19) in a screening population, the chest CT appearance of COVID-19 pneumonia is thought to be nonspecific. Purpose To assess the performance of radiologists in the United States and China in differentiating COVID-19 from viral pneumonia at chest CT. Materials and Methods In this study, 219 patients with positive COVID-19, as determined with reverse-transcription polymerase chain reaction (RT-PCR) and abnormal chest CT findings, were retrospectively identified from seven Chinese hospitals in Hunan Province, China, from January 6 to February 20, 2020. Two hundred five patients with positive respiratory pathogen panel results for viral pneumonia and CT findings consistent with or highly suspicious for pneumonia, according to original radiologic interpretation within 7 days of each other, were identified from Rhode Island Hospital in Providence, RI. Three radiologists from China reviewed all chest CT scans (n = 424) blinded to RT-PCR findings to differentiate COVID-19 from viral pneumonia. A sample of 58 age-matched patients was randomly selected and evaluated by four radiologists from the United States in a similar fashion. Different CT features were recorded and compared between the two groups. Results For all chest CT scans (n = 424), the accuracy of the three radiologists from China in differentiating COVID-19 from non-COVID-19 viral pneumonia was 83% (350 of 424), 80% (338 of 424), and 60% (255 of 424). In the randomly selected sample (n = 58), the sensitivities of three radiologists from China and four radiologists from the United States were 80%, 67%, 97%, 93%, 83%, 73%, and 70%, respectively. The corresponding specificities of the same readers were 100%, 93%, 7%, 100%, 93%, 93%, and 100%, respectively. Compared with non-COVID-19 pneumonia, COVID-19 pneumonia was more likely to have a peripheral distribution (80% vs 57%, P < .001), ground-glass opacity (91% vs 68%, P < .001), fine reticular opacity (56% vs 22%, P < .001), and vascular thickening (59% vs 22%, P < .001), but it was less likely to have a central and peripheral distribution (14% vs 35%, P < .001), pleural effusion (4% vs 39%, P < .001), or lymphadenopathy (3% vs 10%, P = .002). Conclusion Radiologists in China and in the United States distinguished coronavirus disease 2019 from viral pneumonia at chest CT with moderate to high accuracy. © RSNA, 2020 Online supplemental material is available for this article. A translation of this abstract in Farsi is available in the supplement. ترجمه چکیده این مقاله به فارسی، در ضمیمه موجود است.

Figures

Figure 1:
Figure 1:
Illustration of study flow RIH: Rhode Island Hospital
Figure 2:
Figure 2:
Distribution of viral pathogens based on RPP test in the final cohort. It is an FDA approved assay that simultaneous detects 19 viruses (influenza A virus; influenza A H1 virus; influenza A 2009 H1 virus; influenza A H3 virus; influenza B virus; adenovirus; coronaviruses [HKU1, OC43, NL63, and 229E]; human rhinovirus/enterovirus; human metapneumovirus; parainfluenza viruses 1, 2, 3, and 4; and respiratory syncytial virus [RSV] [RSV subtype A and RSV subtype B]) and 2 bacteria (Mycoplasma pneumoniae and Chlamydia pneumoniae). The ePlex panel (16) has been proven to be a highly sensitive and specific multiplex assay for respiratory pathogen detection. In a multicentric study, the positive percent agreement values (equivalent to sensitivity when a perfect reference method is unavailable) ranged from 85.1% to 95.1% and the negative percent agreement values (equivalent to specificity) ranged from 99.5% to 99.8% when compared to another well-established RP panel from BioFire (Salt Lack City, UT) (17).
Figure 3a:
Figure 3a:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3b:
Figure 3b:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3c:
Figure 3c:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3d:
Figure 3d:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3e:
Figure 3e:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3f:
Figure 3f:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3g:
Figure 3g:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)
Figure 3h:
Figure 3h:
A. Cases in a 58-patient review process that are commonly misdiagnosed. Example cases where the majority of radiologists mistook non-COVID-19 pneumonia for COVID-19 (A and B) or other vice versa (C-H)

References

    1. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J. et al. . A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med 2020; 382:727-733. Doi: 10.1056/NEJMoa2001017.
    1. Centers for Disease Control and Prevention . Coronavirus Disease 2019 (COVID-19) Locations with Confirmed COVID-19 Cases. . Published February 29, 2020. Accessed March 1, 2020.
    1. World Health Organization . Coronavirus Disease 2019 (COVID-19) Situation Reports – 41. . Published March 1, 2020. Accessed March 1, 2020.
    1. World Health Organization . Statement on the Second Meeting of the International Health Regulations (2005) Emergency Committee Regarding the Outbreak of Novel Coronavirus (2019-nCoV). 2020. . Published January 31, 2020. Accessed February 29, 2020.
    1. Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, Tao Q, Sun Z, Xia L. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology 2020. Doi: 10.1148/radiol.2020200642. Published February 26, 2020. Accessed March 1, 2020.
    1. Center for Disease Control and Prevention . Interim Guidelines for Collecting, Handling, and Testing Clinical Specimens from Persons Under Investigation (PUIs) for Coronavirus Disease 2019 (COVID-19). 2020. . Published February 14, 2020. Accessed February 28, 2020.
    1. Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, Ji W. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology 2020. Doi: 10.1148/radiol.2020200432. Published February 19, 2020. Accessed February 29, 2020.
    1. Kanne JP, Little BP, Chung JH, Elicker BM, Ketail LH. Essentials for Radiologists on COVID-19: An Update—Radiology Scientific Expert Panel. Radiology 2020. Doi: 10.1148/radiol.2020200527. Published February 27, 2020. Accessed February 27, 2020.
    1. Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J. Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing. Radiology 2020. Doi: 10.1148/radiol.2020200343. Published February 12, 2020. Accessed March 1, 2020.
    1. Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N, Diao K, Zhu X, Li K, Li S, Shan H, Jacobi A, Chung M. Chest CT Findings in Coronavirus Disease-19 (COVID-10): Relationship to Duration of Infection. Radiology 2020. Doi: 10.1148/radiol.2020200463. Published February 20, 2020. Accessed February 25, 2020.
    1. Pan F, Ye T, Sun P, Gui S, Liang B, Li L, Zheng D, Wang J, Hesketh RL, Yang L, Zheng C. Time Course of Lung Changes of Chest CT During Recovery From 2019 Novel Coronavirus (COVID-19) Pneumonia. Radiology 2020. Doi: 10.1148/radiol.2020200370. Published February 13, 2020. Accessed February 29, 2020.
    1. Chung M, Bernheim A, Mei X, Zhang N, Huang M, Zeng X, Cui J, Xu W, Zang Y, Fayad ZA, Jacobi A, Li K, Li S, Shan H. CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV). Radiology 2020. Doi: 10.1148/radiol.2020200230. Published February 4, 2020. Accessed February 24, 2020.
    1. GenMark Diagnostics, Inc. ePlex Pipeline. GenMarkDx. . Published 2020. Accessed February 19, 2020.
    1. Zu ZY, Jiang MD, Xu PP, Chen W, Ni QQ, Lu GM, Zhang LJ. Coronavirus Disease 2019 (COVID-19): A Perspective from China. Radiology 2020. Doi: 10.1148/radiol.2020200490. Published February 21, 2020. Accessed February 28, 2020.
    1. Du Qingyang. Diagnostic Criteria. In: COVID-19 Pneumonia Diagnosis and Treatment Plan, trial version 6. Beijing, CN: National Health Commission of the PRC, February; 19, 2020. 4-6.
    1. Babady NE, England MR, Jurcic Smith KL, He T, Wijetunge DS, Tang YW, Chamberland RR, Menegus M, Swierkosz EM, Jerris RC, Greene W. Multicenter Evaluation of the ePlex Respiratory Pathogen Panel for the Detection of Viral and Bacterial Respiratory Tract Pathogens in Nasopharyngeal Swabs. J Clin Microbiol 2018; 56 (2) e01658-17. Doi: 10.1128/JCM.01658-17.

Source: PubMed

3
Iratkozz fel