Predicting COVID-19 Cases on a Large Chest X-Ray Dataset Using Modified Pre-trained CNN Architectures

Karac, Abdulkadir

doi:10.2478/acss-2023-0005

Abstract

The Coronavirus is a virus that spreads very quickly. Therefore, it has had very destructive effects in many areas worldwide. Because X-ray images are an easily accessible, fast, and inexpensive method, they are widely used worldwide to diagnose COVID-19. This study tried detecting COVID-19 from X-ray images using pre-trained VGG16, VGG19, InceptionV3, and Resnet50 CNN architectures and modified versions of these architectures. The fully connected layers of the pre-trained architectures have been reorganized in the modified CNN architectures. These architectures were trained on binary and three-class datasets, revealing their classification performance. The data set was collected from four different sources and consisted of 594 COVID-19, 1345 viral pneumonia, and 1341 normal X-ray images. Models are built using Tensorflow and Keras Libraries with Python programming language. Preprocessing was performed on the dataset by applying resizing, normalization, and one hot encoding operation. Model performances were evaluated according to many performance metrics such as recall, specificity, accuracy, precision, F1-score, confusion matrix, ROC analysis, etc., using 5-fold cross-validation. The highest classification performance was obtained in the modified VGG19 model with 99.84 % accuracy for binary classification (COVID-19 vs. Normal) and in the modified VGG16 model with 98.26 % accuracy for triple classification (COVID-19 vs. Pneumonia vs. Normal). These models have a higher accuracy rate than other studies in the literature. In addition, the number of COVID-19 X-ray images in the dataset used in this study is approximately two times higher than in other studies. Since it is obtained from different sources, it is irregular and does not have a standard. Despite this, it is noteworthy that higher classification performance was achieved than in previous studies. Modified VGG16 and VGG19 models (available at github.com/akaraci/LargeDatasetCovid19) can be used as an auxiliary tool in slight healthcare organizations’ shortage of specialists to detect COVID-19.

References

C. Long, H. Xu, Q. Shen et al., “Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT?” European Journal of Radiology, vol. 126, May 2020, Art. no. 108961. https://doi.org/10.1016/j.ejrad.2020.108961
Search in Google Scholar Back to article
T. Ozturk et al., “Automated detection of COVID-19 cases using deep neural networks with X-ray images,” Computers in Biology and Medicine, vol. 121, Jun. 2020, Art. no. 103792. https://doi.org/10.1016/j.compbiomed.2020.103792
Search in Google Scholar Back to article
L. Wang, Z.Q. Lin, and A. Wong, “COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images,” Scientific Reports, vol. 10, Nov. 2020, Art. no. 19549. https://doi.org/10.1038/s41598-020-76550-z
Search in Google Scholar Back to article
T. Mahmud, M.A. Rahman, and S.A. Fattah, “CovXNet: A multi-dilation convolutional neural network for automatic COVID-19 and other pneumonia detection from chest X-ray images with transferable multi-receptive feature optimization,” Computers in Biology and Medicine, vol. 122, Jul. 2020, Art. no. 103869. https://doi.org/10.1016/j.compbiomed.2020.103869
Search in Google Scholar Back to article
R.M Pereira, D. Bertolini, L.O. Teixeira, C.N. Silla, and Y.M.G. Costa, “COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios,” Computer Methods and Programs in Biomedicine, vol. 194, Oct. 2020, Art. no. 105532. https://doi.org/10.1016/j.cmpb.2020.105532
Search in Google Scholar Back to article
A.I. Khan, J.L. Shah, and M.M. Bhat, “CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images,” Computer Methods and Programs in Biomedicine, vol. 196, Nov. 2020, Art. no. 105581. https://doi.org/10.1016/j.cmpb.2020.105581
Search in Google Scholar Back to article
S. Toraman, T.B. Alakus, and I. Turkoglu, “Convolutional capsnet: A novel artificial neural network approach to detect COVID-19 disease from X-ray images using capsule networks,” Chaos, Solitons and Fractals, vol. 140, Nov. 2020, Art. no. 110122. https://doi.org/10.1016/j.chaos.2020.110122
Search in Google Scholar Back to article
A. Narin, C. Kaya, and Z .Pamuk, “Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks,” Pattern. Anal. Appl., vol. 24, pp. 1207–1220, May 2021. https://doi.org/10.1007/s10044-021-00984-y
Search in Google Scholar Back to article
E.Y.P. Lee, M-Y. Ng, P-L. Khong, “COVID-19 pneumonia: what has CT taught us?” Lancet. Infect. Dis., vol. 20, no. 4, pp. 384–385, Apr. 2020. https://doi.org/10.1016/S1473-3099(20)30134-1
Search in Google Scholar Back to article
T. Singhal, “A review of coronavirus disease-2019 (COVID-19),” Indian J. Pediatr., vol. 87, pp. 281–286, Mar. 2020. https://doi.org/10.1007/s12098-020-03263-6
Search in Google Scholar Back to article
L. Brunese, F. Mercaldo, A. Reginelli, and A. Santone, “Explainable deep learning for pulmonary disease and coronavirus COVID-19 detection from X-rays,” Computer Methods and Programs in Biomedicine, vol. 196, Nov. 2020, Art. no. 105608. https://doi.org/10.1016/j.cmpb.2020.105608
Search in Google Scholar Back to article
M. Toğaçar, B. Ergen, and Z. Cömert, “COVID-19 detection using deep learning models to exploit Social Mimic Optimization and structured chest X-ray images using fuzzy color and stacking approaches,” Computers in Biology and Medicine, vol. 121, Jun. 2020, Art. no. 103805. https://doi.org/10.1016/j.compbiomed.2020.103805
Search in Google Scholar Back to article
E.E-D. Hemdan, M.A. Shouman, and M.E. Karar, “COVIDX-Net: A framework of deep learning classifiers to diagnose COVID-19 in X-ray images,” ArXiv, vol. abs/2003.1, 2020. https://doi.org/10.48550/arXiv.2003.11055
Search in Google Scholar Back to article
D. Han, Q. Liu, and W. Fan, “A new image classification method using CNN transfer learning and web data augmentation,” Expert Syst. Appl., vol. 95, pp. 43–56, Apr. 2018. https://doi.org/10.1016/j.eswa.2017.11.028
Search in Google Scholar Back to article
P.M. Kwabena, F. A. Adekoya, A. A. Mighty, and B.Y. Edward, “Capsule networks – A survey,” J. King Saud Univ. – Comput. Inf. Sci., vol. 34, no. 1, pp. 1295–1310, Jan. 2022. https://doi.org/10.1016/j.jksuci.2019.09.014
Search in Google Scholar Back to article
L. A. Dombetzki, “An overview over Capsule Networks,” in Proceedings of the Seminars FutureInternet (FI) and Innovative Internet Technologies and Mobile Communication (IITM), Munich, Germany, 2018, pp. 89–95. https://doi.org/https://doi.org/10.2313/NET-2018-11-1
Search in Google Scholar Back to article
V. Chouhan et al., “A novel transfer learning based approach for pneumonia detection in chest X-ray images”, Appl. Sci., vol. 10, no. 2, Jan. 2020, Art. no. 559. https://doi.org/10.3390/app10020559
Search in Google Scholar Back to article
I.D. Apostolopoulos and T.A. Mpesiana, “Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks,” Phys. Eng. Sci. Med., vol. 43, pp. 635–640, Apr. 2020. https://doi.org/10.1007/s13246-020-00865-4
Search in Google Scholar Back to article
K. Weiss, T.M. Khoshgoftaar, D.D. Wang, “A survey of transfer learning,” J. Big Data, vol. 3, May 2016, Art. no. 9. https://doi.org/10.1186/s40537-016-0043-6
Search in Google Scholar Back to article
S.J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345–1359, Oct. 2010. https://doi.org/10.1109/TKDE.2009.191
Search in Google Scholar Back to article
A.M. Ismael and A. Şengür, “Deep learning approaches for COVID-19 detection based on chest X-ray images,” Expert Syst. Appl., vol. 164, Feb. 2020, Art. no. 114054. https://doi.org/10.1016/j.eswa.2020.114054
Search in Google Scholar Back to article
K. Ahammed et al., “Early detection of coronavirus cases using chest X-ray images employing machine learning and deep learning approaches,” medRxiv, 2020. https://doi.org/10.1101/2020.06.07.20124594
Search in Google Scholar Back to article
A. Mangal et al., “CovidAID: COVID-19 detection using chest X-ray,” arXiv, 2020. https://doi.org/10.48550/arXiv.2004.09803
Search in Google Scholar Back to article
K. Medhi, M. Jamil, and M.I. Hussain, “Automatic detection of COVID-19 infection from chest X-ray using deep learning,” medRxiv, 2020. https://doi.org/10.1101/2020.05.10.20097063
Search in Google Scholar Back to article
A. Harit, D. Shubharthi, and C. Bagish, “Performance result for detection of COVID-19 using deep learning,” Int. J. Innov. Technol. Explor. Eng., vol. 9, no. 7, pp. 699–703, May 2020. https://doi.org/10.35940/ijitee.G5684.059720
Search in Google Scholar Back to article
H. Benbrahim, H. Hachimi, and A. Amine, “Deep transfer learning with apache spark to detect COVID-19 in chest X-ray images,” Rom. J. Inf. Sci. Technol., vol. 23, pp. 117–129, 2020. https://romjist.ro/full-texts/paper658.pdf
Search in Google Scholar Back to article
J. Zhang et al., “Viral pneumonia screening on chest X-ray images using confidence-aware anomaly detection,” arXiv, 2020. https://doi.org/10.48550/arXiv.2003.12338
Search in Google Scholar Back to article
L.O. Hall, R. Paul, D.B. Goldgof, and G.M. Goldgof, “Finding Covid-19 from chest X-rays using deep learning on a small dataset,” arXiv, 2020. https://doi.org/10.48550/arXiv.2004.02060
Search in Google Scholar Back to article
H.S. Maghdid, A.T. Asaad, K.Z. Ghafoor, A.S. Sadiq, and M.K. Khan, “Diagnosing COVID-19 pneumonia from X-Ray and CT images using deep learning and transfer learning algorithms,” arXiv, 2020. https://doi.org/10.48550/arXiv.2004.00038
Search in Google Scholar Back to article
C. Butt, J. Gill, D. Chun, and B.A. Babu, “RETRACTED ARTICLE: Deep learning system to screen coronavirus disease 2019 pneumonia,” Appl Intell., vol. 53, 2023, Art. no. 4874. https://doi.org/10.1007/s10489-020-01714-3
Search in Google Scholar Back to article
S. Ying et al., “Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images,” medRxiv, 2020. https://doi.org/10.1101/2020.02.23.20026930
Search in Google Scholar Back to article
C. Zheng et al., “Deep learning-based detection for COVID-19 from chest CT using weak label,” medRxiv, 2020. https://doi.org/10.1101/2020.03.12.2002718
Search in Google Scholar Back to article
J.P. Cohen, P. Morrison, and L. Dao, “COVID-19 image data collection,” arXiv, 2020. https://doi.org/https://arxiv.org/abs/2003.11597v1
Search in Google Scholar Back to article
A. Chung, “Actualmed COVID-19 chest X-ray data initiative,” 2020. [Online]. Available: https://github.com/agchung/Actualmed-COVID-chestxray-dataset
Search in Google Scholar Back to article
A. Chung, “Figure 1. COVID-19 chest x-ray data initiative,” 2020. [Online]. Available: https://github.com/agchung/Figure1-COVID-chestxray-dataset
Search in Google Scholar Back to article
“COVID-19 Radiography Database. COVID-19 Chest X-ray images and Lung masks Database.” [Online]. Available: https://www.kaggle.com/datasets/tawsifurrahman/covid19-radiography-database
Search in Google Scholar Back to article
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” in 3rd International Conference on Learning Representations, ICLR 2015 – Conference Track Proceedings, San Diego, 2015, pp 1–14. https://arxiv.org/abs/1409.1556
Search in Google Scholar Back to article
C. Szegedy et al., “Going deeper with convolutions,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, Jun. 2015, pp. 1–9. https://doi.org/10.1109/CVPR.2015.7298594
Search in Google Scholar Back to article
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, Jun. 2016, pp. 770–778. https://doi.org/10.1109/CVPR.2016.90
Search in Google Scholar Back to article
H. Arshad et al., “A multilevel paradigm for deep convolutional neural network features selection with an application to human gait recognition,” Expert Systems, vol. 39, no. 7, Aug. 2020, Art. no. e12541. https://doi.org/10.1111/exsy.12541
Search in Google Scholar Back to article
Y. Seo and K. Shin, “Hierarchical convolutional neural networks for fashion image classification,” Expert Syst. Appl., vol. 116, pp. 328–339, Feb. 2019. https://doi.org/10.1016/j.eswa.2018.09.022
Search in Google Scholar Back to article
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, Jun. 2016, pp. 2818–2826. https://doi.org/10.1109/CVPR.2016.308
Search in Google Scholar Back to article
I. Kouretas and V. Paliouras, “Simplified hardware implementation of the Softmax activation function,” in 2019 8th Int. Conf. Mod. Circuits Syst. Technol. MOCAST 2019, Thessaloniki, Greece, May 2019, pp. 1–4. https://doi.org/10.1109/MOCAST.2019.8741677
Search in Google Scholar Back to article
A.F. Agarap, “Deep learning using rectified linear units (ReLU),” arXiv, arXiv:1803, Mar. 2018. https://www.researchgate.net/publication/323956667_Deep_Learning_using_Rectified_Linear_Units_ReLU
Search in Google Scholar Back to article
W. An, H. Wang, Q. Sun, J. Xu, Q. Dai and L. Zhang, “A PID controller approach for stochastic optimization of deep networks,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, Jun. 2018, pp. 8522–8531. https://doi.org/10.1109/CVPR.2018.00889
Search in Google Scholar Back to article
A.L. Maas et al., “Building DNN acoustic models for large vocabulary speech recognition,” Comput. Speech. Lang., vol. 41, pp. 195–213, Jan. 2017. https://doi.org/10.1016/j.csl.2016.06.007
Search in Google Scholar Back to article
A. Karaci, H. Yaprak, O. Ozkaraca, I. Demir, and O. Simsek, “Estimating the properties of ground-waste-brick mortars using DNN and ANN,” Comput. Model. Eng. Sci., vol. 118, no. 1, pp. 207–228, 2019. https://doi.org/10.31614/cmes.2019.04216
Search in Google Scholar Back to article
M.M. Ahamad et al., “A machine learning model to identify early stage symptoms of SARS-Cov-2 infected patients,” Expert Syst. Appl., vol. 160, Dec. 2020, Art. no. 113661. https://doi.org/10.1016/j.eswa.2020.113661
Search in Google Scholar Back to article
D.G. Altman and J.M. Bland, “Statistics notes: Diagnostic tests 1: sensitivity and specificity,” BMJ, vol. 308, pp. 1552–1552, Jun. 1994. https://doi.org/10.1136/bmj.308.6943.1552
Search in Google Scholar Back to article
A. Aktaş, B. Doğan, Ö. Demir, “Derin öğrenme yöntemleri ile dokunsal parke yüzeyi tespiti,” Gazi Üniversitesi Mühendislik-Mimarlık Fakültesi Derg, 2020. https://doi.org/10.17341/gazimmfd.652101
Search in Google Scholar Back to article
J. Davis and M. Goadrich, “The relationship between Precision-Recall and ROC curves,” in Proceedings of the 23rd international conference on Machine learning – ICML’06, ACM Press, New York, USA, Jun. 2006, pp. 233–240. https://doi.org/10.1145/1143844.1143874
Search in Google Scholar Back to article
A.C.J.W. Janssens and F.K. Martens, “Reflection on modern methods: Revisiting the area under the ROC Curve,” Int. J. Epidemiol., vol. 49, pp. 1397–1403, 2020. https://doi.org/10.1093/ije/dyz274
Search in Google Scholar Back to article
R.R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual explanations from deep networks via gradient-based localization,” Int. J. Comput. Vis., vol. 128, pp. 336–359, 2016. 20 https://doi.org/10.1007/s11263-019-01228-7
Search in Google Scholar Back to article
H. Panwar, P.K. Gupta, M.K. Siddiqui, R. Morales-Menendez, and V. Singh, “Application of deep learning for fast detection of COVID-19 in X-Rays using nCOVnet,” Chaos, Solitons and Fractals, vol. 138, Sep. 2020, Art. no. 109944. https://doi.org/10.1016/j.chaos.2020.109944
Search in Google Scholar Back to article
X. Xu, et al., “A deep learning system to screen novel coronavirus disease 2019 pneumonia,” Engineering, vol.6, no. 10, pp. 1122–1129, Oct. 2020. https://doi.org/10.1016/j.eng.2020.04.010
Search in Google Scholar Back to article
E. Acar, B. Oztoprak, M. Resorlu, M. Das, I. Yilmaz, and I. Oztoprak, “Efficiency of artificial intelligence in detecting COVID-19 pneumonia and other pneumonia causes by quantum Fourier transform method,” medRxiv, 2021. https://doi.org/10.1101/2020.12.29.20248900
Search in Google Scholar Back to article
P.K. Chaudhary and R.B. Pachori, “FBSED based automatic diagnosis of COVID-19 using X-ray and CT images,” Comput. Biol. Med., vol. 134, Jul. 2021, Art. no. 104454. https://doi.org/10.1016/J.COMPBIOMED.2021.104454
Search in Google Scholar Back to article
D. Al-Karawi, S. Al-Zaidi, N. Polus and S. Jassim, “Machine learning analysis of chest CT scan images as a complementary digital test of coronavirus (COVID-19) patients,” medRxiv, 2020. https://doi.org/10.1101/2020.04.13.20063479
Search in Google Scholar Back to article
S. Liu, X. Li, Y. Jiang, H. Luo, Y. Gao and S. Yin, “Integrated learning approach based on fused segmentation information for skeletal fluorosis diagnosis and severity grading,” in IEEE Transactions on Industrial Informatics, vol. 17, no. 11, pp. 7554–7563, Nov. 2021. https://doi.org/10.1109/TII.2021.3055397
Search in Google Scholar Back to article

Predicting COVID-19 Cases on a Large Chest X-Ray Dataset Using Modified Pre-trained CNN Architectures

Abstract

Paradigm

My account