Abstract

A rapid diagnostic system is a primary role in the healthcare system exclusively during a pandemic situation to control contagious diseases like coronavirus disease-2019 (COVID-19). Many countries remain lacking to spot COVID cases by the reverse transcription-polymerase chain reaction (RT-PCR) test. On this stretch, deep learning algorithms have been strengthened the medical image processing system to analyze the infection, categorization, and further diagnosis. It is motivated to discover the alternate way to identify the disease using existing medical implications. Hence, this review narrated the character and attainment of deep learning algorithms at each juncture from origin to COVID-19. This literature highlights the importance of deep learning and further focused the medical image processing research on handling the data of magnetic resonance imaging (MRI), computed tomography (CT) scan, and electromagnetic radiation (X-ray) images. Additionally, this systematic review tabulates the popular deep learning networks with operational parameters, peer-reviewed research with their outcomes, popular nets, and prevalent datasets, and highlighted the facts to stimulate future research. The consequence of this literature ascertains convolutional neural network-based deep learning approaches work better in the medical image processing system, and especially it is very supportive of sorting out the COVID-19 complications.

Keyword

Deep learning, Image processing, COVID-19, CT scan, X-ray image, Convolutional neural network (CNN), Neural nets, MRI scan, Diagnostic system, Healthcare.

Cite this article

Mareeswari V, Vijayan R, Sathiyamoorthy E, Ephzibah

Refference

[1][1]Oleary DE. Artificial intelligence and big data. IEEE Intelligent Systems. 2013; 28(2):96-9.

[2][2]Castiglioni I, Ippolito D, Interlenghi M, Monti CB, Salvatore C, Schiaffino S, et al. Artificial intelligence applied on chest X-ray can aid in the diagnosis of COVID-19 infection: a first experience from Lombardy, Italy. MedRxiv. 2020.

[3][3]Schmidhuber J. Deep learning in neural networks: an overview. Neural Networks. 2015; 61:85-117.

[4][4]Bengio Y, Courville A, Vincent P. Representation learning: a review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013; 35(8):1798-828.

[5][5]Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van DDG, et al. Mastering the game of Go with deep neural networks and tree search. Nature. 2016; 529(7587):484-9.

[6][6]Gers FA, Schraudolph NN, Schmidhuber J. Learning precise timing with LSTM recurrent networks. Journal of Machine Learning Research. 2002:115-43.

[7][7]Anumanchipalli GK, Chartier J, Chang EF. Speech synthesis from neural decoding of spoken sentences. Nature. 2019; 568(7753):493-8.

[8][8]Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J. A novel connectionist system for unconstrained handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008; 31(5):855-68.

[9][9]Hewamalage H, Bergmeir C, Bandara K. Recurrent neural networks for time series forecasting: current status and future directions. International Journal of Forecasting. 2021; 37(1):388-427.

[10][10]Zang J, Wang L, Liu Z, Zhang Q, Hua G, Zheng N. Attention-based temporal weighted convolutional neural network for action recognition. In IFIP international conference on artificial intelligence applications and innovations 2018 (pp. 97-108). Springer, Cham.

[11][11]Movahedi F, Coyle JL, Sejdić E. Deep belief networks for electroencephalography: a review of recent contributions and future outlooks. IEEE Journal of Biomedical and Health Informatics. 2017; 22(3):642-52.

[12][12]Gawehn E, Hiss JA, Schneider G. Deep learning in drug discovery. Molecular informatics. 2016; 35(1):3-14.

[13][13]Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006; 70(1-3):489-501.

[14][14]Smolensky P. Information processing in dynamical systems: foundations of harmony theory. Colorado Univ at Boulder Dept of Computer Science; 1986.

[15][15]Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MRI. Zeitschrift für Medizinische Physik. 2019; 29(2):102-27.

[16][16]Qin C, Schlemper J, Caballero J, Price AN, Hajnal JV, Rueckert D. Convolutional recurrent neural networks for dynamic MR image reconstruction. IEEE Transactions on Medical Imaging. 2018; 38(1):280-90.

[17][17]Chen F, Taviani V, Malkiel I, Cheng JY, Tamir JI, Shaikh J, et al. Variable-density single-shot fast spin-echo MRI with deep learning reconstruction by using variational networks. Radiology. 2018; 289(2):366-73.

[18][18]Knoll F, Hammernik K, Kobler E, Pock T, Recht MP, Sodickson DK. Assessment of the generalization of learned image reconstruction and the potential for transfer learning. Magnetic Resonance in Medicine. 2019; 81(1):116-28.

[19][19]Mardani M, Gong E, Cheng JY, Vasanawala SS, Zaharchuk G, Xing L, et al. Deep generative adversarial neural networks for compressive sensing MRI. IEEE Transactions on Medical Imaging. 2018; 38(1):167-79.

[20][20]Zhu B, Liu JZ, Cauley SF, Rosen BR, Rosen MS. Image reconstruction by domain-transform manifold learning. Nature. 2018; 555(7697):487-92.

[21][21]Yoon J, Gong E, Chatnuntawech I, Bilgic B, Lee J, Jung W, et al. Quantitative susceptibility mapping using deep neural network: QSMnet. Neuroimage. 2018; 179:199-206.

[22][22]Bollmann S, Rasmussen KG, Kristensen M, Blendal RG, Østergaard LR, Plocharski M, et al. DeepQSM-using deep learning to solve the dipole inversion for quantitative susceptibility mapping. Neuroimage. 2019; 195:373-83.

[23][23]Benou A, Veksler R, Friedman A, Raviv TR. Ensemble of expert deep neural networks for spatio-temporal denoising of contrast-enhanced MRI sequences. Medical Image Analysis. 2017; 42:145-59.

[24][24]Chaudhari AS, Fang Z, Kogan F, Wood J, Stevens KJ, Gibbons EK, et al. Super‐resolution musculoskeletal MRI using deep learning. Magnetic Resonance in Medicine. 2018; 80(5):2139-54.

[25][25]Li X, Chen F, Sun D, Tao M. Predicting menopausal symptoms with artificial neural network. Expert Systems with Applications. 2015; 42(22):8698-706.

[26][26]Kupusinac A, Stokic E, Kovacevic I. Hybrid EANN-EA system for the primary estimation of cardiometabolic risk. Journal of Medical Systems. 2016; 40(6):1-9.

[27][27]Youlden DR, Cramb SM, Baade PD. The international epidemiology of lung cancer: geographical distribution and secular trends. Journal of Thoracic Oncology. 2008; 3(8):819-31.

[28][28]Thun MJ, Carter BD, Feskanich D, Freedman ND, Prentice R, Lopez AD, et al. 50-year trends in smoking-related mortality in the United States. New England Journal of Medicine. 2013; 368:351-64.

[29][29]Barta JA, Powell CA, Wisnivesky JP. Global epidemiology of lung cancer. Annals of Global Health. 2019; 85(1).

[30][30]Halder A, Dey D, Sadhu AK. Lung nodule detection from feature engineering to deep learning in thoracic CT images: a comprehensive review. Journal of Digital Imaging. 2020; 33(3):655-77.

[31][31]Liu X, Hou F, Qin H, Hao A. Multi-view multi-scale CNNs for lung nodule type classification from CT images. Pattern Recognition. 2018; 77:262-75.

[32][32]Paul R, Hawkins S, Schabath MB, Gillies RJ, Hall LO, Goldgof DB. Predicting malignant nodules by fusing deep features with classical radiomics features. Journal of Medical Imaging. 2018.

[33][33]Xie Y, Zhang J, Xia Y, Fulham M, Zhang Y. Fusing texture, shape and deep model-learned information at decision level for automated classification of lung nodules on chest CT. Information Fusion. 2018; 42:102-10.

[34][34]Da SGL, Da SNOP, Silva AC, De PAC, Gattass M. Lung nodules diagnosis based on evolutionary convolutional neural network. Multimedia Tools and Applications. 2017; 76(18):19039-55.

[35][35]Wang S, Zhou M, Liu Z, Liu Z, Gu D, Zang Y, et al. Central focused convolutional neural networks: developing a data-driven model for lung nodule segmentation. Medical Image Analysis. 2017; 40:172-83.

[36][36]Dou Q, Chen H, Yu L, Qin J, Heng PA. Multilevel contextual 3-D CNNs for false positive reduction in pulmonary nodule detection. IEEE Transactions on Biomedical Engineering. 2016; 64(7):1558-67.

[37][37]Xie Y, Xia Y, Zhang J, Song Y, Feng D, Fulham M, et al. Knowledge-based collaborative deep learning for benign-malignant lung nodule classification on chest CT. IEEE Transactions on Medical Imaging. 2018; 38(4):991-1004.

[38][38]Ozdemir O, Russell RL, Berlin AA. A 3D probabilistic deep learning system for detection and diagnosis of lung cancer using low-dose CT scans. IEEE Transactions on Medical Imaging. 2019; 39(5):1419-29.

[39][39]Nasrullah N, Sang J, Alam MS, Mateen M, Cai B, Hu H. Automated lung nodule detection and classification using deep learning combined with multiple strategies. Sensors. 2019; 19(17).

[40][40]Gu Y, Lu X, Yang L, Zhang B, Yu D, Zhao Y, et al. Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs. Computers in Biology and Medicine. 2018; 103:220-31.

[41][41]Wang Q, Shen F, Shen L, Huang J, Sheng W. Lung nodule detection in CT images using a raw patch-based convolutional neural network. Journal of Digital Imaging. 2019; 32(6):971-9.

[42][42]Savitha G, Jidesh P. A holistic deep learning approach for identification and classification of sub-solid lung nodules in computed tomographic scans. Computers & Electrical Engineering. 2020; 84.

[43][43]Cai L, Long T, Dai Y, Huang Y. Mask R-CNN-based detection and segmentation for pulmonary nodule 3D visualization diagnosis. IEEE Access. 2020; 8:44400-9.

[44][44]Wang J, Wang J, Wen Y, Lu H, Niu T, Pan J, et al. Pulmonary nodule detection in volumetric chest CT scans using CNNs-based nodule-size-adaptive detection and classification. IEEE Access. 2019; 7:46033-44.

[45][45]Xie Y, Zhang J, Xia Y. Semi-supervised adversarial model for benign–malignant lung nodule classification on chest CT. Medical Image Analysis. 2019; 57:237-48.

[46][46]Liu M, Jiang X, Liu Y, Zhao F, Zhou H. A semi-supervised convolutional transfer neural network for 3D pulmonary nodules detection. Neurocomputing. 2020; 391:199-209.

[47][47]Asuntha A, Srinivasan A. Deep learning for lung cancer detection and classification. Multimedia Tools and Applications. 2020; 79(11):7731-62.

[48][48]Zhang G, Lin L, Wang J. Lung nodule classification in CT images using 3D densenet. In journal of physics: conference series 2021 (pp. 1-8). IOP Publishing.

[49][49]Mastouri R, Khlifa N, Neji H, Hantous-Zannad S. A bilinear convolutional neural network for lung nodules classification on CT images. International Journal of Computer Assisted Radiology and Surgery. 2021; 16(1):91-101.

[50][50]Liang J, Ye G, Guo J, Huang Q, Zhang S. Reducing false-positives in lung nodules detection using balanced datasets. Frontiers in Public Health. 2021.

[51][51]Pezzano G, Ripoll VR, Radeva P. CoLe-CNN: context-learning convolutional neural network with adaptive loss function for lung nodule segmentation. Computer Methods and Programs in Biomedicine. 2021.

[52][52]Liu H, Cao H, Song E, Ma G, Xu X, Jin R, Liu C, Hung CC. Multi-model ensemble learning architecture based on 3D CNN for lung nodule malignancy suspiciousness classification. Journal of Digital Imaging. 2020; 33(5):1242-56.

[53][53]Xia K, Chi J, Gao Y, Jiang Y, Wu C. Adaptive aggregated attention network for pulmonary nodule classification. Applied Sciences. 2021; 11(2).

[54][54]Ali I, Muzammil M, Haq IU, Khaliq AA, Abdullah S. Efficient lung nodule classification using transferable texture convolutional neural network. IEEE Access. 2020; 8:175859-70.

[55][55]Lecun Y. LeNet-5, convolutional neural networks. URL: http://yann. lecun. com/exdb/lenet. 2015.

[56][56]Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. 2012.

[57][57]Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. 2014.

[58][58]Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K. SqueezeNet: alexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360. 2016.

[59][59]Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In proceedings of the IEEE conference on computer vision and pattern recognition 2015 (pp. 1-9).

[60][60]Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. Mobilenetv2: inverted residuals and linear bottlenecks. In proceedings of the IEEE conference on computer vision and pattern recognition 2018 (pp. 4510-20).

[61][61]He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In proceedings of the IEEE conference on computer vision and pattern recognition 2016 (pp. 770-8).

[62][62]Chollet F. Xception: deep learning with depthwise separable convolutions. In proceedings of the conference on computer vision and pattern recognition 2017 (pp. 1251-8).

[63][63]Ismael AM, Şengür A. Deep learning approaches for COVID-19 detection based on chest X-ray images. Expert Systems with Applications. 2021.

[64][64]Abdel-Basset M, Chang V, Hawash H, Chakrabortty RK, Ryan M. FSS-2019-nCov: a deep learning architecture for semi-supervised few-shot segmentation of COVID-19 infection. Knowledge-Based Systems. 2021.

[65][65]https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/laboratory-guidance/. Accessed 3 March 2020.

[66][66]Chung M, Bernheim A, Mei X, Zhang N, Huang M, Zeng X, et al. CT imaging features of 2019 novel coronavirus (2019-nCoV). Radiology. 2020; 295(1):202-7.

[67][67]Taylor-phillips S, Stinton C. Fatigue in radiology: a fertile area for future research. The British Journal of Radiology. 2019.

[68][68]https://medicalsegmentation. com/about, 2020. Accessed 3 March 2020.

[69][69]Castellano G, Bonilha L, Li LM, Cendes F. Texture analysis of medical images. Clinical Radiology. 2004; 59(12):1061-9.

[70][70]Sun W, Zheng B, Qian W. Automatic feature learning using multichannel ROI based on deep structured algorithms for computerized lung cancer diagnosis. Computers in Biology and Medicine. 2017; 89:530-9.

[71][71]Ardakani AA, Kanafi AR, Acharya UR, Khadem N, Mohammadi A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: results of 10 convolutional neural networks. Computers in Biology and Medicine. 2020.

[72][72]Li Y, Xia L. Coronavirus disease 2019 (COVID-19): role of chest CT in diagnosis and management. Cardiopulmonary Imaging, Original Research. 2020; 214(6):1280-6.

[73][73]Kermany DS, Goldbaum M, Cai W, Valentim CC, Liang H, Baxter SL, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018; 172(5):1122-31.

[74][74]Wang S, Kang B, Ma J, Zeng X, Xiao M, Guo J, et al. A deep learning algorithm using CT images to screen for corona virus disease (COVID-19). European Radiology. 2021; 31(8):6096-104.

[75][75]Wang Z, Li H, Li J, Yang C, Guo X, Hu Z, et al. Elevated serum IgM levels indicate poor outcome in patients with coronavirus disease 2019 pneumonia: a retrospective case-control study. Available at SSRN 3557987. 2020.

[76][76]Gozes O, Frid-Adar M, Greenspan H, Browning PD, Zhang H, Ji W, et al. Rapid AI development cycle for the coronavirus (COVID-19) pandemic: initial results for automated detection & patient monitoring using deep learning CT image analysis. arXiv preprint arXiv:2003.05037. 2020.

[77][77]Wang L, Lin ZQ, Wong A. Covid-net: a tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Scientific Reports. 2020; 10(1):1-12.

[78][78]Afshar P, Heidarian S, Naderkhani F, Oikonomou A, Plataniotis KN, Mohammadi A. Covid-caps: a capsule network-based framework for identification of covid-19 cases from x-ray images. Pattern Recognition Letters. 2020; 138:638-43.

[79][79]Li X, Li C, Zhu D. Covid-mobilexpert: On-device COVID-19 screening using snapshots of chest x-ray. arXiv preprint arXiv:2004.03042. 2020.

[80][80]Farooq M, Hafeez A. Covid-resnet: A deep learning framework for screening of covid19 from radiographs. arXiv preprint arXiv:2003.14395. 2020.

[81][81]Ucar F, Korkmaz D. COVID iagnosis-net: deep bayes-squeezenet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images. Medical Hypotheses. 2020; 140.

[82][82]Shorfuzzaman M, Hossain MS. MetaCOVID: a Siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients. Pattern Recognition. 2021.

[83][83]Malhotra A, Mittal S, Majumdar P, Chhabra S, Thakral K, Vatsa M, et al. Multi-task driven explainable diagnosis of COVID-19 using chest X-ray images. Pattern Recognition. 2022.

[84][84]Kedia P, Katarya R. CoVNet-19: A deep learning model for the detection and analysis of COVID-19 patients. Applied Soft Computing. 2021; 104.

[85][85]Wang SH, Nayak DR, Guttery DS, Zhang X, Zhang YD. COVID-19 classification by CCSHNet with deep fusion using transfer learning and discriminant correlation analysis. Information Fusion. 2021; 68:131-48.

[86][86]Demir F. DeepcoroNet: a deep LSTM approach for automated detection of COVID-19 cases from chest X-ray images. Applied Soft Computing. 2021; 103.

[87][87]Aswathy AL, SS VC. Cascaded 3D UNet architecture for segmenting the COVID‑19 infection from lung CT volume. Scientific Reports. 2022.

[88][88]Aytaç UC, Güneş A, Ajlouni N. A novel adaptive momentum method for medical image classification using convolutional neural network. BMC Medical Imaging. 2022; 22(1):1-12.

[89][89]Yao HY, Wan WG, Li X. A deep adversarial model for segmentation assisted COVID-19 diagnosis using CT images. EURASIP Journal on Advances in Signal Processing. 2022.

[90][90]Pan L, Ji B, Wang X, Peng S. MFDNN: Multi-channel feature deep neural network algorithm to identify COVID19 chest X-ray images. medRxiv. 2021.

[91][91]Liu X, Yuan Q, Gao Y, He K, Wang S, Tang X, et al. Weakly supervised segmentation of covid19 infection with scribble annotation on ct images. Pattern Recognition. 2022; 122.

[92][92]Maftouni M, Law AC, Shen B, Grado ZJ, Zhou Y, Yazdi NA. A robust ensemble-deep learning model for covid-19 diagnosis based on an integrated CT scan images database. In IIE annual conference. proceedings 2021 (pp. 632-7). Institute of Industrial and Systems Engineers (IISE).

[93][93]Fan DP, Zhou T, Ji GP, Zhou Y, Chen G, Fu H, et al. Inf-net: automatic COVID-19 lung infection segmentation from CT images. IEEE Transactions on Medical Imaging. 2020; 39(8):2626-37.

[94][94]Zhang K, Liu X, Shen J, Li Z, Sang Y, Wu X, et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell. 2020; 181(6):1423-33.

[95][95]Zhao J, Zhang Y, He X, Xie P. Covid-CT-dataset: a CT scan dataset about COVID-19. arXiv preprint arXiv:2003.13865. 2020.

[96][96]Wang LL, Lo K, Chandrasekhar Y, Reas R, Yang J, Eide D, et al. Cord-19: the COVID-19 open research dataset. ArXiv. 2020.

[97][97]Angelov P, Almeida SE. SARS-CoV-2 CT-scan dataset: a large dataset of real patients CT scans for SARS-CoV-2 identification. MedRxiv. 2020.

[98][98]Cohen JP, Morrison P, Dao L. COVID-19 image data collection. arXiv preprint arXiv:2003.11597. 2020.

[99][99]Chowdhury ME, Rahman T, Khandakar A, Mazhar R, Kadir MA, Mahbub ZB, et al. Can AI help in screening viral and COVID-19 pneumonia?. IEEE Access. 2020; 8:132665-76.

[100][100]Rahman T, Khandakar A, Qiblawey Y, Tahir A, Kiranyaz S, Kashem SB, et al. Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images. Computers in Biology and Medicine. 2021.

[101][101]https://wiki.cancerimagingarchive.net/display/Public/REMBRANDT. Accessed 3 March 2022.

[102][102]Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In proceedings of the IEEE conference on computer vision and pattern recognition 2017 (pp. 2097-106).

[103][103]Armato III SG, McLennan G, Bidaut L, McNitt‐gray MF, Meyer CR, Reeves AP, et al. The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Medical physics. 2011; 38(2):915-31

[104][104]Gu Y, Chi J, Liu J, Yang L, Zhang B, Yu D, et al. A survey of computer-aided diagnosis of lung nodules from CT scans using deep learning. Computers in Biology and Medicine. 2021.

[105][105]Li R, Xiao C, Huang Y, Hassan H, Huang B. Deep learning applications in computed tomography images for pulmonary nodule detection and diagnosis: a review. Diagnostics. 2022; 12(2):1-21.