Abstract

The battle against thoracic illnesses has been a major focus in the fields of machine learning and computer vision. Radiology has made significant advancements in the early detection of thoracic disorders. Chest X-rays have become a commonly employed procedure for identifying and categorizing such diseases. However, the shortage of qualified radiologists presents a challenge to accurate diagnosis. Recently, there has been growing interest in the utilization of convolutional neural network (CNN) models for classifying thoracic diseases. Nevertheless, CNNs have limitations in handling translation and rotation in input data, primarily due to the need for extensive training datasets. To address these limitations, capsule networks (CapsNN) have emerged as a novel architecture for automatic learning. CapsNNs are particularly well-suited for managing complex translation and rotation tasks. In this study, a thoracic-cap modelling framework based on CapsNNs was proposed as an alternative approach capable of working with small datasets. Experimental results utilizing a collection of X-ray images demonstrate that the proposed thoracic-caps model outperforms previous CNN-based models, achieving an accuracy of 96.46%. A total of 3043 images of healthy individuals and patients with various thoracic problems were utilized. These findings underscore the effectiveness of CapsNN, a deep fusion neural network, in identifying different thoracic diseases using chest X-ray radiography.

Keyword

Capsule neural network, Deep learning, Thoracic disorders, Chest X-ray, Early diagnosis, Medical imaging.

Cite this article

Pant H, Lohani MC, Bhatt AK

Refference

[1][1]Pant H, Lohani MC, Bhatt AK, Pant J, Sharma RK. Thoracic disease detection using deep learning. In 5th international conference on computing methodologies and communication 2021 (pp. 1197-203). IEEE.

[2][2]Palani S, Kulkarni A, Kochara A, Kiruthika M. Detection of thoracic diseases using deep learning. In ITM web of conferences 2020 (pp. 1-7). EDP Sciences.

[3][3]Fating S, Kotambkar DM. Characterization of common thoracic diseases from chest x-ray images using CNN. In advanced machine intelligence and signal processing 2022(pp. 665-77). Singapore: Springer Nature Singapore.

[4][4]Heidarian S, Afshar P, Enshaei N, Naderkhani F, Rafiee MJ, Babaki FF, et al. Covid-fact: a fully-automated capsule network-based framework for identification of covid-19 cases from chest CT scans. Frontiers in Artificial Intelligence. 2021; 4:1-13.

[5][5]Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. Evolutionary Intelligence. 2022; 15(1):1-22.

[6][6]Sabour S, Frosst N, Hinton GE. Dynamic routing between capsules. In conference on neural information processing systems (pp. 1-12). 2017.

[7][7]Yamashita R, Nishio M, Do RK, Togashi K. Convolutional neural networks: an overview and application in radiology. Insights into Imaging. 2018; 9:611-29.

[8][8]Yadav SS, Jadhav SM. Deep convolutional neural network based medical image classification for disease diagnosis. Journal of Big Data. 2019; 6(1):1-8.

[9][9]Li Q, Cai W, Wang X, Zhou Y, Feng DD, Chen M. Medical image classification with convolutional neural network. In 13th international conference on control automation robotics & vision 2014 (pp. 844-8). IEEE.

[10][10]Jiménez-sánchez A, Albarqouni S, Mateus D. Capsule networks against medical imaging data challenges. In intravascular imaging and computer assisted stenting and large-scale annotation of biomedical data and expert label synthesis: 7th joint international workshop, CVII-STENT and third international workshop, LABELS, held in conjunction with MICCAI, Granada, Spain 2018 (pp. 150-60). Springer International Publishing.

[11][11]Wang D, Liu Q. An optimization view on dynamic routing between capsules. Workshop track - ICLR 2018 (pp. 1-4).

[12][12]Yan F, Huang X, Yao Y, Lu M, Li M. Combining LSTM and dense net for automatic annotation and classification of chest x-ray images. IEEE Access. 2019; 7:74181-9.

[13][13]Hertel R, Benlamri R. Deep learning techniques for COVID-19 diagnosis and prognosis based on radiological imaging. ACM Computing Surveys. 2023; 55(12):1-39.

[14][14]Cardoso MJ, Arbel T, Lee SL, Cheplygina V, Balocco S, Mateus D, et al. Intravascular imaging and computer assisted stenting, and large-scale annotation of biomedical data and expert label synthesis. In CVII-STENT and second international workshop, LABELS 2017. Springer.

[15][15]Gazda M, Plavka J, Gazda J, Drotar P. Self-supervised deep convolutional neural network for chest X-ray classification. IEEE Access. 2021; 9:151972-82.

[16][16]Bai HX, Hsieh B, Xiong Z, Halsey K, Choi JW, Tran TM, et al. Performance of radiologists in differentiating COVID-19 from non-COVID-19 viral pneumonia at chest CT. Radiology. 2020; 296(2):E46-54.

[17][17]Nijiati M, Ma J, Hu C, Tuersun A, Abulizi A, Kelimu A, et al. Artificial intelligence assisting the early detection of active pulmonary tuberculosis from chest X-rays: a population-based study. Frontiers in Molecular Biosciences. 2022; 9:874475.

[18][18]Bhattacharyya A, Bhaik D, Kumar S, Thakur P, Sharma R, Pachori RB. A deep learning based approach for automatic detection of COVID-19 cases using chest X-ray images. Biomedical Signal Processing and Control. 2022; 71:1-13.

[19][19]Hu S, Gao Y, Niu Z, Jiang Y, Li L, Xiao X, et al. Weakly supervised deep learning for covid-19 infection detection and classification from CT images. IEEE Access. 2020; 8:118869-83.

[20][20]Chouhan V, Singh SK, Khamparia A, Gupta D, Tiwari P, Moreira C, et al. A novel transfer learning based approach for pneumonia detection in chest X-ray images. Applied Sciences. 2020; 10(2):1-17.

[21][21]Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. The Lancet. 2020; 395(10223):497-506.

[22][22]Rajaraman S, Antani SK. Modality-specific deep learning model ensembles toward improving TB detection in chest radiographs. IEEE Access. 2020; 8:27318-26.

[23][23]Rajpurkar P, Irvin J, Ball RL, Zhu K, Yang B, Mehta H, et al. Deep learning for chest radiograph diagnosis: a retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Medicine. 2018; 15(11):e1002686.

[24][24]Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems. 2012; 25:84-90.

[25][25]Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In proceedings of the IEEE conference on computer vision and pattern recognition 2017 (pp. 2097-106). IEEE.

[26][26]Qin C, Yao D, Shi Y, Song Z. Computer-aided detection in chest radiography based on artificial intelligence: a survey. Biomedical Engineering Online. 2018; 17(1):1-23.

[27][27]Parveen S, Khan KB. Detection and classification of pneumonia in chest X-ray images by supervised learning. In 23rd international multitopic conference 2020 (pp. 1-5). IEEE.

[28][28]Mittal A, Kumar D, Mittal M, Saba T, Abunadi I, Rehman A, et al. Detecting pneumonia using convolutions and dynamic capsule routing for chest X-ray images. Sensors. 2020; 20(4):1-30.

[29][29]Huang G, Liu Z, Van DML, Weinberger KQ. Densely connected convolutional networks. In proceedings of the IEEE conference on computer vision and pattern recognition 2017 (pp. 4700-8). IEEE.

[30][30]Abedalla A, Abdullah M, Al-ayyoub M, Benkhelifa E. Chest X-ray pneumothorax segmentation using U-Net with EfficientNet and ResNet architectures. Peer Journal Computer Science. 2021; 7:1-36.

[31][31]Heidari M, Mirniaharikandehei S, Khuzani AZ, Danala G, Qiu Y, Zheng B. Improving the performance of CNN to predict the likelihood of COVID-19 using chest X-ray images with preprocessing algorithms. International Journal of Medical Informatics. 2020; 144:1-9.

[32][32]Afshar P, Heidarian S, Naderkhani F, Oikonomou A, Plataniotis KN, Mohammadi A. Covid-caps: a capsule network-based framework for identification of covid-19 cases from x-ray images. Pattern Recognition Letters. 2020; 138:638-43.

[33][33]Teto JK, Xie Y. Automatically Identifying of animals in the wilderness: comparative studies between CNN and C-Capsule network. In proceedings of the 3rd international conference on compute and data analysis 2019 (pp. 128-33). ACM.

[34][34]Rohilla A, Hooda R, Mittal A. TB detection in chest radiograph using deep learning architecture. International conference on emerging trends in engineering, technology, science and management (pp. 136-47). 2017.

[35][35]Nardelli P, Jimenez-Carretero D, Bermejo-Pelaez D, Washko GR, Rahaghi FN, Ledesma-Carbayo MJ, et al. Pulmonary artery–vein classification in CT images using deep learning. IEEE Transactions on Medical Imaging. 2018; 37(11):2428-40.

[36][36]Chen HJ, Ruan SJ, Huang SW, Peng YT. Lung x-ray segmentation using deep convolutional neural networks on contrast-enhanced binarized images. Mathematics. 2020; 8(4):1-12.

[37][37]Berman M, Blaschko MB. Optimization of the Jaccard index for image segmentation with the Lovász hinge. CoRR. 2017: 1-9.

[38][38]Li Z, Wang C, Han M, Xue Y, Wei W, Li LJ, et al. Thoracic disease identification and localization with limited supervision. In proceedings of the IEEE conference on computer vision and pattern recognition 2018 (pp. 8290-9). IEEE.

[39][39]Rios A, Kavuluru R. Convolutional neural networks for biomedical text classification: application in indexing biomedical articles. In proceedings of the 6th ACM conference on bioinformatics, computational biology and health informatics 2015 (pp. 258-67). ACM.

[40][40]Baltruschat IM, Nickisch H, Grass M, Knopp T, Saalbach A. Comparison of deep learning approaches for multi-label chest X-ray classification. Scientific Reports. 2019; 9(1):1-10.

[41][41]Alapat DJ, Menon MV, Ashok S. A review on detection of pneumonia in chest X-ray images using neural networks. Journal of Biomedical Physics & Engineering. 2022; 12(6):551- 8.

[42][42]Ananthakrishnan B, Shaik A, Kumar S, Narendran SO, Mattu K, Kavitha MS. Automated detection and classification of oral squamous cell carcinoma using deep neural networks. Diagnostics. 2023; 13(5):1-19.

[43][43]Yang J, Shi R, Wei D, Liu Z, Zhao L, Ke B, et al. MedMNIST v2-A large-scale lightweight benchmark for 2D and 3D biomedical image classification. Scientific Data. 2023; 10(1):1-10.

[44][44]https://www.sciencedaily.com/releases/2010/10/101022123749.htm. Accessed 22 April 2022.

[45][45]Nampally A, Koyyada S, Vaishnavi S, Shaik M. Diagnosis of COVID-19 cases on X-Ray images using CNN. International Journal of Science and Research Archive. 2022; 8(1):31-7.

[46][46]Ma Y, Lv W. Identification of pneumonia in chest X-ray image based on transformer. International Journal of Antennas and Propagation. 2022; 2022:1-8.

[47][47]Ar B, Rs VK, Ss K. LCD-capsule network for the detection and classification of lung cancer on computed tomography images. Multimedia Tools and Applications. 2023: 1-20.

[48][48]Abouel-magd LM, Darwish A, Snasel V, Hassanien AE. A pre-trained convolutional neural network with optimized capsule networks for chest X-rays COVID-19 diagnosis. Cluster Computing. 2023; 26(2):1389-403.