Abstract

Agribusiness is the main source of income for roughly 70% of people who reside in rural areas. India is the world's second-largest producer of pulses, textile raw materials, spices, coconuts, and other agricultural products. India's gross domestic product (GDP) is significantly impacted by the agriculture industry. Technology advancements help the agricultural industry to forecast various elements, such as soil quality, crop quality, and, disease detection to boost crop yield. Disease detection is one of the essential tasks that have to be carried out in agriculture. The early identification of the leaf disease helps to prevent further spread to other leaves in the plant by which the yield can be improved. In this work, plant leaf disease detection and stage classification are performed based on the severity of leaf infection. A deep learning model, you only look once version5 (YOLOv5) is used to detect plant leaf disease then background of the diseased leaf is removed using U2-Net architecture followed by stage classification performed using vision transformer (ViT) for classifying it as different stages such as low, moderate, and high. A recommendation solution has been provided to mitigate the leaf disease. YOLOv5 was trained using different open-source datasets namely 1) PlantDoc and 2) Plantvillage. This work mainly concentrates on the apple leaf for performing stage classification. The YOLO v5 gives a maximum f1-score of 0.57 at a confidence score of 0.2 and the vision transformer with a background image gives an f1-score of 0.758 and without a background image, 0.908 f1-score is achieved.

Keyword

You only look once version5(YOLOV5), Vision transformer (ViT), Computer-aided disease detection system (CADS), Region proposal network (RPN), Natural language processing (NLP), Explainable artificial intelligence (XAI), Deep convolutional neural network (DCNN).

Cite this article

Bandi R, Swamy S, C. AS

Refference

[1][1]https://agricoop.nic.in/Documents/annual-report-2020-21.pdf. Accessed 19 February 2023.

[2][2]Raza A, Razzaq A, Mehmood SS, Zou X, Zhang X, Lv Y, et al. Impact of climate change on crops adaptation and strategies to tackle its outcome: a review. Plants. 2019; 8(2):1-29.

[3][3]López MM, Bertolini E, Olmos A, Caruso P, Gorris MT, Llop P, et al. Innovative tools for detection of plant pathogenic viruses and bacteria. International Microbiology. 2003; 6:233-43.

[4][4]Liang Q, Xiang S, Hu Y, Coppola G, Zhang D, Sun W. PD2SE-Net: computer-assisted plant disease diagnosis and severity estimation network. Computers and Electronics in Agriculture. 2019; 157:518-29.

[5][5]Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N. PlantDoc: a dataset for visual plant disease detection. In proceedings of the 7th ACM IKDD CoDS and 25th COMAD 2020 (pp. 249-53).

[6][6]https://www.kaggle.com/datasets/abdallahalidev/plantvillage-dataset. Accessed 10 February 2023.

[7][7]Fang Y, Ramasamy RP. Current and prospective methods for plant disease detection. Biosensors. 2015; 5(3):537-61.

[8][8]Mou L, Meng Z, Yan R, Li G, Xu Y, Zhang L, et al. How transferable are neural networks in NLP applications? Proceedings of the conference on empirical methods in natural language processing 2016 (pp. 479-89). Association for Computational Linguistic.

[9][9]Dhanya VG, Subeesh A, Kushwaha NL, Vishwakarma DK, Kumar TN, Ritika G, et al. Deep learning based computer vision approaches for smart agricultural applications. Artificial Intelligence in Agriculture. 2022; 6:211-9.

[10][10]Dhaygude SB, Kumbhar NP. Agricultural plant leaf disease detection using image processing. International Journal of Advanced Research in Electrical, Electronics and Instrumentation Engineering. 2013; 2(1):599-602.

[11][11]Sethy PK, Barpanda NK, Rath AK. Detection and identification of rice leaf diseases using multiclass SVM and particle swarm optimization technique. International Journal of Innovative Technology and Exploring Engineering. 2019; 8(6S2):2278-3075.

[12][12]Sebastian VB, Unnikrishnan A, Balakrishnan K. Gray level co-occurrence matrices: generalisation and some new features. International Journal of Computer Science, Engineering and Information Technology. 2012; 2(2):151-7.

[13][13]Khirade SD, Patil AB. Plant disease detection using image processing. In international conference on computing communication control and automation 2015 (pp. 768-71). IEEE.

[14][14]Cao D, Chen Z, Gao L. An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks. Human-centric Computing and Information Sciences. 2020; 10(1):1-22.

[15][15]Guo Y, Zhang J, Yin C, Hu X, Zou Y, Xue Z, et al. Plant disease identification based on deep learning algorithm in smart farming. Discrete Dynamics in Nature and Society. 2020; 2020:1-11.

[16][16]Cohen R. The chan-vese algorithm. Computer Vision and Pattern Recognition. 2011:1-18.

[17][17]Hassan SM, Maji AK, Jasiński M, Leonowicz Z, Jasińska E. Identification of plant-leaf diseases using CNN and transfer-learning approach. Electronics. 2021; 10(12):1-19.

[18][18]Rashid J, Khan I, Ali G, Almotiri SH, Alghamdi MA, Masood K. Multi-level deep learning model for potato leaf disease recognition. Electronics. 2021; 10(17):1-27.

[19][19]Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: unified, real-time object detection. In proceedings of the conference on computer vision and pattern recognition 2016 (pp. 779-88). IEEE.

[20][20]Redmon J, Farhadi A. Yolo9000: better, faster, stronger. In proceedings of the conference on computer vision and pattern recognition 2017 (pp. 7263-71). IEEE.

[21][21]Redmon J, Farhadi A. Yolov3: an incremental improvement. Computer Vision and Pattern Recognition. 2018:1-6.

[22][22]Bochkovskiy A, Wang CY, Liao HY. Yolov4: optimal speed and accuracy of object detection. Computer Vision and Pattern Recognition. 2020:1-17.

[23][23]https://github.com/ultralytics/yolov5. Accessed 10 February 2023.

[24][24]Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2016:1-14.

[25][25]http://www.pascal-network.org/challenges/VOC/voc2007/index.html. Accessed 15 February 2023.

[26][26]http://pascallin.ecs.soton.ac.uk/challenges/VOC/voc2012/index.html. Accessed 15 February 2023.

[27][27]Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft coco: common objects in context. In computer vision–ECCV, 13th European conference, Zurich, Switzerland, proceedings 2014 (pp. 740-55). Springer International Publishing.

[28][28]Tan M, Le Q. Efficientnet: rethinking model scaling for convolutional neural networks. In international conference on machine learning 2019 (pp. 6105-14). PMLR.

[29][29]Malik HS, Dwivedi M, Omkar SN, Javed T, Bakey A, Pala MR, et al. Disease recognition in sugarcane crop using deep learning. In advances in artificial intelligence and data engineering 2021 (pp. 189-206). Springer Singapore.

[30][30]Toda Y, Okura F. How convolutional neural networks diagnose plant disease. Plant Phenomics. 2019. 2019:1-14.

[31][31]Nagasubramanian K, Jones S, Singh AK, Sarkar S, Singh A, Ganapathysubramanian B. Plant disease identification using explainable 3D deep learning on hyperspectral images. Plant Methods. 2019; 15:1-10.

[32][32]Liu J, Wang X. Early recognition of tomato gray leaf spot disease based on MobileNetv2-Yolov3 model. Plant Methods. 2020; 16:1-6.

[33][33]Malik A, Vaidya G, Jagota V, Eswaran S, Sirohi A, Batra I, et al. Design and evaluation of a hybrid technique for detecting sunflower leaf disease using deep learning approach. Journal of Food Quality. 2022; 2022:1-12.

[34][34]Tammina S. Transfer learning using vgg-16 with deep convolutional neural network for classifying images. International Journal of Scientific and Research Publications. 2019; 9(10):143-50.

[35][35]Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. Mobilenetv2: inverted residuals and linear bottlenecks. In proceedings of the conference on computer vision and pattern recognition 2018 (pp. 4510-20). IEEE.

[36][36]Srinidhi VV, Sahay A, Deeba K. Plant pathology disease detection in apple leaves using deep convolutional neural networks: apple leaves disease detection using efficientnet and densenet. In 5th international conference on computing methodologies and communication 2021 (pp. 1119-27). IEEE.

[37][37]Sibiya M, Sumbwanyambe M. Automatic fuzzy logic-based maize common rust disease severity predictions with thresholding and deep learning. Pathogens. 2021; 10(2):1-17.

[38][38]Shiferaw D, Hailegnaw A, Assefa A, Abebe D, Dagne E, Fekadie G. LabVIEW based fuzzy logic controller for PLC. In international conference on computer, control, electrical, and electronics engineering 2019 (pp. 1-4). IEEE.

[39][39]Shi T, Liu Y, Zheng X, Hu K, Huang H, Liu H, et al. Recent advances in plant disease severity assessment using convolutional neural networks. Scientific Reports. 2023; 13(1):1-14.

[40][40]Abd AYM, Caro OJ, Bravo LM, Kaur C, Al AMS, Bala BK. Leaf disease identification and classification using optimized deep learning. Measurement: Sensors. 2023; 25:1-6.

[41][41]Mohammed L, Yusoff Y. Detection and classification of plant leaf diseases using digital image processing methods: a review. ASEAN Engineering Journal. 2023; 13(1):1-9.

[42][42]Han K, Wang Y, Chen H, Chen X, Guo J, Liu Z, et al. A survey on vision transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2022; 45(1):87-110.

[43][43]Xu R, Lin H, Lu K, Cao L, Liu Y. A forest fire detection system based on ensemble learning. Forests. 2021; 12(2):1-16.

[44][44]Bo S, Jing Y. Image clustering using mean shift algorithm. In fourth international conference on computational intelligence and communication networks 2012 (pp. 327-30). IEEE.

[45][45]Canny J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1986; 8(6):679-98.

[46][46]Qin X, Zhang Z, Huang C, Dehghan M, Zaiane OR, Jagersand M. U2-Net: going deeper with nested U-structure for salient object detection. Pattern Recognition. 2020; 106(2020):1-12.

[47][47]Arvind CS, Prajwal R, Bhat PN, Sreedevi A, Prabhudeva KN. Fish detection and tracking in pisciculture environment using deep instance segmentation. In TENCON region 10 conference 2019 (pp. 778-83). IEEE.