Submitted:
14 April 2023
Posted:
14 April 2023
You are already at the latest version
Abstract
Keywords:Â
1. Introduction
2. Materials and Methods
2.1. LBFtomato Leaf Image Datasets
2.2. Test environment
2.3. Use cascading structures to reduce model loss
2.3. Using Three-Channel Attention Mechanism to Enhance Model Robustness.
2.4. Reducing model parameters using Vgg-style convolutional neural network
3. Results
3.1. Research on Tomato Leaf Disease Classification Based on LBFNet Model.
3.1.1. The impact of different optimizers on the model.


3.1.2. The impact of different learning rate parameters on the model


3.1.3. The impact of different Attention mechanism on the model.
| Module | Accuracy | Loss | Parameters | Train time/s |
| LBFB | 0.6267 | 1.0625 | 689,034 | 4633 |
| LBFB+cascade | 0.9567 | 0.1513 | 955,722 | 2158 |
| LBFB+three-channel attention mechanism | 0.9688 | 0.1034 | 532,900 | 1347 |
| LBFB+cascade+three-channel attention mechanism | 0.9906 | 0.0408 | 897,188 | 966 |
| LBFB+SE | 0.5578 | 1.2754 | 691,098 | 5194 |
| LBFB+cascade+SE | 0.9465 | 0.1703 | 957,786 | 2879 |
| LBFB+CA | 0.8922 | 0.3146 | 776,914 | 1552 |
| LBFB+CA+cascade | 0.9683 | 0.1220 | 962,386 | 2312 |
| LBFB+ECA | 0.8745 | 0.3650 | 773,584 | 1432 |
| LBFB+ECA+cascade | 0.9615 | 0.1405 | 955,728 | 1786 |
| LBFB+DUAL | 0.8853 | 0.3411 | 794,060 | 2434 |
| LBFB+DUAL+cascade | 0.9588 | 0.1261 | 976,204 | 2755 |
| LBFB+CBAM | 0.9089 | 0.3053 | 794,940 | 1537 |
| LBFB+cascade+CBAM | 0.9790 | 0.0815 | 777,468 | 1172 |
3.2. Model performance comparison
3.2.1. Parameter settings
3.2.2. Evaluation Metrics
3.2.3. comparative analysis result








3.2.4. Reduce model size using quantitative pruning
4. Discussion
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Liu J, Wang X. Plant diseases and pests detection based on deep learning: a review[J]. Plant Methods, 2021, 17(1): 1-18.
- Abade A, Ferreira P A, de Barros Vidal F. Plant diseases recognition on images using convolutional neural networks: A systematic review[J]. Computers and Electronics in Agriculture, 2021, 185: 106125.
- Kamilaris A, Prenafeta-Boldú F X. A review of the use of convolutional neural networks in agriculture[J]. The Journal of Agricultural Science, 2018, 156(3): 312-322.
- Gui P, Dang W, Zhu F, et al. Towards automatic field plant disease recognition[J]. Computers and Electronics in Agriculture, 2021, 191: 106523.
- Yang C, Teng Z, Dong C, et al. In-Field Citrus Disease Classification via Convolutional Neural Network from Smartphone Images[J]. Agriculture, 2022, 12(9): 1487.
- Nguyen T H, Nguyen T N, Ngo B V. A VGG-19 Model with Transfer Learning and Image Segmentation for Classification of Tomato Leaf Disease[J]. AgriEngineering, 2022, 4(4): 871-887.
- Chen S, Xiong J, Jiao J, et al. Citrus fruits maturity detection in natural environments based on convolutional neural networks and visual saliency map[J]. Precision Agriculture, 2022, 23(5): 1515-1531.
- Mishra S, Sachan R, Rajpal D. Deep convolutional neural network based detection system for real-time corn plant disease recognition[J]. Procedia Computer Science, 2020, 167: 2003-2010.
- Dong C, Zhang Z, Yue J, et al. Automatic recognition of strawberry diseases and pests using convolutional neural network[J]. Smart Agricultural Technology, 2021, 1: 100009.
- Xu W, Zhao L, Li J, et al. Detection and classification of tea buds based on deep learning[J]. Computers and Electronics in Agriculture, 2022, 192: 106547.
- Liu C, Zhu H, Guo W, et al. EFDet: An efficient detection method for cucumber disease under natural complex environments[J]. Computers and Electronics in Agriculture, 2021, 189: 106378.
- Chen J, Liu Q, Gao L. Visual tea leaf disease recognition using a convolutional neural network model[J]. Symmetry, 2019, 11(3): 343.
- Singh A K, Sreenivasu S V N, Mahalaxmi U, et al. Hybrid feature-based disease detection in plant leaf using convolutional neural network, bayesian optimized SVM, and random forest classifier[J]. Journal of Food Quality, 2022, 2022: 1-16.
- Zhang S W, Shang Y J, Wang L. Plant disease recognition based on plant leaf image[J]. J. Anim. Plant Sci, 2015, 25(3): 42-45.
- Szegedy C, Ioffe S, Vanhoucke V, et al. Inception-v4, inception-resnet and the impact of residual connections on learning[C].AAAI. 2017, 4: 12.
- Abbas A, Jain S, Gour M, et al. Tomato plant disease detection using transfer learning with C-GAN synthetic images[J]. Computers and Electronics in Agriculture, 2021, 187: 106279.
- Huang G, Liu Z, Weinberger K Q, et al. Densely connected convolutional networks[C].Proceedings of the IEEE conference on computer vision and pattern recognition. 2017, 1(2): 3.
- Howard A G, Zhu M, Chen B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications[J]. arXiv preprint arXiv:1704.04861, 2017.
- Ding X, Zhang X, Ma N, et al. Repvgg: Making vgg-style convnets great again[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 13733-13742.
- Zeng W, Li M. Crop leaf disease recognition based on Self-Attention convolutional neural network[J]. Computers and Electronics in Agriculture, 2020, 172: 105341.
- Deng H, Luo D, Chang Z, et al. RAHC_GAN: A Data Augmentation Method for Tomato Leaf Disease Recognition[J]. Symmetry, 2021, 13(9): 1597.
- Gong C, Wang D, Li M, et al. KeepAugment: A simple information-preserving data augmentation approach[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 1055-1064.
- Wang H, Song H, Wu H, et al. Multilayer feature fusion and attention-based network for crops and weeds segmentation[J]. Journal of Plant Diseases and Protection, 2022, 129(6): 1475-1489.
- Fang W, Guan F, Yu H, et al. Identification of wormholes in soybean leaves based on multi-feature structure and attention mechanism[J]. Journal of Plant Diseases and Protection, 2022: 1-12.
- Wang S H, Fernandes S L, Zhu Z, et al. AVNC: attention-based VGG-style network for COVID-19 diagnosis by three-channel attention mechanism[J]. IEEE Sensors Journal, 2021, 22(18): 17431-17438.
- Fukui H, Hirakawa T, Yamashita T, et al. Attention branch network: Learning of attention mechanism for visual explanation[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2019: 10705-10714.
- Chefer H, Gur S, Wolf L. Transformer interpretability beyond attention visualization[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 782-791.
- Guo M H, Xu T X, Liu J J, et al. Attention mechanisms in computer vision: A survey[J]. Computational Visual Media, 2022, 8(3): 331-368.
- Gadekallu T R, Rajput D S, Reddy M P K, et al. A novel PCA–whale optimization-based deep neural network model for classification of tomato plant diseases using GPU[J]. Journal of Real-Time Image Processing, 2021, 18: 1383-1396.
- Gonzalez-Huitron V, León-Borges J A, Rodriguez-Mata A E, et al. Disease detection in tomato leaves via CNN with lightweight architectures implemented in Raspberry Pi 4[J]. Computers and Electronics in Agriculture, 2021, 181: 105951.
- Rangarajan A K, Purushothaman R, Ramesh A. Tomato crop disease classification using pre-trained deep learning algorithm[J]. Procedia computer science, 2018, 133: 1040-1047.
- Wang Q, Qi F, Sun M, et al. Identification of tomato disease types and detection of infected areas based on deep convolutional neural networks and object detection techniques[J]. Computational intelligence and neuroscience, 2019, 2019.
- Zhang Y, Song C, Zhang D. Deep learning-based object detection improvement for tomato disease[J]. IEEE access, 2020, 8: 56607-56614.
- Chakravarthy A S, Raman S. Early blight identification in tomato leaves using deep learning[C]//2020 International conference on contemporary computing and applications (IC3A). IEEE, 2020: 154-158.
- Ahmed S, Hasan M B, Ahmed T, et al. Less is more: lighter and faster deep neural architecture for tomato leaf disease classification[J]. IEEE Access, 2022, 10: 68868-68884.
- Yu H, Liu J, Chen C, et al. Optimized deep residual network system for diagnosing tomato pests[J]. Computers and Electronics in Agriculture, 2022, 195: 106805.
- Singh D, Jain N, Jain P, et al. PlantDoc: A dataset for visual plant disease detection[M]//Proceedings of the 7th ACM IKDD CoDS and 25th COMAD. 2020: 249-253.






| Class of T omato Leaf Images | Train Images | Validation Images |
| Tomato bacterial spot disease | 1410 | 717 |
| Early blight disease | 670 | 330 |
| Healthy leaf | 940 | 651 |
| Tomato late blight disease | 1140 | 769 |
| Leaf mold disease | 570 | 382 |
| Tomato Septoria leaf spot disease | 1060 | 711 |
| Two-spotted spider mites | 1060 | 616 |
| Target spot disease | 950 | 454 |
| Mosaic virus disease | 270 | 103 |
| Yellow leaf curl virus disease | 3810 | 1547 |
| Class of T omato Leaf Images | Train Images | Validation Images |
| Tomato bacterial spot disease | 1071 | 340 |
| Early blight disease | 1000 | 200 |
| Healthy leaf | 1081 | 254 |
| Tomato late blight disease | 925 | 381 |
| Leaf mold disease | 1000 | 192 |
| Tomato Septoria leaf spot disease | 1083 | 355 |
| Two-spotted spider mites | 1115 | 335 |
| Target spot disease | 1029 | 284 |
| Mosaic virus disease | 1000 | 74 |
| Yellow leaf curl virus disease | 1085 | 258 |
| Model | Accuracy | Loss | Parameters | Train time/s | Test time/s | F1-score | recall | precision |
| Resnet50 | 0.9482 | 0.1579 | 23,608,202 | 28,377 | 0.51 | 0.92 | 0.91 | 0.92 |
| Vgg16 | 0.9590 | 0.0891 | 165,758,794 | 41,577 | 0.23 | 0.96 | 0.96 | 0.96 |
| Mobilenet | 0.9492 | 0.1449 | 2,279,714 | 10,142 | 0.40 | 0.90 | 0.91 | 0.91 |
| Googlenet | 0.8633 | 0.3947 | 10,360,590 | 7,857 | 0.32 | 0.87 | 0.87 | 0.87 |
| LBFNet | 0.9906 | 0.0408 | 897,188 | 966 | 0.21 | 0.98 | 0.98 | 0.98 |
| vit-transformer | 1.0 | 0.012 | 85,806,346 | 365,320 | 0.28 | 1.0 | 0.97 | 0.98 |
| ConvNeXt | 0.9884 | 0.071 | 27,827,818 | 197,320 | 0.42 | 0.99 | 0.99 | 0.98 |
| Model | Accuracy | Loss | Parameters | Train time/s | Test time/s | F1-score | recall | precision |
| Resnet50 | 0.8965 | 0.3025 | 23,608,202 | 27,837 | 0.54 | 0.81 | 0.79 | 0.80 |
| Vgg16 | 0.8175 | 0.5938 | 165,758,794 | 41,926 | 0.25 | 0.80 | 0.79 | 0.77 |
| Mobilenet | 0.7920 | 0.5924 | 2,279,714 | 15,858 | 0.45 | 0.77 | 0.79 | 0.80 |
| Googlenet | 0.8281 | 0.5588 | 10,360,590 | 7,172 | 0.36 | 0.82 | 0.84 | 0.82 |
| LBFNet | 0.9756 | 0.2696 | 897,188 | 1420 | 0.23 | 0.97 | 0.98 | 0.98 |
| vit-transformer | 0.9943 | 0.015 | 85,806,346 | 412,702 | 0.41 | 0.99 | 0.98 | 0.99 |
| ConvNeXt | 0.978 | 0.089 | 27,827,818 | 277,456 | 0.52 | 0.97 | 0.98 | 0.97 |
| F1-score | recall | precision | Image numbers | |
| Bacterial_spot | 0.96 | 0.98 | 0.97 | 340 |
| Early_blight | 0.97 | 0.96 | 0.97 | 200 |
| healthy | 0.98 | 0.98 | 0.98 | 381 |
| Late_blight | 0.99 | 0.99 | 0.99 | 192 |
| Leaf_Mold | 0.99 | 0.99 | 0.99 | 355 |
| Septoria_leaf_spot | 0.98 | 0.99 | 0.99 | 335 |
| Spider_mites | 0.99 | 0.96 | 0.99 | 284 |
| Target_Spot | 0.99 | 0.98 | 0.99 | 258 |
| mosaic_virus | 0.94 | 1.0 | 0.97 | 74 |
| yellow_Leaf_Curl_Virus | 0.99 | 0.99 | 0.99 | 254 |
| accuracy | 0.98 | 2673 | ||
| macro avg | 0.98 | 0.98 | 0.98 | 2673 |
| weighted avg | 0.98 | 0.98 | 0.98 | 2673 |
| Size | Accuarcy | Loss | F1-score | recall | precision | |
| LBFNet | 6.85 MB | 0.9906 | 0.0408 | 0.98 | 0.98 | 0.98 |
| pruned_quantized_model | 3.46 MB | 0.9766 | 0.0712 | 0.97 | 0.97 | 0.97 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).