Submitted:
15 January 2024
Posted:
16 January 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Study Area
2.2. Data Acquisition and Preprocessing
2.3. Network Modeling and Model Parameter Selection
2.3.1. U-Net Model
2.3.2. Experimental Environment
2.3.3. Model Parameter Selection
2.4. Dataset Construction
2.4.1. Classification of Complex Habitat for Tobacco
2.4.2 Construction of Sample Datasets
2.5. Evaluation Index
3. Results
3.1. Quantitative Analysis of Plant Extraction Precision
3.2. Visual Analysis of Tobacco Plant Extraction
3.3. Optimization Sample
4. Discussion
4.1. Analysis of Omitted Factors
4.2. Analysis of Erroneous Factors
4.3. Analysis of the Impact of Optimized Samples on the Accuracy of the Model in Identifying Tobacco Plants
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Vilma Cokkinides, P.P.B. , MS; Elizabeth Ward, PhD; Ahmedin Jemal, DVM, PhD;Michael Thun, MD, MS. Progress and Opportunities inTobacco Control. CA Cancer J Clin. 2006, 56, 135–142. [Google Scholar]
- Bose, P.; Kasabov, N.K.; Bruzzone, L.; Hartono, R.N. Spiking Neural Networks for Crop Yield Estimation Based on Spatiotemporal Analysis of Image Time Series. IEEE Transactions on Geoscience and Remote Sensing. 2016, 1–11. [Google Scholar] [CrossRef]
- Xiangpeng Fan, J.Z. , Yan Xu. Research advances of monitoring agricultural information using UAV low-altitude remote sensing. Philosophy,Humanities Social Sciences. 2021, 38, 623–631. [Google Scholar]
- Li, Q. Study on Multi-scale identification of tobacco in complex habitat in karst mountainous areas using low altitude remote sensing. Guizhou Normal University, 2023.
- Zhijun Tong, D.F. , Xuejun Chen, Jianmin Zeng, Fangchan Jiao. Genetic analysis of six important yield-related traits in tobacco (Nicotiana tabacum L). Acta Tabacaria Sinica. 2020, 26, 72–81. [Google Scholar]
- Liao, X.; Xiao, Q.; Zhang, H. UAV remote sensing: Popularization and expand application development trend. National Remote Sensing Bulletin. 2019, 23, 1046–1052. [Google Scholar] [CrossRef]
- Huang, D.H.Z.Z.R.P.M.Z.L.Y.Y.Z.D.X.Q.L.L.H.Y. Challenges and main research advances of low-altitude remote sensing for crops in southwest plateau mountains. Journal of Guizhou Normal University (Natural Sciences). 2021, 39, 51–59. [Google Scholar]
- Feng Quanlong, N.B., Zhu Dehai, Chen Boan, Zhang Chao,Yang Jianyu Review.for deep learning in land use and land cover remote sensing classification Nongye Jixie Xuebao/Transactions of the Chinese Society of Agricultural Machinery. 2022, 53, 1–17.
- Huang, L.Y.Z.Z.S.L.D. Research on vegetation extraction and fractional vegetation cover of karst area based on visible light image of UAV. Acta Agrestia Sinica. 2020, 28, 1664–1672. [Google Scholar]
- Doraiswamy, R.C.; Hatfield, J.L.; Jackson, T.J.; Akhmedov, B.; Prueger, J.; Stern, A. Crop condition and yield simulations using Landsat and MODIS. Remote Sensing of Environment: An Interdisciplinary Journal 2004, 92.
- Berni, J.A.J.; Zarco-Tejada, P.J.; Suarez, L.; Fereres, E. Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle. IEEE Transactions on Geoscience & Remote Sensing. 2009, 47, 722–738. [Google Scholar] [CrossRef]
- Schmidhuber, J. Deep learning in neural networks: An overview. Neural Networks. 2015, 61, 85–117. [Google Scholar] [CrossRef]
- Uto, K.; Seki, H.; Saito, G.; Kosugi, Y. Characterization of Rice Paddies by a UAV-Mounted Miniature Hyperspectral Sensor System. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2013, 6, 851–860. [Google Scholar] [CrossRef]
- Tian, H.X.L. Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV). Biosystems Engineering. 2011, 108, 174–190. [Google Scholar]
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet classification with deep convolutional neural networks. Communications of the ACM. 2017, 60, 84–90. [Google Scholar] [CrossRef]
- Konstantinos, L.; Patrizia, B.; Dimitrios, M.; Simon, P.; Dionysis, B. Machine Learning in Agriculture: A Review. Sensors. 2018, 18, 2674. [Google Scholar] [CrossRef] [PubMed]
- Pound, M.P.; Atkinson, J.A.; Townsend, A.J.; Wilson, M.H.; Marcus, G.; Jackson, A.S.; Adrian, B.; Georgios, T.; Wells, D.M.; Murchie, E.H. Deep Machine Learning provides state-of-the-art performance in image-based plant phenotyping. Gigascience. 2018, 1–10. [Google Scholar] [CrossRef] [PubMed]
- Tian, Y.; Li, T.; Li, C.; Piao, Z.; Wang, B. Method for recognition of grape disease based on support vector machine. Transactions of the Chinese Society of Agricultural Engineering. 2007, 23, 175–180. [Google Scholar]
- Baldevbhai, P.J. Color Image Segmentation for Medical Images using L*a*b* Color Space. IOSR Journal of Electronics and Communication Engineering. 2012, 32, 11. [Google Scholar] [CrossRef]
- Chang, C.-C.; Lin, C.-J. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2, Article 27. [Google Scholar] [CrossRef]
- Tatsumi; Yamashiki; Torres; MAC; Taipe; CLR. Crop classification of upland fields using Random forest of time-series Landsat 7 ETM+ data. COMPUT ELECTRON AGR 2015, 2015, 115, 171–179. [CrossRef]
- Masci, J.G. , Alessandro; Ciresan, Dan; Fricout, Gabriel; Schmidhuber, Jurgen. A fast learning algorithm for image segmentation with max-pooling convolutional networks..in Proc. IEEE Int. Conf. Image Process 2013.
- Jeon, H.Y.; Tian, L.F.; Zhu, H. Robust Crop and Weed Segmentation under Uncontrolled Outdoor Illumination. Sensors. 2011, 11, 6270–6283. [Google Scholar] [CrossRef]
- Achanta, R.; Shaji, A.; Smith, K.; Lucchi, A.; Fua, P. ; Sabine. Süsstrunk. SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. IEEE transactions on pattern analysis and machine intelligence. 2012, 34, 2274–2282. [Google Scholar]
- Maggiori, E.; Tarabalka, Y.; Charpiat, G.; Alliez, P. Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing. 2017, 55, 645–657. [Google Scholar] [CrossRef]
- Chen, Y.; Lee, W.S.; Gan, H.; Peres, N.; Fraisse, C.; Zhang, Y.; He, Y. Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages. Remote Sensing. 2019, 11. [Google Scholar] [CrossRef]
- Oh, S.; Chang, A.; Ashapure, A.; Jung, J.; Dube, N.; Maeda, M.; Gonzalez, D.; Landivar, J. Plant Counting of Cotton from UAS Imagery Using Deep Learning-Based Object Detection Framework. Remote Sensing. 2020, 12, 2981. [Google Scholar] [CrossRef]
- Wu, J.; Yang, G.; Yang, H.; Zhu, Y.; Li, Z.; Lei, L.; Zhao, C. Extracting apple tree crown information from remote imagery using deep learning. Computers and Electronics in Agriculture. 2020, 174. [Google Scholar] [CrossRef]
- Freudenberg, M.; Nölke, N.; Agostini, A.; Urban, K.; Wörgötter, F.; Kleinn, C. Large Scale Palm Tree Detection In High Resolution Satellite Images Using U-Net. Remote Sensing. 2019, 11. [Google Scholar] [CrossRef]
- Yang, M.-D.; Tseng, H.-H.; Hsu, Y.-C.; Tsai, H.P. Semantic Segmentation Using Deep Learning with Vegetation Indices for Rice Lodging Identification in Multi-date UAV Visible Images. Remote Sensing. 2020, 12. [Google Scholar] [CrossRef]
- Liu, X.R.L.Z.C.Y.S.L.X.L.S. Counting cigar tobacco plants from UAV multispectral images via key points detection approach. Journal of Agricultural Machinery. 2023, 54, 266–273. [Google Scholar]
- Li, Q.; Yan, L.; Huang, D.; Zhou, Z.; Zhang, Y.; Xiao, D. Construction of a small sample dataset and identification of Pitaya trees (Selenicereus) based on UAV image on close-range acquisition. Journal of Applied Remote Sensing. 2022, 16. [Google Scholar] [CrossRef]
- Huang, L.; Wu, X.; Peng, Q.; Yu, X.; Camara, J.S. Depth Semantic Segmentation of Tobacco Planting Areas from Unmanned Aerial Vehicle Remote Sensing Images in Plateau Mountains. Journal of Spectroscopy 2021, 2021, 1–14. [Google Scholar] [CrossRef]
- Olaf Ronneberger, P.F. , and Thomas Brox; Computer Science Department and BIOSS Centre for Biological Signalling Studies. U-Net: Convolutional Networks for Biomedical Image Segmentation. 2015, 9351, 234–241. [Google Scholar]
- Liskowski, P.; Krawiec, K. Segmenting Retinal Blood Vessels WithDeep Neural Networks. IEEE Transactions on Medical Imaging 2016, 35, 2369–2380. [Google Scholar] [CrossRef] [PubMed]
- Ubbens, J.R.; Stavness, I. Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks. Frontiers in Plant Science 2017, 8. [Google Scholar] [CrossRef] [PubMed]
- Wei, S.; Zhang, H.; Wang, C.; Wang, Y.; Xu, L. Multi-Temporal SAR Data Large-Scale Crop Mapping Based on U-Net Model. Remote Sensing 2019, 11, 68. [Google Scholar] [CrossRef]
- Lucas Prado Osco a, M.d.S.d.A.b. , José Marcato Junior a. A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery. ISPRS Journal of Photogrammetry and Remote Sensing 2020, 160, 97–106. [Google Scholar]
- Kunlin,Zou, C.; Chen, X.; Zhang, F.; Zhou, H.; Zhang, C. A Field Weed Density Evaluation Method Based on UAV Imaging and Modified U-Net. Remote Sensing 2021, 13, 310. [Google Scholar]
- Zhou, Z.; Peng, R.; Li, R.; Li, Y.; Huang, D.; Zhu, M. Remote Sensing Identification and Rapid Yield Estimation of Pitaya Plants in Different Karst Mountainous Complex Habitats. Agriculture 2023, 13, 1742. [Google Scholar] [CrossRef]
- Khan, A.; Ilyas, T.; Umraiz, M.; Mannan, Z.I.; Kim, H. CED-Net: Crops and Weeds Segmentation for Smart Farming Using a Small Cascaded Encoder-Decoder Architecture. Electronics 2020, 9. [Google Scholar] [CrossRef]
- Shorten, C.; Khoshgoftaar, T.M. A survey on Image Data Augmentation for Deep Learning. Journal of Big Data 2019, 6, 48. [Google Scholar] [CrossRef]










| Scenes | Precision | Recall | F1-score | IOU |
|---|---|---|---|---|
| Smooth tectonics and weed-free (Ⅰ) | 0.76 | 0.86 | 0.81 | 0.67 |
| Smooth tectonics and unevenly growing (Ⅱ) | 0.74 | 0.89 | 0.81 | 0.67 |
| Smooth tectonics and weed-infested (Ⅲ) | 0.49 | 0.69 | 0.57 | 0.40 |
| Smooth tectonics and planted with smaller seedlings (Ⅳ) | 0.58 | 0.79 | 0.67 | 0.50 |
| Subsurface fragmented and weed-free (Ⅴ) | 0.85 | 0.84 | 0.84 | 0.73 |
| Surface fragmented and shadow-masked (Ⅵ) | 0.73 | 0.87 | 0.79 | 0.66 |
| Subsurface fragmented and weed-infested (Ⅶ) | 0.77 | 0.88 | 0.82 | 0.69 |
| Surface fragmented and planted with smaller seedlings (Ⅷ) | 0.77 | 0.79 | 0.78 | 0.64 |
| The whole image | 0.68 | 0.85 | 0.75 | 0.60 |
| Factor | Tobacco | Maize | Weeds | Shrub | Bare rock | White plastic |
|---|---|---|---|---|---|---|
| Typical incorrect recognition patches | ![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
| Misidentification | 1008072.52 | 367544 | 110935 | 7643 | 3204 | 2574 |
| Percentage | 67.21% | 24.50% | 7.40% | 0.51% | 0.21% | 0.17% |
| Scenes | Precision | Recall | F1-score | Iou |
|---|---|---|---|---|
| Smooth tectonics and weed-free (Ⅰ) | 10.93% | 0.77% | 6.16% | 9.10% |
| Smooth tectonics and unevenly growing(Ⅱ) | 3.82% | -9.35% | -2.08% | -2.87% |
| Smooth tectonics and weed-infested(Ⅲ) | 25.31% | 7.68% | 18.10% | 20.34% |
| Smooth tectonics and planted with smaller seedlings(Ⅳ) | 22.81% | -7.81% | 8.92% | 10.74% |
| Subsurface fragmented and weed-free (Ⅴ) | 0.78% | -4.17% | -1.80% | -2.65% |
| Surface fragmented and shadow-masked (Ⅵ) | 16.92% | -8.65% | 4.29% | 6.10% |
| Subsurface fragmented and weed-infested (Ⅶ) | 15.72% | -6.97% | 4.34% | 6.44% |
| Surface fragmented and planted with smaller seedlings (Ⅷ) | 4.59% | -25.21% | -13.18% | -15.93% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).





