1. Introduction
Tomatoes, renowned for their nutritional richness in minerals, vitamins, fiber, and amino acids, play a vital role in the global food supply. Researchers have also unveiled their potential in reducing cancer risks, elevating their significance in a balanced diet. However, the agricultural sector encounters formidable challenges, notably the persistent issue of tomato infections that impede sustained development. Among these challenges, powdery mildew, attributed to the Leveillula Taurica pathogen, emerges as a prevalent fungal ailment exacerbated by unpredictable weather patterns. The conventional methods of disease detection involve laborious processes, often relying on expert inspection through naked eye examination. This not only proves time-consuming but is also limited in its accuracy and location-specific nature [
1].
Beyond the prevalent powdery mildew caused by the Leveillula Taurica pathogen, other fungal pathogens contribute to substantial crop losses. Plant diseases come in various forms, primarily categorized into microorganisms, viral, and fungal pathogens. Bacterial infections, caused by microorganisms, often result in symptoms like wilting, leaf spots, and cankers, profoundly impacting overall plant health. Fungal diseases represent a broad category of plant pathogens, with diverse impacts on agriculture. Oomycetes, often confused with fungi, cause diseases like late blight in crops such as potatoes and tomatoes. Additionally, various fungal species, including rusts, smuts, and damping-off agents, infect different plant parts, leading to symptoms ranging from leaf discoloration to seedling death. Moreover, the
Figure 1 can elucidate the classification of plant diseases into three distinct types, clearly delineating which specific diseases fall under the categories of microorganism, viral, and fungal pathogens. This visual representation would serve to enhance the understanding of the diverse nature of plant diseases and their respective classifications within the broader spectrum of agricultural challenges. The intricate nature of fungal diseases underscores the importance of developing robust strategies for their identification and management in order to safeguard global crop production and food security.
In response to these agricultural impediments, this research proposes an innovative solution by integrating hyperspectral imaging and deep learning techniques to detect crop disease and its severity. Powdery mildew severity in tomato plants is to be assessed through the conversion of normal images into hyperspectral-like representations. This approach presents a shift towards more efficient disease detection and management. The use of hyperspectral imaging brings a three-dimensional perspective, amalgamating spatial and spectral dimensions. This comprehensive data collection surpasses the capabilities of traditional RGB and multispectral imaging, capturing rich spectral information across hundreds or even thousands of spectral bands.
Despite the promising prospects of hyperspectral imaging, challenges such as expensive and specialized hardware, and limitations in spatial and temporal resolutions persist. Researchers, however, are exploring computational methods for reconstructing hyperspectral data from RGB measurements. This opens up potential applications, ranging from data augmentation for deep neural network training to computational scene imaging. With improvements in spectroscopy and imaging technologies in recent decades, hyperspectral imaging (HSI) technology has evolved as a highly efficient non-destructive measuring approach. Originally developed for remote sensing, this technology is now widely utilised in resource management, agriculture, mineral exploration, and environmental monitoring. Certain features of the tomato leaf allow HSI to be used to check its water condition. Tomato leaves lose more than 90% of the water they take through transpiration, making them more vulnerable to water stress than other organs such as the fruit. In the pursuit of elucidating the intricacies of leaf morphological characteristics, a judiciously chosen region of interest (ROI) plays a pivotal role. The imaging protocol involved the deliberate application of a lone wavelength, precisely calibrated at 1390 nm. This specific wavelength is purposefully employed due to its capacity to capture minute features relevant to leaf morphology with heightened precision. The culmination of this meticulous approach is the generation of a two-dimensional image a sample of which is shown in
Figure 2, portraying a detailed and refined representation of the leaf's morphological intricacies under the influence of the specified 1390 nm wavelength [
3].
K. Lin et al. [
4] introduces a novel deep learning scheme for powdery mildew infection representation, utilizing masked regions from a segmentation model for precise severity assessment. Distinguished by its simplicity and lack of reliance on expensive specialized imaging equipment, the proposed method outperforms traditional segmentation approaches, providing both area and shape information for disease regions. Comparative analysis with K-means, Random Forest, and Gradient Boosting Decision Tree methods highlights the superior representation ability of the deep learning-based approach. Nevertheless, it is essential to acknowledge certain limitations inherent in this methodology. Implementation of the proposed method necessitates the acquisition of images under controlled conditions, precluding its direct application in field settings. Furthermore, the restricted size and diversity of annotated datasets pose challenges, as their dataset lacks symptoms attributed to other disorders, potentially impacting the performance of deep learning methods, as highlighted by Barbedo [
5]. Consequently, it becomes imperative to minimize the presence of other types of leaf damage to mitigate potential confounding factors. In the realm of plant disease detection, Lin et al. employ a novel deep learning approach using masked regions for powdery mildew severity assessment. While demonstrating superior performance, it is limited to controlled conditions. Nguyen et al. [
6] published in Sensors, focuses on early plant viral disease detection through a synergistic combination of hyperspectral imaging and deep learning. This paper explores the use of hyperspectral imaging for early detection of Grapevine Vein-Clearing Virus (GVCV) in Chardonel grapevines. It investigates spectral differences, identifies important vegetation indices, and develops classification methods for early disease detection. The research introduces novel methodologies, including statistical tests to differentiate reflectance spectra between healthy and infected plants, as well as an exploratory analysis to identify crucial disease-centric vegetation indices. The predominant factor contributing to limitations in image-wise classification was the constrained sample size, consisting of only 40 images. In contrast, while both Vegetation Index (VI)-based and pixel-based methods primarily focused on spectral features, the image-based approach concurrently extracted joint spatial–spectral features. However, the inclusion of spatial features introduced potential noise, particularly evident in the highly fragmented portions of grapevines extracted instead of capturing the entirety of individual plants in each image. Nguyen et al. [
6] explored hyperspectral imaging for early plant viral disease detection, facing challenges with a constrained sample size. Pushparaj et al. [
7] makes a substantial contribution by conducting a comparative analysis of several Convolutional Neural Network (CNN)-based methods employed in hyperspectral image reconstruction. The evaluation utilizes the NTIRE 2020 challenge dataset and specifically examines the performance of distinct models, encompassing a 5-layer basic CNN, Enhanced-ResNet with 10 layers, and Dense-HSCNN. Through a meticulous exploration of these models, the study seeks to provide nuanced insights into their respective efficiencies. The ultimate goal is to identify the most effective model, thereby enhancing our understanding of hyperspectral imaging techniques and contributing to advancements in the field. The research is positioned as a valuable resource for practitioners seeking optimal strategies for hyperspectral image reconstruction. Pushparaj et al. [
7] conduct a comparative analysis of CNN-based methods in hyperspectral image reconstruction, contributing valuable insights. L. Yan et al. [
8] presents a pioneering CNN based framework designed for the recovery of hyperspectral information from RGB images. The innovation lies in the incorporation of prior category information, specifically pertaining to object material and coordinate data. By integrating this additional information, the proposed framework aims to enhance the stability and robustness of hyperspectral image reconstructions. A key contribution of the paper is the introduction of a comprehensive hyperspectral dataset, boasting 128 channels and accompanied by labeled prior information. This dataset not only serves as a benchmark for evaluating the efficacy of the introduced framework but also stands as a valuable resource for researchers engaged in the exploration and analysis of spectral imaging. Yan et al. present a CNN-based framework for hyperspectral information recovery, introducing a comprehensive dataset. Building upon these works, our proposed model integrates RGB to SHSI conversion, leveraging pretrained VGG-16, and incorporates Gaussian Mixture Models for precise severity determination. This innovative framework aims to address limitations in existing methods, offering a nuanced approach to enhance plant disease severity detection in agricultural settings.
Hence, the primary objectives of this project are as follows:
Develop a deep learning model for converting standard RGB images into simulated hyperspectral images.
Investigate the utility of simulated hyperspectral images for powdery mildew spot severity assessment in plants.
Implement a feature extraction process for analyzing hyperspectral-like data to quantify disease severity.
Evaluate the performance of the proposed system and its potential for practical application in agriculture.