4. Analysis
The evaluation of the leaf disease and invasive species detec-tion algorithm focused on key performance metrics, particu-larly highlighting areas of success and potential improvement in identifying invasive species.
4.1. Example Output of the Algorithm
The output illustrates data of leaf arrangement, where several leaflets emanate from a common point.
Neural Network Model for Detecting Leaf Diseases and Assessing Invasive Species: A Computational Approach — 6/8.
The color analysis shows that 51.89% of the leaf is green, indicating general health, while small amounts of yellow (0.27%) suggest early stages of aging or environmental stress. Brown coloration (0.0%) is absent, pointing to a lack of signif-icant decay or disease. The leaf margins are serrated, observed in 93 instances.
This species is identified as native to temperate and trop-ical regions, and no signs of invasive species were detected. The morphological traits and color analysis confirm the leaf’s typical features for its ecological setting.
4.2. Performance Evaluation Metrics
The classification performance for each category (healthy, dis-eased, and invasive) was assessed using the following metrics:
Accuracy: Measures overall correctness across all cate-gories.
Precision: Indicates the proportion of true positive predictions relative to all positive predictions.
Recall (Sensitivity): Reflects the model’s ability to capture true positives among all actual positive cases.
F1-Score: Combines precision and recall, providing a balanced measure of the model’s effectiveness, espe-cially when dealing with imbalanced datasets.
Results indicated strong performance in detecting healthy and diseased leaves, while the invasive species detection ex-hibited lower precision and recall. This discrepancy highlights the inherent challenge of distinguishing invasive species based on their subtle morphological differences from native or dis-eased species.
Table 1.
Performance Evaluation Metrics for Leaf Detection and Classification.
Table 1.
Performance Evaluation Metrics for Leaf Detection and Classification.
| Category |
Accuracy |
Precision |
Recall |
F1-Score |
| Healthy |
98.2% |
97.8% |
98.4% |
98.1% |
| Diseased |
95.7% |
95.3% |
95.9% |
95.6% |
| Invasive |
92.1% |
91.7% |
92.4% |
92.0% |
4.3. Invasive Species Detection Performance
Invasive species detection proved to be the most challenging task for the model. With an accuracy of 92.1%, precision and recall metrics slightly lagged behind those of the healthy and diseased categories, primarily due to class imbalance and morphological similarities between invasive species and native plants.
Several invasive species were particularly difficult to iden-tify, such as Phragmites australis and Ailanthus altissima, which closely resemble some native species or those suffering from certain diseases. Despite these challenges, data aug-mentation strategies, including rotation and scaling, helped mitigate the issue to some extent by enriching the training data for invasive species.
4.4. Addressing Class Imbalance in Invasive Species Detection
One of the primary factors contributing to the reduced accu-racy in detecting invasive species was the imbalance in the dataset, where invasive species were underrepresented. To address this issue, I employed several strategies:
Data augmentation: I applied transformations such as flipping, rotation, and scaling to artificially inflate the dataset of invasive species, allowing the model to learn from more diverse examples.
Transfer learning: Fine-tuning a pre-trained model helped improve feature extraction, as the base model had already been trained on a large, diverse image set, which gave it an advantage in detecting the finer details that distinguish invasive species.
The result was an increase in detection accuracy, though further improvement could still be made by collecting more in-vasive species data and refining the feature extraction process to focus on distinct morphological traits.
4.5. Cross-Validation and Generalization Capability
To ensure the model’s robustness, I used k-fold cross-validation (with k = 5) to assess its generalization ability. The model consistently achieved strong performance across the folds, with an average accuracy of 93.5%, which validates its ability to handle unseen data effectively.
Moreover, when tested on an external dataset, the model demonstrated similar levels of accuracy, particularly in detect-ing healthy and diseased leaves. However, invasive species
Neural Network Model for Detecting Leaf Diseases and Assessing Invasive Species: A Computational Approach — 7/8 detection continued to lag, indicating a need for further re-finement in detecting these subtle morphological cues in real-world applications.
4.6. Hyperparameter Tuning and Model Optimization
Hyperparameter tuning played a critical role in improving the model’s performance. Grid search optimization helped iden-tify the best combination of learning rate, dropout rate, and batch size, which significantly impacted the model’s ability to generalize without overfitting. The optimal combination (learning rate: 0.0001, dropout rate: 0.5) provided a balance between training stability and performance on the test set.
4.7. Error Analysis and Future Directions
While the model excelled at detecting diseases and healthy leaves, further improvements are needed for invasive species detection. Future research will focus on expanding the dataset, particularly for underrepresented invasive species, and refin-ing the feature extraction pipeline to emphasize traits specific to invasive species.
Integrating additional biological information, such as en-vironmental factors or leaf venation patterns, may improve the model’s capacity to accurately differentiate between in-vasive species and diseases. Moreover, incorporating higher-resolution images or multispectral data could provide new avenues for detecting subtle differences in leaf morphology.