Submitted:
08 June 2026
Posted:
09 June 2026
You are already at the latest version
Abstract
Keywords:
1. Introduction
- Primary contribution: slide leakage fabricates accuracyandarchitectural conclusions on the NIH malaria benchmark. We re-evaluate an identical architecture under a leakage-free slide-disjoint protocol, a group split on the slide identifier with three seeds. Accuracy then drops from % to %. This pp fall is itself within the seed standard deviation. Our evidence is therefore not the headline magnitude but the unanimous direction. Every one of the eight tested architectures inflated the same way, and every design conclusion below collapses. Leakage manufactures spurious design conclusions. First, every per-module ablation gain reported under per-cell splitting, namely +0.78/+0.38/+0.56/+0.37 pp, collapses to within seed noise and partly inverts, as detailed in Section 4.4. Second, a prototype-cosine classifier variant appears to deliver a striking +7.0 pp cross-site robustness gain under per-cell training. When both models are retrained under the leakage-free protocol, it gives only +1.8 pp within ±5.5 pp seed noise. The “robustness variant” is itself a leakage artefact, as shown in Section 4.8. Slide leakage thus invents plausible-looking innovations, not merely larger numbers. We recommend slide-disjoint evaluation become standard for this benchmark.
- A leakage-free, on-device-validated compact baseline. What survives rigorous evaluation is a single honest artifact. Under the slide-disjoint protocol, the 21 K-parameter detector reaches ≈95.6% while fitting the STM32H743 envelope. On-chip, it uses 23.5 KB INT8 weights and runs a measured 816 ms per cell, a 1.23 FPS triage rate, for a numerically-faithful forward pass. INT8 preserves FP32 accuracy within pp. This provides an honestly benchmarked, deployable reference for point-of-care malaria biosensing rather than an inflated one.
- A rigorously-validated interference-robustness advantage. The portable-microscope scenario actually requires resilience to imaging degradation. On this property, under a leakage-free 3-seed all-CNN degradation sweep, the compact model is the 2nd-most-robust of eight CNNs, with an accuracy drop of pp from S0 to S5, as reported in Section 4.10. It trails only the -larger, non-deployable ResNet-18, and is, by a seed-consistent margin, the most robust MCU-deployable model. Unlike the per-module ablations and the prototype variant, this advantage survives leakage-free evaluation. Knowledge distillation from the leakage-free EfficientNet-B0 teacher additionally recovers ≈1/3 of the clean-accuracy gap, from % to %, at zero inference cost, as reported in Section 4.11. We report it honestly as a partial mitigation, not a gap-closer.
2. Related Work
2.1. Deep Learning for Malaria Detection on the NIH Benchmark
2.2. Lightweight CNN Architectures
2.3. TinyML and IoT in Healthcare
2.4. Data Leakage and Evaluation Rigor in Medical-Imaging ML
3. Proposed Method
3.1. Overview

3.2. Morphology Stem
3.3. Stain-Color Feature Extractor (SCFE)
3.3.1. Motivation
3.3.2. Design
3.4. Multi-Scale Morphology Encoder (MSME)
3.4.1. Motivation
- Ring-form trophozoites: 1–2 m diameter, mapping to ∼2–4 pixels at resolution. Characterized by small, sharp chromatin dots.
- Mature trophozoites: 5–8 m, mapping to ∼8–12 pixels. Larger cytoplasmic area with visible pigment granules.
- Schizonts: 10–20 m, mapping to ∼15–30 pixels. Contain multiple merozoites with distinct boundaries.
3.4.2. Design
- Fine branch: Standard depthwise convolution, targeting ring-form structures and chromatin dots (2–5 pixel features).
- Medium branch: Two stacked depthwise convolutions (effective receptive field), targeting mature trophozoites (8–12 pixel features). Stacking avoids the parameter cost of a direct kernel.
- Coarse branch: depthwise convolution with dilation rate 2, targeting schizonts and larger structures (15–30 pixel features). The Medium and Coarse branches share a theoretical receptive field but differ critically in sampling pattern. The Medium branch samples densely to capture continuous textures such as pigment granules. The Coarse branch instead samples sparsely with gaps, capturing boundary and edge features at wider spatial extent. After the stem’s downsampling, the dilated receptive field covers ∼20 pixels in the original image, matching schizont dimensions.
3.5. Cross-Domain Diagnostic Gate (CDDG)
3.5.1. Motivation
3.5.2. Design
3.6. Prototype Cosine Head (Variant Used as a Leakage Case Study)
3.7. Multi-Task Head
- Classification head: A single FC layer (64 to 2) for infection detection (parasitized vs. uninfected).
- Burden estimation head: A single FC layer (64 to 1) with sigmoid activation, predicting a continuous parasite burden score in . The burden score is auto-generated from image analysis as the normalized dark-stain pixel ratio within each cell, serving as a proxy for parasite load.
3.8. Complexity Analysis
4. Experiments
- 1.
- How much the per-cell protocol inflates the headline accuracy relative to slide-disjoint evaluation, across all models.
- 2.
- Whether the per-module ablation gains reported under per-cell splitting survive leakage-free evaluation; they do not.
- 3.
- On-device deployment measurements on STM32H743 hardware, which are split-independent.
- 4.
- Characterising, not claiming, the cross-dataset failure mode and the per-cell-only robustness illustration.
4.1. Experimental Setup
4.1.1. Dataset
4.1.2. Evaluation Protocol: Per-Cell vs. Slide-Disjoint
4.1.3. Compared Methods
- Tiny-MobileNetV2 (width=0.1): 89 K parameters, MobileNetV2 scaled down with width multiplier 0.1.
- SingleStream: 8 K parameters, a single-stream depthwise-separable CNN with the same computational budget as MalariaNet but without domain-specific design.
4.1.4. Training Details
4.1.5. Evaluation Metrics
4.2. Main Results Under the Per-Cell Protocol (Literature-Standard, Optimistic)
4.3. Clinical Decision Metrics Under Endemic Prevalence
4.4. Ablation Study Under Slide-Disjoint Evaluation
- 1.
- Per-module gains do not survive rigorous evaluation. The full model (95.61±1.02%) differs from SingleStream by only +0.24 pp, from Uniform-scale MSME by +0.07 pp, and is in fact marginally lower than w/o SCFE (−0.03 pp) and w/o CDDG (−0.08 pp). Every difference is far smaller than the ≈1 pp seed-to-seed standard deviation, and none is statistically distinguishable. No contrast attains significance even uncorrected, so multiple-comparison control such as Bonferroni or Holm would only widen these intervals and reinforce the null. Such correction is therefore not the binding consideration here. We consequently do not claim individually validated per-module contributions.
- 2.
- The per-cell protocol inflated both the headline and every ablation delta. Under the optimistic per-cell split the same architecture reported 97.06 % with module gains of +0.78/+0.38/+0.56/+0.37 pp. Under slide-disjoint evaluation the headline falls by 1.45 pp and the module gains collapse to within noise and partly invert. This quantifies how strongly slide leakage flatters NIH-malaria results. To our knowledge, this methodological caution has not been quantified for this benchmark, and we regard it as a contribution in its own right, as discussed in Section 5.
- 3.
- What the architecture does provide is a compact 21 K-parameter detector that remains at ≈95.6 % under rigorous evaluation while fitting the STM32H7 envelope, as quantified in Section 4.5. Consider the prototype-cosine variant MalariaNet-P. Its apparent +7 pp cross-site gain under per-cell training is shown in Section 4.8 to be a per-cell-training leakage artefact, collapsing to +1.8 pp within ±5 pp seed noise under slide-disjoint training. We therefore do not claim it as a robustness contribution. We retain it only as a case study of leakage fabricating an apparent innovation. We position the stain–morphology decomposition as an interpretable, parameter-frugal design, not as a set of separately significant ablation gains.
4.5. Deployment Analysis
4.6. Comparison with Published Methods
4.7. Cross-Dataset Generalization: Per-Cell-Trained, Interpret with the Leakage Caveat

4.8. Case Study: Leakage Fabricates an Apparent “Robustness Variant”
4.9. Multi-Task Results (Per-Cell, Not Re-Evaluated Leakage-Free)
4.10. Robustness to Imaging Interference Across Compared Models
4.11. Knowledge Distillation: A Partial, Honest Mitigation of the Pretraining Gap
4.12. Visualising the Leakage Effect
5. Discussion
5.1. Slide Leakage and Its Consequences for the MCU-Malaria Literature
5.2. MalariaNet as an IoT Edge Diagnostic Agent
5.3. Practical Deployment Considerations
5.4. Limitations
6. Conclusion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| CNN | Convolutional Neural Network |
| MCU | Microcontroller Unit |
| POC | Point-of-Care |
| SCFE | Stain-Color Feature Extractor |
| MSME | Multi-Scale Morphology Encoder |
| CDDG | Cross-Domain Diagnostic Gate |
| INT8 | 8-bit Integer Quantization |
| FP32 | 32-bit Floating Point |
| AUC | Area Under the Curve |
| ROC | Receiver Operating Characteristic |
| PPV | Positive Predictive Value |
| NPV | Negative Predictive Value |
| NIH | National Institutes of Health |
| BBBC | Broad Bioimage Benchmark Collection |
| RDT | Rapid Diagnostic Test |
| WHO | World Health Organization |
References
- World Health Organization. World malaria report 2023. Technical report, World Health Organization, Geneva, 2023.
- Mujahid, M.; Rustam, F.; Shafique, R.; Montero, E.C.; Alvarado, E.S.; de la Torre Diez, I.; Ashraf, I. Efficient deep learning-based approach for malaria detection using red blood cell smears. Scientific Reports 2024, 14, 13249. [CrossRef]
- Poostchi, M.; Silamut, K.; Maude, R.J.; Jaeger, S.; Thoma, G. Image analysis and machine learning for detecting malaria. Translational Research 2018, 194, 36–55. [CrossRef]
- Fuhad, K.M.F.; Tuba, J.F.; Sarker, M.R.A.; Momen, S.; Mohammed, N.; Rahman, T. Deep Learning Based Automatic Malaria Parasite Detection from Blood Smear and Its Smartphone Based Application. Diagnostics 2020, 10, 329. [CrossRef]
- Warden, P.; Situnayake, D. TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers; O’Reilly Media, 2019.
- Yang, F.; Poostchi, M.; Yu, H.; Zhou, Z.; Silamut, K.; Yu, J.; Maude, R.J.; Jaeger, S.; Antani, S. Deep Learning for Smartphone-Based Malaria Parasite Detection in Thick Blood Smears. IEEE Journal of Biomedical and Health Informatics 2020, 24, 1427–1438. [CrossRef]
- Islam, M.R.; Nahiduzzaman, M.; Goni, M.O.F.; et al. Explainable transformer-based deep learning model for the detection of malaria parasites from blood cell images. Sensors 2022, 22, 4358. [CrossRef]
- Chaudhry, H.A.H.; Farid, M.S.; Fiandrotti, A.; Grangetto, M. A lightweight deep learning architecture for malaria parasite-type classification and life cycle stage detection. Neural Computing and Applications 2024, 36, 19795–19805. [CrossRef]
- Sandler, M.; Howard, A.; Zhu, M.; Zhmoginov, A.; Chen, L.C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2018, pp. 4510–4520. [CrossRef]
- Ma, N.; Zhang, X.; Zheng, H.T.; Sun, J. ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design. In Proceedings of the Computer Vision – ECCV 2018; Ferrari, V.; Hebert, M.; Sminchisescu, C.; Weiss, Y., Eds., Cham, 2018; pp. 122–138. [CrossRef]
- Tan, M.; Le, Q. EfficientNet: Rethinking model scaling for convolutional neural networks. In Proceedings of the ICML, 2019, pp. 6105–6114. [CrossRef]
- Lin, J.; Chen, W.M.; Lin, Y.; et al. MCUNet: Tiny deep learning on IoT devices. In Proceedings of the NeurIPS, 2020, Vol. 33, pp. 11711–11722. [CrossRef]
- Lai, L.; Suda, N.; Chandra, V. CMSIS-NN: Efficient neural network kernels for Arm Cortex-M CPUs. arXiv preprint arXiv:1801.06601 2018. [CrossRef]
- Ponnada, S.; Tak, T.K.; Kshirsagar, P.R.; et al. Expanding Applications of TINYML in Versatile Assistive Devices: From Navigation Assistance to Health Monitoring System Using Optimised NASNET-XGBOOST Transfer Learning. IEEE Access 2024, 12, 168328–168338. [CrossRef]
- Zeynali, M.; Alipour, K.; Tarvirdizadeh, B.; Ghamari, M. Non-invasive blood glucose monitoring using PPG signals with various deep learning models and implementation using TinyML. Scientific Reports 2025, 15, 581. [CrossRef]
- Kapoor, S.; Narayanan, A. Leakage and the reproducibility crisis in machine-learning-based science. Patterns 2023, 4, 100804. [CrossRef]
- Obuchowicz, R.; Strzelecki, M.; Piórkowski, A. Clinical Applications of Artificial Intelligence in Medical Imaging and Image Processing: A Review. Cancers 2024, 16, 1870. [CrossRef]
- Ruifrok, A.C.; Johnston, D.A. Quantification of histochemical staining by color deconvolution. Analytical and Quantitative Cytology and Histology 2001, 23, 291–299.
- Hu, J.; Shen, L.; Sun, G. Squeeze-and-Excitation Networks. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2018, pp. 7132–7141. [CrossRef]
- Snell, J.; Swersky, K.; Zemel, R. Prototypical Networks for Few-shot Learning. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), 2017, Vol. 30, pp. 4077–4087. [CrossRef]
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016, pp. 770–778. [CrossRef]
- Nettur, S.B.; Karpurapu, S.; Nettur, U.; Gajja, L.S.; Myneni, S.; Dusi, A.; Posham, L. UltraLightSqueezeNet: A deep learning architecture for malaria classification with up to 54x fewer trainable parameters for resource constrained devices. arXiv preprint arXiv:2501.14172 2025. [CrossRef]
- Ljosa, V.; Sokolnicki, K.L.; Carpenter, A.E. Annotated high-throughput microscopy image sets for validation. Nature Methods 2012, 9, 637. [CrossRef]
- Chattopadhyay, A.; Sarkar, A.; Howlader, P.; Balasubramanian, V.N. Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks. In Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), March 2018, pp. 839–847. [CrossRef]









| Component | Parameters | Percentage |
|---|---|---|
| Stem | 1,072 | 5.1% |
| SCFE (Stain stream) | 721 | 3.4% |
| MSME (Morphology stream) | 9,376 | 44.4% |
| CDDG (Gate) | 2,682 | 12.7% |
| Head | 7,194 | 34.1% |
| BN & biases | 40 | 0.2% |
| Total | 21,085 | 100% |
| Model | Params | Size (KB) | Per-cell Acc (%) | Slide-disj. Acc (%) | (pp) | MCU |
|---|---|---|---|---|---|---|
| ResNet-18 | 11.18M | 43,700 | 96.15 | No | ||
| MobileNetV2 | 2.23M | 8,832 | 96.90 | No | ||
| EfficientNet-B0 | 4.01M | 15,832 | 97.22 | No | ||
| MobileNetV3-Small | 1.52M | 5,985 | 97.37 | No | ||
| ShuffleNetV2-x0.5 | 340K | 1,375 | 97.58 | No | ||
| Tiny-MobileNetV2 | 89K | 375 | 96.69 | No | ||
| SingleStream | 8K | 34 | 96.28 | Yes | ||
| MalariaNet (Ours) | 21K | 85 | 97.06 | Yes |
| Prevalence | PPV | NPV | Setting (typical) |
|---|---|---|---|
| 0.5% | 15.4% | 99.97% | Low-transmission elimination |
| 1% | 26.8% | 99.94% | Mesoendemic, dry season |
| 5% | 65.6% | 99.67% | Hyperendemic, baseline |
| 10% | 80.1% | 99.31% | High endemic, sub-Saharan |
| 20% | 90.1% | 98.5% | Peak-season epidemic |
| 50% | 97.3% | 94.1% | Balanced split (reference) |
| Configuration | Acc (%) | Sens (%) | Spec (%) | AUC | Acc |
|---|---|---|---|---|---|
| SingleStream (no decoupling) | |||||
| w/o SCFE (no stain stream) | |||||
| w/o CDDG (simple concat) | |||||
| Uniform scale MSME | |||||
| Full MalariaNet | n/a |
| Model | Size (KB) | FLOPs (M) | <200 KB | Slide-disj. Acc (%) |
|---|---|---|---|---|
| ResNet-18 | 43,700 | 595.4 | No | 95.90 |
| MobileNetV2 | 8,832 | 106.5 | No | 96.51 |
| EfficientNet-B0 | 15,832 | 135.6 | No | 96.75 |
| MobileNetV3-Small | 5,985 | 20.8 | No | 96.13 |
| ShuffleNetV2-x0.5 | 1,375 | 14.2 | No | 96.56 |
| Tiny-MobileNetV2 | 375 | 11.0 | No | 95.83 |
| SingleStream | 34 | 3.3 | Yes | 95.37 |
| MalariaNet | 85 | 4.8 | Yes | 95.61 |
| Metric | Measured Value |
|---|---|
| MCU | STM32H743IIT6 @ 400 MHz (board-limited; chip rated 480 MHz) |
| INT8 weights (Flash) | 23.5 KB |
| Code size (Flash) | 23.8 KB |
| Activation SRAM | 489 KB |
| Latency (, measured) | ms / 326.4 M cycles (1.23 FPS) |
| Latency range () | 816.0–816.3 ms (<0.3 ms) |
| On-chip kernel fidelity, max|C−ref| |
| Method | Year / Venue | Params | Acc (%) | MCU-Deployable |
|---|---|---|---|---|
| Custom CNN [3] | 2018 / Transl. Res. | ∼1M | 95.9 | No |
| Fuhad et al. [4] | 2020 / Diagnostics | – | 99.2 | No |
| Islam et al. (ViT) [7] | 2022 / Sensors | ∼86M | 95.0 | No |
| Mujahid et al. [2] | 2024 / Sci. Reports | 7.8M | 97.6 | No |
| Chaudhry et al. [8] | 2024 / Neural Comp. App. | <400K | 97.1 | No |
| UltraLightSqueezeNet-V3 [22] | 2025 / arXiv | ∼120K | 96.6 | Possible |
| MalariaNet (Ours), per-cell | – | 21K | 97.06±0.45 | Yes |
| MalariaNet (Ours), slide-disjoint | – | 21K | 95.61±1.02 | Yes |
| Model | Acc (%) | Sens (%) | Spec (%) | AUC |
|---|---|---|---|---|
| SingleStream | 48.44 | 97.55 | 8.30 | 0.539 |
| Tiny-MobileNetV2 | 59.74 | 97.76 | 28.67 | 0.850 |
| MalariaNet | 63.79 | 96.33 | 37.20 | 0.830 |
| MalariaNet w/o SCFE | 74.03 | 88.42 | 62.27 | 0.873 |
| Training protocol | Model | NIH acc (%) | BBBC041 acc (%) |
|---|---|---|---|
| Per-cell (leaky) | MalariaNet | ||
| MalariaNet-P | |||
| Slide-disjoint | MalariaNet | ||
| MalariaNet-P |
| Metric | Value |
|---|---|
| Classification Task | |
| Accuracy (%) | 96.57 ± 0.37 |
| Sensitivity (%) | 96.13 ± 0.33 |
| Specificity (%) | 97.00 ± 1.02 |
| AUC | 0.9923 ± 0.002 |
| Burden Estimation Task | |
| MAE (all samples) | 0.027 ± 0.006 |
| Correlation (all) | 0.748 ± 0.10 |
| MAE (parasitized only) | 0.041 ± 0.010 |
| Correlation (parasitized) | 0.732 ± 0.10 |
| Model | |
| Additional parameters | 65 (<0.3%) |
| Total size | 85.5 KB |
| Model | Params | S0 (%) | S5 (%) | Drop (pp) | MCU |
|---|---|---|---|---|---|
| ResNet-18 | 11.18M | 95.90 | 77.14 | No | |
| MalariaNet | 21K | 95.61 | 73.78 | Yes | |
| Tiny-MobileNetV2 | 89K | 95.83 | 72.98 | No | |
| MobileNetV2 | 2.23M | 96.51 | 73.14 | No | |
| EfficientNet-B0 | 4.01M | 96.75 | 72.71 | No | |
| ShuffleNetV2-x0.5 | 340K | 96.56 | 68.33 | No | |
| SingleStream | 8K | 95.37 | 66.79 | Yes | |
| MobileNetV3-Small | 1.52M | 96.13 | 62.42 | No |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.