Submitted:
04 October 2025
Posted:
06 October 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Dataset Preparation
2.2. Model Architecture
2.3. Training Configuration and Optimization
2.4. Data Augmentation
2.5. Model Performance Monitoring and Evaluation
3. Results
3.1. Model Performance
3.2. Results with Data Augmentation
3.3. Model Performance with Data Augmentation
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Guo, W.; Wang, H.; Li, C. Signal pathways of melanoma and targeted therapy. Signal Transduction and Targeted Therapy 2021, 6, 424. [Google Scholar] [CrossRef] [PubMed]
- Platz, A.; Egyhazi, S.; Ringborg, U.; Hansson, J. Human cutaneous melanoma; a review of NRAS and BRAF mutation frequencies in relation to histogenetic subclass and body site. Molecular Oncology 2008, 1, 395–405. [Google Scholar] [CrossRef]
- Thomas, N.E.; Edmiston, S.N.; Alexander, A.; Groben, P.A.; Parrish, E.; Kricker, A.; Armstrong, B.K.; Anton-Culver, H.; Gruber, S.B.; From, L.; et al. Association Between NRAS and BRAF Mutational Status and Melanoma-Specific Survival Among Patients With Higher-Risk Primary Melanoma. JAMA Oncology 2015, 1, 359. [Google Scholar] [CrossRef]
- Kim, H.J.; Kim, Y.H. Molecular Frontiers in Melanoma: Pathogenesis, Diagnosis, and Therapeutic Advances. International Journal of Molecular Sciences 2024, 25, 2984. [Google Scholar] [CrossRef]
- Palmieri, G.; Capone, M.; Ascierto, M.L.; Gentilcore, G.; Stroncek, D.F.; Casula, M.; Sini, M.C.; Palla, M.; Mozzillo, N.; Ascierto, P.A. Main roads to melanoma. Journal of Translational Medicine 2009, 7, 86. [Google Scholar] [CrossRef]
- Craig, S.; Earnshaw, C.H.; Virós, A. Ultraviolet light and melanoma. The Journal of Pathology 2018, 244, 578–585. [Google Scholar] [CrossRef]
- Arnold, M.; Singh, D.; Laversanne, M.; Vignat, J.; Vaccarella, S.; Meheus, F.; Cust, A.E.; De Vries, E.; Whiteman, D.C.; Bray, F. Global Burden of Cutaneous Melanoma in 2020 and Projections to 2040. JAMA Dermatology 2022, 158, 495. [Google Scholar] [CrossRef] [PubMed]
- De Pinto, G.; Mignozzi, S.; La Vecchia, C.; Levi, F.; Negri, E.; Santucci, C. Global trends in cutaneous malignant melanoma incidence and mortality. Melanoma Research 2024, 34, 265–275. [Google Scholar] [CrossRef]
- Gershenwald, J.E.; Guy, G.P. Stemming the Rising Incidence of Melanoma: Calling Prevention to Action. JNCI: Journal of the National Cancer Institute 2016, 108. [Google Scholar] [CrossRef] [PubMed]
- Elder, D.E. Precursors to melanoma and their mimics: nevi of special sites. Modern Pathology 2006, 19, S4–S20. [Google Scholar] [CrossRef]
- Raluca Jitian (Mihulecea), C.; Frățilă, S.; Rotaru, M. Clinical-dermoscopic similarities between atypical nevi and early stage melanoma. Experimental and Therapeutic Medicine 2021, 22, 854. [Google Scholar] [CrossRef]
- Liu, P.; Su, J.; Zheng, X.; Chen, M.; Chen, X.; Li, J.; Peng, C.; Kuang, Y.; Zhu, W. A Clinicopathological Analysis of Melanocytic Nevi: A Retrospective Series. Frontiers in Medicine 2021, 8, 681668. [Google Scholar] [CrossRef]
- Hekler, A.; Utikal, J.S.; Enk, A.H.; Solass, W.; Schmitt, M.; Klode, J.; Schadendorf, D.; Sondermann, W.; Franklin, C.; Bestvater, F.; et al. Deep learning outperformed 11 pathologists in the classification of histopathological melanoma images. European Journal of Cancer 2019, 118, 91–96. [Google Scholar] [CrossRef]
- Brinker, T.J.; Hekler, A.; Enk, A.H.; Klode, J.; Hauschild, A.; Berking, C.; Schilling, B.; Haferkamp, S.; Schadendorf, D.; Fröhling, S.; et al. A convolutional neural network trained with dermoscopic images performed on par with 145 dermatologists in a clinical melanoma image classification task. European Journal of Cancer 2019, 111, 148–154. [Google Scholar] [CrossRef]
- Brinker, T.J.; Hekler, A.; Enk, A.H.; Klode, J.; Hauschild, A.; Berking, C.; Schilling, B.; Haferkamp, S.; Schadendorf, D.; Holland-Letz, T.; et al. Deep learning outperformed 136 of 157 dermatologists in a head-to-head dermoscopic melanoma image classification task. European Journal of Cancer 2019, 113, 47–54. [Google Scholar] [CrossRef] [PubMed]
- Jojoa Acosta, M.F.; Caballero Tovar, L.Y.; Garcia-Zapirain, M.B.; Percybrooks, W.S. Melanoma diagnosis using deep learning techniques on dermatoscopic images. BMC Medical Imaging 2021, 21, 6. [Google Scholar] [CrossRef] [PubMed]
- Haenssle, H.; Fink, C.; Schneiderbauer, R.; Toberer, F.; Buhl, T.; Blum, A.; Kalloo, A.; Hassen, A.B.H.; Thomas, L.; Enk, A.; et al. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Annals of Oncology 2018, 29, 1836–1842. [Google Scholar] [CrossRef]
- Nasr-Esfahani, E.; Samavi, S.; Karimi, N.; Soroushmehr, S.; Jafari, M.; Ward, K.; Najarian, K. Melanoma detection by analysis of clinical images using convolutional neural network. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA; 2016; pp. 1373–1376. [Google Scholar] [CrossRef]
- Nigar, N.; Umar, M.; Shahzad, M.K.; Islam, S.; Abalo, D. A Deep Learning Approach Based on Explainable Artificial Intelligence for Skin Lesion Classification. IEEE Access 2022, 10, 113715–113725. [Google Scholar] [CrossRef]
- Barata, C.; Celebi, M.E.; Marques, J.S. Explainable skin lesion diagnosis using taxonomies. Pattern Recognition 2021, 110, 107413. [Google Scholar] [CrossRef]
- Shorfuzzaman, M. An explainable stacked ensemble of deep learning models for improved melanoma skin cancer detection. Multimedia Systems 2021, 28, 1309–1323. [Google Scholar] [CrossRef]
- Mridha, K.; Uddin, M.M.; Shin, J.; Khadka, S.; Mridha, M.F. An Interpretable Skin Cancer Classification Using Optimized Convolutional Neural Network for a Smart Healthcare System. IEEE Access 2023, 11, 41003–41018. [Google Scholar] [CrossRef]
- Ali, M.S.; Miah, M.S.; Haque, J.; Rahman, M.M.; Islam, M.K. An enhanced technique of skin cancer classification using deep convolutional neural network with transfer learning models. Machine Learning with Applications 2021, 5, 100036. [Google Scholar] [CrossRef]
- Kassem, M.A.; Hosny, K.M.; Fouad, M.M. Skin Lesions Classification Into Eight Classes for ISIC 2019 Using Deep Convolutional Neural Network and Transfer Learning. IEEE Access 2020, 8, 114822–114832. [Google Scholar] [CrossRef]
- Alzubaidi, L.; Al-Amidie, M.; Al-Asadi, A.; Humaidi, A.J.; Al-Shamma, O.; Fadhel, M.A.; Zhang, J.; Santamaría, J.; Duan, Y. Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data. Cancers 2021, 13, 1590. [Google Scholar] [CrossRef]
- Hosny, K.M.; Kassem, M.A.; Foaud, M.M. Classification of skin lesions using transfer learning and augmentation with Alex-net. PLOS ONE 2019, 14, e0217293. [Google Scholar] [CrossRef]
- Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. An image is worth 16×16 words: Transformers for image recognition at scale. In Proceedings of the International conference on learning representations (ICLR); 2021. [Google Scholar]
- Yang, G.; Luo, S.; Greer, P. A Novel Vision Transformer Model for Skin Cancer Classification. Neural Processing Letters 2023, 55, 9335–9351. [Google Scholar] [CrossRef]
- Aladhadh, S.; Alsanea, M.; Aloraini, M.; Khan, T.; Habib, S.; Islam, M. An Effective Skin Cancer Classification Mechanism via Medical Vision Transformer. Sensors 2022, 22, 4008. [Google Scholar] [CrossRef] [PubMed]
- Nie, Y.; Sommella, P.; Carratù, M.; O’Nils, M.; Lundgren, J. A Deep CNN Transformer Hybrid Model for Skin Lesion Classification of Dermoscopic Images Using Focal Loss. Diagnostics 2022, 13, 72. [Google Scholar] [CrossRef] [PubMed]
- Xin, C.; Liu, Z.; Zhao, K.; Miao, L.; Ma, Y.; Zhu, X.; Zhou, Q.; Wang, S.; Li, L.; Yang, F.; et al. An improved transformer network for skin cancer classification. Computers in Biology and Medicine 2022, 149, 105939. [Google Scholar] [CrossRef] [PubMed]
- Arshed, M.A.; Mumtaz, S.; Ibrahim, M.; Ahmed, S.; Tahir, M.; Shafi, M. Multi-Class Skin Cancer Classification Using Vision Transformer Networks and Convolutional Neural Network-Based Pre-Trained Models. Information 2023, 14, 415. [Google Scholar] [CrossRef]
- Codella, N.C.F.; Gutman, D.; Celebi, M.E.; Helba, B.; Marchetti, M.A.; Dusza, S.W.; Kalloo, A.; Liopyris, K.; Mishra, N.; Kittler, H.; et al. Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). In Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018); 2018; pp. 168–8452. [Google Scholar] [CrossRef]
- Jeong, J.J.; Tariq, A.; Adejumo, T.; Trivedi, H.; Gichoya, J.W.; Banerjee, I. Systematic Review of Generative Adversarial Networks (GANs) for Medical Image Classification and Segmentation. Journal of Digital Imaging 2022, 35, 137–152. [Google Scholar] [CrossRef]
- Goceri, E. GAN based augmentation using a hybrid loss function for dermoscopy images. Artificial Intelligence Review 2024, 57, 234. [Google Scholar] [CrossRef]
- Behara, K.; Bhero, E.; Agee, J.T. Skin Lesion Synthesis and Classification Using an Improved DCGAN Classifier. Diagnostics 2023, 13, 2635. [Google Scholar] [CrossRef]
- Yazdanparast, T.; Shamsipour, M.; Ayatollahi, A.; Delavar, S.; Ahmadi, M.; Samadi, A.; Firooz, A. Comparison of the Diagnostic Accuracy of Teledermoscopy, Face-to-Face Examinations and Artificial Intelligence in the Diagnosis of Melanoma. Indian Journal of Dermatology 2024, 69, 296–300. [Google Scholar] [CrossRef]
- Cerminara, S.E.; Cheng, P.; Kostner, L.; Huber, S.; Kunz, M.; Maul, J.T.; Böhm, J.S.; Dettwiler, C.F.; Geser, A.; Jakopović, C.; et al. Diagnostic performance of augmented intelligence with 2D and 3D total body photography and convolutional neural networks in a high-risk population for melanoma under real-world conditions: A new era of skin cancer screening? European Journal of Cancer 2023, 190, 112954. [Google Scholar] [CrossRef]
- Crawford, M.E.; Kamali, K.; Dorey, R.A.; MacIntyre, O.C.; Cleminson, K.; MacGillivary, M.L.; Green, P.J.; Langley, R.G.; Purdy, K.S.; DeCoste, R.C.; et al. Using Artificial Intelligence as a Melanoma Screening Tool in Self-Referred Patients. Journal of Cutaneous Medicine and Surgery 2024, 28, 37–43. [Google Scholar] [CrossRef] [PubMed]
- Hartman, R.I.; Trepanowski, N.; Chang, M.S.; Tepedino, K.; Gianacas, C.; McNiff, J.M.; Fung, M.; Braghiroli, N.F.; Grant-Kels, J.M. Multicenter prospective blinded melanoma detection study with a handheld elastic scattering spectroscopy device. JAAD International 2024, 15, 24–31. [Google Scholar] [CrossRef] [PubMed]
- MacLellan, A.N.; Price, E.L.; Publicover-Brouwer, P.; Matheson, K.; Ly, T.Y.; Pasternak, S.; Walsh, N.M.; Gallant, C.J.; Oakley, A.; Hull, P.R.; et al. The use of noninvasive imaging techniques in the diagnosis of melanoma: a prospective diagnostic accuracy study. Journal of the American Academy of Dermatology 2021, 85, 353–359. [Google Scholar] [CrossRef]
- Miller, I.; Rosic, N.; Stapelberg, M.; Hudson, J.; Coxon, P.; Furness, J.; Walsh, J.; Climstein, M. Performance of Commercial Dermatoscopic Systems That Incorporate Artificial Intelligence for the Identification of Melanoma in General Practice: A Systematic Review. Cancers 2024, 16, 1443. [Google Scholar] [CrossRef] [PubMed]
- Wei, M.L.; Tada, M.; So, A.; Torres, R. Artificial intelligence and skin cancer. Frontiers in Medicine 2024, 11, 1331895. [Google Scholar] [CrossRef]
- Winkler, J.K.; Blum, A.; Kommoss, K.; Enk, A.; Toberer, F.; Rosenberger, A.; Haenssle, H.A. Assessment of Diagnostic Performance of Dermatologists Cooperating With a Convolutional Neural Network in a Prospective Clinical Study: Human With Machine. JAMA Dermatology 2023, 159, 621. [Google Scholar] [CrossRef]
- ISIC 2019 challenge, 2019.
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention is All you Need. In Proceedings of the Advances in Neural Information Processing Systems; Guyon, I.; Luxburg, U.V.; Bengio, S.; Wallach, H.; Fergus, R.; Vishwanathan, S.; Garnett, R., Eds. Curran Associates, Inc., Vol. 30. 2017. [Google Scholar]
- Emara, T.; Afify, H.M.; Ismail, F.H.; Hassanien, A.E. A Modified Inception-v4 for Imbalanced Skin Cancer Classification Dataset. In Proceedings of the 2019 14th International Conference on Computer Engineering and Systems (ICCES); 2019; pp. 28–33. [Google Scholar] [CrossRef]
- Alzamel, M.; Iliopoulos, C.; Lim, Z. Deep learning approaches and data augmentation for melanoma detection. Neural Computing and Applications 2024, 37, 10591–10604. [Google Scholar] [CrossRef]
- Safdar, K.; Akbar, S.; Shoukat, A. A Majority Voting based Ensemble Approach of Deep Learning Classifiers for Automated Melanoma Detection. In Proceedings of the 2021 International Conference on Innovative Computing (ICIC); 2021; pp. 1–6. [Google Scholar] [CrossRef]
- Karras, T.; Aittala, M.; Hellsten, J.; Laine, S.; Lehtinen, J.; Aila, T. Training generative adversarial networks with limited data. In Proceedings of the Advances in neural information processing systems; 2020; pp. 12104–12114. [Google Scholar] [CrossRef]
- NVlabs. StyleGAN2-ADA PyTorch, 2020.
- Obuchowski, N.A.; Bullen, J.A. Receiver operating characteristic (ROC) curves: review of methods with applications in diagnostic medicine. Physics in Medicine & Biology 2018, 63, 07TR01. [Google Scholar] [CrossRef] [PubMed]
- Hajian-Tilaki, K. Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation. Caspian Journal of Internal Medicine 2013, 4, 627–635. [Google Scholar]
- Fawcett, T. An introduction to ROC analysis. Pattern Recognition Letters 2006, 27, 861–874. [Google Scholar] [CrossRef]
- He, Z.; Zhang, Q.; Song, M.; Tan, X.; Wang, W. Four overlooked errors in ROC analysis: how to prevent and avoid. BMJ Evidence-Based Medicine 2025, 30, 208–211. [Google Scholar] [CrossRef]
- DeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L. Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach. Biometrics 1988, 44, 837. [Google Scholar] [CrossRef]
- Hedegaard, L.; Alok, A.; Jose, J.; Iosifidis, A. Structured pruning adapters. Pattern Recognition 2024, 156, 110724. [Google Scholar] [CrossRef]
- Na, G.S. Efficient learning rate adaptation based on hierarchical optimization approach. Neural Networks 2022, 150, 326–335. [Google Scholar] [CrossRef] [PubMed]
- Razuvayevskaya, O.; Wu, B.; Leite, J.A.; Heppell, F.; Srba, I.; Scarton, C.; Bontcheva, K.; Song, X. Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classification. PLOS ONE 2024, 19, e0301738. [Google Scholar] [CrossRef]





| Model | Validation (ISIC-2019) | Testing (MN187) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | |
| ViT-L/16 | 0.921 | 0.919 | 0.919 | 0.920 | 0.919 | 0.902 | 0.896 | 0.896 | 0.902 | 0.902 |
| ViT-B/16 | 0.919 | 0.916 | 0.915 | 0.914 | 0.916 | 0.887 | 0.889 | 0.877 | 0.886 | 0.882 |
| ResNet-152 | 0.909 | 0.908 | 0.907 | 0.908 | 0.908 | 0.857 | 0.861 | 0.869 | 0.860 | 0.861 |
| EfficientNet-B7 | 0.889 | 0.887 | 0.887 | 0.889 | 0.889 | 0.847 | 0.835 | 0.838 | 0.834 | 0.839 |
| DenseNet-201 | 0.915 | 0.916 | 0.914 | 0.914 | 0.914 | 0.842 | 0.858 | 0.855 | 0.861 | 0.845 |
| ConvNeXt-XL | 0.926 | 0.927 | 0.929 | 0.926 | 0.928 | 0.881 | 0.877 | 0.881 | 0.884 | 0.885 |
| Model | Deep Learning Model AUC | Mole Analyzer Pro AUC | DeLong Test p-value |
|---|---|---|---|
| ViT-L/16 | 0.901 | 0.856 | 0.070 |
| ConvNeXt-XL | 0.884 | 0.856 | 0.226 |
| ViT-B/16 | 0.888 | 0.856 | 0.240 |
| ResNet-152 | 0.868 | 0.856 | 0.654 |
| EfficientNet-B7 | 0.846 | 0.856 | 0.709 |
| DenseNet-201 | 0.859 | 0.856 | 0.910 |
| Model | Validation (ISIC-2019) | Testing (MN187) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | Run 1 | Run 2 | Run 3 | Run 4 | Run 5 | |
| ViT-L/16 | 0.938 | 0.936 | 0.936 | 0.937 | 0.935 | 0.914 | 0.909 | 0.908 | 0.915 | 0.908 |
| ViT-B/16 | 0.924 | 0.927 | 0.927 | 0.928 | 0.927 | 0.896 | 0.892 | 0.891 | 0.901 | 0.899 |
| ResNet-152 | 0.911 | 0.909 | 0.912 | 0.912 | 0.911 | 0.875 | 0.870 | 0.873 | 0.872 | 0.872 |
| EfficientNet-B7 | 0.895 | 0.894 | 0.893 | 0.894 | 0.893 | 0.860 | 0.866 | 0.863 | 0.866 | 0.869 |
| DenseNet-201 | 0.921 | 0.921 | 0.920 | 0.920 | 0.921 | 0.870 | 0.868 | 0.872 | 0.875 | 0.861 |
| ConvNeXt-XL | 0.934 | 0.936 | 0.933 | 0.933 | 0.934 | 0.891 | 0.894 | 0.885 | 0.889 | 0.894 |
| Model | Deep Learning Model AUC | Mole Analyzer Pro AUC | DeLong Test p-value |
|---|---|---|---|
| ViT-L/16 | 0.920 | 0.856 | 0.032 |
| Fine tuned ViT-L/16 | 0.926 | 0.856 | 0.006 |
| EfficientNet-B7 | 0.870 | 0.856 | 0.645 |
| DenseNet-201 | 0.880 | 0.856 | 0.466 |
| ConvNeXt-XL | 0.897 | 0.856 | 0.154 |
| ResNet-152 | 0.877 | 0.856 | 0.498 |
| ViT-B/16 | 0.905 | 0.856 | 0.098 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).