Submitted:
12 June 2025
Posted:
13 June 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Background and Related Work
2.1. Federated Learning: An Overview
2.2. Secure Aggregation Protocols
2.3. Ethical and Regulatory Considerations
2.4. Related Work
2.5. Conclusion
3. Secure Aggregation Protocols in Federated AI
3.1. Introduction
3.2. Mechanisms of Secure Aggregation
3.2.1. Homomorphic Encryption
3.2.2. Secure Multiparty Computation (SMPC)
3.2.3. Differential Privacy
3.3. Classification of Secure Aggregation Protocols
3.3.1. Cryptographic Techniques
- Homomorphic Encryption-Based Protocols: These utilize homomorphic encryption to perform computations on encrypted data, maintaining privacy throughout the process.
- SMPC-Based Protocols: These focus on distributing data shares among parties for joint computation, ensuring that no single party has access to the complete dataset.
- Differential Privacy Protocols: These incorporate mechanisms to add noise to the aggregated results, providing statistical privacy guarantees.
3.3.2. Application Domains
- Clinical Trials: In scenarios where multiple institutions collaborate on clinical research, secure aggregation protocols can enable joint analyses without compromising patient confidentiality.
- Electronic Health Records (EHR): Aggregating data from EHRs across different healthcare providers can enhance predictive modeling while protecting sensitive patient information.
- Wearable Health Devices: Data from wearable devices can be securely aggregated to inform population health studies, thereby leveraging real-time health information.
3.4. Challenges and Limitations
3.4.1. Computational Overhead
3.4.2. Communication Costs
3.4.3. Scalability
3.5. Conclusion
4. Secure Aggregation Protocols in Federated AI
4.1. Overview of Secure Aggregation
4.2. Cryptographic Foundations
4.2.1. Homomorphic Encryption
4.2.2. Secure Multiparty Computation (SMC)
4.2.3. Differential Privacy
4.3. Comparative Analysis of Protocols
- Privacy Guarantees: The extent to which a protocol protects individual data contributions.
- Computational Efficiency: The speed and resource requirements for executing the protocol.
- Communication Overhead: The amount of data exchanged between participants during the aggregation process.
- Scalability: The ability of the protocol to function effectively across a growing number of participants.
4.4. Case Studies and Practical Implementations
- Collaborative Clinical Trials: In multi-site clinical trials, secure aggregation protocols have enabled researchers to collaboratively analyze patient data while ensuring compliance with privacy regulations.
- Decentralized Health Monitoring: Wearable health devices utilize secure aggregation to combine user data for predictive analytics without compromising individual privacy.
- Cross-Institutional Research: Institutions have employed federated learning with secure aggregation to share insights derived from disparate health datasets, fostering innovation while adhering to strict data governance policies.
4.5. Future Directions
5. Comparative Analysis of Secure Aggregation Protocols
5.1. Overview of Secure Aggregation Protocols
5.1.1. Homomorphic Encryption
5.1.2. Secure Multiparty Computation (MPC)
5.1.3. Differential Privacy
5.2. Performance Metrics
- Computational Efficiency: The time and resources required to execute the aggregation process.
- Communication Overhead: The amount of data exchanged between parties during the aggregation.
- Security Guarantees: The level of protection against potential attacks, such as eavesdropping or data leakage.
- Scalability: The ability of the protocol to maintain performance as the number of participating entities increases.
5.3. Comparative Analysis
5.3.1. Protocol A: Overview and Evaluation
5.3.2. Protocol B: Overview and Evaluation
5.3.3. Protocol C: Overview and Evaluation
5.4. Conclusion
6. Future Directions in Secure Aggregation for Federated AI in Healthcare
6.1. Advancements in Cryptographic Techniques
6.2. Enhancing Privacy Guarantees
6.3. Scalability and Interoperability
6.4. Ethical and Regulatory Considerations
6.5. Conclusion
7. Future Directions and Challenges
7.1. Emerging Trends in Federated Learning
7.2. Challenges to Implementation
7.3. Ethical Considerations and Regulatory Compliance
7.4. Research Opportunities
7.5. Conclusion
References
- Hossan KM, R.; Rahman, M.H.; Hossain, M.D. HUMAN-CENTERED AI IN HEALTHCARE: BRIDGING SMART SYSTEMS AND PERSONALIZED MEDICINE FOR COMPASSIONATE CARE.
- Hossain, M.D.; Rahman, M.H.; Hossan, K.M.R. Artificial Intelligence in healthcare: Transformative applications, ethical challenges, and future directions in medical diagnostics and personalized medicine. 2025. [Google Scholar]
- Kim, J.W.; Khan, A.U.; Banerjee, I. Systematic review of hybrid vision transformer architectures for radiological image analysis. Journal of Imaging Informatics in Medicine 2025, 1–15. [Google Scholar] [CrossRef] [PubMed]
- Springenberg, M.; Frommholz, A.; Wenzel, M.; Weicken, E.; Ma, J.; Strodthoff, N. From modern CNNs to vision transformers: Assessing the performance, robustness, and classification strategies of deep learning models in histopathology. Medical image analysis 2023, 87, 102809. [Google Scholar] [CrossRef] [PubMed]
- Atabansi, C.C.; Nie, J.; Liu, H.; Song, Q.; Yan, L.; Zhou, X. A survey of Transformer applications for histopathological image analysis: New developments and future directions. BioMedical Engineering OnLine 2023, 22, 96. [Google Scholar] [CrossRef] [PubMed]
- Sharma, R.R.; Sungheetha, A.; Tiwari, M.; Pindoo, I.A.; Ellappan, V.; Pradeep, G.G.S. Comparative Analysis of Vision Transformer and CNN Architectures in Medical Image Classification. In International Conference on Sustainability Innovation in Computing and Engineering (ICSICE 2024); Atlantis Press: 2025; pp. 1343-1355.
- Patil, P.R. Deep Learning Revolution in Skin Cancer Diagnosis with Hybrid Transformer-CNN Architectures. Vidhyayana-An International Multidisciplinary Peer-Reviewed E-Journal-ISSN 2454-8596.
- Shobayo, O.; Saatchi, R. Developments in Deep Learning Artificial Neural Network Techniques for Medical Image Analysis and Interpretation. Diagnostics 2025, 15, 1072. [Google Scholar] [CrossRef] [PubMed]
- Karthik, R.; Thalanki, V.; Yadav, P. Deep Learning-Based Histopathological Analysis for Colon Cancer Diagnosis: A Comparative Study of CNN and Transformer Models with Image Preprocessing Techniques. In International Conference on Intelligent Systems Design and Applications; Springer Nature Switzerland: Cham, 2023; pp. 90–101. [Google Scholar]
- Xu, H.; Xu, Q.; Cong, F.; Kang, J.; Han, C.; Liu, Z.; Lu, C. Vision transformers for computational histopathology. IEEE Reviews in Biomedical Engineering 2023, 17, 63–79. [Google Scholar] [CrossRef] [PubMed]
- Singh, S. Computer-aided diagnosis of thoracic diseases in chest X-rays using hybrid cnn-transformer architecture. arXiv arXiv:2404.11843, 2024.
- Fu, B.; Zhang, M.; He, J.; Cao, Y.; Guo, Y.; Wang, R. StoHisNet: A hybrid multi-classification model with CNN and Transformer for gastric pathology images. Computer Methods and Programs in Biomedicine 2022, 221, 106924. [Google Scholar] [CrossRef] [PubMed]
- Bougourzi, F.; Dornaika, F.; Distante, C.; Taleb-Ahmed, A. D-TrAttUnet: Toward hybrid CNN-transformer architecture for generic and subtle segmentation in medical images. Computers in biology and medicine 2024, 176, 108590. [Google Scholar] [CrossRef] [PubMed]
- Islam, M.T.; Rahman, M.A.; Mazumder, M.T.R.; Shourov, S.H. COMPARATIVE ANALYSIS OF NEURAL NETWORK ARCHITECTURES FOR MEDICAL IMAGE CLASSIFICATION: EVALUATING PERFORMANCE ACROSS DIVERSE MODELS. American Journal of Advanced Technology and Engineering Solutions 2024, 4, 01–42. [Google Scholar] [CrossRef]
- Vanitha, K.; Manimaran, A.; Chokkanathan, K.; Anitha, K.; Mahesh, T.R.; Kumar, V.V.; Vivekananda, G.N. Attention-based Feature Fusion with External Attention Transformers for Breast Cancer Histopathology Analysis. IEEE Access 2024. [CrossRef]
- Borji, A.; Kronreif, G.; Angermayr, B.; Hatamikia, S. Advanced hybrid deep learning model for enhanced evaluation of osteosarcoma histopathology images. Frontiers in Medicine 2025, 12, 1555907. [Google Scholar] [CrossRef] [PubMed]
- Aburass, S.; Dorgham, O.; Al Shaqsi, J.; Abu Rumman, M.; Al-Kadi, O. Vision Transformers in Medical Imaging: a Comprehensive Review of Advancements and Applications Across Multiple Diseases. Journal of Imaging Informatics in Medicine 2025, 1–44. [Google Scholar] [CrossRef] [PubMed]
- Wang, X.; Yang, S.; Zhang, J.; Wang, M.; Zhang, J.; Yang, W.; Han, X. Transformer-based unsupervised contrastive learning for histopathological image classification. Medical image analysis 2022, 81, 102559. [Google Scholar] [CrossRef] [PubMed]
- Xia, K.; Wang, J. Recent advances of transformers in medical image analysis: a comprehensive review. MedComm–Future Medicine 2023, 2, e38. [Google Scholar] [CrossRef]
- Gupta, S.; Dubey, A.K.; Singh, R.; Kalra, M.K.; Abraham, A.; Kumari, V.; Suri, J.S. Four transformer-based deep learning classifiers embedded with an attention U-Net-based lung segmenter and layer-wise relevance propagation-based heatmaps for COVID-19 X-ray scans. Diagnostics 2024, 14, 1534. [Google Scholar] [CrossRef] [PubMed]
- Henry, E.U.; Emebob, O.; Omonhinmin, C.A. Vision transformers in medical imaging: A review. arXiv arXiv:2211.10043, 2022.
- Manjunatha, A.; Mahendra, G. TransNet: A Hybrid Deep Learning Architecture Combining CNNs and Transformers for Enhanced Medical Image Segmentation. In 2024 International Conference on Computing and Intelligent Reality Technologies (ICCIRT); IEEE: 2024; pp. 221-225.
- Reza, S.M.; Hasnath, A.B.; Roy, A.; Rahman, A.; Faruk, A.B. Analysis of transformer and CNN based approaches for classifying renal abnormality from image data. Doctoral dissertation, Brac University, 2024.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).