Submitted:
31 December 2024
Posted:
03 January 2025
Read the latest preprint version here
Abstract
Keywords:
I. Introduction
Main Contributions
- Proposed an Enhanced Grey Wolf Optimizer (SCGWO): A novel improvement of the GWO algorithm is presented, integrating Sinusoidal Mapping for population initialization and a Transverse-Longitudinal Crossover strategy, significantly enhancing both global exploration and local exploitation capabilities.
- Introduced Dynamic Weight Adjustment Mechanism: A dynamic weight adjustment mechanism is developed to adaptively balance the roles of , , and wolves, ensuring better exploration in early stages and faster convergence in later stages.
- Evaluated on Comprehensive Benchmark Functions: The proposed SCGWO is rigorously tested on 10 complex benchmark functions, demonstrating superior performance in terms of convergence speed, solution accuracy, and robustness when compared to the classic GWO.
- Validated through Real-World Application: The effectiveness of SCGWO is further validated through its application to the hyperparameter optimization of a random forest model, achieving better tuning results than conventional optimization methods.
II. Related Work
A. Grey Wolf Optimizer (GWO)
1) Encircling Prey
2) Hunting Prey
3) Attacking Prey
B. Improvements to GWO
III. Enhanced Grey Wolf Optimizer (SCGWO)
A. Sinusoidal Chaos Mapping for Population Initialization
B. Transverse-Longitudinal Crossover Strategy
1) Transverse Crossover Operation
2) Longitudinal Crossover Operation
IV. Simulations and Results
A. Experiment Setup
B. Results and Discussion
| Function | Algorithm | Best Value | Mean Value |
|---|---|---|---|
| F1 | GWO | ||
| SCGWO | |||
| F2 | GWO | ||
| SCGWO | |||
| F3 | GWO | ||
| SCGWO | |||
| F4 | GWO | ||
| SCGWO | |||
| F5 | GWO | ||
| SCGWO | |||
| F6 | GWO | ||
| SCGWO | |||
| F7 | GWO | ||
| SCGWO | |||
| F8 | GWO | ||
| SCGWO | |||
| F9 | GWO | ||
| SCGWO | |||
| F10 | GWO | ||
| SCGWO |
V. Random Forest Hyperparameter Optimization
VI. SHAP Analysis
VII. Future Work
VIII. Conclusion
Appendix A. Experimental Details
Appendix A.1. Modeling and Optimization

References
- Behnam Abdollahzadeh, Reza Ebrahimi, and Saeed Arani Arani. Improved grey wolf optimization algorithm based on chaos theory for optimization problems. Applied Soft Computing, 90:106187, 2020.
- Sanjay Arora and Satvir Singh. A review on nature-inspired optimization algorithms. International Journal of Industrial Engineering Computations, 10(4):681–709, 2019.
- Jagdish Bansal and Himanshu Sharma. Enhanced grey wolf optimizer with levy flight for engineering design optimization. Journal of Computational Design and Engineering, 9(1):23–38, 2022.
- Xingyuan Bu, Yuwei Wu, Zhi Gao, and Yunde Jia. Deep convolutional network with locality and sparsity constraints for texture classification. Pattern Recognition, 91:34–46, 2019.
- Gaurav Dhiman and Vijay Kumar. Hybrid optimization strategies combining grey wolf optimizer with differential evolution and simulated annealing. Expert Systems with Applications, 159:113584, 2021.
- Ebrahim Emary, Hossam M Zawbaa, and Aboul Ella Hassanien. Binary grey wolf optimization approaches for feature selection. Neurocomputing, 172:371–381, 2016.
- Zhi Gao, Yuwei Wu, Xingyuan Bu, Tan Yu, Junsong Yuan, and Yunde Jia. Learning a robust representation via a deep network on symmetric positive definite manifolds. Pattern Recognition, 92:1–12, 2019.
- Soliman Khalil. Machine learning model for housing dataset, 2021. Kaggle. Available online: https://www.kaggle.com/code/solimankhalil/ml-model-linear-regression-housing-dataset.
- Zhixin Lai, Jing Wu, Suiyao Chen, Yucheng Zhou, and Naira Hovakimyan. Residual-based language models are free boosters for biomedical imaging tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 5086–5096, June 2024.
- Keqin Li, Lipeng Liu, Jiajing Chen, Dezhi Yu, Xiaofan Zhou, Ming Li, Congyu Wang, and Zhao Li. Research on reinforcement learning based warehouse robot navigation algorithm in complex warehouse layout. arXiv preprint arXiv:2411.06128, 2024.
- Xinjin Li, Yuanzhe Yang, Yixiao Yuan, Yu Ma, Yangchen Huang, and Haowei Ni. Intelligent vehicle classification system based on deep learning and multi-sensor fusion. Preprints, July 2024.
- Dong Liu, Zhixin Lai, Yite Wang, Jing Wu, Yanxuan Yu, Zhongwei Wan, Benjamin Lengerich, and Ying Nian Wu. Efficient large foundation model inference: A perspective from model and system co-design. 2024.
- Dong Liu, Roger Waleffe, Meng Jiang, and Shivaram Venkataraman. Graphsnapshot: Graph machine learning acceleration with fast storage and retrieval. 2024.
- Dong Liu and Yanxuan Yu. Mt2st: Adaptive multi-task to single-task learning. 2024.
- Xiaoyi Liu, Zhou Yu, Lianghao Tan, Yafeng Yan, and Ge Shi. Enhancing skin lesion diagnosis with ensemble learning. 2024.
- Danqing Ma, Meng Wang, Ao Xiang, Zongqing Qi, and Qin Yang. Transformer-based classification outcome prediction for multimodal stroke treatment. 2024.
- Seyedali Mirjalili, Seyed Mohammad Mirjalili, and Andrew Lewis. Grey wolf optimizer. Advances in Engineering Software, 69:46–61, 2014.
- Haowei Ni, Shuchen Meng, Xupeng Chen, Ziqing Zhao, Andi Chen, Panfeng Li, Shiyao Zhang, Qifu Yin, Yuanqing Wang, and Yuxi Chan. Harnessing earnings reports for stock predictions: A qlora-enhanced llm approach. arXiv preprint arXiv:2408.06634, 2024.
- Haowei Ni, Shuchen Meng, Xieming Geng, Panfeng Li, Zhuoying Li, Xupeng Chen, Xiaotong Wang, and Shiyao Zhang. Time series modeling for heart rate prediction: From arima to transformers. arXiv preprint arXiv:2406.12199, 2024.
- Junran Peng, Xingyuan Bu, Ming Sun, Zhaoxiang Zhang, Tieniu Tan, and Junjie Yan. Large-scale object detection in the wild from imbalanced multi-labels. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9709–9718, 2020.
- Yiyi Tao. Sqba: sequential query-based blackbox attack. In Fifth International Conference on Artificial Intelligence and Computer Science (AICS 2023), volume 12803, page 128032Q. International Society for Optics and Photonics, SPIE, 2017.
- Yiyi Tao. Meta learning enabled adversarial defense. In 2023 IEEE International Conference on Sensors, Electronics and Computer Engineering (ICSECE), pages 1326–1330, 2023.
- Zeyu Wang, Yue Zhu, Zichao Li, Zhuoyue Wang, Hao Qin, and Xinqi Liu. Graph neural network recommendation system for football formation. Applied Science and Biotechnology Journal for Advanced Research, 3(3):33–39, 2024.
- Yijie Weng and Jianhao Wu. Fortifying the global data fortress: a multidimensional examination of cyber security indexes and data protection measures across 193 nations. International Journal of Frontiers in Engineering Technology, 6(2), 2024.
- Yijie Weng and Jianhao Wu. Leveraging artificial intelligence to enhance data security and combat cyber attacks. Journal of Artificial Intelligence General science (JAIGS) ISSN: 3006-4023, 5(1):392–399, 2024.
- Yijie Weng, Jianhao Wu, Tara Kelly, and William Johnson. Comprehensive overview of artificial intelligence applications in modern industries. arXiv preprint arXiv:2409.13059, 2024.
- Wangjiaxuan Xin, Kanlun Wang, Zhe Fu, and Lina Zhou. Let community rules be reflected in online content moderation. 2024.
- Xiaofei Yang and Jinsong Guo. A novel hybrid algorithm of ant colony optimization and grey wolf optimizer for continuous optimization problems. Expert Systems with Applications, 150:113282, 2020.
- Haowei Zhang, Kang Gao, Huiying Huang, Shitong Hou, Jun Li, and Gang Wu. Fully decouple convolutional network for damage detection of rebars in rc beams. Engineering Structures, 285:116023, 2023.
- Hongye Zheng, Bingxing Wang, Minheng Xiao, Honglin Qin, Zhizhong Wu, and Lianghao Tan. Adaptive friction in deep learning: Enhancing optimizers with sigmoid and tanh function. arXiv preprint arXiv:2408.11839, 2024.
- Hua Zhu, Yi Wang, and Jian Zhang. An adaptive multi-population differential evolution with cooperative co-evolution for high-dimensional optimization. Swarm and Evolutionary Computation, 44:226–239, 2019.
- Wenbo Zhu. Optimizing distributed networking with big data scheduling and cloud computing. In International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022), volume 12303, pages 23–28. SPIE, 2022.


| Function | Name | Search Range | DIM | OPT Value |
| F1 | Sphere | [-100, 100] | 30 | 0 |
| F2 | Schwefel2.22 | [-10, 10] | 30 | 0 |
| F3 | Schwefel1.2 | [-100, 100] | 30 | 0 |
| F4 | Schwefel2.21 | [-100, 100] | 30 | 0 |
| F5 | Rosenbrock | [-30, 30] | 30 | 0 |
| F6 | Step | [-100, 100] | 30 | 0 |
| F7 | Rastrigin | [-5.12, 5.12] | 30 | 0 |
| F8 | Ackley | [-32, 32] | 30 | 0 |
| F9 | Griewank | [-600, 600] | 30 | 0 |
| F10 | Penalized | [-50, 50] | 30 | 0 |
| Method | MAE (train) | RMSE (train) | (train) | MAE (test) | RMSE (test) | (test) |
| Default | 285109 | 398584 | 0.9494 | 957916 | 1357261 | 0.5722 |
| GWO | 413922 | 547712 | 0.9045 | 922632 | 1262471 | 0.6299 |
| SCGWO | 448753 | 616299 | 0.8791 | 917518 | 1238437 | 0.6438 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).