Submitted:
15 November 2024
Posted:
15 November 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
- Dynamic Weight Adjustment: The model utilizes meta-learning to automate weight adjustment for each base model within the VotingRegressor ensemble, enhancing adaptability across varying atmospheric conditions without manual intervention.
- Improved Predictive Accuracy and Robustness: By capturing complex patterns within solar radiation data, the meta-learning VotingRegressor demonstrates substantial accuracy improvements over traditional and static ensemble models, evidenced by reduced Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) metrics.
- Practical Applicability for Renewable Energy Systems: Validated on data from the National Solar Radiation Database (NSRDB) over a diverse set of meteorological conditions, the model proves effective for real-world applications, including solar farm optimization, grid management, and renewable energy trading, highlighting its potential as a valuable tool in the renewable energy sector.
2. Literature Review
3. Methodology
3.1. Data Collection and Preprocessing
3.2. Model Design and Configuration
3.3. Meta-Learning and Dynamic Weight Optimization
4. Experiments and Results
4.1. Experimental Setup
4.2. Evaluation Metrics
- Mean Absolute Error (MAE) (Equation 1): Represents the average absolute error between the predicted and observed values, directly reflecting prediction accuracy [35],Error! Bookmark not defined.,Error! Bookmark not defined.]. Lower values indicate better model performance.
- 2.
- Root Mean Squared Error (RMSE) (Equation 2): This metric places greater emphasis on larger errors, making it suitable for applications sensitive to significant deviations in solar radiation predictions [36],Error! Bookmark not defined.,Error! Bookmark not defined.].
- 3.
- R-squared (R²) (Equation 3): Represents the variance explained by the model, with values closer to 1 indicating strong predictive fit [Error! Bookmark not defined.,Error! Bookmark not defined.,[37].
4.3. Results
4.3.1. Performance of Base Models
4.3.2. Ensemble Model with Meta-Learning
4.3.3. Comparative Performance by Weather Condition
4.3.4. Feature Importance in Tree-Based Models
4.3.5. Error Trend Over Time
4.3.6. Interpretation of Results
- Enhanced Predictive Accuracy: Performance analysis indicated that the meta-learning model decreased MAE by 19% and RMSE by 14% relative to traditional baselines, demonstrating notable accuracy gains [38]. These reductions reflect the model’s capability to effectively minimize prediction errors, thereby enhancing the reliability of solar radiation forecasts [39]. Such accuracy is especially critical in solar radiation applications, where even minor errors can lead to inefficient resource allocation, suboptimal energy storage, or imbalances in energy grid stability [40]. By capturing both linear and non-linear patterns within the data through its dynamic weighting mechanism, the model ensures consistent performance across diverse conditions [41]. This capability not only emphasizes the robustness of the meta-learning approach but also highlights its practical utility in addressing the variability and complexity inherent in solar radiation data [42]. Moreover, the reduction in RMSE indicates the model’s capacity to mitigate large prediction deviations, further solidifying its role as a reliable forecasting tool in renewable energy systems [Error! Bookmark not defined.,Error! Bookmark not defined.].
- Dynamic Adaptability to Atmospheric Conditions: One of the key contributions of this study is the model’s demonstrated adaptability across different weather conditions, including clear, cloudy, and partly cloudy days. Table 4 shows that the meta-learning model maintained consistent performance under all scenarios, showcasing its ability to recalibrate in response to changing atmospheric conditions. This adaptability is essential for real-world applications where atmospheric factors are highly variable and traditional models may falter [43]. By dynamically adjusting weights based on prevailing weather conditions, the model effectively balances contributions from linear and non-linear predictors, enhancing resilience in volatile environments [Error! Bookmark not defined.].
- Weight Adjustment Visualization and Model Transparency: Figure 2 illustrates the dynamic weight adjustments made by the meta-learning framework over time, showing that different base models were prioritized based on the data patterns encountered. This weight adjustment visualization provides transparency into how the ensemble model adapts and allocates emphasis to base models like Random Forest and CatBoost when non-linear patterns dominate, or to Linear Regression during periods of linear variation [9]. This transparency is crucial for stakeholders who need to understand the model’s inner workings, especially in sectors like renewable energy, where interpretability fosters trust and improves decision-making [Error! Bookmark not defined.].
- Feature Importance Analysis: Figure 3 offers insights into the feature importance from the tree-based models (XGBoost and CatBoost) within the ensemble. Features such as temperature, humidity, and atmospheric pressure emerged as primary predictors, aligning with existing literature on solar radiation forecasting [Error! Bookmark not defined.]. This feature importance analysis not only reinforces the model’s alignment with physical principles of solar radiation but also provides actionable insights for domain experts to focus on the most impactful variables.
- Consistency and Stability Over Time: The error trend analysis in Figure 4 reveals a stable pattern in prediction errors over the test period, indicating the model’s consistency in performance. This stability is a critical aspect of the model’s contribution, as it suggests that the meta-learning mechanism enables the model to perform reliably even with fluctuations in atmospheric conditions [Error! Bookmark not defined.]. For applications in solar farm optimization and energy grid management, such stability is valuable for long-term planning and operational reliability [44].
- Implications for Renewable Energy Forecasting: The demonstrated improvements in predictive accuracy, adaptability, and stability position the meta-learning VotingRegressor as a highly applicable tool for renewable energy systems. By ensuring accurate forecasts across diverse conditions, this model can support solar farm operators in optimizing energy storage and supply strategies, reduce the need for non-renewable backup power, and enhance grid stability [Error! Bookmark not defined.]. Furthermore, its adaptability and robustness provide a benchmark for future developments in solar radiation forecasting models, setting a precedent for the integration of meta-learning techniques in energy forecasting applications [Error! Bookmark not defined.].
5. Discussion
6. Conclusions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Ukoba, K.; Olatunji, K. O.; Adeoye, E.; Jen, T. C.; Madyira, D. M. Optimizing renewable energy systems through artificial intelligence: Review and future prospects. Energy Environ. 2024, 0958305X, 1–12. [CrossRef]
- Wang, Z.; Zhang, M.; Wang, L.; Qin, W.; Ma, Y.; Gong, W.; Yu, L. Investigating the all-sky surface solar radiation and its influencing factors in the Yangtze River Basin in recent four decades. Atmos. Environ. 2021, 244, 117888. [CrossRef]
- Guermoui, M.; Melgani, F.; Gairaa, K.; Mekhalfi, M. L. A comprehensive review of hybrid models for solar radiation forecasting. J. Clean. Prod. 2020, 258, 120357. [CrossRef]
- Krishnan, N.; Kumar, K. R.; Inda, C. S. How solar radiation forecasting impacts the utilization of solar energy: A critical review. J. Clean. Prod. 2023, 388, 135860. [CrossRef]
- Al-Dahidi, S.; Madhiarasan, M.; Al-Ghussain, L.; Abubaker, A. M.; Ahmad, A. D.; Alrbai, M.; Zio, E. Forecasting solar photovoltaic power production: A comprehensive review and innovative data-driven modeling framework. Energies 2024, 17(16), 4145. [CrossRef]
- Hospedales, T.; Antoniou, A.; Micaelli, P.; Storkey, A. Meta-learning in neural networks: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 44(9), 5149–5169. [CrossRef]
- Boutahir, M. K.; Hessane, A.; Farhaoui, Y.; Azrour, M.; Benyeogor, M. S.; Innab, N. Meta-learning guided weight optimization for enhanced solar radiation forecasting and sustainable energy management with VotingRegressor. Sustainability 2024, 16(13), 5505. [CrossRef]
- Abbas, F.; Zhang, F.; Iqbal, J.; Abbas, F.; Alrefaei, A. F.; Albeshr, M. Assessing the dimensionality reduction of the geospatial dataset using principal component analysis (PCA) and its impact on the accuracy and performance of ensembled and non-ensembled algorithms. Sci. Rep. 2023, 13, 455.
- Tian, Y.; Zhao, X.; Huang, W. Meta-learning approaches for learning-to-learn in deep learning: A survey. Neurocomputing 2022, 494, 203–223. [CrossRef]
- Franceschi, L. A Unified Framework for Gradient-Based Hyperparameter Optimization and Meta-Learning. Ph.D. Thesis, UCL (University College London), London, UK, 2021.
- Kim, M.; Hospedales, T. M. A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learning. arXiv 2024, arXiv:2410.10417.
- Lata, S.; Verma, A. Exploring the state of art existing deep learning-based advanced weather forecasting systems: A systematic review. Nanotechnology Perceptions 2024, 17(4), 1305–1330. [CrossRef]
- Bączkiewicz, A.; Wątróbski, J.; Sałabun, W.; Kołodziejczyk, J. An ANN model trained on regional data in the prediction of particular weather conditions. Appl. Sci. 2021, 11(11), 4757. [CrossRef]
- Yakut, E.; Süzülmüş, S. Modelling monthly mean air temperature using artificial neural network, adaptive neuro-fuzzy inference system, and support vector regression methods: A case study for Turkey. Network: Comput. Neural Syst. 2020, 31(1–4), 1–36. [CrossRef]
- Jallal, M. A.; Chabaa, S.; Zeroual, A. A novel deep neural network based on randomly occurring distributed delayed PSO algorithm for monitoring the energy produced by four dual-axis solar trackers. Renew. Energy 2020, 149, 1182–1196. [CrossRef]
- Bassey, K. E. Hybrid renewable energy systems modeling. Eng. Sci. Technol. J. 2023, 4(6), 571–588. [CrossRef]
- Hissou, H.; Benkirane, S.; Guezzaz, A.; Beni-Hssane, A.; Azrour, M. Comparative analysis of solar radiation forecasting models: Unveiling the potential of feature selection techniques. In Smart Internet of Things for Environment and Healthcare; Springer Nature Switzerland: Cham, Switzerland, 2024; pp. 97–105.
- Zhang, L.; Jánošík, D. Enhanced short-term load forecasting with hybrid machine learning models: CatBoost and XGBoost approaches. Expert Syst. Appl. 2024, 241, 122686. [CrossRef]
- Emrani, A.; Berrada, A.; Ameur, A.; Bakhouya, M. Assessment of the round-trip efficiency of gravity energy storage system: Analytical and numerical analysis of energy loss mechanisms. J. Energy Storage 2022, 55, 105504. [CrossRef]
- Belmahdi, B.; Louzazni, M.; El Bouardi, A. Comparative optimization of global solar radiation forecasting using machine learning and time series models. Environ. Sci. Pollut. Res. 2022, 29(10), 14871–14888. [CrossRef]
- Sarmas, E.; Spiliotis, E.; Stamatopoulos, E.; Marinakis, V.; Doukas, H. Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models. Renew. Energy 2023, 216, 118997. [CrossRef]
- Vettoruzzo, A.; Bouguelia, M. R.; Rögnvaldsson, T. Personalized federated learning with contextual modulation and meta-learning. In Proceedings of the 2024 SIAM International Conference on Data Mining (SDM); Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2024; pp. 842–850.
- Tunio, M. H.; Jianping, L.; Ahmed, A.; Zeng, X.; Butt, M. H. F.; Shah, S. A.; Saboor, A. Robust meta-knowledge-informed model for precise crop yield estimation using transferable adaptive method. In Proceedings of the 2023 20th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP); IEEE: Guangzhou, China, 2023; pp. 1–7.
- Mfetoum, I. M.; Ngoh, S. K.; Molu, R. J. J.; Nde Kenfack, B. F.; Onguene, R.; Naoussi, S. R. D.; Berhanu, M. A multilayer perceptron neural network approach for optimizing solar irradiance forecasting in Central Africa with meteorological insights. Sci. Rep. 2024, 14(1), 3572. [CrossRef]
- Sammar, M. J.; Saeed, M. A.; Mohsin, S. M.; Akber, S. M. A.; Bukhsh, R.; Abazeed, M.; Ali, M. Illuminating the future: A comprehensive review of AI-based solar irradiance prediction models. IEEE Access 2024, 12, 1–15. [CrossRef]
- Sagingalieva, A.; Komornyik, S.; Senokosov, A.; Joshi, A.; Sedykh, A.; Mansell, C.; Melnikov, A. Photovoltaic power forecasting using quantum machine learning. arXiv 2023, arXiv:2312.16379.
- National Renewable Energy Laboratory (NREL). National Solar Radiation Database (NSRDB). Available online: https://nsrdb.nrel.gov (accessed on November 01, 2024).
- Yang, D.; van der Meer, D. Post-processing in solar forecasting: Ten overarching thinking tools. Renew. Sustain. Energy Rev. 2021, 140, 110735.
- Dash, C. S. K.; Behera, A. K.; Dehuri, S.; Ghosh, A. An outliers detection and elimination framework in classification task of data mining. Decis. Anal. J. 2023, 6, 100164. [CrossRef]
- Singh, D.; Singh, B. Feature-wise normalization: An effective way of normalizing data. Pattern Recognition. 2022, 122, 108307. [CrossRef]
- Jahangir, M. S.; Biazar, S. M.; Hah, D.; Quilty, J.; Isazadeh, M. Investigating the impact of input variable selection on daily solar radiation prediction accuracy using data-driven models: A case study in northern Iran. Stoch. Environ. Res. Risk Assess. 2022, 36(1), 225–249. [CrossRef]
- Atif, M.; Junejo, F.; Wahidi, S. F. Big data pre-processing for machine parameter optimization. In Big Data Computing; CRC Press: Boca Raton, FL, USA, 2024; pp. 65–85.
- Bischl, B.; Binder, M.; Lang, M.; Pielok, T.; Richter, J.; Coors, S.; Lindauer, M. Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2023, 13(2), e1484. [CrossRef]
- Schultz, M. G.; Betancourt, C.; Gong, B.; Kleinert, F.; Langguth, M.; Leufen, L. H.; Stadtler, S. Can deep learning beat numerical weather prediction? Philos. Trans. R. Soc., A 2021, 379(2194), 20200097.
- Qi, J.; Du, J.; Siniscalchi, S. M.; Ma, X.; Lee, C. H. Analyzing upper bounds on mean absolute errors for deep neural network-based vector-to-vector regression. IEEE Trans. Signal Process. 2020, 68, 3411–3422. [CrossRef]
- Alrashidi, M.; Alrashidi, M.; Rahman, S. Global solar radiation prediction: Application of novel hybrid data-driven model. Appl. Soft Comput. 2021, 112, 107768.
- Sun, H.; Luo, Q.; Xia, Z.; Li, Y.; Yu, Y. Bottomhole pressure prediction of carbonate reservoirs using XGBoost. Processes 2024, 12(1), 125. [CrossRef]
- Asghar, R.; Fulginei, F. R.; Quercio, M.; Mahrouch, A. Artificial neural networks for photovoltaic power forecasting: A review of five promising models. IEEE Access 2024, 12, 1–15. [CrossRef]
- Kumari, P.; Toshniwal, D. Deep learning models for solar irradiance forecasting: A comprehensive review. J. Clean. Prod. 2021, 318, 128566. [CrossRef]
- Novirdoust, A. A.; Bichler, M.; Bojung, C.; Buhl, H. U.; Fridgen, G.; Gretschko, V.; Weibelzahl, M. Electricity spot market design 2030–2050. Energy Policy 2021, 151, 112109.
- Ming-Yu, C.; Le, T.; Mao-zu, G. Bayesian neural network-based equipment operational trend prediction method using channel attention mechanism. IEEE Access 2024, 12, 1–10. [CrossRef]
- Kayit, A. D.; Tahir, M. I. Novel way to predict stock movements using multiple models and comprehensive analysis: Leveraging voting meta-ensemble techniques. J. Niger. Soc. Phys. Sci. 2024, 6(3), 2039–2039. [CrossRef]
- Kayisu, A. K.; Fasouli, P.; Kambale, W. V.; Bokoro, P.; Kyamakya, K. Ensemble learning with physics-informed neural networks for harsh time series analysis. In Proceedings of the International Conference on Autonomous Systems; Springer Nature Switzerland: Cham, Switzerland, 2023; pp. 110–121.
- Badam, R.; Murthy, B. R.; Doss, S. Solar energy forecasting: Enhancing reliability and precision. In Intelligent Systems and Industrial Internet of Things for Sustainable Development; Chapman and Hall/CRC: Boca Raton, FL, USA, 2024; pp. 292–316.
- Honari, H.; Enayati, A. M. S.; Tamizi, M. G.; Najjaran, H. Meta SAC-Lag: Towards deployable safe reinforcement learning via meta-gradient-based hyperparameter tuning. arXiv 2024, arXiv:2408.07962.
- Shapsough, S.; Takrouri, M.; Dhaouadi, R.; Zualkernan, I. A. Using IoT and smart monitoring devices to optimize the efficiency of large-scale distributed solar farms. Wirel. Netw. 2021, 27, 4313–4329. [CrossRef]
- Ahmed, R.; Sreeram, V.; Mishra, Y.; Arif, M. D. A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization. Renew. Sustain. Energy Rev. 2020, 124, 109792. [CrossRef]
- Lim, S. C.; Huh, J. H.; Hong, S. H.; Park, C. Y.; Kim, J. C. Solar power forecasting using CNN-LSTM hybrid model. Energies 2022, 15(21), 8233. [CrossRef]
- Müller, R.; Pfeifroth, U. Remote sensing of solar surface radiation–a reflection of concepts, applications, and input data based on experience with the effective cloud albedo. Atmos. Meas. Tech. 2022, 15(5), 1537–1561.
- Sweeney, C.; Bessa, R. J.; Browell, J.; Pinson, P. The future of forecasting for renewable energy. Wiley Interdiscip. Rev. Energy Environ. 2020, 9(2), e365. [CrossRef]




| Model | Hyperparameter | Value | Rationale |
|---|---|---|---|
| Linear Regression | Regularization | L2 | Enhances stability by reducing variance. |
| Random Forest | Number of Trees | 100 | Provides a balance between accuracy and computation. |
| XGBoost | Learning Rate | 0.1 | Controls step size to prevent overfitting. |
| CatBoost | Depth | 6 | Optimizes for accuracy while managing computational cost. |
| Model | MAE | RMSE | R² |
|---|---|---|---|
| Linear Regression | 2.5 | 3.1 | 0.82 |
| Random Forest | 1.8 | 2.4 | 0.87 |
| XGBoost | 1.5 | 2.1 | 0.90 |
| CatBoost | 1.4 | 2.0 | 0.91 |
| Model | MAE | RMSE | R² |
|---|---|---|---|
| VotingRegressor (no meta-learning) | 1.6 | 2.2 | 0.89 |
| VotingRegressor with Meta-Learning | 1.3 | 1.9 | 0.92 |
| Weather Condition | MAE | RMSE | R² |
|---|---|---|---|
| Clear | 1.1 | 1.6 | 0.94 |
| Cloudy | 1.4 | 2.0 | 0.91 |
| Partly Cloudy | 1.2 | 1.8 | 0.93 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).