Submitted:
12 April 2025
Posted:
14 April 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
- Thorough Review and Categorization of Scenario Generation Methods: We extensively review deep learning approaches employed for scenario generation, addressing limitations in existing studies. For instance, while prior works such as [9,10,11] have explored aspects of scenario generation, their coverage is too general. Some articles, such as [10,11], briefly mention GANs and Long Short-Term Memory (LSTM) networks, but fail to discuss their recent advancements or other newly developed approaches. In contrast, other works, like [9], focus specifically on GANs, leaving other techniques underexplored.
- Comprehensive Analysis of Scenario Reduction Techniques: We deliver an in-depth examination and categorization of scenario reduction methods utilizing deep learning algorithms. Unlike scenario generation, the application of deep learning to scenario reduction has been largely overlooked in the existing review literature, leaving a critical gap that this article aims to address.
2. Deep Learning for Scenario Generation
2.1. Generative Adversarial Networks (GANs)
2.2. Denoising Diffusion Probabilistic Models
2.3. Variational Auto-Encoder
2.4. Long Short-Term Memory Networks
2.5. Attention Mechanism
- Self-Attention (Scaled Dot-Product Attention): This mechanism computes the significance of each element in an input sequence relative to every other element within the same sequence. It excels at capturing long-range dependencies and intricate relationships in sequential or structured data. Widely adopted in Transformer models, self-attention has been a cornerstone in advancing fields like natural language processing and image analysis.
- Cross-Attention: This mechanism aligns elements from one input (e.g., a query) with another input (e.g., context), as seen in encoder-decoder architectures where the decoder focuses on specific parts of the encoded sequence during generation.
- Multi-Head Attention: This approach divides inputs into multiple attention heads, allowing each to detect and represent unique elements of input relationships before merging them into a richer representation.
2.6. Comparisons and Discussions
3. Deep Learning for Scenario Reduction
3.1. Clustering as a Part of Deep Networks for Scenario Reduction
- Embedding the Input Data: The deep network acquires a low-dimensional representation, or embedding, from high-dimensional input data. For example, an encoder within an autoencoder framework might be employed to transform the data into a concise latent space [52].
- Clustering in Latent Space: Once the data is embedded, a clustering approach like k-means is applied to the latent space. The clustering step identifies representative scenarios by grouping similar data points together.
- Loss Function for Joint Optimization: To improve scenario reduction performance, a custom loss function is used that incorporates clustering objectives, which is a combination of a reconstruction loss (), ensuring that the reduced scenarios can still approximate the original data, and clustering loss (), encouraging tight clusters and well-separated cluster centers (e.g., k-means loss or pairwise distance loss):where is a weighting parameter.
- Scenario Selection: After training, cluster centroids or representative points from each cluster are chosen as the reduced set of scenarios.
3.2. Generate a Large Number of Scenarios and Reduce Them
- Scenario Generation: A large dataset of scenarios is generated using generative models like GANs or VAEs [54].
3.3. Fast Scenario Reduction Using Deep Learning
- Transform scenario data into a 2D image-like format.
- Use a deep convolutional neural network (DCNN) to process the “images.”
- Output a reduced set of scenarios, represented as a smaller “image.”
3.4. Comparison and Discussion
4. Challenges and Future Research Directions in Deep Learning for Scenario Analysis
5. Conclusions
References
- A. Ahmed, M. Khalid, “A review on the selected applications of forecasting models in renewable power systems,” Renewable and Sustainable Energy Reviews, vol. 100, pp. 9-21, Feb. 2019. [CrossRef]
- Amjady, N. Chapter 4: Short-Term Electricity Prices Forecasting. In Electric Power Systems: Advanced Forecasting Techniques and Optimal Generation Scheduling; CRC Press; Taylor & Francis, 2012. [Google Scholar]
- D. M. Minhas, R. R, Khalid and G. Frey, “Activation of electrical loads under electricity price uncertainty,” in IEEE International Conference on Smart Energy Grid Engineering (SEGE), pp. 16, Aug. 2017. [CrossRef]
- S. Rahmani, N. Amjady, “A new optimal power flow approach for wind energy integrated power systems,” Energy, vol. 134, pp. 349-359, Sep. 2017. [CrossRef]
- H. Heitsch, W. Römisch, “Scenario reduction algorithms in stochastic programming,” Computational Optimization and Applications, vol. 24, pp. 187-206, Feb. 2003. [CrossRef]
- I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S/ Ozair, A. Courville, and Y. Bengio, “Generative adversarial networks,” Communications of the ACM, vol. 63, No. 11, pp. 139 – 144, Oct. 2020. [CrossRef]
- A. Sherstinsky, “Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network,” Physica D: Nonlinear Phenomena, vol, 404, pp. 1-28, Mar. 2020. [CrossRef]
- Z. Li, F. Liu, W. Yang, S. Peng, and J. Zhou, “A survey of convolutional neural networks: Analysis, applications, and prospects,” IEEE Trans. Neural Networks and Learning Systems, vol. 33, No. 12, pp. 6999-7019, Dec. 2022. [CrossRef]
- M. A. Kousounadis-Knousen, I. K. Bazionis, A. P. Georgilaki, F. Catthoor, P. S. Georgilakis, “A review of solar power scenario generation methods with focus on weather classifications, temporal horizons, and deep generative models,” Energies, vol. 16, no. 15, pp. 1-29, July 2023. [CrossRef]
- J. Li, J. Zhou, and B. Chen, “Review of wind power scenario generation methods for optimal operation of renewable energy systems,” Applied Energy, vol. 280, pp. 1-18, Dec. 2020. [CrossRef]
- H. Li, Z. Ren, M. Fan, W. Li, Y. Xu, Y. Jiang, W. Xi, “A review of scenario analysis methods in planning and operation of modern power systems: Methodologies, applications, and challenges,” Electric Power Systems Research, vol. 205, pp. 1-20, Apr. 2022. [CrossRef]
- S. A. Hosseini, J.-F. Toubeau, Z. De Grève, Y. Wang, N. Amjady, F. Vallée, “Data-Driven Multi-Resolution Probabilistic Energy and Reserve Bidding of Wind Power,” IEEE Transactions on Power Systems, Vol. 38, No. 1, pp. 85-99, January 2023. [CrossRef]
- N. M. M. Bendaoud, N. Farah, S. B. Ahmed, “Comparing generative adversarial networks architectures for electricity demand forecasting,” Energy and Buildings, vol. 247, pp. 1-12, Sep. 2021. [CrossRef]
- B. Yilmaz, C. Laudagé, R. Korn, and S. Desmettre, “Electricity GANs: Generative adversarial networks for electricity price scenario generation,” Commodities, vol. 3, no. 3, pp. 254-280, July 2024. [CrossRef]
- R. Rastgoo, N. Amjady, S. Islam, I. Kamwa, S. M. Muyeen, “Extreme Outage Prediction in Power Systems Using a New Deep Generative Informer Model,” International Journal of Electric Power & Energy Systems, Vol. 167, June 2025, 110627. [CrossRef]
- C. Huo, C. Peng, Z. Hao, X. Rong, X. Dong, and S. Yang, “Scenario generation method considering the uncertainty of renewable energy generations based on generative adversarial networks,” in International Conference on Energy and Electrical Power Systems (ICEEPS), pp. 130-134, July 2024. [CrossRef]
- R. Rastgoo, N. Amjady, and H. Zareipour, “A Deep Generative Model for Selecting Representative Periods in Renewable Energy-Integrated Power Systems,” Applied Soft Computing, Vol. 165, Nov. 2024, 112107. [CrossRef]
- M. Kang, R. Zhu, D. Chen, C. Li, W. Gu, X. Qian, “A cross-modal generative adversarial network for scenarios generation of renewable energy,” IEEE Trans. Power Systems, vol. 39, no. 2, pp. 2630 – 2640, Mar. 2024. [CrossRef]
- J. Qiao, T. Pu, and X. Wang, “Renewable scenario generation using controllable generative adversarial networks with transparent latent space,” CSEE Journal of Power and Energy Systems, vol. 7, no. 1, pp. 66 – 77, Jan. 2021. [CrossRef]
- W. Dong, X. Chen, and Q. Yang, “Data-driven scenario generation of renewable energy production based on controllable generative adversarial networks with interpretability,” Applied Energy, vol. 308, pp. 1-13, Feb. 2022. [CrossRef]
- R. Yuan, B. Wang, Y. Sun, X. Song, and J. Watada, “Conditional style-based generative adversarial networks for renewable scenario generation,” IEEE Trans. Power Systems, vol. 38, no. 2, pp. 1281 – 1296, March 2023. [CrossRef]
- L. Xiaojie Pan, M. Zhang, Y. Wang, S. Du, and T. Ding, “Renewable scenario generation under extreme meteorological conditions via improved conditional generative adversarial networks,” in International Conference on Harmonics and Quality of Power (ICHQP), pp. 559-564, Oct. 2024. [CrossRef]
- Y. Zhang, Q. Ai, F. Xiao, R. Hao, T. Lu, “Typical wind power scenario generation for multiple wind farms using conditional improved Wasserstein generative adversarial network,” International Journal of Electrical Power and Energy Systems, vol. 114, pp. 1-12, Jan. 2020. [CrossRef]
- X. Zhang, D. Li, and X. Fu, “A novel Wasserstein generative adversarial network for stochastic wind power output scenario generation,” IET Renewable Power Generation, vol. 18, no. 16, pp. 3537-4232, Dec. 2024. [CrossRef]
- Z. Li, “Improved conditional generative adversarial network-based approach for extreme scenario generation in renewable energy sources,” in International Conference on Civil Aviation Safety and Information Technology (ICCASIT), pp. 1391-1398, Oct. 2024. [CrossRef]
- W. Wang, H. Wei, K. Zhou, S, Tian, “WGAN-GP generating wind power scenarios and using BP neural network for classification evaluation,” in International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT), pp. 1430-1436, Mar. 2024. [CrossRef]
- R. Ding, G. He, Y. Sun, X, Zhang, Y. Cai, and Z. Hu, “Refined wind-solar scene generation research based on improved deep convolutional CWGAN-GP model,” in Asian Conference on Frontiers of Power and Energy (ACFPE), pp. 414-418, Oct. 2024. [CrossRef]
- X. Liu, J. Yu, L. Gong, M. Liu, and X. Xiang, “A GCN-based adaptive generative adversarial network model for short-term wind speed scenario prediction,” Energy, vol. 294, pp. 1-20, May 2024. [CrossRef]
- Y.-H. Cho, S. Liu, H. Zhu, and D. Lee, “Wind power scenario generation using graph convolutional generative adversarial network,” in IEEE Power & Energy Society General Meeting (PESGM), pp. 1-5, July 2023. [CrossRef]
- H. Wei, Z. Hongxuan, D. Yu, W. Yiting, D. Ling, and X. Ming, “Short-term optimal operation of hydro-wind-solar hybrid system with improved generative adversarial networks,” Applied Energy, vol. 250, pp. 389-403, Sep. 2019. [CrossRef]
- X. Zhang, S. Fan, and D. Li, “Spectral normalization generative adversarial networks for photovoltaic power scenario generation,” IET Renewable Power Generation, vol. 99, pp. 1-10, Mar. 2024. [CrossRef]
- Ho, J.; Jain, A.; Abbeel, P. Denoising diffusion probabilistic models. 34th Conference on Neural Information Processing Systems, 2020; pp. 1–14. [Google Scholar]
- Z. Yang, J. Yan, Y. Hong, J. Yang, K. Wang, and Y. Li, “Scenario generation of PV power based on DDPM,” in Conference on Energy Internet and Energy System Integration (EI2), pp. 1-5, Dec. 2023. [CrossRef]
- X. Dong, Z. Mao, Y. Sun, X. Xu, “Short-term wind power scenario generation based on conditional latent diffusion models,” IEEE Trans. Sustainable Energy, vol. 15, no. 2, pp. 1074 – 1085, Apr. 2024. [CrossRef]
- F. Meng, Y. Nan, G. Zheng, J. Shen, Y. Mi, and C. Lu, “Scenario generation of renewable energy resources based on denoising diffusion probability models,” in 4th International Conference on Advanced Electrical and Energy Systems, pp. 1-6, Dec. 2023. [CrossRef]
- D. Wang, D. Peng, D. Huang, H. Zhao, and B. Qu, “Low-carbon optimization scheduling of IES based on enhanced diffusion model for scenario deep generation,” International Journal of Electrical Power and Energy Systems, vol. 167, pp. 1-24, June 2025. [CrossRef]
- J. Zhai, S. Zhang, J. Chen, and Q. He, “Autoencoder and its various variants,” in IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1-5, Oct. 2018. [CrossRef]
- T. Kim, D. Lee, S. Hwangbo, “A deep-learning framework for forecasting renewable demands using variational auto-encoder and bidirectional long short-term memory,” Sustainable Energy, Grids and Networks, vol. 38, pp. 1-15, June 2024. [CrossRef]
- S. Xiao, Z. Liu, X. He, J. Zhang, and H. Liu, “Wind power output scenario generation based on importance weighted autoencoder,” in International Conference on Electrical Machines and Systems (ICEMS), pp. 1-6, Nov. 2023. [CrossRef]
- B. Peng, Z. Sun, and M. Liu, “Medium- and long-term scenario generation method based on autoencoder and generation adversarial network,” in International Conference on Neural Networks, Information and Communication Engineering (NNICE), pp. 1-7, Feb. 2023. [CrossRef]
- Z. Li, X. Peng, W. Cui, Y. Xu, J. Liu, H. Yuan, C. Sing Lai, and L. L. Lai, “A novel scenario generation method of renewable energy using improved VAEGAN with controllable interpretable features,” Applied Energy, vol. 363, pp. 1-15, June 2024. [CrossRef]
- S. Hochreiter, J. Schmidhuber, “Long Short-Term Memory,” Neural Computation, Vol. 9, No. 8, pp. 1735–1780, Nov. 1997. [CrossRef]
- J. Liang, W. Tang, “Wind power scenario generation for microgrid day-ahead scheduling using sequential generative adversarial networks,” in IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, pp. 1-6, Oct. 2019. [CrossRef]
- J. Liang, W. Tang, “Sequence generative adversarial networks for wind power scenario generation,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 1, pp. 110-118, Jan. 2020. [CrossRef]
- J. Yang, S. Zhang, Y. Xiang, J. Liu, J. Liu, X. Han, and F. Teng, “LSTM auto-encoder based representative scenario generation method for hybrid hydro-PV power system,” IET Generation, Transmission & Distribution, vol. 14, no. 24, pp. 5935-5943, Aug. 2020. [CrossRef]
- B. Stappers, N. G. Paterakis, K. Kok, M. Gibescu, “A class-driven approach based on long short-term memory networks for electricity price scenario generation and reduction,” IEEE Trans. Power Systems, vol. 35, no. 4, pp. 3040-3050, July 2020. [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. 31st Conference on Neural Information Processing Systems, November 2017; pp. 1–11. [Google Scholar]
- L. Ye, Y. Peng, Y. Li, and Z. Li, “A novel informer-time-series generative adversarial networks for day-ahead scenario generation of wind power,” Applied Energy, vol. 364, pp. 1-15, June. 2024. [CrossRef]
- H. Li, H. Yu, Z. Liu, F. Li, X. Wu, B. Cao, C. Zhang, D. Liu, “Long-term scenario generation of renewable energy generation using attention-based conditional generative adversarial networks,” IET Energy Conversion and Economics, vol. 5, no. 1, pp. pp. 15-27, Feb. 2024. [CrossRef]
- Z. Zhang, R. Zhu, “A photovoltaic power scenario generation method based on HiLo-WGAN,” in International Forum on Electrical Engineering and Automation (IFEEA), pp. 636-640, Nov. 2024. [CrossRef]
- L. Gu, J. Xu, D. Ke, Y. Deng, X. Hua, and Y. Yu, “Short-term output scenario generation of renewable energy using transformer–wasserstein generative adversarial nets-gradient penalty,” Sustainability, vol. 16, no. 24, pp. 1 – 20, Dec. 2024. [CrossRef]
- J. Liang, W. Tang, “Scenario reduction for stochastic day-ahead scheduling: A mixed autoencoder based time-series clustering approach,” IEEE Trans. Smart Grid, vol. 12, no. 3, pp. 2652-2662, May 2021. [CrossRef]
- Y. Peng, L. Ye, P. Li, T. Gong, “A deep convolutional embedded clustering method for scenario reduction of production simulation,” in International Conference on Power and Renewable Energy (ICPRE), pp. 1-6, Sep. 2023. [CrossRef]
- W. Huang, L. Liang, Z. Dai, S. Cao, H. Zhang, X. Zhao, J. Hou, H. Li, W. Ma, and L. Che, “Scenario reduction of power systems with renewable generations using improved time-GAN,” in International Conference on Smart Grid and Energy, pp. 1-9, Sep. 2023. [CrossRef]
- Li, Q.; Gao, D.W. Fast scenario reduction for power systems by deep learning. Signal Processing 2019, 11, 1–4. [Google Scholar] [CrossRef]
- A. Ajagekar, F. You, “Quantum computing based hybrid deep learning for fault diagnosis in electrical power systems” Applied Energy, Vol. 303, pp. 1-31, Dec. 2021. [CrossRef]










| Reference | Model | Key features |
|---|---|---|
| [18] | Cross-Model GANs | A new model was designed to capture spatio-temporal correlations in renewable energy data, improving scenario accuracy |
| [19,20] | Controllable GANs | Novel mechanisms were introduced to stabilize training and address mode collapse |
| [21] | Conditional Style-Based GANs | Meteorological data was incorporated as conditional input to enable the generation of data with specific attributes or characteristics. By leveraging a style-based GAN, the model captures the overall trend attributes (high-level) and local stochastic fluctuations (low-level) of renewable energy profiles. |
| [22,23,24,25,26,27] | Wasserstein GANs (WGANs) | The stability and efficiency of GAN were enhanced by replacing the original loss function with one based on the Wasserstein distance during training |
| [28,29] | Graph Neural Network-Based GANs | Graph structures were utilized to capture intricate relationships in weather patterns |
| [30] | GAN with Variational Inference | Overall performance was improved by combining the generative mechanism of GANs with the uncertainty modeling of variational inference |
| [31] | Spectral Normalization GAN | Spectral normalization was applied to the discriminator’s parameters to enhance stability during the training process. |
| Gate/State | Indication | Description |
|---|---|---|
| Cell State | The cell state serves as a memory mechanism, preserving information across time steps with minimal alterations to maintain long-term dependencies. | |
| Hidden State | The hidden state reflects the LSTM cell’s output at each time step. | |
| Forget Gate | The forget gate determines which portions of the cell state should be discarded. | |
| Input Gate | The input gate identifies which fresh information should be incorporated into the cell state. | |
| Candidate Cell State | The candidate cell state embodies the potential new information that may be added to the cell state. | |
| Output Gate | The output gate governs the LSTM cell’s output for the current time step. |
| Challenges | Description | Possible Solutions |
|---|---|---|
| Model Complexity and Training Instability | Deep learning models, such as GANs and diffusion models, require substantial computational resources and may suffer from training instability, including issues like mode collapse or vanishing gradients. | Research could focus on developing more robust architectures, such as Wasserstein GANs or hybrid models, to improve training stability and reduce computational complexity. |
| Lack of Interpretability and Transparency | Deep learning models are often regarded as “black-box” methods, which makes it challenging to interpret and understand how scenarios are generated. | Exploring explainable AI techniques to improve model transparency would be crucial for decision-makers in energy systems. |
| High Computational Costs | Generative models, especially GANs and diffusion models, often require high computational resources, limiting their real-time applicability and scalability. | There is an opportunity to develop more efficient architectures, such as low-rank approximations or model pruning, to reduce computational requirements. |
| Scalability to Large-scale Systems | As power systems grow larger and more complex, the dimensionality of the data increases, making it difficult for deep learning models to handle the scale without compromising performance or efficiency. | New architectures, such as distributed learning systems, could enable the scaling of deep learning techniques to large datasets. |
| Challenges | Description | Possible Solutions |
|---|---|---|
| Loss of Critical Information | Scenario reduction techniques, such as clustering or dimensionality reduction, can sometimes discard important information, leading to reduced model accuracy or suboptimal decision-making. | More sophisticated reduction algorithms, such as deep clustering or hierarchical clustering, could improve the quality of reduced scenarios by better capturing relationships between scenarios. |
| Real-Time Processing and Adaptability | Many scenario reduction techniques, while effective, are not well-suited for real-time applications, where fast adaptation to changing inputs is required, such as in energy trading or grid management. | Developing real-time scenario reduction frameworks using deep reinforcement learning or online learning techniques could help tackle this challenge. |
| Computational Complexity | Advanced reduction methods, particularly those using deep learning, can be computationally intensive, limiting their practical use for large-scale, high-dimensional data in power systems. | Research could focus on hybrid methods that combine numerical optimization approaches with deep learning to balance computational efficiency and scenario quality. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).