Submitted:
31 October 2024
Posted:
01 November 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Methodology
2.1. CEEMDAN
-
Add Gaussian white noise to the original signal:In the formula, is the original signal, is the adaptive Gaussian white noise added in the processing, is the signal-to-noise ratio between the noise and the original signal, is the new signal generated after adding white noise for the time, and N is the number of integrations.
-
After decomposition of , multiple intrinsic mode sequences and residuals are obtained:In the formula, N is the number of components, is the first IMF component obtained by CEEMDAN decomposition, is the intrinsic mode obtained after decomposition, is the residual obtained after the first decomposition.
-
Add adaptive Gaussian white noise to to obtain a new signal. Repeat the above steps to obtain other intrinsic modes and residuals:In the formula, is the th component obtained by CEEMDAN decomposition, is the residual signal at the stage, is the component after decomposition, is the signal-to-noise ratio added in the stage, k is the total number of modes.
- Repeat the above steps until R cannot be decomposed anymore. The decomposition result of the original signal by CEEMDAN can be expressed as:
2.2. CNN
2.3. LSTM
2.4. Attention Mechanism
3. Training and Testing
3.1. Procedure
- Decompose the GIC data by CEEMDAN to obtain the intrinsic modes , ... and the R;
- The intrinsic modes and residual are respectively normalized by MinMax to the interval (-1, 1), and the data sets are divided according to 8:2 for both;
- The training set is input into the CNN to further extract features, and then the training set after feature extraction enters the LSTM layer for training, and then enters the Attention layer to adjust the training weights. During the training process, different hyperparameters are input, and the grid search method (Grid SeaschCV) is used to find the best hyperparameters;
- Obtain the final inverse-normalized training result with the best hyperparameters. Then accumulate the prediction results of different intrinsic modes and compare them with the observed data, and conduct a comprehensive evaluation of the prediction model.
3.2. Evaluation
4. Results
4.1. Data
4.2. Events
4.3. CEEMDAN of GIC Sequences
4.4. IMFs Prediction
4.5. GIC Prediction
- The GIC value predicted by the LSTM model is larger than the real value. After adding CNN and Attention, the predicted value of the CNN-LSTM-Attention model is closer to the real value.
- The GIC response speed of the LSTM model and the CNN-LSTM-Attention model has a delay of about 3 seconds. This delay phenomenon has also been observed in other studies using LSTM for prediction[24]. One possible reason: The LSTM model algorithm uses fixed time window samples for training and learning. In order to minimize the error, using the value at t as the predicted value at not only requires no additional operations but also has a small error, resulting in a delay in the final prediction.
- The CEEMDAN-LSTM model and the CEEMDAN-CNN-LSTM-Attention model can reduce the time delay of the GIC response during geomagnetic storms by about 3 seconds by decomposing and predicting GIC data and then accumulating.
- In terms of overall prediction performance, the CNN-LSTM-Attention model and the CEEMDAN-LSTM model are close in prediction performance. However, in the response during geomagnetic storms, the CEEMDAN-LSTM model is significantly better than the CNN-LSTM-Attention model. This shows that adding the CEEMDAN method can effectively reduce prediction delay and thus improve prediction performance.
- For the LSTM model, R2 is the lowest at 0.830, and RMSE and MAE are the highest, at 3.00A and 2.45A respectively.
- The CNN-LSTM-Attention model adds CNN and Attention to improve the prediction effect. R2, RMSE and MAE are 0.850, 2.82A and 2.22A respectively.
- The CEEMDAN-LSTM model after adding the CEEMDAN method has a reduced degree of delay. And since it is decomposed into IMFn and R, which reduces the difficulty of machine learning, the prediction effect is greatly improved. R2, RMSE and MAE are 0.949, 1.63A and 1.26A respectively.
- The CEEMDAN-CNN-LSTM-Attention model has the highest R2 at 0.992, and the lowest RMSE and MAE at 0.64A and 0.50A respectively, verifying that the CEEMDAN-CNN-LSTM-Attention model proposed in this paper shows good prediction performance when predicting GIC during geomagnetic storms.
5. Discussion
- This paper addresses the inherent instability and nonlinearity of GIC data observed during geomagnetic storms by employing the CEEMDAN method for data preprocessing. This approach decomposes the GIC data into intrinsic mode signals across multiple time scales, thereby enhancing data stability. The integration of CEEMDAN with LSTM yields a significant enhancement in predictive accuracy compared to the use of LSTM alone. Moreover, the CEEMDAN-LSTM model effectively mitigates the time delay issues associated with responses to geomagnetic storms, leading to improved overall prediction performance.
- The predictive performance of the CNN-LSTM-Attention model, which incorporates both CNN and Attention mechanisms, surpasses that of the LSTM model alone. This enhancement suggests that the CNN effectively captures instantaneous features from the data, while the Attention mechanism refines the model’s accuracy by dynamically adjusting the weights assigned to different features.
- Due to the general scarcity of continuous GIC monitoring in actual power grid research, this paper is constrained to a limited number of storm samples for training and testing the predictive model. Consequently, the hybrid model, trained on this modest historical dataset, currently lacks the practical predictive capability for GIC. This limitation also extends to its generalizability and universal applicability to a certain extent.
- The hybrid neural network prediction model presented in this study employs GIC data for single-step forecasting. Given that CEEMDAN is capable of executing only single-sequence decomposition per iteration, the temporal efficiency of sequentially decomposing multiple input parameters merits consideration when developing a multi-parameter GIC prediction model. Concurrently, the intrinsic modes derived from CEEMDAN decomposition are collectively processed using a CNN-LSTM-Attention architecture, which functions as a multi-input and multi-output system. Naturally, variations exist in the number of intrinsic modes fed into the modeling process, and the resulting trained models exhibit minor discrepancies.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- F. R ,N. A ,N. L , et al. Investigating the Magnetic Structure of Interplanetary Coronal Mass Ejections Using Simultaneous Multispacecraft In Situ Measurements. The Astrophysical Journal 2023, 957, 1. [Google Scholar] [CrossRef]
- Rajkumar, H. Intense, Long-Duration Geomagnetically Induced Currents (GICs) Caused by Intense Substorm Clusters. Space Weather 2022, 20, 3. [Google Scholar] [CrossRef]
- XinW ,LiuC ,WangG , et al. Vibration characteristics of a single-phase four-column auto-transformer core excited by geomagnetically induced currents. IET Electric Power Applications 2024, 18, 766–778. [Google Scholar] [CrossRef]
- David O ,Pitambar J. Power system harmonic analysis with real geomagnetically induced current from the 2003 halloween storm. Scientific African 2024, 22. [Google Scholar] [CrossRef]
- Zan-ming C ,Chun-ming L ,An-qi L , et al. Modeling Calculation and Influencing Factors of Geomagnetically Induced Current in Sanhua Power Grid. Journal of Physics: Conference Series 2023, 2564, 1. [Google Scholar] [CrossRef]
- Liu C ,Liu L ,Pirjola R , et al. Calculation of geomagnetically induced currents in mid- to low-latitude power grids based on the plane wave method: A preliminary case study. Space Weather 2024, 7, 4. [Google Scholar] [CrossRef]
- Pirjola, R. and Viljanen, A. Complex image method for calculating electric and magnetic fields produced by an auroral electrojet of a finite length. Annales Geophysicae 1998, 16, 1434–1444. [Google Scholar] [CrossRef]
- Boteler, D.H. and Pirjola, R.J. The complex-image method for calculating the magnetic and electric fields at the surface of the Earth by the auroral electrojet. Geophysical JournalInternational 1998, 132, 31–40. [Google Scholar] [CrossRef]
- A. V ,A. P ,O. A , et al. Fast computation of the geoelectric field using the method of elementary current systems and planar Earth models. Annales Geophysicae 2024, 22, 101–113. [Google Scholar] [CrossRef]
- Ngwira M C ,McKinnell L ,Cilliers J P , et al. Limitations of the modeling of geomagnetically induced currents in the South African power network. Space Weather 2009, 7, 10. [Google Scholar] [CrossRef]
- Wintoft, P. , er al. Study of the solar wind coupling to the time difference horizontal geomagnetic field. Annales Geophysicae 2005, 23, 1949–1957. [Google Scholar] [CrossRef]
- V. P ,O. K ,M. H , et al. Is the Global MHD Modeling of the Magnetosphere Adequate for GIC Prediction: the May 27–28, 2017 Storm. Cosmic Research 2023, 61, 120–132. [Google Scholar] [CrossRef]
- Zhang J J ,Yu Q Y ,Wang C , et al. Measurements and Simulations of the Geomagnetically Induced Currents in Low-Latitude Power Networks During Geomagnetic Storms. Space Weather 2020, 18, 8. [Google Scholar] [CrossRef]
- Tan, Y. , Hu, Q., Wang, Z., Zhong, Q. Geomagnetic index Kp forecasting with LSTM. IET Electric Power Applications 2018, 16, 406–416. [Google Scholar] [CrossRef]
- Camporeale S C G A M. Multiple-Hour-Ahead Forecast of the Dst Index Using a Combination of Long Short-Term Memory Neural Network and Gaussian Process. Space Weather 2018, 18, 1882–1896. [Google Scholar] [CrossRef]
- Zhang, H. , Xu, H. R., Peng, G. S., Qian, Y. D., Zhang, X. X., Yang, G. L., et al. A prediction model of relativistic electrons at geostationary orbit using the EMD-LSTM network and geomagnetic indices. Space Weather 2022, 20, 1029. [Google Scholar] [CrossRef]
- Cid M C A. Deep Neural Networks With Convolutional and LSTM Layers for SYM-H and ASY-H Forecasting. Space Weather 2021, 19, 6. [Google Scholar] [CrossRef]
- Bailey, R. L. , Leonhardt, R., Möstl, C., Beggan, C., Reiss, M. A., Bhaskar, A., Weiss, A. J. Forecasting GICs and geoelectric fields from solar wind data using LSTMs: Application in Austria. Space Weather 2022, 20. [Google Scholar] [CrossRef]
- Huang, N.E. , Shen, Z., Long, S.R., et al. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London Series A: mathematical, physical and engineering sciences 1998, 454, 903–995. [Google Scholar] [CrossRef]
- Wu, Z. , Huang, N.E. Ensemble empirical mode decomposition: a noise-assisted data analysis method. Advances in adaptive data analysis 2009, 1, 1–41. [Google Scholar] [CrossRef]
- Torres, M.E. , Colominas, M.A., Schlotthauer, G., et al. A complete ensemble empirical mode decomposition with adaptive noise. IEEE, 2011. [Google Scholar] [CrossRef]
- Rio F ,Matthew B H ,Maria C , et al. Facial expression recognition using bidirectional LSTM-CNN. Procedia Computer Science 2023, 47, 21639. [Google Scholar]
- Yuan G ,Chengkuan F ,Yingjun R. A novel model for the prediction of long-term building energy demand: LSTM with Attention layer. IOP Conference Series: Earth and Environmental Science 2019, 18294012033, 012033. [Google Scholar] [CrossRef]
- Jianxian C ,Xun D ,Li H , et al. An Air Quality Prediction Model Based on a Noise Reduction Self-Coding Deep Network. Mathematical Problems in Engineering 2020, 2020. [Google Scholar] [CrossRef]










| Model | R2 | RMSE/A | MAE/A |
|---|---|---|---|
| LSTM | 0.963 | 1.36 | 1.04 |
| CNN-LSTM-Attention | 0.980 | 1.01 | 0.71 |
| CEEMDAN-LSTM | 0.981 | 0.99 | 0.78 |
| CEEMDAN-CNN-LSTM-Attention | 0.994 | 0.54 | 0.41 |
| Model | R2 | RMSE/A | MAE/A |
|---|---|---|---|
| LSTM | 0.830 | 3.00 | 2.45 |
| CNN-LSTM-Attention | 0.850 | 2.82 | 2.22 |
| CEEMDAN-LSTM | 0.949 | 1.63 | 1.26 |
| CEEMDAN-CNN-LSTM-Attention | 0.992 | 0.64 | 0.50 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).