Modern power system integrates more and more new energy and use a large number of power electronic equipment. This makes it face more challenges in online optimization and real-time control. Deep reinforcement learning(DRL) has the ability of processing big data and high-dimensional features, as well as the ability of independently learning and optimizing decision-making in complex environments. In this paper, we explore DRL based online combination optimization method of grid section for large complex power system. In our method, to improve the convergence speed of the model, we propose to discretize the output action of the unit and simplify the action space. We also design a reinforcement learning loss function with strong constraints to further improve the convergence speed of the model and facilitate the algorithm to obtain the stable solution. Moreover, to avoid the local optimal solution problem caused by the discretization of the output action, we propose to use the annealing optimization algorithm to make the granularity of the unit output finer. We verify our method on IEEE 118-bus system. The experimental results show that our model has fast convergence speed and better performance, and can obtain stable solutions.

The magnetic properties of 0.10 mm ultra-thin grain-oriented (UTGO) silicon steel and Fe-based amorphous (FBA) alloy under sinusoidal excitation were measured experimentally, and the magnetic field strength and iron loss of the two materials under different frequencies and magnetic densities were obtained. Based on the measured data, the magnetization and loss characteristics of the two materials were analyzed and compared. Furthermore, two Epstein square ring models of the same specification and different materials were designed, and the reliability of the models was verified. Then, the electromagnetic characteristics of the two Epstein square ring models at higher and lower frequencies were calculated by using the finite element method, and the iron loss was obtained and compared. The results show that the FBA alloy has good application characteristics at low frequency and low power, and the 0.10 mm UTGO silicon steel has good application characteristics at high frequency and high power. This research can provide important data basis to promote the application of these two materials in new energy equipment.