Submitted:
10 January 2024
Posted:
10 January 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
- We introduce a novel method that uses INNs to reconstruct the spatial distribution of the void fraction from limited magnetic flux density measurements, thereby addressing the inverse problem of the Biot-Savart Equation in electrolysis.
- We show that INN is more accurate than the Tikhonov approach to reconstruct the distribution of the void fraction when the amplitude of the noise in the magnetic sensor measurements is not known or varies considerably in space and time.
- In scenarios where the number of sensors is further reduced, and the distance of the sensor placement from the region where the conductivity needs to be reconstructed is further increased, we show that our INN model is able to provide a good reconstruction of the void fraction distribution.
- We present a new evaluation metric named Random Error Diffusion that computes the likelihood that the predicted conductivity distribution resembles the ground truth. Based on Random Error Diffusion, we show that our INN-based approach is better than the Tikhonov regularization.
2. Related Work
2.1. Electrolysis for Clean Hydrogen: Notable Challenges
2.2. Solving Inverse Problem of Biot-Savart Equation - Analytical Approaches
2.3. Solving Inverse Problems using Deep Learning
2.4. Invertible Neural Networks (INNs)
3. Simulation Setup
3.1. Simulation Design
3.2. Simulation Parameters
3.3. Mesh Transformation
3.4. Solving Forward Process via Biot-Savart Equation
3.5. Simulation Data
4. Method
4.1. INN Architecture

4.2. INN Training and Testing Procedure
4.3. Random Error Diffusion

4.3.1. Algorithm
4.4. Bias and Deviation
4.4.1. Peak Signal-to-Noise Ratio (PSNR)
5. Experiments and Results
5.1. Data Standardization
5.2. INN Hyperparameters
5.3. Evaluated Methods
5.4. Qualitative Results
5.4.1. Prediction of the Conductivity Maps: A Comparative Study
5.4.2. Effect of the Sensor Distance and Number of Sensors
5.4.3. Robustness to Noise: INN vs Tikhonov without Noisy Training Data
5.4.4. Robustness to Noise: INN vs Tikhonov with Noisy Training Data
5.4.5. Robustness to Noise: Summary
5.4.6. Effect of Number of Uniform Noise Samples
5.4.7. Random Sampling from Latent Space
5.5. Quantitative Results
5.5.1. Effect of Number of Coupling Blocks on Validation Loss
5.5.2. Random Error Diffusion
5.5.3. Bias and Deviation
5.5.4. Number of Uniform Noise Samples
6. Conclusion
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Capurso, T.; Stefanizzi, M.; Torresi, M.; Camporeale, S.M. Perspective of the role of hydrogen in the 21st century energy transition. Energy Conversion and Management 2022, 251, 114898. [Google Scholar] [CrossRef]
- Angulo, A.; van der Linde, P.; Gardeniers, H.; Modestino, M.; Fernández Rivas, D. Influence of bubbles on the energy conversion efficiency of electrochemical reactors. Joule 2020, 4(3), 555–579. [Google Scholar] [CrossRef]
- Ardizzone, L.; Kruse, J.; Rother, C.; Köthe, U. Analyzing inverse Problems with invertible neural networks. In Proceedings of the International Conference on Learning Representations (ICLR) 2019. [Google Scholar]
- Hanke, M. Limitations of the L-curve method in ill-posed problems. BIT Numerical Mathematics 1996, 36(2), 287–301. [Google Scholar] [CrossRef]
- Hossain, S.S.; Mutschke, G.; Bashkatov, A.; Eckert, K. The thermocapillary effect on gas bubbles growing on electrodes of different sizes. Electrochimica Acta 2020, 353, 136461. [Google Scholar] [CrossRef]
- Li, H.; Schwab, J.; Antholzer, S.; Haltmeier, M. NETT: Solving inverse problems with deep neural networks. Inverse Problems 2020, 36(6), 065005. [Google Scholar] [CrossRef]
- Stefani, F.; Gundrum, T.; Gerbeth, G. Contactless inductive flow tomography. Physical Review E 2004, 70, 056306. [Google Scholar] [CrossRef] [PubMed]
- Dinh, L.; Sohl-Dickstein, J.; Bengio, S. Density estimation using Real NVP. In Proceedings of the International Conference on Learning Representations (ICLR) 2017. [Google Scholar]
- Kingma, D.P.; Dhariwal, P. Glow: Generative flow with invertible 1x1 convolutions. Advances in neural information processing systems 2018, 31. [Google Scholar]
- Amores, E.; Sánchez, M.; Rojas, N.; Sánchez-Molina, M. Renewable hydrogen production by water electrolysis. In Sustainable Fuel Technologies Handbook, 1st ed.; Dutta, S., Hussain, C.M., Eds.; Academic Press: London, UK, 2021; pp. 271–313. [Google Scholar]
- Roth, B.J.; Sepulveda, N.G.; Wikswo Jr, J.P. 1989. Using a magnetometer to image a two-dimensional current distribution. Journal of applied physics, 1989; 65, 1, 361–372. [Google Scholar]
- Johansen, T.H.; Baziljevich, M.; Bratsberg, H.; Galperin, Y.; Lindelof, P.E.; Shen, Y.; Vase, P. Direct observation of the current distribution in thin superconducting strips using magneto-optic imaging. Physical Review B 1996, 54(22), 16264. [Google Scholar] [CrossRef]
- Svensson, J.; Werner, A.; JET-EFDA Contributors. Current tomography for axisymmetric plasmas. Plasma Physics and Controlled Fusion 2008, 50(8), 085002. [Google Scholar] [CrossRef]
- Adler, J.; Öktem, O. Solving ill-posed inverse problems using iterative deep neural networks. Inverse Problems 2017, 33(12), 124007. [Google Scholar] [CrossRef]
- Hauer, K.H.; Potthast, R.; Wannert, M. Algorithms for magnetic tomography—on the role of a priori knowledge and constraints. Inverse Problems 2022, 24(4), 045008. [Google Scholar] [CrossRef]
- Larminie, J.; Dicks, A.; McDonald, M.S. Fuel cell systems explained. Chichester, UK: J. Wiley 2003, 2, 207–225. [Google Scholar]
- Molnarne, M.; Schroeder, V. Hazardous properties of hydrogen and hydrogen containing fuel gases. Process Safety and Environmental Protection 2019, 130, 1–5. [Google Scholar] [CrossRef]
- Shepard, D. A two-dimensional interpolation function for irregularly-spaced data. In Proceedings of the 1968 23rd ACM national conference 1968, 517–524. [Google Scholar]
- Gan, L.; Jiang, P.; Lev, B.; Zhou, X. Balancing of supply and demand of renewable energy power system: A review and bibliometric analysis. Sustainable Futures 2020, 2, 100013. [Google Scholar] [CrossRef]
- Iain Staffell, I.; Pfenninger, S. The increasing impact of weather on electricity supply and demand. Energy 2018, 145, 65–78. [Google Scholar] [CrossRef]
- Wang, M.; Wang, Z.; Gong, X.; Guo, Z. The intensification technologies to water electrolysis for hydrogen production—A Review. Renewable and Sustainable Energy Reviews 2014, 29, 573–588. [Google Scholar] [CrossRef]
- Zhao, X.; Ren, H.; Luo, L. Gas bubbles in electrochemical gas evolution reactions. Langmuir 2019, 35, 5392–5408. [Google Scholar] [CrossRef]
- Jeon, D.H.; Kim, S.; Kim, M.; Lee, C. , Cho, H. Oxygen bubble transport in a porous transport layer of polymer electrolyte water electrolyzer. Journal of Power Sources 2023, 553, 232322. [Google Scholar] [CrossRef]
- Mo, J.; Kang, Z.; Yang, G.; Li, Y.; Retterer, ST.; Cullen, DA.; Toops, TJ.; Bender, G.; Pivovar, BS.; Green Jr, JB.; Zhang, FY. In situ investigation on ultrafast oxygen evolution reactions of water splitting in proton exchange membrane electrolyzer cells. Journal of Materials Chemistry A 2017, 5(35), 18469–75. [Google Scholar] [CrossRef]
- Hauer, K.-H.; Potthast, R.; Wüster, T.; Stolten, D. Magnetotomography—a new method for analysing fuel cell performance and quality. Journal of Power Sources, 2005; 143, 1–2, 67–74. [Google Scholar]
- Bianchi, D.; Lai, G.; Li, W. Uniformly convex neural networks and non-stationary iterated network Tikhonov (iNETT) method. Inverse Problems 2023, 39(5), 055002. [Google Scholar] [CrossRef]
- Lei, J.; Liu, Q.; Wang, X. Deep learning-based inversion method for imaging problems in electrical capacitance tomography. IEEE Transactions on Instrumentation and Measurement 2018, 67(9), 2107–2118. [Google Scholar] [CrossRef]
- Zhu, H.; Sun, J.; Xu, L.; Tian, W.; Sun, S. Permittivity reconstruction in electrical capacitance tomography based on visual representation of deep neural network. IEEE Sensors Journal 2020, 20(9), 4803–15. [Google Scholar] [CrossRef]
- Smyl, D.; Liu, D. Optimizing electrode positions in 2-D electrical impedance tomography using deep learning. IEEE Transactions on Instrumentation and Measurement 2020, 69(9), 6030–44. [Google Scholar] [CrossRef]
- Fan, Y.; Ying, L. Solving electrical impedance tomography with deep learning. Journal of Computational Physics 2020, 404, 109119. [Google Scholar] [CrossRef]
- Tan, C.; Lv, S.; Dong, F.; Takei, M. Image reconstruction based on convolutional neural network for electrical resistance tomography. IEEE Sensors Journal 2018, 19(1), 196–204. [Google Scholar] [CrossRef]
- Li, F.; Tan, C.; Dong, F. Electrical resistance tomography image reconstruction with densely connected convolutional neural network. IEEE Transactions on Instrumentation and Measurement 2020, 70, 1. [Google Scholar] [CrossRef]
- Li, F.; Tan, C.; Dong, F.; Jia, J. V-net deep imaging method for electrical resistance tomography. IEEE Sensors Journal 2020, 20(12), 6460–9. [Google Scholar] [CrossRef]
- Padmanabha, GA.; Zabaras, N. Solving inverse problems using conditional invertible neural networks. Journal of Computational Physics 2021, 433, 110194. [Google Scholar] [CrossRef]
- Aggarwal, HK.; Mani, MP.; Jacob, M. MoDL: Model-based deep learning architecture for inverse problems. IEEE Transactions on Medical Imaging 2018, 38(2), 394–405. [Google Scholar] [CrossRef] [PubMed]
- Bao, G.; Ye, X.; Zang, Y.; Zhou, H. Numerical solution of inverse problems by weak adversarial networks. Inverse Problems 2020, 36(11), 115003. [Google Scholar] [CrossRef]
- Sim, B.; Oh, G.; Kim, J.; Jung, C.; Ye, JC. Optimal transport driven CycleGAN for unsupervised learning in inverse problems. SIAM Journal on Imaging Sciences 2020, 13(4), 2281–306. [Google Scholar] [CrossRef]
- Kłosowski, G.; Rymarczyk, T.; Wójcik, D. The use of an LSTM-based autoencoder for measurement denoising in process tomography. International Journal of Applied Electromagnetics and Mechanics 2023, 1–4. [Google Scholar] [CrossRef]
- Genzel, M.; Macdonald, J.; März, M. Solving inverse problems with deep neural networks–robustness included? IEEE Transactions on Pattern Analysis and Machine Intelligence 2022, 45(1), 1119–34. [Google Scholar] [CrossRef]
- Afkham, BM.; Chung, J.; Chung, M. Learning regularization parameters of inverse problems via deep neural networks. Inverse Problems 2021, 37(10), 105017. [Google Scholar] [CrossRef]
- McCann, MT.; Jin, KH.; Unser, M. Convolutional neural networks for inverse problems in imaging: A review. IEEE Signal Processing Magazine 2017, 34(6), 85–95. [Google Scholar] [CrossRef]
- Lucas, A.; Iliadis, M.; Molina, R.; Katsaggelos, AK. Using deep neural networks for inverse problems in imaging: beyond analytical methods. IEEE Signal Processing Magazine 2018, 35(1), 20–36. [Google Scholar] [CrossRef]
- Liang, D.; Cheng, J.; Ke, Z.; Ying, L. Deep magnetic resonance image reconstruction: Inverse problems meet neural networks. IEEE Signal Processing Magazine 2020, 37(1), 141–51. [Google Scholar] [CrossRef]
- Chun, IY.; Huang, Z.; Lim, H.; Fessler, J. Momentum-Net: Fast and convergent iterative neural network for inverse problems. IEEE transactions on pattern analysis and machine intelligence 2020. [Google Scholar] [CrossRef] [PubMed]
- Li, L.; Wang, LG.; Teixeira, FL.; Liu, C.; Nehorai, A.; Cui, TJ. DeepNIS: Deep neural network for nonlinear electromagnetic inverse scattering. IEEE Transactions on Antennas and Propagation 2018, 67(3), 1819–25. [Google Scholar] [CrossRef]
- Ongie, G.; Jalal, A.; Metzler, CA.; Baraniuk, RG.; Dimakis, AG.; Willett, R. Deep learning techniques for inverse problems in imaging. IEEE Journal on Selected Areas in Information Theory 2020, 1(1), 39–56. [Google Scholar] [CrossRef]
- Lunz, S.; Öktem, O.; Schönlieb, CB. Adversarial regularizers in inverse problems. NeurIPS 2018, 31. [Google Scholar]
- Ye, JC.; Han, Y.; Cha, E. Deep convolutional framelets: A general deep learning framework for inverse problems. SIAM Journal on Imaging Sciences 2018, 11(2), 991–1048. [Google Scholar] [CrossRef]
- Baguer, DO.; Leuschner, J.; Schmidt, M. Computed tomography reconstruction using deep image prior and learned reconstruction methods. Inverse Problems 2020, 36(9), 094004. [Google Scholar] [CrossRef]
- Bubba, TA.; Kutyniok, G.; Lassas, M.; März, M.; Samek, W.; Siltanen, S.; Srinivasan, V. Learning the invisible: A hybrid deep learning-shearlet framework for limited angle computed tomography. Inverse Problems 2019, 35(6), 064002. [Google Scholar] [CrossRef]
- Li, L.; Wang, LG.; Teixeira, FL. Performance analysis and dynamic evolution of deep convolutional neural network for electromagnetic inverse scattering. IEEE Antennas and Wireless Propagation Letters 2019, 18(11), 2259–63. [Google Scholar] [CrossRef]
- Gong, K.; Guan, J.; Kim, K.; Zhang, X.; Yang, J.; Seo, Y.; El Fakhri, G.; Qi, J.; Li, Q. Iterative PET image reconstruction using convolutional neural network representation. IEEE Transactions on Medical Imaging 2018, 38(3), 675–85. [Google Scholar] [CrossRef]
- Dittmer, S.; Kluth, T.; Maass, P.; Otero Baguer, D. Regularization by architecture: A deep prior approach for inverse problems. Journal of Mathematical Imaging and Vision 2020, 62, 456–70. [Google Scholar] [CrossRef]
- Arridge, S.; Maass, P.; Öktem, O.; Schönlieb, CB. Solving inverse problems using data-driven models. Acta Numerica 2019, 28, 1–74. [Google Scholar] [CrossRef]
- Şahin, GG.; Gurevych, I. Two birds with one stone: Investigating invertible neural networks for inverse problems in morphology. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2020; 7814–7821. [Google Scholar]
- Denker, A.; Schmidt, M.; Leuschner, J.; Maass, P. Conditional invertible neural networks for medical imaging. Journal of Imaging 2021, 7(11), 243. [Google Scholar] [CrossRef]
- Luo, M.; Lee, S. Inverse design of optical lenses enabled by generative flow-based invertible neural networks. Scientific Reports 2023, 13(1), 16416. [Google Scholar] [CrossRef]
- Dinh, L.; Krueger, D.; Bengio, Y. NICE: Non-linear Independent Components Estimation. ICLR Workshop 2015. [Google Scholar]
- Grathwohl, W.; Chen, R.T.Q.; Bettencourt, J.; Sutskever, I.; Duvenaud, D. FFJORD: Free-form continuous dynamics for scalable reversible generative models. ICLR 2019. [Google Scholar]
- Huang, C.W.; Krueger, D.; Lacoste, A.; Courville, A. Neural Autoregressive Flows. ICML 2018. [Google Scholar]
- Jaini, P.; Selby, K.A.; Yu, Y. Sum-of-squares polynomial flow. Proceedings of the 36th International Conference on Machine Learning, ICML, 2019. [Google Scholar]
- Durkan, C.; Bekasov, A.; Murray, I.; Papamakarios, G. Cubic-spline flows. Workshop on Invertible Neural Networks and Normalizing Flows, ICML, 2019. [Google Scholar]
- Durkan, C.; Bekasov, A.; Murray, I.; Papamakarios, G. Neural Spline Flows. Advances in Neural Information Processing Systems 2019. [Google Scholar]
- Ivan, K.; Simon, J.D.P.; Marcus, A.B. Normalizing Flows: An introduction and review of current methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 2020, 43(11), 3964–3979. [Google Scholar]
- Kumar, N.; Krause, L.; Wondrak, T.; Eckert, S.; Eckert, K.; Gumhold, S. Learning to reconstruct the bubble distribution with conductivity maps using Invertible Neural Networks and Error Diffusion. arXiv preprint arXiv:2307.02496, arXiv:2307.02496 2023.
- Krause, L.; Kumar, N.; Wondrak, T.; Gumhold, S.; Eckert, S.; Eckert, K. Current Tomography–Localization of void fractions in conducting liquids by measuring the induced magnetic flux density. arXiv preprint arXiv:2307.11540, arXiv:2307.11540 2023.
- Zhang, H.Q.; Jin, Y.; Qiu, Y. The optical and electrical characteristics of PMMA film prepared by spin coating method. IOP Conference Series: Materials Science and Engineering 2015, 87, 012032. [Google Scholar] [CrossRef]
- Plevachuk, Y.; Sklyarchuk, V.; Eckert, S.; Gerbeth, G.; Novakovic, R. Thermophysical properties of the liquid Ga–In–Sn eutectic alloy. Journal of Chemical & Engineering Data, 2014; 59, 3, 757–763. [Google Scholar]
- Floyd, R.W.; Steinberg, L. An adaptive algorithm for spatial grey scale. Proceedings of the Society of Information Display 1976, 17, 75–77. [Google Scholar]
- Ivanova, M. E; Peters, R.; Müller, M.; Haas, S.; Seidler, M. F.; Mutschke, G.; Eckert, K.; Röse, P.; Calnan, S.; Bagacki, R.; Schlatmann, R.; Grosselindemann, C.; Schäfer, L.-A.; Menzler, N. H.; Weber, A.; van de Krol, R.; Liang, F.; Abdi, F. F.; Brendelberger, S.; Neumann, N.; Grobbel, J.; Roeb, M.; Sattler, C.; Duran, I.; Dietrich, B.; Hofberger, M. E. C.; Stoppel, L.; Uhlenbruck, N.; Wetzel, T.; Rauner, D.; Hecimovic, A.; Fantz, U.; Kulyk, N.; Harting, J.; Guillon, O. Technological pathways to produce compressed and highly pure hydrogen from solar power. Angewandte Chemie International Edition 2023, 62, e202218850. [Google Scholar] [PubMed]
- Sieger, M.; Mitra, R.; Schindler, F.; Vogt, T.; Stefani, F.; Eckert, S.; Wondrak, T. Challenges in contactless inductive flow tomography for Rayleigh-Bénard convection cells. Magnetohydrodynamics 2022, 58, 25–32. [Google Scholar]
- Wieser, C.; Helmbold, A.; Gülzow, E. A new technique for two-dimensional current distribution measurements in electrochemical cells. Journal of Applied Electrochemistry 2000, 30, 803–807. [Google Scholar] [CrossRef]
- Plait, A.; Giurgea, S.; Hissel, D.; Espanet, C. New magnetic field analyzer device dedicated for polymer electrolyte fuel cells noninvasive diagnostic. International Journal of Hydrogen Energy 2020, 45(27), 14071–14082. [Google Scholar] [CrossRef]
- Bashkatov, A.; Hossain, S.S.; Yang, X.; Mutschke, G.; Eckert, K. Oscillating hydrogen bubbles at Pt microelectrodes. Physical Review Letters 2019, 123(21), 214503. [Google Scholar] [CrossRef]
- Bashkatov, A.; Hossain, S.S.; Mutschke, G.; Yang, X.; Rox, H.; Weidinger, I. M.; Eckert, K. On the growth regimes of hydrogen bubbles at microelectrodes. Physical Chemistry Chemical Physics 2022, 24(43), 26738–26752. [Google Scholar] [CrossRef]















![]() |
![]() |
![]() |
![]() |
![]() |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).




