Abstract
In this paper, the authors propose Neumann series neural operator (NSNO) to learn the solution operator of Helmholtz equation from inhomogeneity coefficients and source terms to solutions. Helmholtz equation is a crucial partial differential equation (PDE) with applications in various scientific and engineering fields. However, efficient solver of Helmholtz equation is still a big challenge especially in the case of high wavenumber. Recently, deep learning has shown great potential in solving PDEs especially in learning solution operators. Inspired by Neumann series in Helmholtz equation, the authors design a novel network architecture in which U-Net is embedded inside to capture the multiscale feature. Extensive experiments show that the proposed NSNO significantly outperforms the state-of-the-art FNO with at least 60% lower relative L2-error, especially in the large wavenumber case, and has 50% lower computational cost and less data requirement. Moreover, NSNO can be used as the surrogate model in inverse scattering problems. Numerical tests show that NSNO is able to give comparable results with traditional finite difference forward solver while the computational cost is reduced tremendously.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Colton D and Kress R, Inverse Acoustic and Electromagnetic Scattering Theory, Springer-Verlag, New York, 2013.
Arridge S R, Optical tomography in medical imaging, Inverse Problems, 2007, 15): 41–93.
Colton D, Coyle J, and Monk P, Recent developments in inverse acoustic scattering theory, SIAM Review, 2000, 42(3): 369–414.
Singer I, Turkel E, High-order finite difference methods for the Helmholtz equation, Comput. Methods Appl. Mech. Engrg., 1998, 163(1–4): 343–358.
Babuška I, Ihlenburg F, Paik E T, et al., A generalized finite element method for solving the Helmholtz equation in two dimensions with minimal pollution, Comput. Methods Appl. Mech. Engrg., 1995, 128(3–4): 325–359.
Saad Y and Schultz M H, GMRES: A generalized minimal residual algorithm for solving non-symmetric linear systems, SIAM. Sci. Stat. Comput., 1986, 7(3): 856–869.
Ernst O G and Gander M J, Why it is difficult to solve Helmholtz problems with classical iterative methods, Numerical Analysis of Multiscale Problems, Springer-Verlag, New York, 2011, 325–363.
Hornik K, Stinchcombe M, and White H, Multilayer feedforward networks are universal approximators, Neural Networks, 1989, 2(5): 359–366.
Goodfellow I, Bengio Y, and Courville A, Deep Learning, MIT Press, Cambridge, 2016.
Young T, Hazarika D, Poria S, et al., Recent trends in deep learning based natural language processing, IEEE Comput. Intell. Mag., 2018, 13(3): 55–75.
Beck C, Hutzenthaler M, Jentzen A, et al., An overview on deep learning-based approximation methods for partial differential equations, 2020, arXiv: 2012.12348.
Kovachki N, Li Z, Liu B, et al., Neural operator: Learning maps between function spaces, 2021, arXiv: 2108.08481.
Raissi M, Perdikaris P, and Karniadakis G E, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, J. Comput. Phys., 2019, 378): 686–707.
Alkhalifah T, Song C, Waheed U B, et al., Wavefield solutions from machine learned functions constrained by the Helmholtz equation, Artificial Intelligence in Geosciences, 2021, 2): 11–19.
Cui T, Wang Z, and Xiang X, An efficient neural network method with plane wave activation functions for solving Helmholtz equation, Computers and Mathematics with Applications, 2022, 111): 34–49.
Lu L, Jin P, Pang G, et al., Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators, Nature Machine Intelligence, 2021, 3(3): 218–229.
Li Z, Kovachki N, Azizzadenesheli K, et al., Fourier neural operator for parametric partial differential equations, 2020, arXiv: 2010.08895.
Lu L, Meng X, Cai S, et al., A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data, Computer Methods in Applied Mechanics and Engineering, 2022, 393): 114778.
Wang S, Wang H, and Perdikaris P, Learning the solution operator of parametric partial differential equations with physics-informed DeepONets, Science Advances, 2021, 7(40): eabi8605.
Li Z, Zheng H, Kovachki N, et al., Physics-informed neural operator for learning partial differential equations, 2021, arXiv: 2111.03794.
Stanziola A, Arridge S R, Cox B T, et al., A Helmholtz equation solver using unsupervised learning: Application to transcranial ultrasound, J. Comput. Phys., 2021, 441): 110430.
Lin G, Hu P, Chen F, et al., BINet: Learning to solve partial differential equations with boundary integral networks, CSIAM Trans. Appl. Math., 2023, 4(2): 275–305.
Ronneberger O, Fischer P, and Brox T, U-net: Convolutional networks for biomedical image segmentation, Medical Image Computing and Computer-Assisted Intervention — MICCAI 2015, Munich, 2015.
Jin J, The Finite Element Methods in Electromagnetics, Wiley, New York, 2022.
Hetmaniuk U, Stability estimates for a class of Helmholtz problems, Commun. Math. Sci., 2007, 5(3): 665–678.
Liu X, Xu B, and Zhang L, Ht-net: Hierarchical transformer based operator learning model for multiscale pdes, 2022, arXiv: 2210.10890.
Zhou Z, Rahman Siddiquee M M, Tajbakhsh N, et al., Unet++: A nested u-net architecture for medical image segmentation, Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, Granada, 2018.
Li X, Chen H, Qi X, et al, H-DenseUNet: Hybrid densely connected UNet for liver and tumor segmentation from CT volumes, IEEE Trans. Med. Imag., 2018, 37(12): 2663–2674.
Hendrycks D and Gimpel K, Gaussian error linear units (gelus), 2016, arXiv: 1606.08415.
Cho S J, Ji S W, Hong J P, et al., Rethinking coarse-to-fine approach in single image deblurring, Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, 2021.
Kingma D P and Ba J, Adam: A method for stochastic optimization, 2014, arXiv: 1412.6980.
Wei Z and Chen X, Deep-learning schemes for full-wave nonlinear inverse scattering problems, IEEE Trans. Geosci. Remote Sens., 2018, 57(4): 1849–1860.
Zhang Z, Leung W T, and Schaeffer H, BelNet: Basis enhanced learning, a mesh-free neural operator, 2022, arXiv: 2212.07336.
Hochreiter S, The vanishing gradient problem during learning recurrent neural nets and problem solutions, International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 1998, 6(2): 107–116.
Amestoy P R, Duff I S, L’Excellent J Y, et al., A fully asynchronous multifrontal solver using distributed dynamic scheduling, SIAM J. Matrix. Anal. Appl., 2001, 23(1): 15–41.
Liu D C and Nocedal J, On the limited memory BFGS method for large scale optimization, Mathematical Programming, 1989, 45(1–3): 503–528.
Plessix R E, A review of the adjoint-state method for computing the gradient of a functional with geophysical applications, Geophys. J. Int., 2006, 167(2): 495–503.
Jansson Y and Lindeberg T, Exploring the ability of CNNs to generalise to previously unseen scales over wide scale ranges, 2020 25th International Conference on Pattern Recognition (ICPR), Milan, 2021.
Deng, L, The mnist database of handwritten digit images for machine learning research, IEEE Signal Processing Mag., 2012, 29(6): 141–142.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The authors declare no conflict of interest.
Additional information
This research was supported by the National Science Foundation of China under Grant No. 92370125 and the National Key R&D Program of China under Grant Nos. 2019YFA0709600 and 2019YFA0709602.
Rights and permissions
About this article
Cite this article
Chen, F., Liu, Z., Lin, G. et al. NSNO: Neumann Series Neural Operator for Solving Helmholtz Equations in Inhomogeneous Medium. J Syst Sci Complex 37, 413–440 (2024). https://doi.org/10.1007/s11424-024-3294-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-024-3294-x