Abstract
A variant of a numerical algorithm for simulating viscous gasdynamic flows on unstructured hybrid grids and its software implementation for heterogeneous computations is described. The system of Navier–Stokes equations is approximated by the finite-volume method of an increased approximation order with the values of the variables being defined at the mass centers of the grid elements. The distributed software implementation of the numerical algorithm is adapted to running on hybrid computer systems of various architectures. Comparative implementations were created using the MPI, OpenMP, CUDA, and OpenCL software models permitting the use of multicore processors and various types of accelerators, including NVIDIA and AMD graphics processors, and Intel Xeon Phi multicore coprocessors. The data exchange between MPI processes and between processors and accelerators is carried out simultaneously with the execution of calculations (both in MPI + OpenMP mode and when using CUDA or OpenCL). The indicators of parallel efficiency and performance on systems with different types of computing devices are studied in detail. In the tests, up to 260 GPUs were successfully used.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
E. Elsen, P. le Gresley, and E. Darve, “Large calculation of the flow over a hypersonic vehicle using a gPU,” J. Comput. Phys. 227, 10148–10161 (2008).
P. Micikevicius, “3D finite difference computation on GPUs using CUDA,” in Proceeding of 2nd Workshop on General Purpose Processing on Graphics Processing Units, 2009.
D. A. Jacobsen and I. Senocak, “Multi-level parallelism for incompressible flow computations on GPU clusters,” Parallel Comput. 39, 1–20 (2013).
P. Zaspel and M. Griebel, “Solving incompressible two-phase flows on multi-GPU clusters,” Comput. Fluids 80, 356–364 (2013).
A. A. Davydov, B. N. Chetverushkin, and E. V. Shil’nikov, “Simulating flows of incompressible and weakly compressible fluids on multicore hybrid computer systems,” Comput. Math. Math. Phys. 50, 2157–2165 (2010).
E. V. Koromyslov, M. V. Usanin, L. Yu. Gomzikov, A. A. Siner, and T. P. Lyubimova, “Numerical simulation of aerodynamic and noise characteristics of subsonic turbulent jets using graphic processing units,” Vychisl. Mekh. Sploshn. Sred 9 (1), 84–96 (2016).
A. V. Gorobets, F. X. Trias, and A. Oliva, “A parallel MPI + OpenMP + OpenCL algorithm for hybrid supercomputations of incompressible flows,” Comput. Fluids 88, 764–772 (2013).
R. Rossi, F. Mossaiby, and S. R. Idelsohn, “A portable OpenCL-based unstructured edge-based finite element Navier-Stokes solver on graphics hardware,” Comput. Fluids 81, 134–144 (2013).
P. B. Bogdanov, A. V. Gorobets, and S. A. Sukov, “Adaptation and optimization of basic operations for an unstructured mesh CFD algorithm for computation on massively parallel accelerators,” Comput. Math. Math. Phys. 53, 1183–1194 (2013).
P. B. Bogdanov, A. A. Efremov, A. V. Gorobets, and S. A. Sukov, “Using a scheduler for efficient data exchange on hybrid supercomputers with massively-parallel accelerators,” Vychisl. Metody Program. 14, 122–134 (2013).
A. V. Chikitkin, V. A. Titarev, M. N. Petrov, and S. V. Utyuzhnikov, “Parallel technologies for aerodynamics problems solving in FlowModellium software complex,” in Proceedings of the Conference on Supercomputer Days in Russia, Sept. 26–27, 2016, Moscow.
E. F. Toro, Riemann Solvers and Numerical Methods for Fluid Dynamics: A Practical Introduction, 3rd ed. (Springer, Berlin, Heidelberg, 2009).
E. N. Golovchenko and M. V. Yakobovskii, “Parallel partitioning tool GridSpiderPar for large mesh decomposition,” Vychisl. Metody Program. 16, 507–517 (2015).
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © S.A. Soukov, A.V. Gorobets, P.B. Bogdanov, 2017, published in Matematicheskoe Modelirovanie, 2017, Vol. 29, No. 8, pp. 3–16.
Rights and permissions
About this article
Cite this article
Soukov, S.A., Gorobets, A.V. & Bogdanov, P.B. Portable Solution for Modeling Compressible Flows on All Existing Hybrid Supercomputers. Math Models Comput Simul 10, 135–144 (2018). https://doi.org/10.1134/S2070048218020138
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S2070048218020138