ISPH modelling for hydrodynamic applications using a new MPI-based parallel approach
Tóm tắt
This paper presents a novel parallel design for Smoothed Particle Hydrodynamics. The Message Passing Interface (MPI), standard for distributed memory programming, is used to parallelize the code as a necessary precursor to future multi–GPU implementation. In the proposed parallelization scheme, the domain decomposition is performed based on both spatial and particle decompositions to reach efficient and well-balanced parallelization. To take the advantage of memory locality, the Peano–Hilbert ordering of the underlaying cells, which allows particles that are spatially close to also be close in memory, is adopted. In our scheme, the dynamic load balancing is performed in three Cartesian dimensions as a feedback system that recognizes the particle imbalance and applies the load balancing accordingly. The incompressible SPH (ISPH) method along with an eddy viscosity turbulence model is solved explicitly in the proposed parallel scheme, rather than the typical weakly compressible or implicit incompressible Poisson formulations. The performance of the code is tested for several test cases including a dam–break problem impacting on a short box. The simulation results for water depth at two locations in the tank and two pressure sensors on the box are compared with experimental data and reasonable agreement is achieved.
Tài liệu tham khảo
Adami S, Hu X, Adams N (2012) A generalized wall boundary condition for smoothed particle hydrodynamics. J Comput Phys 231(21):7057–7075
Barreiro A, Crespo AJ, Domínguez JM, Gómez-Gesteira M (2013) Smoothed particle hydrodynamics for coastal engineering problems. Comput Struct 120:96–106
Canelas RB, Crespo AJ, Domínguez JM, Ferreira RM, Gómez-Gesteira M (2016) SPH-DCDEM model for arbitrary geometries in free surface solid-fluid flows. Comput Phys Commun 202:131–140
Cercos-Pita JL (2015) AQUAgpusph, a new free 3D SPH solver accelerated with OpenCL. Comput Phys Commun 192:295–312
Cherfils J, Pinon G, Rivoalen E (2012) Josephine: a parallel SPH code for free-surface flows. Comput Phys Commun 183(7):1468–1480
Colagrossi A (2005) A meshless Lagrangian method for free-surface and interface flows with fragmentation. PhD thesis, Universita di Roma La Sapienza
Crespo A, Domínguez J, Rogers B, Gómez-Gesteira M, Longshaw S, Canelas R, Vacondio R, Barreiro A, García-Feal O (2015) DualSPHysics: open-source parallel CFD solver based on smoothed particle hydrodynamics (SPH). Comput Phys Commun 187:204–216
Cummins SJ, Rudman M (1999) An SPH projection method. J Comput Phys 152(2):584–607
Domínguez JM, Crespo AJ, Gómez-Gesteira M (2013a) Optimization strategies for CPU and GPU implementations of a smoothed particle hydrodynamics method. Comput Phys Commun 184(3):617–627
Domínguez JM, Crespo AJ, Valdez-Balderas D, Rogers BD, Gómez-Gesteira M (2013b) New multi-GPU implementation for smoothed particle hydrodynamics on heterogeneous clusters. Comput Phys Commun 184(8):1848–1860
Ferrari A, Dumbser M, Toro EF, Armanini A (2009) A new 3D parallel SPH scheme for free surface flows. Comput Fluids 38(6):1203–1217
Gomez-Gesteira M, Rogers BD, Crespo AJ, Dalrymple RA, Narayanaswamy M, Dominguez JM (2012) SPHysics-development of a free-surface fluid solver-part 1: theory and formulations. Comput Geosci 48:289–299
Gotoh H, Khayyer A (2016) Current achievements and future perspectives for projection-based particle methods with applications in ocean engineering. J Ocean Eng Mar Energy 2(3):1–28
Gotoh H, Shibahara T, Sakai T (2001) Sub-particle-scale turbulence model for the MPS method-Lagrangian flow model for hydraulic engineering. Adv Methods Comput Fluid Dyn 9:339–347
Gotoh H, Shao S, Memita T (2004) SPH-LES model for numerical investigation of wave interaction with partially immersed breakwater. Coast Eng J 46(01):39–63
Gotoh H, Khayyer A, Ikari H, Arikawa T, Shimosako K (2014) On enhancement of incompressible SPH method for simulation of violent sloshing flows. Appl Ocean Res 46:104–115
Guo X, Lind S, Rogers B, Stansby P, Ashworth M (2013) Efficient massive parallelisation for incompressible Smoothed Particle Hydrodynamics with \(10^{8}\) particles. In: Proceedings of the 8th international SPHERIC workshop. Trondheim, Norway, pp 397–402
Henry A, Rafiee A, Schmitt P, Dias F, Whittaker T (2014) The characteristics of wave impacts on an oscillating wave surge converter. J Ocean Wind Energy 1(2):101–110
Hérault A, Bilotta G, Dalrymple RA (2010) SPH on GPU with CUDA. J Hydraul Res 48(S1):74–79
Hosseini S, Manzari M, Hannani S (2007) A fully explicit three-step SPH algorithm for simulation of non-Newtonian fluid flow. Int J Numer Methods Heat Fluid Flow 17(7):715–735
Issa R, Lee ES, Violeau D, Laurence DR (2005) Incompressible separated flows simulations with the smoothed particle hydrodynamics gridless method. Int J Numer Methods Fluids 47(10–11):1101–1106
Jeong J, Jhon M, Halow J, Van Osdol J (2003) Smoothed particle hydrodynamics: applications to heat conduction. Comput Phys Commun 153(1):71–84
Khayyer A, Gotoh H (2012) A 3D higher order Laplacian model for enhancement and stabilization of pressure calculation in 3D MPS-based simulations. Appl Ocean Res 37:120–126
Khayyer A, Gotoh H, Shao S (2008) Corrected incompressible SPH method for accurate water-surface tracking in breaking waves. Coast Eng 55(3):236–250
Khayyer A, Gotoh H, Shimizu Y, Gotoh K (2016) Comparative study on accuracy and conservation properties of particle regularization schemes and proposal of an improved particle shifting scheme. In: Proceedings of the 11th international SPHERIC workshop, pp 416–423
Kleefsman KMT (2005) Water impact loading on offshore structures, a numerical study. PhD thesis, University of Groningen
Kleefsman KMT, Fekken G, Veldman A, Iwanowski B, Buchner B (2005) A volume-of-fluid based simulation method for wave impact problems. J Comput Phys 206(1):363–393
Lee ES, Moulinec C, Xu R, Violeau D, Laurence D, Stansby P (2008) Comparisons of weakly compressible and truly incompressible algorithms for the SPH mesh free particle method. J Comput Phys 227(18):8417–8436
Lee ES, Violeau D, Issa R, Ploix S (2010) Application of weakly compressible and truly incompressible SPH to 3-D water collapse in waterworks. J Hydraul Res 48(S1):50–60
Libersky LD, Petschek AG, Carney TC, Hipp JR, Allahdadi FA (1993) High strain Lagrangian hydrodynamics: a three-dimensional SPH code for dynamic material response. J Comput Phys 109(1):67–75. doi:10.1006/jcph.1993.1199
Lind S, Xu R, Stansby P, Rogers B (2012) Incompressible smoothed particle hydrodynamics for free-surface flows: a generalised diffusion-based algorithm for stability and validations for impulsive flows and propagating waves. J Comput Phys 231(4):1499–1523
Lind S, Stansby P, Rogers B (2016) Fixed and moored bodies in steep and breaking waves using SPH with the Froude-Krylov approximation. J Ocean Eng Mar Energy 2(3):1–24
Marrone S, Colagrossi A, Antuono M, Lugni C, Tulin M (2011) A 2D+t SPH model to study the breaking wave pattern generated by fast ships. J Fluids Struct 27(8):1199–1215
Marrone S, Bouscasse B, Colagrossi A, Antuono M (2012) Study of ship wave breaking patterns using 3D parallel SPH simulations. Comput Fluids 69:54–66
Mokos A, Rogers BD, Stansby PK, Domínguez JM (2015) Multi-phase SPH modelling of violent hydrodynamics on GPUs. Comput Phys Commun 196:304–316
Monaghan J, Kos A (1999) Solitary waves on a Cretan beach. J Waterw Port Coast Ocean Eng 125(3):145–155
Monaghan JJ (1994) Simulating free surface flows with SPH. J Comput Phys 110(2):399–406
Morris JP, Fox PJ, Zhu Y (1997) Modeling low reynolds number incompressible flows using SPH. J Comput Phys 136(1):214–226
Oger G, Doring M, Alessandrini B, Ferrant P (2006) Two-dimensional SPH simulations of wedge water entries. J Comput Phys 213(2):803–822
Oger G, Le Touzé D, Guibert D, de Leffe M, Biddiscombe J, Soumagne J, Piccinali JG (2016) On distributed memory MPI-based parallelization of SPH codes in massive HPC context. Comput Phys Commun 200:1–14
Rafiee A, Dias F (2013) Two-dimensional and three-dimensional simulation of wave interaction with an oscillating wave surge converter. In: International workshop on water waves and floating bodies (IWWWFB) 2013, Marseille, France
Rafiee A, Thiagarajan KP (2009) An sph projection method for simulating fluid-hypoelastic structure interaction. Comput Methods Appl Mech Eng 198(33):2785–2795
Ren J, Jiang T, Lu W, Li G (2016) An improved parallel SPH approach to solve 3D transient generalized newtonian free surface flows. Comput Phys Commun 205:87–105. doi:10.1016/j.cpc.2016.04.014
Rogers B, Dalrymple R, Gómez-Gesteira M, Crespo A (2011) User guide for the parallelsphysics code using mpi v2. 0. http://www.sphysics.org
Shao S, Ji C (2006) SPH computation of plunging waves using a 2D sub-particle scale (SPS) turbulence model. Int J Numer Methods Fluids 51(8):913–936
Shao S, Lo EY (2003) Incompressible SPH method for simulating Newtonian and non-Newtonian flows with a free surface. Adv Water Res 26(7):787–800
Smagorinsky J (1963) General circulation experiments with the primitive equations: I. The basic experiment*. Mon Weather Rev 91(3):99–164
Springel V (2005) The cosmological simulation code GADGET-2. Mon Not R Astron Soc 364(4):1105–1134
Szewc K, Pozorski J, Taniere A (2011) Modeling of natural convection with smoothed particle hydrodynamics: non-Boussinesq formulation. Int J Heat Mass Transf 54(23):4807–4816
Takeda H, Miyama SM, Sekiya M (1994) Numerical simulation of viscous flow by smoothed particle hydrodynamics. Prog Theor Phys 92(5):939–960
Vacondio R, Mignosa P, Pagani S (2013) 3D SPH numerical simulation of the wave generated by the Vajont rockslide. Adv Water Res 59:146–156
Valdez-Balderas D, Domínguez JM, Rogers BD, Crespo AJ (2013) Towards accelerating smoothed particle hydrodynamics simulations for free-surface flows on multi-GPU clusters. J Parallel Distrib Comput 73(11):1483–1493
Vandamme J, Zou Q, Reeve DE (2011) Modeling floating object entry and exit using smoothed particle hhydrodynamics. J Waterw Port Coast Ocean Eng 137(5):213–224
Violeau D, Leroy A (2015) Optimal time step for incompressible SPH. J Comput Phys 288:119–130
Violeau D, Rogers BD (2016) Smoothed particle hydrodynamics (SPH) for free-surface flows: past, present and future. J Hydraul Res 54(1):1–26
Wendland H (1995) Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree. Adv Comput Math 4(1):389–396
Xu R, Stansby P, Laurence D (2009) Accuracy and stability in incompressible SPH (ISPH) based on the projection method and a new approach. J Comput Phys 228(18):6703–6725
Yeylaghi S, Moa B, Oshkai P, Buckham B, Crawford C (2016) ISPH modelling of an oscillating wave surge converter using an OpenMP-based parallel approach. J Ocean Eng Mar Energy pp 1–12. doi:10.1007/s40722-016-0053-7
Zhou C, Liu G, Lou K (2007) Three-dimensional penetration simulation using smoothed particle hydrodynamics. Int J Comput Methods 4(04):671–691