Cosmological Simulations and Data Exploration: a Testcase on the Usage of Grid Infrastructure
Tóm tắt
While new infrastructures for large computational challenges begin to be widely accessible to researchers, computational codes need to be re-designed to exploit new facilities. The Grid and the cloud computing concepts are changing the computational resource distribution and availability, and much effort start to be made to develop new codes for a better exploitation of new resources. This paper presents an example of the use of Grid resources, based on gLite middleware, to run cosmological simulations, that, up to now, are normally executed on Supercomputers. We have also used the Grid to explore and visualize the dataset. We discuss non particular the performance of FLY a parallel code implementing the octal-tree algorithm introduced by J. Barnes and P. Hut to compute the gravitational field efficiently. It simulates the evolution of the collisionless component of the material content of our Universe. FLY was originally developed to run on mainframe systems using the one-side communication paradigm, but we are now presenting a modified version of the computational algorithm to exploit the Grid environment. We also integrated the data exploration and visualization process on the Grid, to obtain preliminary results using the distributed facilities.
Tài liệu tham khảo
Antonuccio-Delogu, V., Dobrotka, A., Becciani, U., Cielo, S., Giocoli, C., Macci, A.V., Romeo-Velon, A.: Dissecting the spin distribution of dark matter haloes. Mon. Not. R. Astron. Soc. 407, 1338 (2010)
Antonuccio, V., Becciani, U., Ferro, D.: FLY. A parallel tree N-body code for cosmological simulations. Reference guide. Comput. Phys. Commun. 155, 159 (2003)
Barnes, J., Hut, P.: A hierarchical O(N log N) force-calculation algorithm. Nature 324, 446 (1986)
Becciani, U., Costa, A., Antonuccio-Delogu, V., Caniglia, G., Comparato, M., Gheller, C., Jin, Z., Krokos, M., Massimino, P.: VisIVO-integrated tools and services for large-scale astrophysical visualization. Publ. Astron. Soc. Pac. 122, 119 (2010)
Becciani, U., Comparato, M., Antonuccio Delogu, V.: FLY: MPI-2 high resolution code for LSS cosmological simulations. Comput. Phys. Commun. 176, 211 (2007)
Becciani, U.: The cometa consortium and the PI2S2 project. Mem. S.A. It. Supp. 13, 10 (2009)
Becciani, U., Antonuccio-Delogu, V., Gambera, M.: A modified parallel treecode for N-body simulation of the large-scale structure of the universe. J. Comput. Phys. 163, 118 (2000)
Berger, M.J., Colella, P.: Local adaptive mesh refinement for shock hydrodynamics. J. Comput. Phys. 82, 64 (1989)
Bryan, G.L., Norman, M.L.: A hybrid AMR application for cosmology and astrophysics. IMA Vol. Math. 117, 165 (1999)
Camarasu-Pop, S., Glatard, T., Mocicki, J.T., Benoit-Cattin, H., Sarrut, D.: Dynamic partitioning of GATE Monte-Carlo simulations on EGEE. J. Grid Computing 8, 241 (2008)
Comparato, M., Becciani, U., Costa, A., Larsson, B., Garilli, B., Gheller, C., Taylor, J.: Visualization, exploration, and data analysis of complex astrophysical data. Publ. Astron. Soc. Pac. 119, 898 (2007)
Dunkley, J., Komatsu, E., Nolta, M.R.: Five-year Wilkinson microwave anisotropy probe observations: likelihoods and parameters from the WMAP data. Astrophys. J. Suppl. 180, 306 (2009)
gLite: Lightweight middleware for Grid computing. http://www.glite.org
Germain Renaud, C., Loomis, C., Moscicki, J., Texier, R.: Scheduling for responsive Grids. J. Grid. Computing 6, 15 (2008)
Hernquist, L., Bouchet, F.R., Suto, Y.: Application of the Ewald method to cosmological N-body simulations. Astrophys. J. Suppl. 75, 231 (1991)
Hernquist, L.: Performance characteristics of tree codes. Astrophys. J. Suppl. 64, 715 (1987)
Hockney, R.W., Eastwood, J.W.: Computer simulation using particles (1988)
Lingrand, D., Montagnat, J., Martyniak, J., Colling, D.: Optimization of jobs submission on the EGEE production Grid: modeling faults using workload. J. Grid Computing 6, 305 (2008)
Merz, U., Pen, U., Trac, H.: Towards optimal parallel PM N-body codes: PMFAST. New Astron. 10, 393 (2005)
Rainer, K., Edgar, G., Krammer, B., Mller, M.S., Resch, M.M.: Towards efficient execution of MPI applications on the Grid: porting and optimization issues. J. Grid Computing 2, 133 (2003)
Reed, D., Gardner, J., Quinn, T., Stadel, J., Fardal, M., Lake, G., Governato, F.: Evolution of the mass function of dark matter haloes. Mon. Not. R. Astron. Soc. 364, 565 (2003)
Sirko, E.: Initial conditions to cosmological N-body simulations, or, how to run an ensemble of simulations. Astrophys. J. Suppl. 64, 728 (2005)
Sheth, R., Tormen, B.: Large-scale bias and the peak background split. Mon. Not. R. Astron. Soc. 308, 119 (1999)
Springel, V., Yoshida, N., White, S.: GADGET: a code for collisionless and gasdynamical cosmological simulations. New Astron. 6, 79 (2001)
The VOTECH Project: Virtual Observatory Technology. http://eurovotech.org
The Cometa Consortium: http://www.consorzio-cometa.it/
Distributed European Infrastructure for Supercomputing Applications: http://www.deisa.eu
OpenMP: an API for multi-platform shared-memory parallel programming. http://www.openmp.org/
The Mandelbrot Set: http://mathworld.wolfram.com/MandelbrotSet.html
Message Passing Interface: http://www.mpi-forum.org/
The PI2S2 Project: http://www.pi2s2.it/
Testing MPI Support: http://wiki.egee-see.org/index.php/Testing_MPI_support
VisIVO Server Web Site: http://visivoserver.oact.inaf.it