Grid-enabled Hybrid Computer System for Computational Astrophysics.ppt

Grid-enabled Hybrid Computer System for Computational Astrophysicsusing OmniRPC Mistuhisa Sato Taisuke Boku Center for Computational Physics University of Tsukuba msato,taisuke @is.tsukuba.ac.jp http://www.hpcs.is.tsukuba.ac.jp/ Grid and Parallel Applications “Typical” Grid Applications Parametric execution: Execute the same program with different parameters using an large amount of computing resources master-workers type of parallel program “Typical” Grid Resources A Cluster of Clusters: some PC Clusters are available Dynamic resources: load and status are changed time-to-time. Special computing resources like GRAPE6 Programming for Grid Using Globus shell GSH Submit batch job scripts to remote nodes Grid MPI MPICH-G, PACX MPI, … General-purpose, but difficult and error-prone No support for dynamic resource and fault-tolerance Grid RPC A good programming interface Ninf ver.1 Use asynchronous RPC calls for parallel programming NetSolve Ninf-G OmniRPC OmniRPC Design Support Master-workers parallel programs for parametric search grid applications A gridRPC based on Ninf Grid RPC The thread-safe RPC design allows to use OpenMP for simple and easy parallel programming API for existing programs Make use of remote clusters of PC/SMP as Grid computing resource omrpc-agent architecture Support large-scale grid environments upto 1000 hosts! Use local scheduler PBS, SunGridEngine, Condor, … for scheduling jobs in remote Seamless programming environment from clusters to grid. It use “rsh” for a cluster, “GRAM” for a grid managed by Globus, “ssh” for a remote nodes. Persistent data support in remote workers For applications which requires large data re-use connection to workers for fast invocation Automatic initializable persistence model for flexible re-allocation and fault tolerance Use direct stub invocation to provide a RPC interface to a specific remote host with security and authentication HMCS-G OmniRPC Agent An agent process in the remote node Inv