《USATLAS dCache System and Service Challenge at BNL》.pptVIP

USATLAS dCache System and Service Challenge at BNL Zhenping (Jane) Liu RHIC/ATLAS Computing Facility, Physics Department Brookhaven National Lab 10/13/2005 HEPIX Fall 2005 at SLAC Outline USATLAS dCache system at BNL Overview of the System Usage of the system Experiences Long-term plan Service Challenge USATLAS dCache system at BNL A distributed disk caching system as a front-end for Mass Storage System (BNL HPSS). In production service for ATLAS users since November 2004. Benefits of using dCache Allows transparent access to large amount of data files distributed on disk pools or stored on HSM (HPSS). Provides the users with one unique name-space for all the data files. File system names space view available through an nfs2/3 interface Data is distributed among a large amount of cheap disk servers. Benefits of using dCache (Cont.) Significantly improves the efficiency of connected tape storage systems, through caching, i.e. gather flush, and scheduled staging techniques. Benefits of using dCache (Cont.) Clever selection mechanism and flexible system tuning The system determines whether the file is already stored on one or more disks or in HPSS. The system determines the source or destination dCache pool based on storage group and network mask of clients, I/O direction, also “CPU” load and disk space, configuration of the dCache pools. Benefits of using dCache (Cont.) Load balanced and fault tolerant Automatic load balancing using cost metric and inter pool transfers. Dynamically replicate files upon detection of hot spot. Allow multiple distributed administrative servers for each type, e.g., read pools, write pools, DCAP doors, SRM doors, GridFTP doors. Benefits of using dCache (Cont.) Scalability Distributed Movers and Access Points (Doors) Highly distributed Storage Pools Direct client – disk(pool) and disk (pool) – hsm (HPSS) connection. Benefits of using dCache (Cont.) Support of various access protocols Local access protocol: DCAP (posix like) GsiFTP d