Flexibility, manageability, and performance in a Grid storage appliance

J. Bent1, V. Venkataramani1, N. LeRoy1, A. Roy1, J. Stanley1, A.C. Arpaci-Dusseau1, R.H. Arpaci-Dusseau1, M. Livny1
1Department of Computer Sciences, University of Wisconsin, Madison, USA

Tóm tắt

We present NeST a flexible software-only storage appliance designed to meet the storage needs of the Grid. NeST has three key features that make it well-suited for deployment in a Grid environment. First, NeST provides a generic data transfer architecture that supports multiple data transfer protocols (including GridFTP and NFS), and allows for the easy addition of new protocols. Second, NeST is dynamic, adapting itself on-the-fly so that it runs effectively on a wide range of hardware and software platforms. Third, NeST is Grid-aware, implying that features that are necessary for integration into the Grid, such as storage space guarantees, mechanisms for resource and data discovery, user authentication, and quality of service, are a part of the NeST infrastructure.

Từ khóa

#Home appliances #Protocols #Costs #Hardware #Distributed computing #Open source software #Grid computing #Computer architecture #Authentication #Quality of service

Tài liệu tham khảo

10.1145/502034.502057 walsh, 1985, Overview of the Sun Network File System, Proceedings of the 1985 Winter Usenix Technical Conference, 117 10.1109/HPDC.2001.945200 1989, RFC-1094 NFS Network File System Protocol Specification Network Working Group Requests for Comments shoshani, 2002, Storage Resource Managers: Middleware Components for Grid Storage, Nineteenth IEEE Symposium on Mass Storage Systems (MSS'02) sharpe, 1999, Just What Is SMB? waldspurger, 1995, Stride Scheduling: Deterministic Proportional-Share Resource Mangement, Technical Report MIT/LCS/TM-528 10.1109/CCGRID.2001.923182 thain, 0, Pluggable File System thain, 2001, Gathering at the Well: Creating Communities for Grid I/O, Proceedings of SuperComputing 2001 fielding, 1997, RFC-2068: HTTP: Hypertext Transfer Protocol Specification Version 1.1, Network Working Group Request for Comments white, 2001, LegionFS: A Secure and Scalable File System Supporting Cross-Domain High-Performance Applications, Proceedings of SuperComputing 2001 10.1177/109434209701100205 10.1145/288090.288111 10.1109/HPDC.2001.945176 10.1145/242857.242867 hitz, 1994, File System Design for an NFS File Server Appliance, Proceedings of the USENIX Winter 1994 Technical Conference, 235 howe, 2000, Bandwidth and Request Throttling for Apache 1 3 10.1145/502034.502046 kleiman, 1986, Vnodes: An Architecture for Multiple File System Types in Sun UNIX, USENIX Conference Proceedings, 151 10.1145/354871.354874 roy, 2001, End-to-End Quality of Service for High-End Applications burnett, 2002, Exploiting Gray-Box Knowledge of Buffer-Cache Management, USENIX 10.1109/HPDC.1998.709966 baru, 1998, The SDSC Storage Resource Broker, Proceedings of CASCON 10.1016/0169-7552(89)90019-6 satyanarayanan, 1999, Digest of the Seventh IEEE Workshop on Hot Topics in Operating Systems chervenak, 2000, Protocols and Services for Distributed Data-Intensive Science, Proc ACAT crovella, 1999, Connection Scheduling in Web Servers, USENIX Symposium on Internet Technologies and Systems 2002, Condor The Condor Directed-Acyclic-Graph Manager (DAGMan) 10.1145/502034.502040 0, EMC Corporation allcock, 2001, Grid FTP Protocol Extensions to FTP for the Grid lancaster, 2001, Measuring Real World Data Availability, Proceedings of the LISA 2001 15th Systems Administration Conference, 93 pai, 1999, Flash: An Efficient and Portable Web Server, Proceedings of the USENIX Technical Conference lohr, 2002, Supercomputing and Business Move Closer, New York Times Business/Financial Desk 10.1109/4236.957895 10.1109/65.238150 patterson, 2002, Availability and Maintainability> > Performance: New Focus for a New Century, Key Note Lecture at the First USENIX Conference on File and Storage Technologies (FAST'02) raman, 2000, Matchmaking frameworks for distributed resource management postel, 1980, RFC-765 FTP File Transfer Protocol Specification