Dynamic right-sizing in FTP (drsFTP): Enhancing Grid performance in user-space

M.K. Gardner1, Wu-chun Feng1, M. Fisk2
1Research & Development in Advanced Network Technology (RADIANT) Computer & Computational Sciences Division, Los Alamos National Laboratory, Los Alamos, NM, USA
2Network Security Team, Network Engineering Group Computing Communications & Networking Division, Los Alamos National Laboratory, Los Alamos, NM, USA

Tóm tắt

With the advent of computational grids, networking performance over the wide-area network (WAN) has become a critical component in the grid infrastructure. Unfortunately, many high-performance grid applications only use a small fraction of the available bandwidth because operating systems and their associated protocol stacks are still tuned for yesterdays WAN speeds. As a result, network gurus undertake the tedious process of manually, tuning system buffers to allow TCP flow control to scale to today's WAN grid environments. Although recent research has shown how to set the size of these system buffers automatically at connection set-up, the buffer sizes are only appropriate at the beginning of the connection's lifetime. To address these problems, we describe an automated and scalable technique called dynamic right-sizing. We implement this technique in user space (in particular for bulk-data transfer) so that end users do not have to modify the kernel to achieve a significant increase in throughput.

Từ khóa

#Wide area networks #Computer networks #Grid computing #Bandwidth #Operating systems #Protocols #Automatic control #Control systems #Kernel #Throughput

Tài liệu tham khảo

fisk, 2001, Dynamic Right-Sizing: TCP Flow-Control Adaptation (Poster), Proceedings of SC 2001 High-Performance Networking and Computing Conference foster, 1999, The Grid Blueprint for a New Computing Infrastructure 10.1177/109434200101500302 jin, 2001, Network Characterization Service, Proc IEEE High-Performance Distributed Computing 0, Lawrence Berkley National Laboratory, Nettest Secure Network Testing and Monitoring 10.1109/INFCOM.1999.749288 lai, 2000, Measuring Link Bandwidths Using a Deterministic Model of Packet Delay, Proceedings of ACM SIGCOMM 2000, 10.1145/347057.347557 lai, 2001, A Tool for Measuring Bottleneck Link Bandwidth, Proceedings of the USENIX Symposium on Internet Technologies and Systems liu, 2000, Automatic TCP Socket Buffer Tuning, Proceedings of SC 2000 High-performance Networking and Computing Conference (Research Gem) mah pchar, 0, A Tool for Measuring Internet Path Characteristics 10.1109/HPDC.2002.1029926 0, Enabling High-performance Data Transfers on Hosts 0, University of Kansas, Netspec A Tool for Network Experimentation and Measurement borman, 1992, TCP Extensions for High Performance (RFC 1323) chervenak, 2001, The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets, International Journal of Supercomputer Applications, 23, 187 weigle, 2002, TICKETing High-Speed Traffic with Commodity Hardware and Software, Proceedings of the Third Annual Passive and Active Measurement Workshop (PAM2002) 0, Enabling high performance data transfers on hosts fisk, 2000, Dynamic Adjustment of TCP Window Sizes, Technical Report Los Alamos Unclassified Report (LAUR) 00–3221 childers, 2000, Access Grid: Immersive Group-to-Group Collaborative Visualization, Proceedings of the 4th International Immersive Projection Workshop 0, The Particle Physics Data Grid fisk, 2001, Dynamic Right-Sizing in TCP, Proceedings of the Los Alamos Computer Science Institute Symposium allcock, 2001, GridFTP Protocol Extensions to ftp for the Grid mathis, 0, Pushing Up Performance for Everyone 0, SC2001 Bandwidth Challenge Proposal Bandwidth to the World 10.17487/rfc0959 tierney, 2001, TCP Tuning Guide for Distributed Applications on Wide-Area Networks, USENIX & SAGE Login semke, 2001, Automatic TCP Buffer Tuning, Computer Communications Review ACM SIGCOMM, 28 tirumala, 0, Iperf 10.1109/HPDC.2001.945196