Adaptive online data compression

E. Jeannot1, B. Knutsson2, M. Bjorkman3
1LORIA, Université H. Poincaré, Nancy I, France
2Distributed System Laboratory, University of Pennsylvania, USA
3Department of Computer Engineering, Mälardalens högskola, Sweden

Tóm tắt

Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission, However such an approach is not efficient when dealing with higher speed networks. Indeed, the time to compress a large file and to send it is greater than the time to send the uncompressed file. In this paper we explore and enhance an algorithm that allows us to overlap communications with compression and to automatically adapt the compression effort to currently available network and processor resources.

Từ khóa

#Data compression #Distributed computing #LAN interconnection #Concurrent computing #Spine #Network servers #Bandwidth #Algorithm design and analysis #File systems #Laboratories

Tài liệu tham khảo

knutsson, 2001, Architectures for Application Transparent Proxies A Study of Network Enhancing Software knutsson, 1997, Trading computation for communication by end-to-end compression, Third International Workshop on High Performance Protocol Architectures (HIPPARCH'97) 10.1016/S0169-7552(98)00299-2 10.1145/45072.45074 mallet, 1997, Operating systems support for protocol boosters, Proc Third Int'l Workshop High Performance Protocol Architectures (HIPPARCH '97) pall, 1997, Microsoft Point-To-Point Compression (MPPC) Protocol, IETF Network Working Group, rfc2118 rand, 1996, The PPP Compression Control Protocol (CCP), IETF Network Working Group, rfc1962 10.1007/BFb0031622 schryver, 1996, PPP BSD Compression Protocol, IETF Network Working Group, rfc1977 10.1109/MC.1984.1659158 1990, Recommendation V.42 bis, FITU casanova, 1996, Netsolve: A network server for solving computational science problems, Proceedings of Super-computing'96 deutsch, 1996, GZIP file format specification version 4.3, IETF Network Working Group, rfc1952 10.1007/3-540-61626-8_21 douglis, 1993, The compression cache: Using online compression to extend physical memory, Proc USENIX Assoc Winter Technical Conf, 519 deutsch, 1996, ZLIB Compressed Data Format Specification version 3.3, IETF Network Working Group, rfc1950 10.1016/S0167-8191(01)00101-6 0, DIET (Distributed Interactive Engineering Toolbox) 10.1109/JRPROC.1952.273898 woods, 1996, PPP Deflate Protocol, IETF Network Working Group, rfc1979 10.1109/TIT.1978.1055934 10.1109/TIT.1977.1055714