Whoops!: a clustered Web cache for DSM systems using memory mapped networks

E. Cecchet1
1INRIA-SIRAC laboratory, France

Tóm tắt

We present Whoops!, a clustered Web cache prototype based on SciFS, a distributed shared memory (DSM) that benefits from the high performances and the remote addressing capabilities of memory mapped networks like Scalable Coherent Interface (SCI). Whoops! uses the DSM for all Web cache management and cache storage. Using a memory mapped network and a DSM programming model allows us to investigate a new algorithm to distribute and handle requests. We present a new implementation of TCP handoff that directly maps remote TCP/IP stacks through the network. This technique reduces processor overhead and forwards TCP acknowledgements in few microseconds. We have also designed parallel pull-based LRU (PPBL), an efficient request distribution algorithm for use with DSM systems. The decision is distributed over all nodes thus providing better scalability. PPBL supports multi-frontend environments letting the DSM handle data distribution. Finally, Whoops! implements on the fly compression when fetching documents from the Web and on the fly decompression when sending documents to clients. We show how this technique can reduce paging activity in the DSM and improve overall cache performance.

Từ khóa

#TCPIP #Linux #Prototypes #Computer architecture #Throughput #Network interfaces #Read-write memory #Hardware #Delay #Memory management

Tài liệu tham khảo

hansen, 2000, Communication Path Optimisations for Cluster Server 10.1016/S0169-7552(98)00088-9 1992, Institute of Electrical and Electronics Engineers - IEEE Standard for Scalable Coherent Interface (SCI) - Standard P1596 khaleel, 1999, Evaluation of data request distribution policies in clustered servers, Proceedings of the 6th Conference on High Performance Computing, 50 nielsen, 1997, Network Performance Effects of HTTP/1.l, CSSl, and PNG, Proceedings of ACM SIG-COMM'97, 10.1145/263105.263157 oberhumer, 2000, Lempel-Ziv-Oberhumer compression library vI 07 0, Resonate Central Dispatch tang, 2001, Modular TCP Handoff Design in STREAMS-Based TCP/IP Implementation, ICNP 2001, 77 0, Web Polygraph – Proxy performance benchmark zhang, 1999, HACC: An Architecture for Cluster-Based Web Servers, Proceedings of the 3rd USENIX Windows NT Symposium bunt, 1999, Achieving load balance and effective caching in clustered web servers, Proceedings of the 4th International Web Caching Workshop 10.1109/INFCOM.1999.749260 cecchet, 2001, Apport des réseaux a capacité d'adressage pour des grappes a mémoire partagée distribuée logicielle, Conception et applications cao, 1997, Cost-Aware WWW proxy caching algorithms, Proceedings of the USENIX Symposium on Internet Technology and Systems, 193 0, Dolphin Interconnect Solutions PCI-SCI cluster adapter specification 10.1109/CCGRID.2001.923239 aron, 1999, Efficient Support for P-HTTP in Cluster-based Web Servers, Proceedings of the 1999 USENIX Annual Technical Conference aron, 2000, Scalable Content-aware Request Distribution in Cluster-based Network Servers, Proceedings of the 2000 Annual Usenix Technical Conference gilchrist, 2000, Archive Comparison Test 2 0 (ACT)