UCFS - a novel User-space, high performance, Customized File System for Web proxy servers

IEEE Transactions on Computers - Tập 51 Số 9 - Trang 1056-1073 - 2002
Jun Wang1, Rui Min1, Yingwu Zhu1, Yiming Hu1
1Department of Electrical and Computer Engineering and Computer Science, University of Cincinnati, Cincinnati, OH, USA

Tóm tắt

Web proxy caching servers play a key role in today's Web infrastructure. Previous studies have shown that disk I/O is one of the major performance bottlenecks of proxy servers. Most conventional file systems do not work well for proxy server workloads and have high overheads. This paper presents a novel, User-space, Customized File System, called UCFS, that can drastically improve the I/O performance of proxy servers. UCFS is a user-level software component of a proxy server which manages data on a raw disk or disk partition. Since the entire system runs in the user space, it is easy and inexpensive to implement. It also has good portability and maintainability. UCFS uses efficient in-memory meta-data tables to eliminate almost all I/O overhead of meta-data searches and updates. It also includes a novel file system called Cluster-structured File System (CFS). Similarly to the Log-structured File Systems (LFS), CFS uses large disk transfers to significantly improve disk write performance. However, CFS can also markedly improve file read operations and it does not generate garbage. Comprehensive simulation experiments using five representative real-world traces show that UCFS can significantly improve proxy server performance. For example, UCFS achieves 8-19 times better I/O performance than the state-of-the-art SQUID server running on a Unix Fast File System (FFS), 4-7.5 times better than SQUID on asynchronous FFS, and 3-9 times better than the improved SQUIDML.

Từ khóa

#File systems #File servers #SQUIDs #Network servers #Web server #Utility programs #Web sites #Telecommunication traffic #Delay

Tài liệu tham khảo

10.1109/MSS.2001.10009 10.1016/S0169-7552(98)00250-5 1998, High-Performance Web Caching White Paper ousterhout, 1988, Beating the I/O Bottleneck: A Case for Log-Structured File Systems vahalia, 1996, UNIX InternalsThe New Frontiers rivest, 1991, MD5 Unoffical Homepage jenkins, 1997, A New Hash Functions for Hash Table Lookup, Dr Dobb's J 10.1109/65.844496 arlitt, 1997, Trace-Driven Simulation of Document Caching Strategies for Internet Web Servers, Simulation J, 68, 23, 10.1177/003754979706800109 10.1109/INFCOM.1999.749260 10.1007/978-1-4613-1431-8_5 10.1023/A:1019236319752 10.1109/12.689646 2000, Quantum Atlas[tm] 10KII Disk Drives nightingale, 1999, The Design and Implementation of DCD Device Driver for UNIX, Proc 1999 USENIX Technical Conf, 295 seltzer, 1995, File System Logging versus Clustering: A Performance Comparison, Proc 1995 USENIX, 249 fielding, 1999, Hypertext Transfer Protocolhttp/1.1 ganger, 1997, Embedded Inodes and Explicit Grouping: Exploiting Disk Bandwidth for Small Files, Proc Usenix Technical Conf, 1 rousskov, 1998, On Peformance of Caching Proxies, Proc SIGMETRICS 1998/PERFORMANCE 1998, 272 10.1145/232973.232991 soloviev, 1998, File Placement in a Web Cache Server, Proc 10th ACM Symp Parallel Algorithms and Architectures 10.1145/41457.37518 10.1016/S0169-7552(98)00033-6 10.1145/146941.146943 10.1145/362883.362891 seltzer, 1993, An Implementation of a Log-Structured File System for UNIX, Proc Winter 1993 USENIX, 307 lumb, 2000, Towards Higher Disk Head Utilization: Extracting Free Bandwidth from Busy Disk Drives, Proc 2000 Conf Operating System Design and Implementation (OSDI) 10.1145/504450.504478 10.1109/TNET.2002.804836 krishnamurthy, 1997, Study of Piggyback Cache Validation for Proxy Caches in the World Wide Web, Proc USENIX Symp Internet Technologies and Systems (ITS-97), 1 ganger, 1994, Metadata Update Performance in File Systems, Proc USENIX Symp Operating System Design and Implementation (OSDI), 49 williams, 1996, Removal Policies in Network caches for World-Wide Web Documents, Proc ACM SIGCOMM Conf Applications Technologies Architectures and Protocols for Computer Comm, 26, 293 10.1145/350853.350863 1997, WWW Collector: The Prefetching Proxy Server for WWW wessels, 1998, NLANR CACHE README 10.1145/572317.572322 10.1016/S0169-7552(98)00247-5 maltzahn, 1999, Reducing the Disk I/O of Web Proxy Server Caches, Proc 1999 USENIX Ann Technical Conf (USENIX-99), 225 gribble, 1997, System Design Issues for Internet Middleware Services: Deductions from a Large Client Trace, Proc 1997 Usenix Symp Internet Technologies and Systems (USITS-97) duska, 1997, The Measured Access Characteristics of World-Wide-Web Client Proxy Caches, Proc 1997 Usenix Symp Internet Technologies and Systems (USITS-97) rousskov, 2000, The Third Cache-Off the Offical Report 10.1023/A:1019240520661 wessels, 2001, SQUID Frequently Asked Questions