A decentralized, adaptive replica location mechanism
Proceedings 11th IEEE International Symposium on High Performance Distributed Computing - Trang 24-32
Tóm tắt
We describe a decentralized, adaptive mechanism for replica location in wide-area distributed systems. Unlike traditional, hierarchical (e.g, DNS) and more recent (e.g., CAN, Chord, Gnutella) distributed search and indexing schemes, nodes in our location mechanism do not route queries, instead, they organize into an overlay network and distribute location information. We contend that this approach works well in environments where replica location queries are prevalent but the dynamic component of the system (e.g., node and network failures, replica add/delete operations) cannot be neglected. We argue that a replica location mechanism that combines probabilistic representations of replica location information with soft-state protocols and a flat overlay network of nodes brings important benefits: genuine decentralization, low query latency, and flexibility to introduce adaptive communication schedules. We support these claims in two ways. First, we provide a rough resource consumption evaluation: we show that, for environments similar to those encountered in large scientific data analysis projects, generated network traffic is limited and, more importantly, is comparable to the traffic generated by a request routing scheme. Second, we provide encouraging performance data from a prototype implementation.
Từ khóa
#Delay #Computer science #Indexing #Data analysis #Telecommunication traffic #Internet #Mathematics #Laboratories #Protocols #SchedulingTài liệu tham khảo
10.1145/358161.358167
10.1016/S1389-1286(00)00179-1
butler, 2000, Design and Deployment of a National-Scale Authentication Infrastructure, IEEE Computer, 33, 60, 10.1109/2.889094
10.1109/INFCOM.1997.635133
10.1145/316194.316202
10.1145/383962.384004
10.1145/378993.379239
gribble, 0, Scalable, Distributed Data Structures for Internet Service Construction, Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (OSDI'2000)
hodes, 2001, An Architecture for Secure Wide-Area Service Discovery, Wireless Networks
iamnitchi, 0, Locating Data in (Small-World?) P2P Scientific Collaborations, 1st International Workshop on Peer-to-Peer Systems
avery, 2001, The GriPhyN Project: Towards Petascale Virtual Data Grids, Technical Report GriPhyN-2001–15
10.1145/67933.67941
yin, 0, Hierarchical Cache Consistency in WAN, USENIX Symposium on Internet Technologies and Systems 1999
holtman, 2001, CMS Data Grid System Overview and Requirements, Technical Report GriPhyN-2001–1
wilde, 2001, Replica Catalog Performance and Capacity Requirements (v.6), MCS-ANL
10.1145/383059.383072
10.1145/383059.383071
zhao, 2001, Tapestry: An infrastructure for fault-tolerant wide-area location and routing, Technical Report CSD-01–1163
10.1109/HOTOS.2001.990064
ripeanu, 2002, Mapping the Gnutella Network: Properties of Large-Scale Peer-to-Peer Systems and Implications for System Design, IEEE Internet Computing Journal special issue on peer-to-peer networking, 6
10.1109/90.851975
10.1145/502034.502048
10.1109/4434.749137
touch, 0, The X-Bone, Third Global Internet Mini-Conference at Globecom '98
10.1016/S0169-7552(98)00015-4
chervenak, 2001, The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Data Sets, J Network and Computer Applications, 187
10.1145/362686.362692
10.1109/SC.2002.10024
10.1145/248052.248120
moore, 1999, Data-Intensive Computing, The Grid Blueprint for a New Computing Infrastructure, 105
10.1145/319151.319153
10.1145/3149.214121
0, Squid Web Proxy Cache
valloppillil, 1988, Cache array routing protocol v1.0, Internet draft
10.1145/258533.258660
10.1016/S1389-1286(99)00055-9
jannotti, 0, Overcast: Reliable Multicasting with an Overlay Network, Proc 4th Symposium on Operating System Design and Implementation (OSDI
fan, 1998, Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol, ACM SIGCOMM'98, 10.1145/285237.285287
10.1145/505202.505224
10.1016/S1389-1286(01)00172-4
chu, 0, Enabling Conferencing Applications on the Internet Using an Overlay Multicast Architecture, SIGCOMM 2001