Scalable data fusion using Astrolabe

K.P. Birman1, R. van Renesse1, W. Vogels1
1Reliable Network Solutions, Inc., Cornell University, USA

Tóm tắt

The dramatic growth of computer networks creates both an opportunity and a daunting distributed computing problem for users seeking to perform data fusion and data mining. The problem is that data often resides on large numbers of devices and evolves rapidly. Systems that collect data at a single location scale poorly and suffer from single-point-failures. Astrolabe performs data fusion in real-time, creating a virtual system-wide hierarchical database, which evolves as the underlying information changes. A scalable aggregation mechanism offers a flexible way to perform data mining within the resulting virtual database. Astrolabe is secure, robust under a wide range of failure and attack scenarios, and imposes low loads even under stress.

Từ khóa

#Data mining #Databases #Peer to peer computing #Robustness #Biosensors #Distributed computing #Protocols #Scalability #Data security #Application software

Tài liệu tham khảo

bonnet, 2001, Towards sensor database systems, Proc 3rd Intl Conf Mobile Data Management, 10.1007/3-540-44498-X_1 10.1145/362686.362692 van renesse, 2001, Astrolabe: A robust and scalable technology for distributed system monitoring, Management and Data Mining 10.1109/DISCEX.2001.932161 10.1145/10590.10591 10.1016/S1389-1286(00)00179-1 golding, 1992, A weak-consistency architecture for distributed information services, Computing Systems, 5, 379 10.1145/41840.41841 10.1007/978-1-4471-1283-9_4 10.1145/268998.266711 vanrenesse, 2002, Scalable management and data mining using astrolabe, IPTPS '01 First Intl Workshop on Peer-to-Peer Systems, 10.1007/3-540-45748-8_27