A Scaleable and Fault-tolerant Architecture for Distributed Web Resource Discovery

A. Fongen, F. Eliassen (Norway), I. Ferguson, S. Stobart, and J. Tait (UK)

Keywords

Large scale distribution, distributed resource discovery, peer-to-peer networking

Abstract

Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been pro posed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content Sensitive Infrastructure (CSI), and demonstrate its proper ties through formal analysis and simulation.

Important Links:



Go Back