Optimizing Distributed Storage Layouts in the Network Storage Manager

Z. Ali, R. Zhang, Q. Malluhi, and S. Yang (USA)

Keywords

Storage Layouts, Parallel Retrieval, and Distributed Applications.

Abstract

Distributed storage systems are increasing being used by data-intensive applications for efficient and reliable data delivery. The Network Storage Manager (NSM) is a distributed storage framework with a unique architecture that maximizes applications control over many of the storage and retrieval policies. Several applications are utilizing NSM for efficient, tunable, and controllable performance. Data layout is one policy that is considered to be application dependant and tailored algorithms are preferred for application with complex or irregular access patters. Experimental results have shown dramatic performance enhancement when optimized layout policies override the default NSM implementation. Layout algorithms are more effective when proper prefetching and cache replacement policies are implemented.

Important Links:



Go Back