BW-DCache: An Inexpensive, Effective and Reliable Cache Solution in a SAN File System

摘要

In order to enhance scalability of Blue Whale Cluster File System (BWFS), this paper analyses the bottleneck of scalability of BWFS in nonlinear editing application, and presents a solution that clients employ local disk storage as cache on clients. We called BW-DCache (BWFS Cache based Disk medium). Moreover, we carefully choose the client cache strategy and replacement algorithm according to data access pattern. By this, clients can get as much data from local cache as possible, avoid random accesses to storage servers and efficiently reduce the load of storage servers. Therefore, the scalability of the whole system is significantly enhanced. The experiment result shows that our solution can enhance the scalability of the Blue Whale System by 80% at most. Moreover, we adopt some optimizations to improve system performance further.