Abstract
Recently, there has been much research about cluster computing to get high performance using low-cost PCs connected with high-speed interconnection networks. In many research areas, many distributed file systems have been developed. In many distributed file systems, PVFS (Parallel Virtual File System) provides users with high bandwidth by stripping data over I/O servers. In PVFS, there is no file system cache. For a new file system cache for PVFS, we designed and implemented cooperative cache for PVFS (Coopc- PVFS). Because the previous developed Coopc-PVFS is a hint-based cooperative cache, a cache manager reads/writes files using approximately correct information so that it has a little read/write overhead. And previous studies about cooperative cache are only focused on shared read data and don’t care about write performance. In this paper, we describe the design and implementation of the home-based Coopc-PVFS to improve read/write performance. Also, we evaluate and analysis the performance of the homebased Coopc-PVFS in comparison to PVFS and to the hint-based Coopc-PVFS.
Chapter PDF
Similar content being viewed by others
References
Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System For Linux Clusters. In: Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317–327 (2000)
Vilayannur, M., Kandemir, M., Sivasubramaniam, A.: Kernel-Level Caching for Optimizing I/O by Exploiting Inter-Application Data Sharing. In: IEEE International Conference on Cluster Computing (CLUSTER 2002) (September 2002)
Dahlin, M., Wang, R., Anderson, T., Patterson, D.: Cooperative Caching: Using remote client memory to improve file system performance. In: Proceedings of the First USENIX Symposium on Operating Systems Design and Implemntation, pp. 267–280. USENIX Assoc., Berkeley (1994)
Feeley, M.J., Morgan, W.E., Pighin, F.H., Karlin, A.R., Levy, H.M.: Implementing global memory management in a workstation cluster. In: Proceedings of the 15th symposium on Operating System Principles (SOSP), pp. 201–212. ACM Press, New York (1995)
Sarkar, P., Hartman, J.: Efficient cooperative caching using hints. In: Proceedings of the second USENIX symposium on Operating systems design and implementation, Seattle, Washington, United States, October 29-November 01, pp. 35–46 (1996)
Can cluster, http://camars.kaist.ac.kr/~nrl
Wong, P., Van der Wijngaart, R.F.: NAS Parallel Benchmark I/O Version 2.4, NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA 94035-1000
Gropp, W., Huss-Lenderman, S., Lumsdaine, A., Lusk, E., Nitzberg, W., Saphir, W., Snir, M.: MPI: The Complete Reference, vol. 2. MIT Press, Cambridge (1998)
Hwang, I.-C., Kim, H., Jung, H., Kim, D.-H., Ghim, H., Maeng, S.-R., Cho, J.-W.: Design and Implementation of the Coopeartive Cache for PVFS. In: International Conference on Computational Science 2004, Krakow, Poland (June 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hwang, IC., Jung, H., Maeng, SR., Cho, JW. (2005). Design and Implementation of the Home-Based Cooperative Cache for PVFS. In: Sunderam, V.S., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science – ICCS 2005. ICCS 2005. Lecture Notes in Computer Science, vol 3516. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11428862_56
Download citation
DOI: https://doi.org/10.1007/11428862_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26044-8
Online ISBN: 978-3-540-32118-7
eBook Packages: Computer ScienceComputer Science (R0)