Abstract
A grid RPC system provides a useful and intuitive programming interface for master-worker type applications in a grid environment. In many grid applications, such as parameter search programs, both master and workers are often required to have a large amount of common data. Since in the RPC model the data must be transferred from the master directly to each worker, the master is sometimes a bottleneck, resulting in poor performance. In order to improve the performance in such cases, we propose a model to decouple the data transfer by a data management layer from the RPC programming. We have designed and implemented a prototype data transfer layer called OmniStorage to OmniRPC, which is a grid RPC system for parallel programming in a grid environment. This allows efficient data transmission of a large amount of data by placing intermediate relay servers, taking the network topology into account, to route the communication and cache the common data in the server. We have evaluated the performance of the proposed system by using synthetic workloads and a real grid application. The results show that OmniStorage can improve the performance of OmniRPC applications compared to the case of using only OmniRPC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bassi, A., Beck, M., Moore, T., Plank, J.S., Swany, M., Wolski, R., Fagg, G.: The internet backplane protocol: a study in resource sharing. Future Gener. Comput. Syst. 19(4), 551–562 (2003)
Casanova, H., Dongarra, J.: Netsolve: A network server for solving computational science problems (1996)
Cohen, B.: Incentives build robustness in bittorrent (2003)
Del-Fabbro, B., Laiymani, D., Nicod, J.-M., Philippe, L.: Data management in grid applications providers. In: DFMA 2005: Proceedings of the First International Conference on Distributed Frameworks for Multimedia Applications (DFMA 2005), pp. 315–322 (2005)
Object Management group, http://www.omg.org
Sato, M., Boku, T., Takahashi, D.: OmniRPC:grid RPC system for parallel programming in grid environment. IPSJ Transactions on Computing System 44(No. SIG11 (ACS 3)), 34–45 (2003)
Nakajima, Y., Sato, M., Boku, T., Takahashi, D., Gotoh, H.: Performance evaluation of omnirpc in a grid environment. In: SAINT-W 2004: Proceedings of the 2004 Symposium on Applications and the Internet- Workshops (SAINT 2004 Workshops), p. 658 (2004)
Ninf Project, http://ninf.apgrid.org/
Sato, M., Nakada, H., Sekiguchi, S., Matsuoka, S., Nagashima, U., Takagi, H.: Ninf: A network based information library for global world-wide computing infrastructure (1997)
Tatebe, O., Morita, Y., Matsuoka, S., Soda, N., Sekiguchi, S.: Grid datafarm architecture for petascale data intensive computing. In: CCGRID 2002: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, Washington, DC, USA, p. 102. IEEE Computer Society, Los Alamitos (2002)
Sakurai, T., Tadano, H., Hayakawa, K., Sato, M., Takahashi, D., Nagashima, U., Inatomi, Y., Umeda, H., Watanabe, T.: A master-worker type parallel method for large-scale eigenvalue problems. IPSJ Transactions on Computing System 46(No. SIG7), 1–8 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Aida, Y., Nakajima, Y., Sato, M., Sakurai, T., Takahashi, D., Boku, T. (2006). Performance Improvement by Data Management Layer in a Grid RPC System. In: Chung, YC., Moreira, J.E. (eds) Advances in Grid and Pervasive Computing. GPC 2006. Lecture Notes in Computer Science, vol 3947. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11745693_33
Download citation
DOI: https://doi.org/10.1007/11745693_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33809-3
Online ISBN: 978-3-540-33810-9
eBook Packages: Computer ScienceComputer Science (R0)