research-article

A survey-based study of grid traffic

Authors:

Yehia El khatib,

Christopher EdwardsAuthors Info & Claims

GridNets '07: Proceedings of the first international conference on Networks for grid applications

Article No.: 4, Pages 1 - 8

Published: 17 October 2007 Publication History

Abstract

Grid computing offers the prospect of harnessing huge amounts of computational resources. However, it is being argued that such potential cannot be fully exploited due to the nature of the Internet architecture which is not suitable for high-speed communication of large data volumes. In an attempt to find out the accuracy of such description of grid application traffic, we have conducted a survey of Grid applications. Among other things, the survey results have revealed the diversity of Grid traffic, suggesting that there is more to Grid traffic than just transfers of huge bulks. In this paper, we present these results and identify different trends of traffic behavior that have been observed within the results. We then validate our findings by looking in detail at two of the applications that we have surveyed.

References

[1]

"Grid Network Monitoring: Demonstration of Enhanced Monitoring Tools". Deliverable D7.2, EU Datagrid Document: WP7-D7.2-0110-4-1. April 2007.]]

[2]

W. Feng, P. Tinnakornsrisuphap. "The Failure of TCP in High-Performance Computational Grids". In proceedings of the 2000 ACM/IEEE conference on Supercomputing (SC2000), article no. 37, Dallas, Texas, USA, November 2000. ISBN: 0-7803-9802-5.]]

Digital Library

[3]

S. Floyd. "HighSpeed TCP for Large Congestion Windows". Request for Comments: 3649. December 2003.]]

Digital Library

[4]

I. Foster, C. Kesselman, G. Tsudik, S. Tuecke. "A Security Architecture for Computational Grids". In proceedings of the 5th ACM conference on Computer and Communications Security, pp: 83--92, San Francisco, California, USA, November 1998. ISBN: 1-58113-007-4.]]

Digital Library

[5]

I. Foster, C. Kesselman, S. Tuecke. "The Anatomy of the Grid: Enabling Scalable Virtual Organizations". International Journal of Supercomputer Applications, vol. 15, no. 3, 2001.]]

Digital Library

[6]

I. Foster, C. Kesselman (ed). "The Grid: Blueprint for a New Computing Infrastructure". Second edition, Morgan Kaufmann Publishers, 2004. ISBN: 1-55860-933-4.]]

Digital Library

[7]

Y. Gu, R. Grossman. "UDT: An Application Level Transport Protocol for Grid Computing". Second International Workshop on Protocols for Fast Long-Distance Networks (PFLDnet2004), Argonne, Illinois, USA, February 2004.]]

[8]

D. Gunter, B. Tierney, K. Jackson, J. Lee, M. Stoufer. "Dynamic Monitoring of High-Performance Distributed Applications". In proceedings of the 11th IEEE Symposium on High Performance Distributed Computing (HPDC-11), Edinburgh, UK, July 2002.]]

Digital Library

[9]

E. He, R. Kettimuthu, Y. Gu, S. Hegde, M. Welzl, P. Vicat-Blanc Primet, J. Leigh, C. Xiong. "Survey of Protocols and Mechanisms for Enhanced Transport over Long Fat Pipes". Global Grid Forum White paper Draft (work in progress), Data Transport Research Group, 2003. Available at: http://www-unix.mcs.anl.gov/~kettimut/Survey.pdf]]

[10]

C. Jin, D. X. Wei, S. H. Low, J. Bunn, D. H. Choe, J. C. Doyle, H. Newman, S. Ravot, S. Singh, F. Paganini, G. Buhrmaster, R. L. A. Cottrell, O. Martin, W. Feng. "FAST TCP: From Theory to Experiments". IEEE Network, vol. 19, no. 1, pp. 4--11, January-February 2005.]]

Digital Library

[11]

D. Katabi, M. Handley, C. Rohrs. "Congestion Control for High Bandwidth-Delay Product Networks". In proceedings of the ACM SIGCOMM 2002 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, session: Congestion Control, pp: 89--102, Pittsburgh, Pennsylvania, USA, August 2002. ISBN: 1-58113-570-X.]]

Digital Library

[12]

T. Kelly. "Scalable TCP: Improving Performance in Highspeed Wide Area Networks". ACM SIGCOMM Computer Communication Review, vol. 33, issue 2, column: Technical papers, pp: 83--91, 2003. ISSN: 0146--4833.]]

Digital Library

[13]

T. Lavian, D. Hoang, J. Mambretti, S. Figueira, S. Naiksatam, N. Kaushik, M. Inder, R. Durairaj, D. Cutrell, S. Merrill, H. Cohen, P. Daspit, F. Travostino. "A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Networks". First International Workshop on Networks for Grid Applications (GridNets2004), San Jose, California, USA, October 2004.]]

[14]

C. Lee, J. Stepanek, R. Wolski, C. Kesselman, I. Foster. "A Network Performance Tool for Grid Environments". In proceedings of the 1999 ACM/IEEE Conference on Supercomputing (SC99), Portland, Oregon, USA, November 1999. ISBN: 1-58113-091-0.]]

Digital Library

[15]

L. Paisley, J. Sventek. "Real-time Detection of Grid Bulk Transfer Traffic". In proceedings of the 10^th IEEE/IFIP Network Operations and Management Symposium (NOMS 2006), pp 66--72, Vancouver, Canada, April 2006. ISSN: 1542--1201, ISBN: 1-4244-0142-9.]]

[16]

C. Partridge, T. Mendez, and W. Milliken. "Host Anycasting Service". Request for Comments: 1546. November 1993.]]

Digital Library

[17]

F. Travostino, J. Mambretti, G. Karmous-Edwards (ed). "Grid Networks: Enabling Grids with Advanced Communication Technology". John Wiley & Sons Ltd, 2006. ISBN: 0-470-01748-1.]]

[18]

D. Wei, C. Jin, S. Low, S. Hegde. "FAST TCP: Motivation, Architecture, Algorithms, Performance". IEEE/ACM Transactions on Networking (TON), vol. 14, issue 6 (December 2006), pp: 1246--1259, 2006. ISSN: 1063--6692.]]

Digital Library

[19]

E. Weigle, W. Feng. "A Case for TCP Vegas in High-Performance Computational Grids". In proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC'01), San Francisco, California, USA, August 2001.]]

Digital Library

[20]

M. Welzl. "Traceable Congestion Control". International Workshop on Internet Charging and QoS Technologies (ICQT 2002), Zürich, Switzerland, October 2002.]]

Digital Library

[21]

M. Welzl, M. M. Yousaf. "Grid-Specific Network Enhancements: A Research Gap?". In proceedings of the IEEE/IFIP International Workshop on Autonomic Grid Networking and Management (AGNM'05), Barcelona, Spain, October 2005.]]

[22]

The ATLAS (A Toroidal LHC ApparatuS) Experiment. http://atlasinfo.cern.ch]]

[23]

Europe-China Grid InterNetworking (EC-GIN), a Framework 6 STREP project, Action Line: IST-2005-2.6.5.1.c Grids China, Project Reference (Contract Number): 045256. http://www.ec-gin.eu/]]

[24]

Grid-enabled Spatial Regression Models (GeSRM), a small grant project funded by the National Centre for e-Social Science (NCeSS). http://www.ncess.ac.uk/research/sgp/gesrm/]]

[25]

Grid Resources On a Workstation Library (GROWL), a collaborative project (JISC VRE programme) between CCLRC Daresbury Laboratory and the Universities of Cambridge and Lancaster. http://www.growl.org.uk/]]

[26]

The Large Hadron Collider. http://lhc.web.cern.ch]]

[27]

The LHC Computing Grid Project. http://lcg.web.cern.ch/LCG]]

[28]

Software for Analysis of Binary Recurrent Events (SABRE). http://sabre.lancs.ac.uk/]]

[29]

CERN press release PR 17.06, "World's largest superconducting magnet switches on", 20.11.2006 http://press.web.cern.ch/Press/PressReleases/Releases2006/PR 17.06E.html]]

Cited By

Ma TEl-khatib YMackay MEdwards CHariri SKeahey K(2010)Characterising a grid site's trafficProceedings of the 19th ACM International Symposium on High Performance Distributed Computing10.1145/1851476.1851581(707-716)Online publication date: 21-Jun-2010
https://dl.acm.org/doi/10.1145/1851476.1851581
Yousaf MWelzl MJunaid MPrimet PWelzl M(2007)Fog in the network weather serviceProceedings of the first international conference on Networks for grid applications10.5555/1386610.1386641(1-6)Online publication date: 17-Oct-2007
https://dl.acm.org/doi/10.5555/1386610.1386641

Index Terms

A survey-based study of grid traffic

Recommendations

Characterising a grid site's traffic
HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Grid computing has been widely adopted for intensive high performance computing. Since grid resources are distributed over complex large-scale infrastructures, understanding grid site data traffic behaviour is important for efficient resource ...
A survey of desktop grid applications for e-science

Desktop grid computing is a relatively new technology that can provide massive computing power for a variety of applications at low cost. These applications may use volunteered computing resources effectively if they have enough mass appeal to obtain a ...
Workflow-based Grid applications

Standardization, usability, and business models are the main success factors for next generation Grid computing systems. This paper focuses on standards and usability within the context of the Fraunhofer Resource Grid that implements a simple, Petri net-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GridNets '07: Proceedings of the first international conference on Networks for grid applications

October 2007

196 pages

ISBN:9789639799028

Sponsors

Orange
Alcatel-Lucent
Myricom
SIGARCH: ACM Special Interest Group on Computer Architecture
ICST
INRIA: Institut Natl de Recherche en Info et en Automatique

Publisher

ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

Brussels, Belgium

Publication History

Published: 17 October 2007

Check for updates

Qualifiers

Research-article

Conference

GridNets07

Sponsor:

SIGARCH
INRIA

GridNets07: 1st International Conference on Networks for Grid Applications & Workshops

October 17 - 19, 2007

Lyon, France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
135
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ma TEl-khatib YMackay MEdwards CHariri SKeahey K(2010)Characterising a grid site's trafficProceedings of the 19th ACM International Symposium on High Performance Distributed Computing10.1145/1851476.1851581(707-716)Online publication date: 21-Jun-2010
https://dl.acm.org/doi/10.1145/1851476.1851581
Yousaf MWelzl MJunaid MPrimet PWelzl M(2007)Fog in the network weather serviceProceedings of the first international conference on Networks for grid applications10.5555/1386610.1386641(1-6)Online publication date: 17-Oct-2007
https://dl.acm.org/doi/10.5555/1386610.1386641

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten