Article

Synthesizing Realistic Computational Grids

Authors:

Peter A. DindaAuthors Info & Claims

SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing

Page 16

https://doi.org/10.1145/1048935.1050167

Published: 15 November 2003 Publication History

Abstract

Realistic workloads are essential in evaluating middleware for computational grids. One important component is the raw grid itself: a network topology graph annotated with the hardware and software available on each node and link. This paper defines our requirements for grid generation and presents GridG, our extensible generator. We describe GridG in two steps: topology generation and annotation. For topology generation, we have both model and mechanism. We extend Tiers, an existing tool from the networking community, to produce graphs that obey recently discovered power laws of Internet topology. We also contribute to network topology theory by illustrating a contradiction between two laws and proposing a new version of one of them. For annotation, GridG captures intra- and inter-host correlations between attributes using conditional probability rules. We construct a set of rules, including one based on empirical evidence of OS concentration in subnets, that produce sensible host annotations.

References

[1]

{1} AIDA, K., TAKEFUSA, A., NAKADA, H., MATSUOKA, S., SEKIGUCHI, S., AND NAGASHIMA, U. Performance evaluation model for scheduling in a global computing system. International Journal of High Performance Computing Applications 14, 3 (2000).

Digital Library

[2]

{2} AIELLO, W., CHUNG, F., AND LU, L. A random graph model for massive graphs. In ACM Symposium on Theory of Computing (2000).

Digital Library

[3]

{3} ALBERT, R., AND LASZLO BARABASI, A. Statistical mechanics of complex networks. Reviews of modern physics 74 (2002).

[4]

{4} BANERJEE, S., LEE, S., BHATTACHARJEE, B., AND SRINIVASAN, A. Resilient multicast overlays. In Sigmetrics 2003 (2003).

Digital Library

[5]

{5} BARABASI, A., AND R. ALBERT. Emergence of scaling in random networks. Science (1999), 509-512.

[6]

{6} BUYYA, R., AND MURSHED, M. Gridsim: A toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. The Journal of Concurrency and Computation: Practice and Experience (CCPE) (May 2002 (to appear)).

[7]

{7} CALVERT, K. L., DOAR, M. B., AND ZEGURA, E. W. Modeling internet topology. IEEE Communications Magazine 35, 6 (June 1997), 160-168.

Digital Library

[8]

{8} CASANOVA, H. Simgrid: A toolkit for the simulation of application scheduling. In the First IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2001) (2001).

Digital Library

[9]

{9} CZAJKOWSKI, K., FITZGERALD, S., FOSTER, I., AND KESSELMAN, C. Grid information services for distributed resource sharing. In 10th IEEE Symp. on High Performance Distributed Computing (2001).

Digital Library

[10]

{10} DINDA, P., GROSS, T., KARRER, R., LOWEKAMP, B., MILLER, N., STEENKISTE, P., AND SUTHERLAND, D. The architecture of the remos system. In 10th IEEE Symp. on High Performance Distributed Computing (2001).

Digital Library

[11]

{11} DINDA, P., AND PLALE, B. A unified relational approach to grid information services. Grid Forum Informational Draft GWD-GIS-012-1 (February 2001).

[12]

{12} DINDA, P. A. Online prediction of the running time of tasks. Cluster Computing 5, 3 (2002).

Digital Library

[13]

{13} DINDA, P. A., AND LU, D. Nondeterministic queries in a relational grid information service. In Proceedings of ACM/IEEE SC 2003 (Supercomputing 2003) (2003). To Appear. (In this volume.).

Digital Library

[14]

{14} DOAR, M. B. A better model for generating test networks. IEEE GLOBECOM (1996).

[15]

{15} FALOUTSOS, M., FALOUTSOS, P., AND FALOUTSOS, C. On power-law relationships of the internet topology. In Proceedings of SIGCOMM '99 (1999).

Digital Library

[16]

{16} FOSTER, I. The anatomy of the grid: Enabling scalable virtual organizations. Lecture Notes in Computer Science 2150 (2001), 1-25.

Digital Library

[17]

{17} FOSTER, I., AND KESSELMAN, C. Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing 11, 2 (Summer 1997), 115-128.

Digital Library

[18]

{18} FOSTER, I., AND KESSELMAN, C., Eds. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1999.

Digital Library

[19]

{19} FYODOR. Remote os detection via tcp/ip stack fingerprinting. (web page). http://www.insecure.org/nmap/nmapfingerprinting-article.html.

[20]

{20} GRIMSHAW, A. S., WULF, W. A., AND TEAM, C. T. L. The legion vision of a worldwide virtual computer. Communications of the ACM 40 (1997), 39-45.

Digital Library

[21]

{21} JIN, C., CHEN, Q., AND JAMIN, S. Inet: Internet topology generator. Tech. Rep. CSE-TR443-00, Department of EECS, University of Michigan Ann Arbor, 2000.

[22]

{22} KLEINBERG, J. M., KUMAR, R., RAGHAVAN, P., RAJAGOPALAN, S., AND TOMKINS, A. S. The web as a graph: Measurements, models and methods. Lecture Notes in Computer Science 1627 (1999), 1-18.

Digital Library

[23]

{23} LOWEKAMP, B. B. Combining active and passive network measurements to build scalable monitoring systems on the grid. Performance Evaluation Review 30, 4 (March 2003), 19- 26.

Digital Library

[24]

{24} MEDINA, A., LAKHINA, A., MATTA, I., FAMEDINA, J. B., AND ANUKOOL. Brite: An approach to universal topology generation. In IEEE MASCOTS '01 (Tools track) (2001).

Digital Library

[25]

{25} MEDINA, A., MATTA, I., AND BYERS, J. On the origin of power laws in internet topologies. ACM SIGCOMM Computer Communication Review (CCR) 30 (2000), 18-28.

Digital Library

[26]

{26} MIHAIL, M., AND PAPADIMITRIOU, C. On the eigenvalue power law. Springer-Verlag Lecture Notes in Computer Science (2002).

[27]

{27} PALMER, C. R., AND STEFFAN, J. G. Generating network topologies that obey power laws. In GLOBECOM '2000 (2000).

[28]

{28} RIPEANU, M., AND FOSTER, I. Mapping gnutella network: Macroscopic propersies of large-scale peer-to-peer systems. In 1st International Workshop on Peer-to-Peer Systems (2002).

Digital Library

[29]

{29} ROWSTRON, A. I. T., AND DRUSCHEL, P. Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. Middleware (2001), 329-350.

Digital Library

[30]

{30} SMITH, W., WAHEED, A., MEYERS, D., AND YAN, J. C. An evaluation of alternative designs for a grid information service. Cluster Computing 4 (2001), 29-37.

Digital Library

[31]

{31} SONG, H. J., LIU, X., JAKOBSEN, D., BHAGWAN, R., ZHANG, X., TAURA, K., AND CHIEN, A. A. The microgrid: a scientific tool for modeling computational grids. In Supercomputing (2000).

Digital Library

[32]

{32} TANGMUNARUNKIT, H., GOVINDAN, R., AND JAMIN, S. Network topology generators: degree-based vs. structural. In Proceedings of SIGCOMM '02 (2002).

Digital Library

[33]

{33} WAXMAN, B. Routing of multipoint connections. IEEE J. of Selected Areas in Communications 6, 9 (1988), 1622-1671.

Digital Library

[34]

{34} WINICK, J., AND JAMIN, S. Inet-3.0: Internet topology generator. Tech. Rep. CSE-TR-456-02, Department of EECS, University of Michigan Ann Arbor, 2002.

[35]

{35} WOLSKI, R., SPRING, N. T., AND HAYES, J. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 15, 5-6 (1999), 757-768.

Digital Library

Cited By

Bandara HJayasumana A(2015)P2P-Based, Multi-Attribute Resource Discovery under Real-World Resources and QueriesACM Transactions on Internet Technology10.1145/272913915:1(1-35)Online publication date: 12-Mar-2015
https://dl.acm.org/doi/10.1145/2729139
Peyvandi SAhmad RZakaria M(2014)Association among independent and dependent factors of host in volunteer computing2014 International Conference on Computer and Information Sciences (ICCOINS)10.1109/ICCOINS.2014.6868834(1-6)Online publication date: Jun-2014
https://doi.org/10.1109/ICCOINS.2014.6868834
Camarasu-Pop SGlatard TBenoit-Cattin HEpema D(2013)Simulating application workflows and services deployed on the european grid infrastructureProceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2013.13(18-25)Online publication date: 13-May-2013
https://dl.acm.org/doi/10.1109/CCGrid.2013.13
Show More Cited By

Recommendations

Simulating Realistic Packet Routing without Routing Protocols
PADS '05: Proceedings of the 19th Workshop on Principles of Advanced and Distributed Simulation

A fundamental requirement for any network simulation environment is the realistic forwarding of packets from a source to a destination in the simulated topology. The routing decisions at each hop along the path should accurately represent decisions made ...
Hill Climbing-Based Decentralized Job Scheduling on Computational Grids
IMSCCS '06: Proceedings of the First International Multi-Symposiums on Computer and Computational Sciences - Volume 1 (IMSCCS'06) - Volume 01

De-centralized job scheduling is implemented by job migrations between neighboring grid nodes. To optimize node selection of a new-submitted job, the job may be migrated many times. Here, the hill climbing method is used to determine the migration ...
Localized routing with guaranteed delivery and a realistic physical layer in wireless sensor networks

Routing is the problem of sending a packet from a source node to a destination node in the network. Existing solutions for sensor networks assume a unit disk graph model, where messages between nodes are received correctly if and only if the distance ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing

November 2003

859 pages

ISBN:1581136951

DOI:10.1145/1048935

General Chair:
James R. McGraw

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SC '03

Sponsor:

SIGARCH
IEEE-CS

SC '03: International Conference for High Performance Computing, Networking, Storage and Analysis

November 15 - 21, 2003

AZ, Phoenix, USA

Acceptance Rates

SC '03 Paper Acceptance Rate 60 of 207 submissions, 29%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
266
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bandara HJayasumana A(2015)P2P-Based, Multi-Attribute Resource Discovery under Real-World Resources and QueriesACM Transactions on Internet Technology10.1145/272913915:1(1-35)Online publication date: 12-Mar-2015
https://dl.acm.org/doi/10.1145/2729139
Peyvandi SAhmad RZakaria M(2014)Association among independent and dependent factors of host in volunteer computing2014 International Conference on Computer and Information Sciences (ICCOINS)10.1109/ICCOINS.2014.6868834(1-6)Online publication date: Jun-2014
https://doi.org/10.1109/ICCOINS.2014.6868834
Camarasu-Pop SGlatard TBenoit-Cattin HEpema D(2013)Simulating application workflows and services deployed on the european grid infrastructureProceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2013.13(18-25)Online publication date: 13-May-2013
https://dl.acm.org/doi/10.1109/CCGrid.2013.13
Heien EKondo DAnderson D(2012)A Correlated Resource Model of Internet End HostsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2011.25123:6(977-984)Online publication date: 1-Jun-2012
https://dl.acm.org/doi/10.1109/TPDS.2011.251
Heien EKondo DAnderson D(2011)Correlated Resource Models of Internet End Hosts2011 31st International Conference on Distributed Computing Systems10.1109/ICDCS.2011.13(278-287)Online publication date: Jun-2011
https://doi.org/10.1109/ICDCS.2011.13
Bandara HJayasumana A(2011)On Characteristics and Modeling of P2P Resources with Correlated Static and Dynamic Attributes2011 IEEE Global Telecommunications Conference - GLOBECOM 201110.1109/GLOCOM.2011.6134288(1-6)Online publication date: Dec-2011
https://doi.org/10.1109/GLOCOM.2011.6134288
Quinson MBobelin LSuter F(2010)Synthesizing Generic Experimental Environments for SimulationProceedings of the 2010 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing10.1109/3PGCIC.2010.37(222-229)Online publication date: 4-Nov-2010
https://dl.acm.org/doi/10.1109/3PGCIC.2010.37
Dong FAkl S(2007)A joint data and computation scheduling algorithm for the gridProceedings of the 13th international Euro-Par conference on Parallel Processing10.5555/2391541.2391611(587-597)Online publication date: 28-Aug-2007
https://dl.acm.org/doi/10.5555/2391541.2391611
Eyraud-Dubois LLegrand AQuinson MVivien F(2007)A first step towards automatically building network representationsProceedings of the 13th international Euro-Par conference on Parallel Processing10.5555/2391541.2391561(160-169)Online publication date: 28-Aug-2007
https://dl.acm.org/doi/10.5555/2391541.2391561
Birrer SBustamante F(2007)A Comparison of Resilient Overlay Multicast ApproachesIEEE Journal on Selected Areas in Communications10.1109/JSAC.2007.07120825:9(1695-1705)Online publication date: 1-Dec-2007
https://dl.acm.org/doi/10.1109/JSAC.2007.071208
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents