research-article

Deep and wide metrics for HPC resource capability and project usage

Author:

David HartAuthors Info & Claims

SC '11: State of the Practice Reports

Article No.: 1, Pages 1 - 7

https://doi.org/10.1145/2063348.2063350

Published: 12 November 2011 Publication History

Abstract

This paper defines and demonstrates application of possible quantitative metrics for the qualitative notions of "deep" and "wide" HPC system use along with the related concepts of capability and capacity computing. By summarizing HPC workloads according to the science-oriented projects using the systems, rather than solely on job sizes and distributions, one can identify differences between the workloads on different systems as well as highlight certain instances of unique usage modalities. Specific definitions of depth and width are suggested, along with metrics that permit comparisons to determine which systems are deeper or wider than others. Similarly, the same data permit an alternate means of defining the degree to which HPC system activities are capability-or capacity-oriented.

References

[1]

Strohmaier, E., Dongarra, J. J., Meuer, H. W., and Simon, H. D. 2005. Recent trends in the marketplace of high performance computing, Parallel Computing, 31, 3--4 (March-April 2005) 261--273, DOI=10.1016/j.parco.2005.02.001.

Digital Library

[2]

Catlett, C. 2005. TeraGrid: A Foundation for US Cyberinfrastructure. In Network and Parallel Computing, H. Jin, D. Reed, W. Jiang, eds. Lecture Notes in Computer Science series. Springer, Berlin/Heidelberg, 3779:1. http://dx.doi.org/10.1007/11577188_1.

Digital Library

[3]

Ndousse, T. 2006. ASCR Performance Measures. Advanced Scientific Computing Advisory Committee (ASCAC) Meeting, (Washington, DC, March 15--16, 2006). http://science.energy.gov/ascr/ascac/meetings/mar-2006/.

[4]

Branscomb, L. et al. 1993. From Desktop to TeraFlop: Exploiting the U. S. Lead in High-Performance Computing. Final Report of the National Science Foundation Blue Ribbon Panel on High-Performance Computing, National Science Foundation, Arlington, VA, 1993; http://www.nsf.gov/pubs/stis1993/nsb93205/nsb93205.txt.

[5]

Hart, D. L. 2011. Measuring TeraGrid: workload characterization for a high-performance computing federation. IJHPCA, Published online before print, February 10, 2011, DOI=10.1177/1094342010394382.

Digital Library

[6]

NCAR. 2011. Allocations. http://www2.cisl.ucar.edu/docs/allocations.

[7]

TeraGrid. 2011. NSF Resource Allocations Policies. https://www.teragrid.org/web/user-support/allocations_policy.

[8]

Department of Energy. 2011. INCITE Call for Proposals. http://hpc.science.doe.gov/allocations/calls/incite2012.

[9]

Katz, D., D. Hart, C. Jordan, A. Majumdar, J. P. Navarro, W. Smith, J. Towns, V. Welch, N. Wilkins-Diehr. 2011. Cyberinfrastructure Usage Modalities on the TeraGrid. Proceedings of the 25th IEEE International Parallel and Distributed Processing Symposium 2011 (IDPDS 2011), Anchorage (Alaska), USA, May 16--20, 2011.

Digital Library

[10]

Feitelson D. G. 2006. Metrics for mass-count disparity. In: Proceedings of the 14th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Tele-communication Systems (MASCOTS), Monterey (Calif.), USA, September 11-14, 2006, pp. 61--68.

Digital Library

[11]

Feitelson, D. G., and Tsafrir, D. 2006. Workload Sanitation for Performance Evaluation. In IEEE International Symposium on Performance Analysis of Systems and Software 2006. IEEE Computer Society, pp. 221--230.

[12]

Wilkins-Diehr, N., Gannon, D., Klimeck, G., Oster, S., and Pamidighantam, S. 2008. TeraGrid science gateways and their impact on science. Computer, 41: 32--41.

Digital Library

[13]

Community Earth System Model (CESM), http://www.cesm.ucar.edu/.

[14]

Weather Research and Forecasting (WRF) Model, http://wrf-model.org/.

[15]

Moore, R. L., Hart, D. L., Pfeiffer, W., Tatineni, M., Yoshimoto, K., and Young, W. S. 2011. Trestles: A high-productivity HPC system targeted to modest-scale and gateway users. TeraGrid'11, July 18-21, 2011, Salt Lake City, Utah.

Digital Library

Cited By

Hart D(2022)Measuring XSEDE: Usage Metrics for the XSEDE Federation of ResourcesPractice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You10.1145/3491418.3530765(1-9)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3491418.3530765
Sinatra S(2015)Women and Heart Disease: Special ConsiderationsNutritional and Integrative Strategies in Cardiovascular Medicine10.1201/b18282-15(325-336)Online publication date: 30-Mar-2015
https://doi.org/10.1201/b18282-15
Moore RBaru CBaxter DFox GMajumdar APapadopoulos PPfeiffer WSinkovits RStrande STatineni MWagner RWilkins-Diehr NNorman MLathrop SAlameda J(2014)Gateways to DiscoveryProceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment10.1145/2616498.2616540(1-8)Online publication date: 13-Jul-2014
https://dl.acm.org/doi/10.1145/2616498.2616540
Show More Cited By

Index Terms

Deep and wide metrics for HPC resource capability and project usage
1. General and reference
  1. Cross-computing tools and techniques
    1. Metrics

Recommendations

Measuring XSEDE: Usage Metrics for the XSEDE Federation of Resources: A comparison of evolving resource usage patterns across TeraGrid and XSEDE
PEARC '22: Practice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You

The Extreme Science and Engineering Discovery Environment (XSEDE) program and its predecessor, the TeraGrid, have provided a range of advanced computing resources to the U.S. research community for nearly two decades. The continuously collected data set ...
Are Slice-Based Cohesion Metrics Actually Useful in Effort-Aware Post-Release Fault-Proneness Prediction? An Empirical Study
Background. Slice-based cohesion metrics leverage program slices with respect to the output variables of a module to quantify the strength of functional relatedness of the elements within the module. Although slice-based cohesion metrics have been ...
A Critical Analysis of Current OO Design Metrics

Chidamber and Kemerer (C&K) outlined some initial proposals for language-independent OO design metrics in 1991. This suite is expanded on by C&K in 1994 and the metrics were tested on systems developed in C++ and Smalltalk™. The six metrics making up ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '11: State of the Practice Reports

November 2011

242 pages

ISBN:9781450311397

DOI:10.1145/2063348

Conference Chair:
Scott Lathrop
University of Chicago
,
Program Chairs:
Jim Costa
Sandia National Laboratories
,
William Kramer
National Center for Supercomputing Applications

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SC '11

Sponsor:

SIGARCH
IEEE-CS

SC '11: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 18, 2011

Washington, Seattle

Acceptance Rates

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
146
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hart D(2022)Measuring XSEDE: Usage Metrics for the XSEDE Federation of ResourcesPractice and Experience in Advanced Research Computing 2022: Revolutionary: Computing, Connections, You10.1145/3491418.3530765(1-9)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.1145/3491418.3530765
Sinatra S(2015)Women and Heart Disease: Special ConsiderationsNutritional and Integrative Strategies in Cardiovascular Medicine10.1201/b18282-15(325-336)Online publication date: 30-Mar-2015
https://doi.org/10.1201/b18282-15
Moore RBaru CBaxter DFox GMajumdar APapadopoulos PPfeiffer WSinkovits RStrande STatineni MWagner RWilkins-Diehr NNorman MLathrop SAlameda J(2014)Gateways to DiscoveryProceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment10.1145/2616498.2616540(1-8)Online publication date: 13-Jul-2014
https://dl.acm.org/doi/10.1145/2616498.2616540
Furlani TSchneider BJones MTowns JHart DGallo SDeLeon RLu CGhadersohi AGentner RPatra Avon Laszewski GWang FPalmer JSimakov NWilkins-Diehr N(2013)Using XDMoD to facilitate XSEDE operations, planning and analysisProceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery10.1145/2484762.2484763(1-8)Online publication date: 22-Jul-2013
https://dl.acm.org/doi/10.1145/2484762.2484763
Szczepanski AHuang JBaer TMack YAhern S(2013)Data Analysis and Visualization in High-Performance ComputingComputer10.1109/MC.2012.19246:5(84-92)Online publication date: 1-May-2013
https://dl.acm.org/doi/10.1109/MC.2012.192
Szczepański AHuang JAhern SFahey MStewart C(2012)A tale of two systemsProceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond10.1145/2335755.2335794(1-8)Online publication date: 16-Jul-2012
https://dl.acm.org/doi/10.1145/2335755.2335794
Furlani TJones MGallo SBruno ALu CGhadersohi AGentner RPatra ADeLeon Rvon Laszewski GWang FZimmerman A(2012)Performance metrics and auditing framework using application kernels for high‐performance computer systemsConcurrency and Computation: Practice and Experience10.1002/cpe.287125:7(918-931)Online publication date: 14-Jun-2012
https://doi.org/10.1002/cpe.2871

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten