research-article

Identifying software usage at HPC centers with the automatic library tracking database

Authors:

Nick JonesAuthors Info & Claims

TG '10: Proceedings of the 2010 TeraGrid Conference

Article No.: 8, Pages 1 - 8

https://doi.org/10.1145/1838574.1838582

Published: 02 August 2010 Publication History

Abstract

A library tracking database has been developed to monitor software/library usage. This Automatic Library Tracking Database (ALTD) automatically and transparently stores, into a database, information about the libraries linked into an application at compilation time and also the executables launched in a batch job. Information gathered into the database can then be mined to provide reports. Analyzing the results from the data collected will help to identify, for example, the most frequently used and the least used libraries and codes, and those users that are using deprecated libraries or applications. We will illustrate the usage of libraries and executables on the Cray XT platforms hosted at the National Institute for Computational Sciences and the Oak Ridge Leadership Computing Facility (both located at Oak Ridge National Laboratory).

References

[1]

Anderson, E., Bai, Z., Bischof, C., Blackford, S., Demmel, J., Dongarra, J., et al. (1999). LAPACK Users' Guide (Third ed.). Society for Industrial and Applied Mathematics

Digital Library

[2]

Aprun, Retrieved from http://docs.cray.com/cgi-bin/craydoc.cgi?mode=Show;q=;f=man/alpsm/10/cat1/aprun.1.html

[3]

Balay, S., Buschelman, K., Eijkhout, V., Gropp, W. D., Kaushik, D., Knepley, M. G., et al. (2008). PETSc Users Manual. Argonne National Laboratory.

[4]

J. Borrill, J. C. Integrated Performance Monitoring of a Cosmology Application on Leading HEC Platforms. International Conference on Parallel Processing: ICPP, 2005.

Digital Library

[5]

Case D. A. et al., The Amber biomolecular simulation programs. J. Computat. Chem. 26, 1668--1688, 2005

[6]

Cray. (n.d.). Using Cray Performance Analysis Tools. Retrieved from http://docs.cray.com/books/S-2376-41/

[7]

Fahey Mark, Jones Nick, Hitchcock Blake and Hadri Bilel, ALTD Manual. University of Tennessee, National Institute of Computational Sciences. in preparation 2010.

[8]

Frigo Matteo and Johnson Steven G., "The Design and Implementation of FFTW3," Proceedings of the IEEE 93 (2), 216--231 (2005). Invited paper, Special Issue on Program Generation, Optimization, and Platform Adaptation

[9]

HDF5: http://www.hdfgroup.org/HDF5/

[10]

Levine, J. Linkers and Loaders. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc, 1999.

Digital Library

[11]

Limbach H., Arnold A., Mann B. and Holm C. "ESPResSo - An Extensible Simulation Package for Research on Soft Matter Systems". Comput. Phys. Commun. 174(9) (704--727), 2006

[12]

Mascagni M. and Srinivasan A. "Algorithm 806: SPRNG: A Scalable Library for Pseudorandom Number Generation," ACM Transactions on Mathematical Software, 26: 436--461, 2000

Digital Library

[13]

Malony, S. S. The TAU Parallel Performance System. International Journal of High Performance Computing Applications, SAGE Publications, 20(2):287--331, 2006

Digital Library

[14]

Mohr, B. TOPAS - Automatic Performance Statistics Collection on the CRAY T3E. T3E, Proceedings of the 5th European SGI/Cray MPP Workshop, 1999

[15]

Papi. Retrieved from http://icl.cs.utk.edu/papi/

[16]

Phillips J. C. et al., Scalable molecular dynamics with NAMD, Journal of Computational Chemistry 26, 16, p 1781--1802, 2005

[17]

Plimpton S. J., Fast Parallel Algorithms for Short-Range Molecular Dynamics, J Comp Phys, 117, 1--19 (1995)

Digital Library

[18]

Rew, R. K. and G. P. Davis, NetCDF: An Interface for Scientific Data Access, IEEE Computer Graphics and Applications, Vol. 10, No. 4, pp. 76--82, July 1990.

Digital Library

[19]

SciDAC. Third Workshop on HPC Best Practices, September 2009 http://outreach.scidac.gov/swbp/

[20]

David Skinner(NERSC) and Chris Atwood (DOD), SciDAC notes http://outreach.scidac.gov/swbp/report/Tools.pdf.

[21]

Solchenbach, F. J. VAMPIR: Visualization and Analysis of MPI Resources, 1996.

[22]

Staples, G. TORQUE resource manager. SC 06 PRoceedings of the 2006 ACM/IEEE conference (p. 8). Tampa, Florida: ACM

Digital Library

[23]

Tam, A. (2001). Enabling Process Accounting on Linux HOWTO

[24]

TOP500 http://www.top500.org

[25]

TRILINOS http://trilinos.sandia.gov.

[26]

Van Der Spoel, David and Lindahl, Erik and Hess, Berk and Groenhof, Gerrit and Mark, Alan E. and Berendsen, Herman J. C, GROMACS: Fast, flexible, and free, Journal of Computational Chemistry, 26, p1701--1718, 2005

[27]

Website on the function PAPI_get_shared_lib_info: http://geco.mines.edu/papi/html/papi_get_shared_lib_info.html

[28]

Wiki page information on LUSTRE project http://wiki.lustre.org/index.php/Main_Page

Cited By

Asnina EPudane MSvike MAlksnis G(2014)Customer Oriented Management of Changes in ERP Systems: The Vendor’s SidePerspectives in Business Informatics Research10.1007/978-3-319-11370-8_23(320-334)Online publication date: 2014
https://doi.org/10.1007/978-3-319-11370-8_23
Lu CFreund SPăsăreanu C(2013)Automatically mining program build information via signature matchingProceedings of the 11th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering10.1145/2462029.2462036(25-32)Online publication date: 20-Jun-2013
https://dl.acm.org/doi/10.1145/2462029.2462036
Hadri BYou HMoore SStewart C(2012)Achieve better performance with PEAK on XSEDE resourcesProceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond10.1145/2335755.2335801(1-8)Online publication date: 16-Jul-2012
https://dl.acm.org/doi/10.1145/2335755.2335801
Show More Cited By

Index Terms

Identifying software usage at HPC centers with the automatic library tracking database
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Software management
        Software maintenance

Recommendations

A digital library instead of a traditional database for nanotechnologies: An attempt to use the ABCD system

Against the background of the limited possibilities of the traditional databases during the creation of the information infrastructure of modern science, the advantages and rich potential of digital libraries as a new class of information systems are ...
Identifying New Directions in Database Performance Tuning

Database performance tuning is a complex and varied active research topic. With enterprise relational database management systems still reliant on the set-based relational concepts that defined early data management products, the disparity between the ...
The Alexandria Digital Library and the alexandria digital earth prototype
JCDL '04: Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries

The Alexandria Digital Library, together with its follow-on -- the Alexandria Digital Earth Prototype Project -- is one of the flagship projects of the NSF/NASA/ Digital Library Initiative Uniquely among these projects, ADL is a georeferenced library ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TG '10: Proceedings of the 2010 TeraGrid Conference

August 2010

177 pages

ISBN:9781605588186

DOI:10.1145/1838574

Co-chairs:
Richard Moore
SDSC
,
Daniel S. Katz
UC/ANL
,
Program Chair:
Shawn Brown
PSC

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Carnegie Mellon University: Carnegie Mellon University

In-Cooperation

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 August 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Advanced Scientific Computing Research

Conference

TG '10

Sponsor:

Carnegie Mellon University

TG '10: TeraGrid 2010

August 2 - 5, 2010

Pennsylvania, Pittsburgh

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
176
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Asnina EPudane MSvike MAlksnis G(2014)Customer Oriented Management of Changes in ERP Systems: The Vendor’s SidePerspectives in Business Informatics Research10.1007/978-3-319-11370-8_23(320-334)Online publication date: 2014
https://doi.org/10.1007/978-3-319-11370-8_23
Lu CFreund SPăsăreanu C(2013)Automatically mining program build information via signature matchingProceedings of the 11th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering10.1145/2462029.2462036(25-32)Online publication date: 20-Jun-2013
https://dl.acm.org/doi/10.1145/2462029.2462036
Hadri BYou HMoore SStewart C(2012)Achieve better performance with PEAK on XSEDE resourcesProceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond10.1145/2335755.2335801(1-8)Online publication date: 16-Jul-2012
https://dl.acm.org/doi/10.1145/2335755.2335801
Lu CJones MFurlani TTowns JBrown SKatz D(2011)Automatically mining program build information via signature matchingProceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery10.1145/2016741.2016766(1-2)Online publication date: 18-Jul-2011
https://dl.acm.org/doi/10.1145/2016741.2016766

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents