Article

Introducing the open trace format (OTF)

Authors:

Andreas Knüpfer,

Ronny Brendel,

Holger Brunst,

Hartmut Mix, and

Wolfgang E. NagelAuthors Info & Claims

ICCS'06: Proceedings of the 6th international conference on Computational Science - Volume Part II

May 2006

Pages 526 - 533

https://doi.org/10.1007/11758525_71

Published: 28 May 2006 Publication History

Abstract

This paper introduces the new Open Trace Format. The first part provides a small overview about Trace Format Libraries in general and existing Formats/Libraries and their features. After that the important requirements are discussed. In particular it concerns efficient parallel and selective access to trace data. The following part presents design decisions and features of OTF comprehensively. Finally, there is some early evaluation of OTF. It features comparison of storage size for several examples as well as sequential and parallel I/O benchmarks. At the end, a conclusion will summarize the results and give some outlook.

References

[1]

Ruth A. Aydt. The Pablo Self-Defining Data Format. Technical report, Department of Computer Science, University of Illinois, Urbana/Illinois, USA, 1994. http://wotug.kent.ac.uk/parallel/performance/tools/pablo/.

Google Scholar

[2]

Holger Brunst, Allen D. Malony, Sameer S. Shende, and Robert Bell. Online Remote Trace Analysis of Parallel Applications on High-Performance Clusters. In Proceedings of ISHPC'03 Conference, Springer LNCS 2858, pages 440-449, 2003.

Google Scholar

[3]

J. Chassin de Kergommeaux, B. de Oliveira Stein, and G. Mouni. Paje Input Data Format. Technical report, 2003.

Google Scholar

[4]

Intel GmbH, Brühl, Germany. Intel Trace Collector User's Guide.

Google Scholar

[5]

Guohua Jin and John Mellor-Crummey. Experiences Tuning SMG98 - a Semicoarsening Multigrid Benchmark based on the Hypre Library. In Proceedings of the International Conference on Supercomputing, New York, June 2002.

Digital Library

Google Scholar

[6]

Jean loup Gailly and Mark Adler. zlib 1.1.4 Manual, March 2002. http://www.zlib. net/manual.html.

Google Scholar

[7]

Hartmut Mix. Open Trace Format. http://tu-dresden.de/zih otf/, 2006.

Google Scholar

[8]

Stephan Seidl. VTF3 - A Fast Vampir Trace File Low-Level Library. personal communications, May 2002.

Google Scholar

[9]

The ASCI Project. The IRS Benchmark Code: Implicit Radiation Solver. http://www.llnl.gov/asci/purple/benchmarks/limited/irs/, 2003.

Google Scholar

[10]

University of Oregon. TAU User's Guide. http://www.cs.uoregon.edu/ research/tau/docs/newguide/.

Google Scholar

[11]

Felix Wolf and Bernd Mohr. EPILOG Binary Trace-Data Format. Technical report, Forschungszentrum Jülich, University of Tennessee, 2004. FZJ-ZAM-IB-2004-06.

Google Scholar

Cited By

View all

Beyer DDangl MDietsch DHeizmann MLemberger TTautschnig M(2022)Verification WitnessesACM Transactions on Software Engineering and Methodology10.1145/347757931:4(1-69)Online publication date: 8-Sep-2022
https://dl.acm.org/doi/10.1145/3477579
Wang CBalaji PSnir Mde Supinski BHall MGamblin T(2021)PilgrimProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476151(1-14)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476151
Malony ARamesh SHuck KChaimov NShende S(2019)A Plugin Architecture for the TAU Performance SystemProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337916(1-11)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337916
Show More Cited By

Recommendations

The open trace format (OTF) and open tracing for HPC
SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing

The Open Trace Format (OTF) is a DOE-sponsored initiative to help deliver open, scalable performance tracing tools for HPC systems. OTF is an open specification of trace information to provide a target for trace generation and to allow trace analysis ...
Read More
Open Budget Format: Issues on Development of Specification and Converter Implementation
ICEGOV '15-16: Proceedings of the 9th International Conference on Theory and Practice of Electronic Governance

Open budgeting is very popular today. Publishing budgets as structured machine-readable data makes working with budget data simpler for analysts, developers. Budgets of countries are very different and developers need a unified format to exchange and ...
Read More
OpenDocument Format: The Standard for Office Documents

For many years, when you used a word-processing application, your files were stored in a format that was fully understood only by the application you used. WordPerfect stored WordPerfect files, Microsoft Word stored Word files, and so on—and, while ...
Read More

Comments

Information & Contributors

Information

Published In

ICCS'06: Proceedings of the 6th international conference on Computational Science - Volume Part II

May 2006

1104 pages

ISBN:3540343814

Editors:
Vassil N. Alexandrov
Advanced Computing and Emerging Technologies Centre, The School of Systems Engineering, University of Reading, Reading, United Kingdom
,
Geert Dick Albada
Department of Mathematics and Computer Science, University of Amsterdam, Kruislaan 403, SJ Amsterdam, The Netherlands
,
Peter A. Sloot
Faculty of Sciences, Section of Computational Science, University of Amsterdam, Kruislaan 403, SJ Amsterdam, The Netherlands
,
Jack Dongarra
Computer Science Department, University of Tennessee, Kruislaan 403, Knoxville, The Netherlands

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 28 May 2006

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

View all

Beyer DDangl MDietsch DHeizmann MLemberger TTautschnig M(2022)Verification WitnessesACM Transactions on Software Engineering and Methodology10.1145/347757931:4(1-69)Online publication date: 8-Sep-2022
https://dl.acm.org/doi/10.1145/3477579
Wang CBalaji PSnir Mde Supinski BHall MGamblin T(2021)PilgrimProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476151(1-14)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476151
Malony ARamesh SHuck KChaimov NShende S(2019)A Plugin Architecture for the TAU Performance SystemProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337916(1-11)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337916
Islam TMohror KSchulz M(2016)Exploring the MPI tool information interfaceInternational Journal of High Performance Computing Applications10.1177/109434201560050730:2(212-222)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1177/1094342015600507
Jin YMa XLiu MLiu QLogan JPodhorszki NChoi JKlasky S(2015)Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark GenerationACM SIGMETRICS Performance Evaluation Review10.1145/2796314.274587643:1(309-320)Online publication date: 15-Jun-2015
https://dl.acm.org/doi/10.1145/2796314.2745876
Beyer DDangl MDietsch DHeizmann MStahlbauer ADi Nitto EHarman MHeymans P(2015)Witness validation and stepwise testification across software verifiersProceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering10.1145/2786805.2786867(721-733)Online publication date: 30-Aug-2015
https://dl.acm.org/doi/10.1145/2786805.2786867
Jin YMa XLiu MLiu QLogan JPodhorszki NChoi JKlasky SLin BXu JSengupta SShah D(2015)Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark GenerationProceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems10.1145/2745844.2745876(309-320)Online publication date: 15-Jun-2015
https://dl.acm.org/doi/10.1145/2745844.2745876
Kang SWang DNichols JSchuchart JKline KWei YRicciuto DWullschleger SPost WIzaurralde R(2015)Development of mpi_EPIC model for global agroecosystem modelingComputers and Electronics in Agriculture10.1016/j.compag.2014.12.004111:C(48-54)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1016/j.compag.2014.12.004
Mohr B(2014)Scalable parallel performance measurement and analysis tools - state-of-the-art and future challengesSupercomputing Frontiers and Innovations: an International Journal10.14529/jsfi1402071:2(108-123)Online publication date: 9-Jul-2014
https://dl.acm.org/doi/10.14529/jsfi140207
Isaacs KGamblin TBhatele ABremer PSchulz MHamann B(2014)Extracting logical structure and identifying stragglers in parallel execution tracesACM SIGPLAN Notices10.1145/2692916.255528849:8(397-398)Online publication date: 6-Feb-2014
https://dl.acm.org/doi/10.1145/2692916.2555288
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

The open trace format (OTF) and open tracing for HPC

Open Budget Format: Issues on Development of Specification and Converter Implementation

OpenDocument Format: The Standard for Office Documents