Measuring Thread Timing to Assess the Feasibility of Early-bird Message Delivery

David E Bernholdt, Swen Boehm, George Bosilca, Manjunath Gorentla Venkata, Ryan E Grant, Thomas Naughton, Howard P Pritchard, Martin Schulz, and Geoffroy R Vallee. 2020. A survey of MPI usage in the US exascale computing project. Concurrency and Computation: Practice and Experience 32, 3 (2020), e4851.

Intel Corporation. [n. d.]. Intel VTune Profiler User Guide. https://www.intel.com/content/www/us/en/develop/documentation/vtune-help/top.html?wapkw=intel%20vtune%20profiler. Accessed: 2022-08-04.

RALPH B. D'AGOSTINO. 1971. An omnibus test of normality for moderate and large size samples. Biometrika 58, 2 (1971), 341–348. https://doi.org/10.1093/biomet/58.2.341

Luiz DeRose, Bernd Mohr, and Seetharami Seelam. 2004. Profiling and tracing OpenMP applications with POMP based monitoring libraries. In European Conference on Parallel Processing. Springer, 39–46.

James Dinan, Pavan Balaji, David Goodell, Douglas Miller, Marc Snir, and Rajeev Thakur. 2013. Enabling MPI interoperability through flexible communication endpoints. In Proceedings of the 20th European MPI Users’ Group Meeting. 13–18.

Matthew GF Dosanjh, Taylor Groves, Ryan E Grant, Ron Brightwell, and Patrick G Bridges. 2016. RMA-MT: a benchmark suite for assessing MPI multi-threaded RMA performance. In 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). IEEE, 550–559.

Mario Flajslik, James Dinan, and Keith D Underwood. 2016. Mitigating MPI message matching misery. In International conference on high performance computing. Springer, 281–299.

Karl Fürlinger and Michael Gerndt. 2005. ompP: A profiling tool for OpenMP. In International Workshop on OpenMP. Springer, 15–23.

Todd Gamblin. [n. d.]. Scalable Load Balance Analysis. https://github.com/tgamblin/libra. Accessed: 2022-08-03.

Todd Gamblin, Bronis R De Supinski, Martin Schulz, Rob Fowler, and Daniel A Reed. 2008. Scalable load-balance measurement for SPMD codes. In SC’08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. IEEE, 1–12.

Ryan E Grant, Matthew GF Dosanjh, Michael J Levenhagen, Ron Brightwell, and Anthony Skjellum. 2019. Finepoints: Partitioned multithreaded MPI communication. In International Conference on High Performance Computing. Springer, 330–350.

Michael Heroux and Richard Barrett. 2019. Mantevo project. https://mantevo.github.io/

Jeongnim Kim, Andrew D Baczewski, Todd D Beaudet, Anouar Benali, M Chandler Bennett, Mark A Berrill, Nick S Blunt, Edgar Josué Landinez Borda, Michele Casula, David M Ceperley, Simone Chiesa, Bryan K Clark, Raymond C Clay, Kris T Delaney, Mark Dewing, Kenneth P Esler, Hongxia Hao, Olle Heinonen, Paul R C Kent, Jaron T Krogel, Ilkka Kylänpää, Ying Wai Li, M Graham Lopez, Ye Luo, Fionn D Malone, Richard M Martin, Amrita Mathuriya, Jeremy McMinis, Cody A Melton, Lubos Mitas, Miguel A Morales, Eric Neuscamman, William D Parker, Sergio D Pineda Flores, Nichols A Romero, Brenda M Rubenstein, Jacqueline A R Shea, Hyeondeok Shin, Luke Shulenburger, Andreas F Tillack, Joshua P Townsend, Norm M Tubman, Brett Van Der Goetz, Jordan E Vincent, D ChangMo Yang, Yubo Yang, Shuai Zhang, and Luning Zhao. 2018. QMCPACK: an open source ab initio quantum Monte Carlo package for the electronic structure of atoms, molecules and solids. Journal of Physics: Condensed Matter 30, 19 (April 2018), 195901. https://doi.org/10.1088/1361-648x/aab9c3

Xu Liu, John Mellor-Crummey, and Michael Fagan. 2013. A new approach for performance analysis of OpenMP programs. In Proceedings of the 27th international ACM conference on International conference on supercomputing. 69–80.

W Pepper Marts, Matthew GF Dosanjh, Scott Levy, Whit Schonbein, Ryan E Grant, and Patrick G Bridges. 2021. MiniMod: A Modular Miniapplication Benchmarking Framework for HPC. In 2021 IEEE International Conference on Cluster Computing (CLUSTER). IEEE, 12–22.

PJ Mendygral, Nick Radcliffe, Krishna Kandalla, David Porter, Brian J O’Neill, Chris Nolting, Paul Edmon, Julius MF Donnert, and Thomas W Jones. 2017. WOMBAT: A scalable and high-performance astrophysical magnetohydrodynamics code. The Astrophysical Journal Supplement Series 228, 2 (2017), 23.

Bernd Mohr, Allen D Malony, Sameer Shende, and Felix Wolf. 2002. Design and prototype of a performance tool interface for OpenMP. The Journal of Supercomputing 23, 1 (2002), 105–128.

Mubrak S Mohsen, Rosni Abdullah, and Yong M Teo. 2009. A survey on performance tools for OpenMP. World Academy of Science, Engineering and Technology 49 (2009), 754–765.

Alessandro Morari, Roberto Gioiosa, Robert W Wisniewski, Francisco J Cazorla, and Mateo Valero. 2011. A quantitative analysis of OS noise. In 2011 IEEE International Parallel & Distributed Processing Symposium. IEEE, 852–863.

Ananya Muddukrishna, Peter A Jonsson, and Mats Brorsson. 2015. Characterizing task-based OpenMP programs. PloS one 10, 4 (2015), e0123545.

Ananya Muddukrishna, Peter A Jonsson, Artur Podobas, and Mats Brorsson. 2016. Grain graphs: OpenMP performance analysis made easy. In Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 1–13.

Institute of Electrical and Electronics Engineers. [n. d.]. International Organization for Standardization. Information Technology–Portable Operating System Interface (POSIX). https://pubs.opengroup.org/onlinepubs/9699919799.2018edition/. Accessed: 2022-08-04.

Fabian Orland and Christian Terboven. 2020. A case study on addressing complex load imbalance in OpenMP. In International Workshop on OpenMP. Springer, 130–145.

S. S. SHAPIRO and M. B. WILK. 1965. An analysis of variance test for normality (complete samples). Biometrika 52, 3-4 (dec 1965), 591–611. https://doi.org/10.1093/biomet/52.3-4.591

Srinivas Sridharan, James Dinan, and Dhiraj D Kalamkar. 2014. Enabling efficient multithreaded MPI communication through a library-based implementation of MPI endpoints. In SC’14: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 487–498.

M. A. Stephens. 1974. EDF Statistics for Goodness of Fit and Some Comparisons. J. Amer. Statist. Assoc. 69, 347 (Sept. 1974), 730–737. https://doi.org/10.1080/01621459.1974.10480196

Yiltan Hassan Temucin, Ryan Grant, and Ahmad Afsahi. 2022. Micro-Benchmarking MPI Partitioned Point-to-Point Communication. In 2022 International Conference on Parallel Processing (ICPP. ACM.

Rajeev Thakur and William Gropp. 2009. Test suite for evaluating performance of multithreaded MPI communication. Parallel Comput. 35, 12 (2009), 608–617.

A. P. Thompson, H. M. Aktulga, R. Berger, D. S. Bolintineanu, W. M. Brown, P. S. Crozier, P. J. in ’t Veld, A. Kohlmeyer, S. G. Moore, T. D. Nguyen, R. Shan, M. J. Stevens, J. Tranchida, C. Trott, and S. J. Plimpton. 2022. LAMMPS - a flexible simulation tool for particle-based materials modeling at the atomic, meso, and continuum scales. Comp. Phys. Comm. 271 (2022), 108171. https://doi.org/10.1016/j.cpc.2021.108171

Karthikeyan Vaidyanathan, Dhiraj D Kalamkar, Kiran Pamnany, Jeff R Hammond, Pavan Balaji, Dipankar Das, Jongsoo Park, and Bálint Joó. 2015. Improving concurrency and asynchrony in multithreaded MPI applications using software offloading. In SC’15: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 1–12.