Lost in heterogeneity: architectural selection based on code features
Article No.: 6, Pages 1 - 6
Abstract
Automatic parallelizing compilers have evolved greatly over the last decade. Tools like Pluto, Pr4All and PPCG are widely adopted to generate optimized OpenMP, CUDA and OpenCL codes. However, in the end, it is the programmer's responsibility to select the best target architecture for a particular application. In this work we provide a solution for the problem of architectural selection. We introduce a low cost model based on a classification problem which selects the fastest architecture for the generated code. We integrate our model in PPCG, a state of the art polyhedral compiler. Our experiments show that our model selects the fastest architecture 87% of the time when choosing between an Ivy Bridge Xeon CPU and a Kepler GPU and 81% of the time when choosing between a Xeon Sandy Bridge CPU and a Xeon Phi acceleration card.
References
[1]
Qualcomm mare, enabling applications for hetrogeneous mobile devices. https://developer.qualcomm.com/downloads/whitepaper-qualcomm-mare-enabling-applications-heterogeneous-mobile-devices, 2014.
[2]
Bondhugula, U., Hartono, A., Ramanujam, J., and Sadayappan, P. A practical automatic polyhedral parallelizer and locality optimizer. In ACM SIGPLAN conference on Programming Languages Design and Implementation (2008), vol. 43, ACM, pp. 101--113.
[3]
Chang, C.-C., and Lin, C.-J. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2 (2011), 27:1--27:27.
[4]
Dollinger, J.-F., and Loechner, V. Adaptive runtime selection for gpu. In Parallel Processing (ICPP), 2013 42nd International Conference on (2013), IEEE, pp. 70--79.
[5]
Dollinger, J.-F., and Loechner, V. CPU+GPU Load Balance Guided by Execution Time Prediction. In Fifth International Workshop on Polyhedral Compilation Techniques (IMPACT 2015) (Amsterdam, Netherlands, Jan. 2015).
[6]
Hastie, T., Tibshirani, R., and Friedman, J. The elements of statistical learnin, 2009.
[7]
Hong, S., and Kim, H. An analytical model for a gpu architecture with memory-level and thread-level parallelism awareness. SIGARCH Comput. Archit. News 37, 3 (June 2009), 152--163.
[8]
Meng, J., Morozov, V. A., Kumaran, K., Vishwanath, V., and Uram, T. D. Grophecy: Gpu performance projection from cpu code skeletons. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (New York, NY, USA, 2011), SC '11, ACM, pp. 14:1--14:11.
[9]
Nugteren, C., and Corporaal, H. The boat hull model: Enabling performance prediction for parallel computing prior to code development. In Proceedings of the 9th Conference on Computing Frontiers (New York, NY, USA, 2012), CF '12, ACM, pp. 203--212.
[10]
Park, E., Cavazos, J., Pouchet, L.-N., Bastoul, C., Cohen, A., and Sadayappan, P. Predictive modeling in a polyhedral optimization space. International Journal of Parallel Programming 41, 5 (2013), 704--750.
[11]
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.
[12]
Ruvinskiy, R., and van Beek, P. An improved machine learning approach for selecting a polyhedral model transformation. In Advances in Artificial Intelligence. Springer, 2015, pp. 100--113.
[13]
Verdoolaege, S., Carlos Juega, J., Cohen, A., Ignacio Gómez, J., Tenllado, C., and Catthoor, F. Polyhedral parallel code generation for cuda. ACM Trans. Archit. Code Optim. 9, 4 (Jan. 2013), 54:1--54:23.
[14]
Verdoolaege, S., and Grosser, T. Polyhedral extraction tool. In In Second International Workshop on Polyhedral Compilation Techniques (IMPACT 12) (2012), Citeseer.
[15]
Verdoolaege, S., Seghir, R., Beyls, K., Loechner, V., and Bruynooghe, M. Counting integer points in parametric polytopes using barvinok's rational functions. Algorithmica 48, 1 (2007), 37--66.
[16]
Wang, Z., Grewe, D., and O'boyle, M. F. P. Automatic and portable mapping of data parallel programs to opencl for gpu-based heterogeneous systems. ACM Trans. Archit. Code Optim. 11, 4 (Dec. 2014), 42:1--42:26.
[17]
Williams, S., Waterman, A., and Patterson, D. Roofline: an insightful visual performance model for multicore architectures. Communications of the ACM 52, 4 (2009), 65--76.
Index Terms
- Lost in heterogeneity: architectural selection based on code features
Recommendations
Lost in Translation: Challenges in Automating CUDA-to-OpenCL Translation
ICPPW '12: Proceedings of the 2012 41st International Conference on Parallel Processing WorkshopsThe use of accelerators in high-performance computing is increasing. The most commonly used accelerator is the graphics processing unit (GPU) because of its low cost and massively parallel performance. The two most common programming environments for ...
Exploiting heterogeneity of communication channels for efficient GPU selection on multi-GPU nodes
Multi-GPU nodes have become the platform of choice for scientific applications. In a multi-GPU node, GPUs are interconnected together via different communication channels. The intranode communications among GPUs may traverse different paths with ...
HASpGEMM: Heterogeneity-Aware Sparse General Matrix-Matrix Multiplication on Modern Asymmetric Multicore Processors
ICPP '23: Proceedings of the 52nd International Conference on Parallel ProcessingSparse general matrix-matrix multiplication (SpGEMM) is an important kernel in computational science and engineering, and has been widely studied on homogeneous processors, e.g., CPUs and GPUs. Recently, the asymmetric multicore processors (AMPs), ...
Comments
Information & Contributors
Information
Published In
November 2015
61 pages
ISBN:9781450339926
DOI:10.1145/2834899
Copyright © 2015 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 November 2015
Check for updates
Qualifiers
- Research-article
Conference
SC15: The International Conference for High Performance Computing, Networking, Storage and Analysis
November 15, 2015
Texas, Austin
Acceptance Rates
Co-HPC '15 Paper Acceptance Rate 7 of 13 submissions, 54%;
Overall Acceptance Rate 7 of 13 submissions, 54%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 113Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)1
Reflects downloads up to 28 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in