article

Parallelizing and optimizing large-scale 3D multi-phase flow simulations on the Tianhe-2 supercomputer

Authors:

Xiaogang DengAuthors Info & Claims

Concurrency and Computation: Practice & Experience, Volume 28, Issue 5

Pages 1678 - 1692

https://doi.org/10.1002/cpe.3717

Published: 10 April 2016 Publication History

Abstract

The lattice Boltzmann method LBM is a widely used computational fluid dynamics method for flow problems with complex geometries and various boundary conditions. Large-scale LBM simulations with increasing resolution and extending temporal range require massive high-performance computing HPC resources, thus motivating us to port it onto modern many-core heterogeneous supercomputers like Tianhe-2. Although many-core accelerators such as graphics processing unit and Intel MIC have a dramatic advantage of floating-point performance and power efficiency over CPUs, they also pose a tough challenge to parallelize and optimize computational fluid dynamics codes on large-scale heterogeneous system.

References

[1]

Godenschwager C, Schornbaum F, Bauer M, Köstler H, Rüde U. A framework for hybrid parallel flow simulations with a trillion cells in complex geometries. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis p. 35. ACM, 2013.

Digital Library

[2]

Biferale L, Mantovani F, Pivanti M, Pozzati F, Sbragaglia M, Scagliarini A, ' Tripiccione R. Optimization of multi-phase compressible lattice Boltzmann codes on massively parallel multi-core systems. Procedia Computer Science 2011; Volume 4: pp.994-1003.

[3]

Bailey P, Myre J, Walsh SD, Lilja DJ, Saar MO. Accelerating lattice Boltzmann fluid flow simulations using graphics processors. In Parallel Processing, 2009. ICPP'09. International Conference on pp. 550-557. IEEE, 2009.

Digital Library

[4]

Fang J, Sips H, Zhang L, Xu C, Che Y, Varbanescu AL. Test-driving intel xeon phi. In Proceedings of the 5th ACM/SPEC International Conference on Performance Engineering pp. 137-148. ACM, 2014.

Digital Library

[5]

Fang J. Towards a Systematic Exploration of the Optimization Space for Many-Core Processors Doctoral dissertation, TU Delft, Delft University of Technology, 2014.

[6]

Xu C, Deng X, Zhang L, Fang J, Wang G, Jiang Y, Cheng X. Collaborating CPU and GPU for large-scale high-order CFD simulations with complex grids on the TianHe-1A supercomputer. Journal of Computational Physics 2014; Volume 278: pp.275-297.

Digital Library

[7]

Official website of openlbmflow. "http://www.lbmflow.com". {10 August 2015}

[8]

Introduction of Tianhe-2 on Top500 website. "http://www.top500.org/system/177999". {10 August 2015}

[9]

Williams S, Waterman A, Patterson D. Roofline: an insightful visual performance model for multicore architectures. Communications of the ACM 2009; Volume 52 Issue 4: pp.65-76.

Digital Library

[10]

Williams S, Carter J, Oliker L, Shalf J, Yelick K. Optimization of a lattice boltzmann computation on state-of-the-art multicore platforms. Journal of Parallel and Distributed Computing 2009; Volume 69 Issue 9: pp.762-777.

Digital Library

[11]

Liu Z, Song A, Xu L, Feng W, Zhou L, Zhang W. A High Scalable Hybrid MPI/OpenMP Parallel Model of Multiple-relaxation-time Lattice Boltzmann Method*. Journal of Computational Information Systems 2014; Volume 10 Issue 20: pp.10147-10157.

[12]

Mountrakis L, Lorenz E, Malaspinas O, Alowayyed S, Chopard B, Hoekstra AG. Parallel performance of an IB-LBM suspension simulation framework. Journal of Computational Science 2015; Volume 9: pp.45-50.

[13]

Pananilath I, Acharya A, Vasista V, Bondhugula U. An Optimizing Code Generator for a Class of Lattice-Boltzmann Computations, 2014.

[14]

Wei C, Zhenghua W, Zongzhe L, Lu Y, Yongxian W. An improved LBM approach for heterogeneous GPU-CPU clusters. In Bio}medical Engineering and Informatics BMEI, 2011 4th International Conference on Vol. 4, pp. 2095-2098. IEEE, 2011.

[15]

Kanoria AA, Damodaran M. Parallel Matlab implementation of the lattice boltzmann method on GPUs, 2014.

[16]

Feichtinger C, Habich J, Köstler H, Rüde U, Aoki T. Performance Modeling and Analysis of Heterogeneous Lattice Boltzmann Simulations on CPU-GPU Clusters. Parallel Computing, 2014.

[17]

Koda Y, Lien FS. The lattice Boltzmann method implemented on the GPU to simulate the turbulent flow over a square cylinder confined in a channel. Flow, Turbulence and Combustion, 2014, 1-18.

[18]

Crimi G, Mantovani F, Pivanti M, Schifano SF, Tripiccione R. Early experience on porting and running a lattice Boltzmann code on the Xeon-Phi co-processor. Procedia Computer Science 2013; Volume 18: pp.551-560.

[19]

Rosales C. Porting to the intel Xeon phi: opportunities and challenges. In Extreme Scaling Workshop XSW, 2013 pp. 1-7. IEEE, 2013.

Digital Library

[20]

McIntosh-Smith S, Curran D. Evaluation of a performance portable lattice Boltzmann code using OpenCL. In Proceedings of the International Workshop on OpenCL 2013 &2014 p. 2. ACM, 2014.

Digital Library

[21]

Bortolotti G, Caberletti M, Crimi G, Ferraro A, Giacomini F, Manzali M, ' Zanella M. Computing on Knights and Kepler Architectures. In Journal of Physics: Conference Series 2014; Volume 513 Issue 5: pp.52032-52038.

[22]

Calore E, Schifano SF, Tripiccione R. A portable OpenCL lattice Boltzmann code for multi-and many-core processor architectures. Procedia Computer Science 2014; Volume 29: pp.40-49.

Cited By

Li DXu CCheng BXiong MGao XDeng X(2017)Performance modeling and optimization of parallel LU-SGS on many-core processors for 3D high-order CFD simulationsThe Journal of Supercomputing10.1007/s11227-016-1943-073:6(2506-2524)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11227-016-1943-0
Hasan MJaafar JAziz IRahim L(2016)A Review on A High Performance Computing-based Interval Fuzzy Type-2 Model for Web Services' QoS EvaluationProceedings of the 4th International Conference on Information and Network Security10.1145/3026724.3026734(77-82)Online publication date: 28-Dec-2016
https://dl.acm.org/doi/10.1145/3026724.3026734

Recommendations

Scaling up Hartree-Fock calculations on Tianhe-2

This paper presents a new optimized and scalable code for Hartree-Fock self-consistent field iterations. Goals of the code design include scalability to large numbers of nodes, and the capability to simultaneously use CPUs and Intel Xeon Phi ...
Collaborating CPU and GPU for large-scale high-order CFD simulations with complex grids on the TianHe-1A supercomputer

Programming and optimizing complex, real-world CFD codes on current many-core accelerated HPC systems is very challenging, especially when collaborating CPUs and accelerators to fully tap the potential of heterogeneous systems. In this paper, with a tri-...
A pressure-based algorithm for multi-phase flow at all speeds

A new finite volume-based numerical algorithm for predicting incompressible and compressible multi-phase flow phenomena is presented. The technique is equally applicable in the subsonic, transonic, and supersonic regimes. The method is formulated on a ...

Comments

Information & Contributors

Information

Published In

cover image Concurrency and Computation: Practice & Experience

Concurrency and Computation: Practice & Experience Volume 28, Issue 5

April 2016

296 pages

ISSN:1532-0626

Issue’s Table of Contents

Publisher

John Wiley and Sons Ltd.

United Kingdom

Publication History

Published: 10 April 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li DXu CCheng BXiong MGao XDeng X(2017)Performance modeling and optimization of parallel LU-SGS on many-core processors for 3D high-order CFD simulationsThe Journal of Supercomputing10.1007/s11227-016-1943-073:6(2506-2524)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11227-016-1943-0
Hasan MJaafar JAziz IRahim L(2016)A Review on A High Performance Computing-based Interval Fuzzy Type-2 Model for Web Services' QoS EvaluationProceedings of the 4th International Conference on Information and Network Security10.1145/3026724.3026734(77-82)Online publication date: 28-Dec-2016
https://dl.acm.org/doi/10.1145/3026724.3026734

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents