Scalable multi-relaxation-time lattice Boltzmann simulations on multi-GPU cluster. (30th March 2015)

• Record Type: Journal Article
• Authors: Hong, Pei-Yao; Huang, Li-Min; Lin, Li-Song; Lin, Chao-An
• Is Part Of: Computers & fluids. Volume 110(2015)
• Page Start: 1
• Page End: 8
• Publication Date: 2015-03-30
• Subjects: Multi relaxation time (MRT) -- Lattice Boltzmann model (LBM) -- Graphic processing unit -- Message Passing Interface -- Three dimensional lid-driven cavity flow; Fluid dynamics -- Data processing -- Periodicals; 532.050285
• DOI: 10.1016/j.compfluid.2014.12.010
• Languages: English
• ISSNs: 0045-7930

Abstract

Highlights: Scalable multi relaxation time lattice Boltzmann method on multi graphic processor units is proposed. Using on-chip memory introduces three to six folds performance increase over its global memory counterpart. Streaming using offset reading is much better than adopting offset writing. Overlapping communication and computation can achieve 38% performance improvement. Three GTX Titans deliver 5000 MLUPS for 192 3 grids with 12 Tesla M2070 attaining half performance. Abstract: In this paper, the D3Q19 multi-relaxation-time lattice Boltzmann model is adopted to simulate three-dimensional cavity flows using graphic processing units (GPUs). For single GPU computations, utilizing on-chip memory generates three to five times speedup over adopting global memory alone. Also, streaming using offset reading attains another two times speedup over employing offset writing. For Message Passing Interface (MPI) based multi-GPU computations, overlapping communication and computation can achieve 38% improvement and provide an efficient scheme to improve the scalability and its performance. Numerical experiments show that 12 Tesla TM M2070 GPUs produce around 5500 million lattices updates per second (MLUPS) using 576 3 grid. On the other hand, three GTX Titans deliver 5000 MLUPS for 192 3 grids, while 12 Tesla attain half performance.