Memory performance estimation of CUDA programs

Yooseong Kim, Aviral Shrivastava

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

CUDA has successfully popularized GPU computing, and GPGPU applications are now used in various embedded systems. The CUDA programming model provides a simple interface to program on GPUs, but tuning GPGPU applications for high performance is still quite challenging. Programmers need to consider numerous architectural details, and small changes in source code, especially on the memory access pattern, can affect performance significantly. This makes it very difficult to optimize CUDA programs. This article presents CuMAPz, which is a tool to analyze and compare the memory performance of CUDA programs. CuMAPz can help programmers explore different ways of using shared and global memories, and optimize their program for efficient memory behavior. CuMAPz models several memory-performance-related factors: data reuse, global memory access coalescing, global memory latency hiding, shared memory bank conflict, channel skew, and branch divergence. Experimental results show that CuMAPz can accurately estimate performance with correlation coefficient of 0.96. By using CuMAPz to explore the memory access design space, we could improve the performance of our benchmarks by 30% more than the previous approach [Hong and Kim 2010].

Original languageEnglish (US)
Article number21
JournalTransactions on Embedded Computing Systems
Volume13
Issue number2
DOIs
StatePublished - Oct 21 2013

Keywords

  • CUDA
  • GPGPU
  • Memory performance
  • Performance estimation
  • Program optimization

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Memory performance estimation of CUDA programs'. Together they form a unique fingerprint.

Cite this