Static function prefetching for efficient code management on scratchpad memory

Youngbin Kim, Kyoungwoo Lee, Aviral Shrivastava

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As cache-based memory hierarchy is becoming a primary factor which limits the scalability and power efficiency of multi-core systems, scratchpad memory (SPM) has been studied as an alternative to cache. When SPM is used as an instruction memory, code management techniques are required to load code blocks on SPM using DMAs. In these techniques, code blocks are generally loaded on-demand to avoid loading incorrect block - unlike cache (e.g. tag arrays), SPM does not have mechanism to detect and recover from faults. While on-demand loading guarantees no fault, it leads to considerable performance overhead since it serializes the execution of DMA and CPU. This paper presents a technique to insert prefetching instructions for function-level code management to enable overlapping execution between DMA engine and CPU. Our technique inserts DMA instructions statically at compile time and does not rely on any profiling or run-time resources. Our evaluation shows that static prefetching can reduce CPU idle time due to DMAs by 58.5% and achieves 14.7% of average performance improvement on the benchmarks showing high overhead due to DMAs.

Original languageEnglish (US)
Title of host publicationProceedings - 2019 IEEE International Conference on Computer Design, ICCD 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages350-358
Number of pages9
ISBN (Electronic)9781538666487
DOIs
StatePublished - Nov 2019
Externally publishedYes
Event37th IEEE International Conference on Computer Design, ICCD 2019 - Abu Dhabi, United Arab Emirates
Duration: Nov 17 2019Nov 20 2019

Publication series

NameProceedings - 2019 IEEE International Conference on Computer Design, ICCD 2019

Conference

Conference37th IEEE International Conference on Computer Design, ICCD 2019
CountryUnited Arab Emirates
CityAbu Dhabi
Period11/17/1911/20/19

Keywords

  • Code Management
  • Compilers
  • Scratchpad Memory

ASJC Scopus subject areas

  • Information Systems and Management
  • Computer Networks and Communications
  • Control and Optimization
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Static function prefetching for efficient code management on scratchpad memory'. Together they form a unique fingerprint.

  • Cite this

    Kim, Y., Lee, K., & Shrivastava, A. (2019). Static function prefetching for efficient code management on scratchpad memory. In Proceedings - 2019 IEEE International Conference on Computer Design, ICCD 2019 (pp. 350-358). [8988595] (Proceedings - 2019 IEEE International Conference on Computer Design, ICCD 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCD46524.2019.00056