Learning cache replacement with CACHEUS

Liana V. Rodriguez, Farzana Yusuf, Steven Lyons, Eysler Paz, Raju Rangaswami, Jason Liu, Ming Zhao, Giri Narasimhan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent advances in machine learning open up new and attractive approaches for solving classic problems in computing systems. For storage systems, cache replacement is one such problem because of its enormous impact on performance. We classify workloads as a composition of four workload primitive types — LFU-friendly, LRU-friendly, scan, and churn. We then design and evaluate CACHEUS, a new class of fully adaptive, machine-learned caching algorithms that utilize a combination of experts designed to address these workload primitive types. The experts used by CACHEUS include the state-of-the-art ARC, LIRS and LFU, and two new ones – SR-LRU, a scan-resistant version of LRU, and CR-LFU, a churn-resistant version of LFU. We evaluate CACHEUS using 17,766 simulation experiments on a collection of 329 workloads run against 6 different cache configurations. Paired t-test analysis demonstrates that CACHEUS using the newly proposed lightweight experts, SR-LRU and CR-LFU, is the most consistently performing caching algorithm across a range of workloads and cache sizes. Furthermore, CACHEUS enables augmenting state-of-the-art algorithms (e.g., LIRS, ARC) by combining it with a complementary cache replacement algorithm (e.g., LFU) to better handle a wider variety of workload primitive types.

Original languageEnglish (US)
Title of host publicationProceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021
PublisherUSENIX Association
Pages341-354
Number of pages14
ISBN (Electronic)9781939133205
StatePublished - 2021
Externally publishedYes
Event19th USENIX Conference on File and Storage Technologies, FAST 2021 - Virtual, Online
Duration: Feb 23 2021Feb 25 2021

Publication series

NameProceedings of the 19th USENIX Conference on File and Storage Technologies, FAST 2021

Conference

Conference19th USENIX Conference on File and Storage Technologies, FAST 2021
CityVirtual, Online
Period2/23/212/25/21

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'Learning cache replacement with CACHEUS'. Together they form a unique fingerprint.

Cite this