Locality-driven MRC construction and cache allocation

Jianyu Fu, Dulcardo Arteaga, Ming Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Flash caches have been widely deployed in cloud computing environments to boost the performance of virtual machines (VMs), but they are usually oversubscribed among the VMs due to the limited cache space compared to the VMs’ working set (WS) size, making the cache allocation a challenging problem. Miss Ratio Curves (MRCs) can be used to manage cache partitioning among the VMs; however, traditional WS-based MRCs are constructed based on all the data, including the data without good locality, which forces the VMs to allocate unnecessary cache space to achieve their objective performance. The paper presents QCache, a locality-driven solution for MRC construction and cache allocation. First, it proposes a new design of MRC, RWS-based MRCs, which is constructed based on the reuse working set and guides the cache allocation based on the good-locality data. Second, with RWS-based MRCs, it provides two different algorithms to optimize the cache allocation among all the VMs, regarding the improvement of the overall performance and the optimization for each VM’s Quality-of-Service respectively.

Original languageEnglish (US)
Title of host publicationHPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium
PublisherAssociation for Computing Machinery, Inc
Pages19-20
Number of pages2
ISBN (Electronic)9781450358996
DOIs
StatePublished - Jun 11 2018
Event27th ACM International Symposium on High-Performance Parallel and Distributed Computing, HPDC 2018 - Tempe, United States
Duration: Jun 11 2018 → …

Other

Other27th ACM International Symposium on High-Performance Parallel and Distributed Computing, HPDC 2018
CountryUnited States
CityTempe
Period6/11/18 → …

Fingerprint

Cloud computing
Virtual machine
Quality of service

ASJC Scopus subject areas

  • Computer Science Applications
  • Software
  • Computational Theory and Mathematics

Cite this

Fu, J., Arteaga, D., & Zhao, M. (2018). Locality-driven MRC construction and cache allocation. In HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium (pp. 19-20). Association for Computing Machinery, Inc. https://doi.org/10.1145/3220192.3220461

Locality-driven MRC construction and cache allocation. / Fu, Jianyu; Arteaga, Dulcardo; Zhao, Ming.

HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium. Association for Computing Machinery, Inc, 2018. p. 19-20.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fu, J, Arteaga, D & Zhao, M 2018, Locality-driven MRC construction and cache allocation. in HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium. Association for Computing Machinery, Inc, pp. 19-20, 27th ACM International Symposium on High-Performance Parallel and Distributed Computing, HPDC 2018, Tempe, United States, 6/11/18. https://doi.org/10.1145/3220192.3220461
Fu J, Arteaga D, Zhao M. Locality-driven MRC construction and cache allocation. In HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium. Association for Computing Machinery, Inc. 2018. p. 19-20 https://doi.org/10.1145/3220192.3220461
Fu, Jianyu ; Arteaga, Dulcardo ; Zhao, Ming. / Locality-driven MRC construction and cache allocation. HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium. Association for Computing Machinery, Inc, 2018. pp. 19-20
@inproceedings{16b18333cd8b4bc8b9ef94310db793c7,
title = "Locality-driven MRC construction and cache allocation",
abstract = "Flash caches have been widely deployed in cloud computing environments to boost the performance of virtual machines (VMs), but they are usually oversubscribed among the VMs due to the limited cache space compared to the VMs’ working set (WS) size, making the cache allocation a challenging problem. Miss Ratio Curves (MRCs) can be used to manage cache partitioning among the VMs; however, traditional WS-based MRCs are constructed based on all the data, including the data without good locality, which forces the VMs to allocate unnecessary cache space to achieve their objective performance. The paper presents QCache, a locality-driven solution for MRC construction and cache allocation. First, it proposes a new design of MRC, RWS-based MRCs, which is constructed based on the reuse working set and guides the cache allocation based on the good-locality data. Second, with RWS-based MRCs, it provides two different algorithms to optimize the cache allocation among all the VMs, regarding the improvement of the overall performance and the optimization for each VM’s Quality-of-Service respectively.",
author = "Jianyu Fu and Dulcardo Arteaga and Ming Zhao",
year = "2018",
month = "6",
day = "11",
doi = "10.1145/3220192.3220461",
language = "English (US)",
pages = "19--20",
booktitle = "HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Locality-driven MRC construction and cache allocation

AU - Fu, Jianyu

AU - Arteaga, Dulcardo

AU - Zhao, Ming

PY - 2018/6/11

Y1 - 2018/6/11

N2 - Flash caches have been widely deployed in cloud computing environments to boost the performance of virtual machines (VMs), but they are usually oversubscribed among the VMs due to the limited cache space compared to the VMs’ working set (WS) size, making the cache allocation a challenging problem. Miss Ratio Curves (MRCs) can be used to manage cache partitioning among the VMs; however, traditional WS-based MRCs are constructed based on all the data, including the data without good locality, which forces the VMs to allocate unnecessary cache space to achieve their objective performance. The paper presents QCache, a locality-driven solution for MRC construction and cache allocation. First, it proposes a new design of MRC, RWS-based MRCs, which is constructed based on the reuse working set and guides the cache allocation based on the good-locality data. Second, with RWS-based MRCs, it provides two different algorithms to optimize the cache allocation among all the VMs, regarding the improvement of the overall performance and the optimization for each VM’s Quality-of-Service respectively.

AB - Flash caches have been widely deployed in cloud computing environments to boost the performance of virtual machines (VMs), but they are usually oversubscribed among the VMs due to the limited cache space compared to the VMs’ working set (WS) size, making the cache allocation a challenging problem. Miss Ratio Curves (MRCs) can be used to manage cache partitioning among the VMs; however, traditional WS-based MRCs are constructed based on all the data, including the data without good locality, which forces the VMs to allocate unnecessary cache space to achieve their objective performance. The paper presents QCache, a locality-driven solution for MRC construction and cache allocation. First, it proposes a new design of MRC, RWS-based MRCs, which is constructed based on the reuse working set and guides the cache allocation based on the good-locality data. Second, with RWS-based MRCs, it provides two different algorithms to optimize the cache allocation among all the VMs, regarding the improvement of the overall performance and the optimization for each VM’s Quality-of-Service respectively.

UR - http://www.scopus.com/inward/record.url?scp=85050117820&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050117820&partnerID=8YFLogxK

U2 - 10.1145/3220192.3220461

DO - 10.1145/3220192.3220461

M3 - Conference contribution

AN - SCOPUS:85050117820

SP - 19

EP - 20

BT - HPDC 2018 - Proceedings of The 27th International Symposium on High-Performance Parallel and Distributed Computing Posters/Doctoral Consortium

PB - Association for Computing Machinery, Inc

ER -