COWCache: effective flash caching for Copy-on-Write virtual disks

Jianyu Fu, Youyou Lu, Jiwu Shu, Guangming Liu, Ming Zhao

Research output: Contribution to journalArticle

Abstract

Host-side flash caching emerges as an effective solution for improving the performance of virtual machines (VMs) in cloud computing environment. However, for VMs with the commonly used Copy-on-Write (COW) virtual disks, flash caching in fact has negative impacts since it brings lots of unnecessary cache writes, hurting both the VM performance and the flash endurance. This paper presents COWCache, a COW-aware caching solution that addresses this problem by co-designing flash caching with COW-based virtual disks. First, COWCache designs a new architecture that bridges the semantic gap between flash caching and virtual disk management for realizing the VMs’ real data locality. Second, it separately manages COW metadata with fine-grained caching and journaling to improve the metadata caching efficiency. Third, it provides a novel decoupled Copy-on-Write mechanism, which decouples the amplified data requests from the critical I/O path and only admits the data with real VM locality into flash cache. COWCache also introduces a new data structure, the virtual cache map, to mitigate the memory footprint overhead for indexing the cached data in flash. Evaluations show that COWCache improves the application performance by up to 122.7% and reduces the flash cache writes by up to 78.5% compared to traditional flash caching solutions.

Original languageEnglish (US)
JournalCluster Computing
DOIs
StatePublished - Jan 1 2019

Fingerprint

Metadata
Cloud computing
Data structures
Durability
Semantics
Virtual machine
Data storage equipment

Keywords

  • Caching
  • Copy-on-Write
  • Flash memory
  • Virtual disk

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications

Cite this

COWCache : effective flash caching for Copy-on-Write virtual disks. / Fu, Jianyu; Lu, Youyou; Shu, Jiwu; Liu, Guangming; Zhao, Ming.

In: Cluster Computing, 01.01.2019.

Research output: Contribution to journalArticle

Fu, Jianyu ; Lu, Youyou ; Shu, Jiwu ; Liu, Guangming ; Zhao, Ming. / COWCache : effective flash caching for Copy-on-Write virtual disks. In: Cluster Computing. 2019.
@article{4cfa82410ceb420b84dec69b8f3aebc1,
title = "COWCache: effective flash caching for Copy-on-Write virtual disks",
abstract = "Host-side flash caching emerges as an effective solution for improving the performance of virtual machines (VMs) in cloud computing environment. However, for VMs with the commonly used Copy-on-Write (COW) virtual disks, flash caching in fact has negative impacts since it brings lots of unnecessary cache writes, hurting both the VM performance and the flash endurance. This paper presents COWCache, a COW-aware caching solution that addresses this problem by co-designing flash caching with COW-based virtual disks. First, COWCache designs a new architecture that bridges the semantic gap between flash caching and virtual disk management for realizing the VMs’ real data locality. Second, it separately manages COW metadata with fine-grained caching and journaling to improve the metadata caching efficiency. Third, it provides a novel decoupled Copy-on-Write mechanism, which decouples the amplified data requests from the critical I/O path and only admits the data with real VM locality into flash cache. COWCache also introduces a new data structure, the virtual cache map, to mitigate the memory footprint overhead for indexing the cached data in flash. Evaluations show that COWCache improves the application performance by up to 122.7{\%} and reduces the flash cache writes by up to 78.5{\%} compared to traditional flash caching solutions.",
keywords = "Caching, Copy-on-Write, Flash memory, Virtual disk",
author = "Jianyu Fu and Youyou Lu and Jiwu Shu and Guangming Liu and Ming Zhao",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s10586-019-02948-8",
language = "English (US)",
journal = "Cluster Computing",
issn = "1386-7857",
publisher = "Kluwer Academic Publishers",

}

TY - JOUR

T1 - COWCache

T2 - effective flash caching for Copy-on-Write virtual disks

AU - Fu, Jianyu

AU - Lu, Youyou

AU - Shu, Jiwu

AU - Liu, Guangming

AU - Zhao, Ming

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Host-side flash caching emerges as an effective solution for improving the performance of virtual machines (VMs) in cloud computing environment. However, for VMs with the commonly used Copy-on-Write (COW) virtual disks, flash caching in fact has negative impacts since it brings lots of unnecessary cache writes, hurting both the VM performance and the flash endurance. This paper presents COWCache, a COW-aware caching solution that addresses this problem by co-designing flash caching with COW-based virtual disks. First, COWCache designs a new architecture that bridges the semantic gap between flash caching and virtual disk management for realizing the VMs’ real data locality. Second, it separately manages COW metadata with fine-grained caching and journaling to improve the metadata caching efficiency. Third, it provides a novel decoupled Copy-on-Write mechanism, which decouples the amplified data requests from the critical I/O path and only admits the data with real VM locality into flash cache. COWCache also introduces a new data structure, the virtual cache map, to mitigate the memory footprint overhead for indexing the cached data in flash. Evaluations show that COWCache improves the application performance by up to 122.7% and reduces the flash cache writes by up to 78.5% compared to traditional flash caching solutions.

AB - Host-side flash caching emerges as an effective solution for improving the performance of virtual machines (VMs) in cloud computing environment. However, for VMs with the commonly used Copy-on-Write (COW) virtual disks, flash caching in fact has negative impacts since it brings lots of unnecessary cache writes, hurting both the VM performance and the flash endurance. This paper presents COWCache, a COW-aware caching solution that addresses this problem by co-designing flash caching with COW-based virtual disks. First, COWCache designs a new architecture that bridges the semantic gap between flash caching and virtual disk management for realizing the VMs’ real data locality. Second, it separately manages COW metadata with fine-grained caching and journaling to improve the metadata caching efficiency. Third, it provides a novel decoupled Copy-on-Write mechanism, which decouples the amplified data requests from the critical I/O path and only admits the data with real VM locality into flash cache. COWCache also introduces a new data structure, the virtual cache map, to mitigate the memory footprint overhead for indexing the cached data in flash. Evaluations show that COWCache improves the application performance by up to 122.7% and reduces the flash cache writes by up to 78.5% compared to traditional flash caching solutions.

KW - Caching

KW - Copy-on-Write

KW - Flash memory

KW - Virtual disk

UR - http://www.scopus.com/inward/record.url?scp=85067388115&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067388115&partnerID=8YFLogxK

U2 - 10.1007/s10586-019-02948-8

DO - 10.1007/s10586-019-02948-8

M3 - Article

AN - SCOPUS:85067388115

JO - Cluster Computing

JF - Cluster Computing

SN - 1386-7857

ER -